Screen projection method and device, electronic equipment and storage medium
By receiving sound wave signals and wireless network signals, and combining them with identification information and wireless network signals, the client can accurately identify the projection host in the conference room, solving the problems of projection host identification delay and interference, and improving projection efficiency.
Patent Information
- Application Number
- CN202310350248.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-03-27
- Publication Date
- 2025-11-18
- Estimated Expiration
- 2043-03-27
AI Technical Summary
In conference room scenarios, the client may have difficulty accurately identifying the projection host in the current area, resulting in delays and interference in the recognition process and affecting projection efficiency.
The client receives sound wave signals and wireless network signals, combines them with identification information and wireless network signals to construct a host identification set, filters out local screen-sharing hosts, and sends screen-sharing data through the wireless network.
It improves the accuracy and efficiency of the screen projection host's recognition, reduces duplicate recognition, and enhances the reliability and speed of the screen projection process.
Smart Images

Figure CN116436714B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of wireless screen projection technology, and in particular to a screen projection method, device, electronic device and storage medium. Background Technology
[0002] In a conference room scenario, when a client needs to project its screen through a projection host, it needs to identify the projection host currently in the conference room. There may be multiple projection hosts inside the conference room, and some may also be located outside. In related technologies, during the process of identifying the projection host in the current conference room from among numerous hosts, the recognition signals emitted by each host experience delays and interference, resulting in low recognition accuracy for the client. When the client makes a mistake in identification, it often needs to repeat the identification process, thus hindering the client's projection efficiency. Summary of the Invention
[0003] The screen projection method, apparatus, electronic device, and storage medium provided in this application embodiment can improve the accuracy of the client in identifying the target host in the current area, thereby improving the screen projection efficiency of the client.
[0004] The technical solution of this application is implemented as follows:
[0005] This application provides a screen mirroring method applied to a client, including:
[0006] Receive N sound wave signals from the current area, each of the sound wave signals including at least the identification information of the corresponding local projection host; N is an integer;
[0007] Receive M wireless network signals from M screen-projecting hosts; M is an integer, and M is not less than N;
[0008] Based on the N identification information and M wireless network signals, the N local screen projection hosts in the current area and their corresponding wireless network signals are determined;
[0009] According to user instructions, select the target projection host from the N local projection hosts;
[0010] Screen projection data is sent to the target screen projection host via a wireless network.
[0011] In the above scheme, determining the N local projection hosts and their corresponding wireless network signals in the current area based on the N identification information and M wireless network signals includes:
[0012] From the predetermined fields included in the M wireless network signals, K first predetermined fields containing predetermined device information are selected; the first predetermined fields correspond to the first projection host; K is an integer, and K is not greater than M;
[0013] Screen projection identification information is extracted from the load data fields included in the K first predetermined fields; the screen projection identification information is the identification information of the corresponding first screen projection host;
[0014] A host identifier set is constructed based on the K screen projection identifiers; the host identifier set includes: the correspondence between each screen projection identifier and the corresponding first screen projection host and the wireless network signal;
[0015] Based on the N identification information, N local screen projection hosts and their corresponding wireless network signals are matched and filtered out from the host identification set.
[0016] In the above scheme, the M wireless network signals include: T first wireless network signals and Q second wireless network signals; T and Q are both integers, and neither T nor Q is greater than M; the data transmission rate of the first wireless network signal is greater than that of the second wireless network signal; the M predetermined fields include: T first network fields and Q second network fields; the first network fields belong to the corresponding first wireless network signal, and the second network fields belong to the corresponding second wireless network signal; the K first predetermined fields include: t second predetermined fields and q third predetermined fields; t and q are both integers, and t is not greater than T, and q is not greater than Q;
[0017] The step of filtering out K first predetermined fields containing predetermined device information from the predetermined fields included in the M wireless network signals includes:
[0018] Filter out t second predetermined fields containing the predetermined device information from the T first network fields;
[0019] Filter out q third predetermined fields containing the predetermined device information from the Q second network fields.
[0020] In the above scheme, the step of extracting the projection identification information from the load data fields included in the K first predetermined fields includes:
[0021] Extract the first projection identification information from the load data fields included in the t second predetermined fields respectively;
[0022] The second projection identification information is extracted from the load data fields included in the q third predetermined fields respectively.
[0023] In the above scheme, the step of constructing a host identifier set based on K of the screen projection identifier information includes:
[0024] For each of the t first projection identification information, construct a first correspondence between each first projection identification information and the corresponding first wireless network signal and the first projection host;
[0025] For each of the q second projection identification information, construct a second correspondence between each second projection identification information and the corresponding second wireless network signal and the first projection host;
[0026] The first and second correspondences, which contain the same first projection host, are merged and integrated to form a third correspondence;
[0027] The host identifier set is obtained by combining t first correspondences, q second correspondences, and the third correspondence.
[0028] In the above scheme, the step of matching and filtering N local screen-casting hosts and their corresponding wireless network signals from the host identifier set based on N identifier information includes:
[0029] Using the first identification information, a fourth correspondence that matches the first identification information is selected from t first correspondences, q second correspondences, and the third correspondences. This process continues until the last identification information is used to complete the matching and filtering in the host identification set, resulting in N fourth correspondences. The first projection host included in each fourth correspondence is then identified as the local projection host, resulting in N local projection hosts and their corresponding wireless network signals.
[0030] In the above scheme, each of the identification information includes at least one of the following for the corresponding local screen mirroring host: physical address, product serial number, screen mirroring code, host name, and hotspot name;
[0031] The screen casting identifier information in the corresponding fourth correspondence relationship matches at least one of the physical address, the product serial number, the screen casting code, the host name, and the hotspot name.
[0032] In the above scheme, sending screen projection data to the target screen projection host via the wireless network between the target screen projection host and the target screen projection host includes:
[0033] If the fourth correspondence corresponding to the target screen projection host includes a first target wireless network signal, then a connection is established with the target screen projection host using the first target wireless network corresponding to the first target wireless network signal;
[0034] After successfully establishing a connection with the target projection host based on the first target wireless network, the projection data is sent to the target projection host using the first target wireless network.
[0035] In the above scheme, if the fourth correspondence corresponding to the target projection host includes a first target wireless network signal, then after establishing a connection with the target projection host using the first target wireless network corresponding to the first target wireless network signal, the method further includes:
[0036] If the connection between the first target wireless network and the target projection host fails to be established, and a second target wireless network signal exists in one of the fourth correspondences corresponding to the target projection host, a connection is established with the target projection host using the second target wireless network corresponding to the second target wireless network signal.
[0037] After successfully establishing a connection with the target projection host based on the second target wireless network, the projection data is sent to the target projection host using the second target wireless network.
[0038] In the above scheme, after receiving N acoustic wave signals from the current area, the method further includes:
[0039] The acoustic signal is decoded and decapsulated to obtain the identification information of the local projection host corresponding to the acoustic signal.
[0040] In the above scheme, after determining the N local projection hosts and their corresponding wireless network signals in the current area based on the N identification information and M wireless network signals, the method further includes:
[0041] The current page displays N identification information controls corresponding to the local screen projection hosts; wherein, the identification information controls include the host name of the corresponding local screen projection host;
[0042] The step of selecting a target screen-casting host from N local screen-casting hosts according to user instructions includes:
[0043] Obtain the user instruction triggered by the target control among the N identification information controls, and determine the target screen projection host among the N local screen projection hosts.
[0044] This application also provides a screen mirroring method, applied to a target screen mirroring host, wherein the target screen mirroring host belongs to N local screen mirroring hosts in the current area, including:
[0045] Send the target acoustic signal and the target network signal to the client;
[0046] Wherein; the client determines the N local screen projection hosts in the current area and their corresponding wireless network signals based on M wireless network signals and N identification information; the M wireless network signals come from the M screen projection hosts; the sound wave signal sent by the local screen projection host includes at least the corresponding identification information; N is an integer; M is an integer, and M is not less than N;
[0047] The system receives screen mirroring data sent by the client via a wireless network and uses the screen mirroring data to perform screen mirroring.
[0048] This application also provides a screen projection device for use on a client, including:
[0049] The first receiving unit is used to receive N sound wave signals from the current area, each of the sound wave signals including at least the identification information of the corresponding local projection host; N is an integer;
[0050] The first receiving unit is further configured to receive M wireless network signals from M screen projection hosts; M is an integer and M is not less than N;
[0051] The determining unit is configured to determine, based on N identification information and M wireless network signals, the N local projection hosts in the current area and their corresponding wireless network signals;
[0052] The selection unit is used to select a target projection host from the N local projection hosts according to user instructions;
[0053] The first sending unit is used to send screen projection data to the target screen projection host through a wireless network between the unit and the target screen projection host.
[0054] This application embodiment also provides a screen projection device, applied to a target screen projection host, wherein the target screen projection host belongs to N local screen projection hosts in the current area, including:
[0055] The second transmitting unit is used to transmit the target acoustic wave signal and the target network signal to the client.
[0056] Wherein; the client determines the N local screen projection hosts in the current area and their corresponding wireless network signals based on M wireless network signals and N identification information; the M wireless network signals come from the M screen projection hosts; the sound wave signal sent by the local screen projection host includes at least the corresponding identification information; N is an integer; M is an integer, and M is not less than N;
[0057] The second receiving unit is used to receive screen projection data sent by the client through a wireless network between the client and the client, and to perform screen projection using the screen projection data.
[0058] This application also provides an electronic device, including a first communication interface, a first memory, and a first processor. The first communication interface performs communication steps between a client and a target projection host. The first memory stores a computer program that can run on the first processor. When the first processor executes the computer program, it implements the steps in the method on the client side.
[0059] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a first processor, implements the steps of the method on the client side.
[0060] This application also provides an electronic device, including a second communication interface, a second memory, and a second processor. The second communication interface executes communication steps between a client and a target projection host. The second memory stores a computer program that can run on the second processor. When the second processor executes the computer program, it implements the steps in the method on the target projection host side.
[0061] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a second processor, implements the steps of the method on the target projection host side.
[0062] In this embodiment, N acoustic signals are received from the current area, each acoustic signal including at least the identification information of the corresponding local projection host; N is an integer; M wireless network signals are received from M projection hosts; M is an integer, and M is not less than N; based on the N identification information and the M wireless network signals, the N local projection hosts in the current area and their corresponding wireless network signals are determined; according to user instructions, a target projection host is selected from the N local projection hosts; projection data is sent to the target projection host through the wireless network between the target projection host and the target projection host. Since the acoustic signals in this application include at least the identification information of the corresponding local projection host, the number of transmitted byte streams of acoustic signals is reduced, improving the transmission efficiency of acoustic signals and increasing the reliability of acoustic signals collected by the client. Furthermore, the method by which the client determines the N local projection hosts through the M wireless network signals and N identification information combines multiple technical points for the identification of local projection hosts, improving the accuracy of local projection host identification, reducing the occurrence of repeated client identification, and thus improving the client's projection efficiency. Attached Figure Description
[0063] Figure 1 A schematic flowchart of an optional screen mirroring method provided in an embodiment of this application;
[0064] Figure 2 An optional effect diagram of the screen projection method provided in the embodiments of this application;
[0065] Figure 3 An optional effect diagram of the screen projection method provided in the embodiments of this application;
[0066] Figure 4 An optional effect diagram of the screen projection method provided in the embodiments of this application;
[0067] Figure 5 An optional effect diagram of the screen projection method provided in the embodiments of this application;
[0068] Figure 6 An optional effect diagram of the screen projection method provided in the embodiments of this application;
[0069] Figure 7 An optional effect diagram of the screen projection method provided in the embodiments of this application;
[0070] Figure 8 A schematic flowchart of an optional screen mirroring method provided in an embodiment of this application;
[0071] Figure 9 A schematic flowchart of an optional screen mirroring method provided in an embodiment of this application;
[0072] Figure 10 A schematic flowchart of an optional screen mirroring method provided in an embodiment of this application;
[0073] Figure 11 An interactive schematic diagram of the screen projection method provided in the embodiments of this application;
[0074] Figure 12 Schematic diagram of the projection device provided in the embodiments of this application Figure 1 ;
[0075] Figure 13 A hardware entity illustration of the screen projection device provided in the embodiments of this application. Figure 1 ;
[0076] Figure 14 Schematic diagram of the projection device provided in the embodiments of this application Figure 2 ;
[0077] Figure 15 A hardware entity illustration of the screen projection device provided in the embodiments of this application. Figure 2 . Detailed Implementation
[0078] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application are further described in detail below with reference to the accompanying drawings and embodiments. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0079] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.
[0080] If the application documents contain similar descriptions such as "first / second", the following explanation shall be added: In the following description, the terms "first / second / third" are used only to distinguish similar objects and do not represent a specific order of objects. It is understood that "first / second / third" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.
[0081] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.
[0082] This application provides a screen mirroring method. Please refer to [link / reference]. Figure 1 This is an optional flowchart illustrating the screen projection method provided in this application embodiment, which will be combined with... Figure 1 The steps shown are explained.
[0083] S101. Receive N sound wave signals from the current area, each sound wave signal including at least the identification information of the corresponding local projection host.
[0084] In this embodiment, when a user enters the current area (conference room) with a device carrying the client, the device responds to the user's instruction to activate the client. The client receives sound wave signals broadcast by N local projection hosts in the current area. The client decapsulates each sound wave signal and extracts the identification information of the corresponding local projection host from each sound wave signal. N is an integer.
[0085] The identification information may include at least one of the following for the corresponding local screen mirroring host: physical address, product serial number, screen mirroring code, host name, and hotspot name. The acoustic signal may carry at least one of the following: physical address, product serial number, screen mirroring code, host name, and hotspot name.
[0086] In this embodiment, prior to S101, each local projection host can encapsulate its corresponding identification information into an acoustic signal, and then send the acoustic signal to the client via broadcast. The client then decodes and decapsulates the acoustic signal to obtain the identification information of the local projection host corresponding to the acoustic signal.
[0087] The sound wave signal can be a signal with an ultrasonic frequency. The transmission frequency band of the sound wave signal can include 19-23.5kHz (high frequency band). Ultrasound is a mechanical vibration wave with a frequency greater than 20,000 Hz and exceeding the upper limit of human hearing threshold. Normal human ears can hear sound waves from 20 Hz to 20,000 Hz. Ultrasound is essentially the same as sound waves, but because its frequency exceeds 20,000 Hz, it cannot be heard by the human ear, hence the name ultrasound.
[0088] For example, in combination Figure 2 After the client is activated on the device, the client displays the screen mirroring interface. Users can click the "Mirror Now" control on the screen mirroring interface to be redirected to... Figure 3 The loading screen appears to be a loading interface. During the loading process, the client listens to and receives sound wave signals broadcast by N local screen-casting hosts in the current area via microphone, and decapsulates each sound wave signal to obtain the identification information of the corresponding local screen-casting host.
[0089] S102, Receive M wireless network signals from M screen projection hosts.
[0090] In this embodiment, after extracting N identification information, the client scans and receives wireless network signals sent by M projection hosts. M is an integer, and M is not less than N.
[0091] Among them, M screen projection hosts can include: N local screen projection hosts, and can also include screen projection hosts from other areas outside the current area.
[0092] In some embodiments, each wireless network signal may include an Information Element (IE) field. Clients can extract the IE field from each wireless network signal. The IE field is part of the management frame of the IEEE 802.11 Wireless Local Area Network (WLAN) protocol, and it is used to convey descriptive information about itself within the management frame. Typically, there are multiple IEs per frame, each consisting of Type-Length-Value (TLVs).
[0093] For example, the structure of an IE field can be as follows:
[0094]
[0095] In this embodiment, each projection host can send at least one of a first wireless network signal and a second wireless network signal. The first wireless network signal can be a Wi-Fi direct signal. The second wireless network signal can be a Wi-Fi signal. Wi-Fi direct signals are point-to-point connections, offering higher network transmission rates and better projection quality. Wi-Fi direct allows devices within the wireless network signal to connect to each other without a wireless router. Similar to Bluetooth technology, this standard allows wireless devices to interconnect in a point-to-point manner, and it offers significant improvements in transmission speed and distance compared to Bluetooth. The client can extract the IE field from the first wireless network signal sent by each projection host, and the IE field from the second wireless network signal sent by each projection host.
[0096] For example, in combination Figure 3 During the loading process, the client scans for wireless network signals, obtains the wireless network signals, and performs IE recognition filtering to identify N local screen projection hosts for display.
[0097] S103. Based on N identification information and M wireless network signals, determine the N local screen projection hosts in the current area and their corresponding wireless network signals.
[0098] In this embodiment, the client can identify N wireless network signals containing identification information from M wireless network signals. Each of the N wireless network signals can contain identification information. Therefore, the client determines that the screen-sharing hosts corresponding to these N wireless network signals are N local screen-sharing hosts.
[0099] In this embodiment, the client can further filter out multiple first screen-casting hosts containing predetermined device information from the IE fields corresponding to the M screen-casting hosts. The wireless network signals sent by each of the multiple first screen-casting hosts correspond to a first predetermined field. The client matches the screen-casting identification information contained in each first predetermined field with each identification information. If a match is found, the first screen-casting host corresponding to that identification information is determined to be a local screen-casting host. This process continues until all the first predetermined fields are matched, identifying N local screen-casting hosts. Then, the wireless network signals corresponding to these N local screen-casting hosts are determined.
[0100] The screen casting identification information includes at least one of the following for the corresponding screen casting host: physical address, product serial number, screen casting code, host name, and hotspot name. Matching screen casting identification information with another identification information can be understood as: at least one of the following information included in the screen casting identification information matches the corresponding information in that identification information: physical address, product serial number, screen casting code, host name, and hotspot name.
[0101] In this embodiment, after identifying N local screen-casting hosts, the client can also display identification information controls corresponding to each of the N local screen-casting hosts on the current page; wherein, the identification information controls include the hostname of the corresponding local screen-casting host. In some other embodiments, the identification information controls may also include at least one of the following: the physical address, product serial number, screen-casting code, and hotspot name of the corresponding local screen-casting host.
[0102] In this embodiment, the client extracts the IE field of the wireless network signal corresponding to each projection host. Multiple first predetermined fields, including predetermined device information, are identified from the multiple IE fields. Projection identification information included in each of the multiple first predetermined fields is extracted from the data field of each first predetermined field. Each projection identification information is matched with other identification information; if a match is found, the projection host corresponding to that projection identification information is determined to be a local projection host. This process continues until all multiple first predetermined fields are matched, identifying N local projection hosts and their corresponding wireless network signals. The wireless network signal corresponding to each local projection host may include: a first wireless network signal and / or a second wireless network signal.
[0103] S104. Based on the user's instructions, determine the target host from among the N local screen projection hosts.
[0104] In this embodiment, after the client identifies N local projection hosts, the client can display the identification information controls corresponding to each of the N local projection hosts on the current page. The client determines the target host from the N local projection hosts based on the user's touch command.
[0105] In this embodiment, the client obtains a selection instruction triggered by a target control among N identification information controls, and determines the target host among N local projection hosts. The target control corresponds to the target host. For example, combined with... Figure 4 The client's current page displays a selection of meeting rooms for screen sharing, including identification controls for multiple local screen sharing hosts. Users can click on the target control among these controls to identify the corresponding host. For example, there could be meeting rooms (A and B). Each meeting room includes multiple local screen sharing hosts, which the client scans and identifies. Meeting room A: contains local screen sharing hosts A1 and A2. Meeting room B: contains local screen sharing hosts B1 and B2. When the client enters meeting room A and clicks "Screen Now," only local screen sharing hosts A1 and A2 are available for selection. When the client enters meeting room B and clicks "Screen Now," only local screen sharing hosts B1 and B2 are available for selection.
[0106] S105. Send screen projection data to the target screen projection host through the wireless network between the target screen projection host and the target screen projection host.
[0107] In this embodiment, the client can send screen projection data to the target screen projection host through the network hotspot corresponding to the wireless network signal of the target screen projection host.
[0108] In this embodiment, when the wireless network signal sent by the target projection host includes a first wireless network signal, the client sends projection data to the target projection host through the network hotspot corresponding to the first wireless network signal. If sending projection data through the network hotspot corresponding to the first wireless network signal fails, the client can send projection data to the target projection host through the network hotspot of the second wireless network signal sent by the target projection host. If sending projection data through the network hotspot of the second wireless network signal fails, the client can perform projection code recognition and then send projection data to the target projection host. The projection data can be video data, text data, image data, etc., that needs to be projected.
[0109] This application primarily describes a solution for automatically identifying one or more screen-sharing conferencing hosts in one or more meeting room scenarios. By combining and deciding on information, it identifies the screen-sharing conferencing hosts in the current meeting room, determines the optimal connection method, and ultimately provides a good screen-sharing experience. The target screen-sharing host identification process includes ultrasonic broadcasting, Wi-Fi direct network node filtering identification, Wi-Fi filtering identification, and screen-sharing code identification. Different technical solutions result in different identification processes for screen-sharing hosts; combining multiple identification strategies improves the accuracy and reliability of host identification.
[0110] To achieve the above objectives, the following technical identification is provided:
[0111] 1. Ultrasonic Broadcast Recognition: The client uses ultrasound to match and obtain ultrasonic broadcast information, such as physical address, product serial number, projection code, host name, and hotspot name.
[0112] 2. Wi-Fi & Direct Network Identification: The client scans for Wi-Fi and direct hotspots in the current network and filters them using custom IE fields to obtain a list of all local screen-casting hosts. It also stores relevant Wi-Fi & direct network information such as physical address, product serial number, casting code, host name, and hotspot name.
[0113] 3. Screen Casting Code Recognition: When the client fails to connect to the target screen casting host via the target network signal, the client and the target screen casting host perform a wireless Internet Protocol (IP) mapping, uniquely locking and identifying the user's target screen casting host through the screen casting code. (This can be done manually by the user or automatically via the screen casting code in Wi-Fi & Direct IE). For example, combined with... Figure 4 If a user is unable to select the desired target screen-casting host from among multiple identification information controls, the user can click "Enter Screen-Casting Code to Cast" below the multiple identification information controls to jump to the desired location. Figure 5 . Figure 5 This is the interface for recognizing the screen mirroring code. Combined with... Figure 5 Users can enter the screen casting code in the space below "Please enter the screen casting code" to cast their screen, or they can select a previous screen casting code to cast their screen.
[0114] In some embodiments, the client obtains the Wi-Fi and direct nodes in the currently accessed wireless network signal through Wi-Fi scanning, which may include:
[0115] 1. The screen-sharing client identifies and filters the IE field of the local screen-sharing host to release the unique identifier of the direct network, thereby collecting a list of all Wi-Fi direct networks in the current meeting room and obtaining the unique identifier of the screen-sharing host from the IE DATA field information. It prioritizes matching the host identifier information discovered by ultrasound in S101 with the identifier information in the current network list, and prioritizes the selection of local screen-sharing hosts with successful matches.
[0116] 2. The client identifies and filters the IE field of the projection host, which reveals the unique identifier of the projection host's Wi-Fi network. This allows the client to collect a list of all Wi-Fi networks in the current meeting room and the unique identifier of the projection host obtained from the IE DATA field. The host identifier information detected by ultrasound in S101 is then matched with the identifier information in the current network list.
[0117] 3. If both strategies 1 and 2 result in successful scans but connection failures, the client can identify the casting code using the wifi_direct or wifiIE information element to enable casting. Alternatively, if neither strategy 2 nor strategy 3 identifies a network, the user can manually enter the casting code to enable local area network casting.
[0118] In this embodiment, N acoustic signals are received from the current area, each acoustic signal including at least the identification information of the corresponding local projection host; N is an integer; M wireless network signals are received from M projection hosts; M is an integer, and M is not less than N; based on the N identification information and the M wireless network signals, the N local projection hosts in the current area and their corresponding wireless network signals are determined; according to user instructions, a target projection host is selected from the N local projection hosts; projection data is sent to the target projection host through the wireless network between the target projection host and the target projection host. Since the acoustic signals in this application include at least the identification information of the corresponding local projection host, the number of transmitted byte streams of acoustic signals is reduced, improving the transmission efficiency of acoustic signals and increasing the reliability of acoustic signals collected by the client. Furthermore, the method by which the client determines the N local projection hosts through the M wireless network signals and N identification information combines multiple technical points for the identification of local projection hosts, improving the accuracy of local projection host identification, reducing the occurrence of repeated client identification, and thus improving the client's projection efficiency.
[0119] Figure 1 The shown S103 can also be implemented by S106 to S109, which will be explained in conjunction with each step.
[0120] S106. Select K first predetermined fields containing predetermined device information from the predetermined fields included in the M wireless network signals.
[0121] In this embodiment, the client extracts predetermined fields from the wireless network signals sent by M projection hosts, obtaining M predetermined fields. The client checks whether each predetermined field includes predetermined device information. If it does, the client determines that the predetermined field is the first predetermined field and identifies the first projection host corresponding to the first predetermined field. This process continues until all M predetermined fields have been detected, resulting in K first predetermined fields. K is an integer, and K is not greater than M.
[0122] In this embodiment, the pre-defined field can be an IE field. The client detects whether the ElementID in each IE field is a pre-defined ID identifier and whether the OUI field is a pre-defined type identifier. When the ElementID in the IE field is a pre-defined ID identifier and the OUI field is a pre-defined type identifier, the IE field is determined to be the first pre-defined field, and the first projection host corresponding to the IE field is determined.
[0123] S107. Extract the screen projection identification information from the load data fields included in the K first predetermined fields respectively.
[0124] In this embodiment, the first predetermined field may include a load data field. The load data field records the projection identification information of the corresponding first projection host. The client extracts the projection identification information included in each of the first predetermined fields.
[0125] Since the K first predetermined fields are part of the M predetermined fields, it can be determined that the data structure of the first predetermined fields is consistent with the data structure of the predetermined fields. The first predetermined fields also include a `data` field, where the screen casting identifier information belongs to the `data` field. The client can extract the corresponding screen casting identifier information from the `data` field of the first predetermined fields.
[0126] S108. Construct a host identifier set based on K screen projection identifier information.
[0127] In this embodiment, the client can construct a host identifier set based on multiple screen projection identifiers. The host identifier set includes the correspondence between each screen projection identifier and its corresponding first screen projection host and wireless network signal.
[0128] In this embodiment, the first projection host can send a first wireless network signal and a second wireless network signal. The client extracts the first projection identifier information from a first predetermined field in the first wireless network signal, and can construct a correspondence between the first projection identifier information and the corresponding first wireless network signal and its corresponding first projection host. The client can extract the second projection identifier information from a first predetermined field in the second wireless network signal, and can construct a correspondence between the second projection identifier information and the corresponding first wireless network signal and its corresponding first projection host. Combining the correspondences constructed for each first projection host yields a host identifier set. This host identifier set can exist in tabular form.
[0129] S109. Based on N identification information, match and filter out N local screen projection hosts and their corresponding wireless network signals from the host identification set.
[0130] In this embodiment of the application, the client can match the screen projection identification information of each correspondence in the host identification set with N identification information. If a match is found, the screen projection host in the correspondence is determined to be the local screen projection host, and the wireless network signal in the correspondence is determined to be the wireless network signal of the corresponding local screen projection host. This process continues until multiple correspondences in the host identification set are matched, thereby determining N local screen projection hosts and their respective corresponding wireless network signals.
[0131] For example, in combination Figure 6 The host computer can broadcast its unique identifier information stored in the ultrasonic module. The client's screen-sharing control module collects and analyzes the ultrasonic signals to obtain the host's unique identifier information. The host computer can configure its first and second wireless networks through IE field settings, enabling the host to create these networks. The client obtains the custom data from the host's first and second wireless networks in the current IE fields, then uses IE filtering to identify the user's selected screen-sharing host and establish a screen-sharing link. The client's first network module scans for discoverable P2P (peer-to-peer lending) devices and matches them with the host's unique identifier information. Upon successful matching, a direct connection interface (a native Windows API) is called to establish a connection. Screen-sharing data transmission then begins. If the screen-sharing control module times out while waiting for a direct response, the second network module's Wi-Fi self-switching function is activated. It matches the Wi-Fi wired physical address with the scanned Wi-Fi network card's discovered Wi-Fi group IE information elements and then establishes a Wi-Fi network link. After the user selects the screen-sharing host, a network connection is established, providing a convenient, efficient, and stable screen-sharing experience.
[0132] In this application, the client first filters out K first predetermined fields from M predetermined fields using predetermined device information, and then filters out N local projection hosts from the first projection hosts corresponding to the M first predetermined fields using N identification information. This process combines predetermined fields and identification information to identify local projection hosts. The secondary filtering improves the accuracy of local projection host identification, reduces the occurrence of repeated identification by the client, and thus improves the client's projection efficiency.
[0133] In some embodiments, S106 to S109 shown can also be implemented by S110 to S118, which will be described in conjunction with each step.
[0134] S110. Filter out t second predetermined fields containing predetermined device information from the T first network fields.
[0135] In this embodiment, the M wireless network signals include: T first wireless network signals and Q second wireless network signals. T and Q are both integers, and neither T nor Q is greater than M. The T first wireless network signals originate from T screen-sharing hosts out of the M screen-sharing hosts. The Q second wireless network signals originate from Q screen-sharing hosts out of the M screen-sharing hosts. The data transmission rate of the first wireless network signals is greater than that of the second wireless network signals. The M predetermined fields include: T first network fields and Q second network fields. The first network fields belong to the corresponding first wireless network signals, and the second network fields belong to the corresponding second wireless network signals. The K first predetermined fields include: t second predetermined fields and q third predetermined fields. t and q are both integers, and t is not greater than T, and q is not greater than Q. The client detects whether each first network field includes predetermined device information. If it does, the client determines that the first network field is a second predetermined field, until all T first network fields have been detected, resulting in t second predetermined fields.
[0136] In this embodiment, the first wireless network signal can be a direct signal, and the first network field can be the IE field in the direct signal. The client can detect whether the IE field in the direct signal includes predetermined device information; if so, it determines that the IE field in the direct signal is a second predetermined field. This process continues until T direct signals have been detected, and t second predetermined fields have been determined.
[0137] S111. Filter out q third predetermined fields containing predetermined device information from the Q second network fields.
[0138] In this embodiment, the client detects whether each second network field includes predetermined device information. If it does, the client determines that the second network field is a third predetermined field. This process continues until Q second network fields are detected, resulting in q third predetermined fields.
[0139] In this embodiment, the second wireless network signal can be a Wi-Fi signal, and the second network field can be the IE field in the Wi-Fi signal. The client can detect whether the IE field in the Wi-Fi signal includes predetermined device information; if it does, the client determines that the IE field in the Wi-Fi signal is a third predetermined field. This process continues until Q direct signals have been detected, and Q third predetermined fields have been determined.
[0140] S112. Extract the first projection identification information from the load data fields included in the t second predetermined fields respectively.
[0141] In this embodiment of the application, the client can extract the first projection identification information from the load data field included in each second predetermined field, thereby obtaining t first projection identification information.
[0142] The first screen projection identification information can be the physical address, product serial number, screen projection code, host name, and hotspot name (direct hotspot name) of the corresponding first screen projection host.
[0143]
[0144] Table 1
[0145] For example, Table 1 is a structure table for the direct IE field. In this embodiment of the application, the client can extract the first screen casting identification information (physical address / device serial number / screen casting code / host name / hotspot name, etc.) from the data field included in each second predetermined field (direct IE field).
[0146] S113. Extract the second projection identification information from the load data fields included in the q third predefined fields respectively.
[0147] In this embodiment of the application, the client can extract the second projection identification information from the load data field included in each third predetermined field, thereby obtaining q second projection identification information.
[0148] The second screen projection identification information can be the physical address, product serial number, screen projection code, host name, and hotspot name (Wi-Fi hotspot name) of the corresponding first screen projection host.
[0149]
[0150] Table 2
[0151] For example, Table 2 is a structure table of the Wi-Fi IE field. In this embodiment of the application, the client can extract the second screen casting identification information (physical address / device serial number / screen casting code / host name / hotspot name, etc.) from the data field included in each second predetermined field (Wi-Fi IE field).
[0152] Among them, the maximum value of the load data in the wifi&direct custom IE field is 325, and the business load data can be used for business expansion in the future to improve product scalability.
[0153] S114. For each of the t first projection identification information, construct a first correspondence between each first projection identification information and the corresponding first wireless network signal and the first projection host.
[0154] In this embodiment of the application, the client constructs a first correspondence between each first screen projection identifier and the corresponding first wireless network signal and the first screen projection host.
[0155] For example, the client can construct a correspondence between the first screen projection identifier information and the corresponding first wireless network name (direct hotspot name) and the corresponding first screen projection host, thereby obtaining t first correspondences.
[0156] S115. For each of the q second projection identification information, construct a second correspondence between each second projection identification information and the corresponding second wireless network signal and the first projection host.
[0157] In this embodiment of the application, the client constructs a second correspondence between each second projection identifier and the corresponding second wireless network signal and the first projection host.
[0158] For example, the client can construct a correspondence between the first screen projection identification information and the corresponding second wireless network name (Wi-Fi hotspot name), and the corresponding first screen projection host, thereby obtaining q second correspondences.
[0159] S116. Merge and integrate the first and second correspondences that contain the same first projection host to form a third correspondence.
[0160] In this embodiment, if a first screen-casting host simultaneously sends a first wireless network signal and a second wireless network signal, the client can merge the first and second correspondences corresponding to the first screen-casting host. The third correspondence includes screen-casting identification information included in both the first and second correspondences, and the correspondence between the first wireless network signal, the second wireless network signal, and the first screen-casting host.
[0161] For example, the third correspondence may include the physical address, product serial number, screen casting code, host name, hotspot name (Wi-Fi hotspot name and direct hotspot name) of the corresponding first screen casting host, and the correspondence between the first wireless network signal, the second wireless network signal and the first screen casting host.
[0162] In some other embodiments, the first correspondence, the second correspondence, and the third correspondence can all be in tabular form.
[0163] S117. The host identifier set is obtained by combining t first correspondences, q second correspondences and third correspondences.
[0164] In this embodiment of the application, the client obtains a set of host identifiers by combining multiple first correspondences, multiple second correspondences, and a third correspondence.
[0165] S118. Using the first identification information, filter out a fourth correspondence that matches the first identification information from t first correspondences, q second correspondences, and third correspondences, until the last identification information is used to complete the matching and filtering in the host identification set, and determine N fourth correspondences. The first screen projection host included in each fourth correspondence is determined as the local screen projection host, and N local screen projection hosts and their corresponding wireless network signals are obtained.
[0166] In this embodiment, the client extracts N identification information in S101. The client can match each identification information with each correspondence in the host identification set. If the identification information matches the screen projection identification information in a certain correspondence, the correspondence is determined to be the fourth correspondence, until all N identification information are matched and N fourth correspondences are determined. The first screen projection host included in each fourth correspondence is determined as the local screen projection host, resulting in N local screen projection hosts, and the wireless network signal in each fourth correspondence is determined to be the wireless network signal of the corresponding local screen projection host.
[0167] Each identification information includes at least one of the following for the corresponding local screen mirroring host: physical address, product serial number, screen mirroring code, host name, and hotspot name; the screen mirroring identification information in the corresponding fourth correspondence relationship matches at least one of the following: physical address, product serial number, screen mirroring code, host name, and hotspot name.
[0168] In this application, the client first filters out t second predetermined fields and q third predetermined fields from T first network fields and Q second network fields based on predetermined device information. Then, it extracts t first projection identification information from the t second predetermined fields and q second projection identification information from the q second predetermined fields. Based on the t first projection identification information and q second projection identification information, a host identification set is constructed. Then, N local projection hosts are selected from the first projection hosts included in the host identification set using N identification information. This process combines predetermined fields and identification information to identify local projection hosts. The secondary filtering improves the accuracy of local projection host identification, reduces the occurrence of repeated identification by the client, and thus improves the client's projection efficiency.
[0169] In some embodiments, S101 may be followed by S120, which will be described in conjunction with the steps.
[0170] S120. Decode and decapsulate the acoustic signal to obtain the identification information of the local projection host corresponding to the acoustic signal.
[0171] In this embodiment of the application, the client can monitor and acquire the ultrasonic signals broadcast by each local projection host in the current conference room. The client decodes and decapsulates each received ultrasonic signal to obtain the identification information of the local projection host corresponding to each ultrasonic signal.
[0172] The local projection host encapsulates the identification information to be sent, encodes it with ultrasonic frequency to generate an acoustic signal, and then plays it using the system's speaker. The client monitors the microphone in real time and passes the received ultrasonic signal to the decoding and decapsulation interface. Once the identification information is parsed and obtained, it is passed to other modules for quick identification and to establish a projection connection.
[0173] For example, in combination Figure 7 The host device encapsulates the identification information to be transmitted via an acoustic module, encodes it using ultrasonic frequencies, and generates an ultrasonic signal. This signal is then transmitted through the host's projection control module to the system's application programming interface (API), which in turn passes it to the host's speaker for broadcast. The client device receives the ultrasonic signal via its microphone and transmits it through the system API and projection control module to its local acoustic module for parsing and decapsulation. Once the identification information is obtained, it is passed to other modules for rapid identification and to establish a projection connection.
[0174] Because this application carries at least identification information in the acoustic signal, it reduces the number of transmitted bytes of the acoustic signal, improves the transmission efficiency of the acoustic signal, and increases the reliability of the acoustic signal collected by the client.
[0175] In some embodiments, S105 shown can also be implemented by S121 to S124, which will be described in conjunction with each step.
[0176] S121. If a fourth correspondence corresponding to the target projection host includes the first target wireless network signal, then a connection is established between the first target wireless network corresponding to the first target wireless network signal and the target projection host.
[0177] In this embodiment of the application, the target screen projection host can correspond to the first, second, or third correspondence in the host identifier set. When the target screen projection host has a first target wireless network in the correspondence in the host identifier set, the client can use the network hotspot corresponding to the first target wireless network signal to establish a connection with the target screen projection host.
[0178] The client can establish a connection with the target screen-casting host using the direct network corresponding to the target screen-casting host.
[0179] S122. After successfully establishing a connection with the target projection host based on the first target wireless network signal, the first target wireless network is used to send projection data to the target projection host.
[0180] In this embodiment of the application, after the client successfully establishes a connection with the target projection host based on the first target wireless network signal, it uses the first target wireless network to send projection data to the target projection host for projection.
[0181] After the client successfully establishes a connection with the target screen-casting host using the direct network corresponding to the target screen-casting host, it can send screen-casting data to the target screen-casting host through the direct network to perform screen-casting.
[0182] S123. If the connection between the target screen projection host and the first target wireless network signal fails to be established, and a second target wireless network signal exists in a fourth correspondence corresponding to the target screen projection host, a connection is established between the second target wireless network signal and the target screen projection host using the second target wireless network signal.
[0183] In this embodiment of the application, after the client fails to establish a connection with the target screen projection host through the first target wireless network signal, and a second target wireless network signal exists in a fourth correspondence corresponding to the target screen projection host, a connection is established with the target screen projection host using the network hotspot corresponding to the second target wireless network signal.
[0184] The client can establish a connection with the target screen projection host by utilizing the Wi-Fi network corresponding to the target screen projection host.
[0185] S124. After successfully establishing a connection with the target projection host based on the second target wireless network, projection data is sent to the target projection host using the second target wireless network to perform projection.
[0186] After the client successfully establishes a connection with the target screen mirroring host using the Wi-Fi network corresponding to the target screen mirroring host, it can send screen mirroring data to the target screen mirroring host via the Wi-Fi network to perform screen mirroring.
[0187] If the client fails to establish a connection with the target screen mirroring host using the Wi-Fi network corresponding to the target screen mirroring host, the client can mirror the screen through the target screen mirroring host by recognizing the screen mirroring code.
[0188] In this embodiment, when the target screen-casting host has a corresponding first target wireless network (direct network), the first target wireless network is used first to transmit screen-casting data, improving the transmission efficiency of screen-casting data. Furthermore, if the target screen-casting host does not have a first target wireless network or the first target wireless network connection fails, the screen-casting data is transmitted through a second target wireless network with lower transmission efficiency, diversifying the methods of transmitting screen-casting data and improving screen-casting stability.
[0189] This application provides a screen mirroring method. Please refer to [link / reference]. Figure 8 This is an optional flowchart illustrating the screen projection method provided in this application embodiment, which will be combined with... Figure 8 The steps shown are explained.
[0190] S401, Click "One-Click Screen Casting".
[0191] S402, Ultrasonic detection and identification.
[0192] Users click "One-Click Screen Projection" on the client. The ultrasonic scanner automatically identifies and matches the local projection host in the current meeting room, and extracts the host's unique identifier from the sound wave signal. This identifier information is then used to discover and match with subsequent wireless networks, presenting the user with a list of optimal host identification options.
[0193] S403, Screen Projection Control Module.
[0194] S404, WiFi module.
[0195] The client can scan for wireless network signals (including direct network signals and Wi-Fi network signals) using the Wi-Fi module.
[0196] S405, Wireless Network Discovery and Identification.
[0197] S406, IE recognition and filtering.
[0198] Network discovery and identification: The client discovers Wi-Fi and Direct networks, identifies hosts using custom IE structure data for Wi-Fi, and filters network signals that match specific data (unique identifier information). A list of network hosts for screen mirroring (a set of host identifiers) is then built.
[0199] S407. The page displays the identified host information.
[0200] The client matches the identification information obtained by ultrasound with the identification information in the network list. If a match is found, the selected information is displayed first; otherwise, the user makes the selection manually.
[0201] S408, No target screen-projection host detected.
[0202] The client matches the identification information obtained by ultrasound with the identification information in the network list. If no network signal matches successfully, then execute S409.
[0203] S409, Screen Casting Code Recognition.
[0204] The client and the target screen mirroring host have a wireless IP mapping, and connect via a local area network to enable screen mirroring. Screen mirroring code usage process: ①: After one-click screen mirroring, the user actively enters the screen mirroring code displayed by the screen mirroring host to start the mirroring experience. ②: If the target screen mirroring host exists in the network list, and Wi-Fi & Direct connection fails, the internal screen mirroring code in IE data is used to automatically identify and mirror the user. ③: If the target screen mirroring host does not exist in the network list, the user actively enters the screen mirroring code displayed by the screen mirroring host to start the mirroring experience.
[0205] S410, Target screen mirroring host detected.
[0206] Users can select the target screen-casting host from among the multiple hosts displayed on the client.
[0207] S411, Does a first target wireless network exist?
[0208] The client detects the current network list to identify the target screen-casting host, and checks whether the target screen-casting host corresponds to a first target wireless network. If there is a first target wireless network, it executes S412; otherwise, it executes S413.
[0209] S412, The first target wireless network connection was successful.
[0210] If the client successfully establishes a direct network connection with the target screen-casting host, it will use the direct network connection to send screen-casting data to the target screen-casting host.
[0211] S413, Is there a second target wireless network?
[0212] The client checks if the target projection host has a Wi-Fi network. If the target projection host has a Wi-Fi network, it executes step S414; otherwise, it executes step S409.
[0213] S414. Has the second target network been successfully connected?
[0214] If the client successfully connects to the target screen-casting host's Wi-Fi network, it will send screen-casting data to the target screen-casting host using the Wi-Fi network connection.
[0215] If the client fails to connect to the target screen mirroring host's Wi-Fi network, then execute S409.
[0216] This application reduces the byte stream transmitted via ultrasonic waves, improving transmission efficiency and reducing data loss, thus enhancing the accuracy of users selecting the conference host for screen sharing. Furthermore, it carries more data through IE data, providing better scalability and extensibility for subsequent business logic. By filtering through the Wi-Fi & Direct IE fields, it uniquely identifies one or more conference hosts, improving screen sharing accuracy. ③: Through IE identification based on various technical points, it determines the optimal screen sharing link, improving the user's screen sharing experience.
[0217] This application provides a screen mirroring method. Please refer to [link / reference]. Figure 9 This is an optional flowchart illustrating the screen projection method provided in this application embodiment, which will be combined with... Figure 9 The steps shown are explained.
[0218] S415. Extract identification information.
[0219] The client's ultrasonic receiving module obtains the identification information of all screen-projecting hosts in the current conference room.
[0220] S416, cast to screen immediately.
[0221] S417. Obtain all sets of first wireless networks and second wireless networks.
[0222] The client collects Wi-Fi and Direct network signals through the Wi-Fi module and constructs a set of host identifiers.
[0223] S418, IE filtering.
[0224] Users click "Screencast Now" on the client, which then discovers and filters Wi-Fi and Direct networks via the Wi-Fi module. To differentiate between Wi-Fi and Direct networks not belonging to the conference host, a custom IE data structure is used for filtering.
[0225] S419. Return the identified information about the first and second wireless networks.
[0226] In this embodiment, the Wi-Fi module returns the network information filtered by the IE data structure to the screen projection control module.
[0227] S420, secondary filtering of identification information received via ultrasonic waves.
[0228] The screen mirroring control module performs secondary filtering based on the host's unique identifier, and finally displays the host information on the page for users to select the host they want to mirror.
[0229] S421. Page displays conference host information for users to choose from.
[0230] S422, the same conference host will preferentially connect to the first wireless network.
[0231] The client prioritizes establishing a network connection with the target screen-casting host's direct network.
[0232] S423, Return connection result.
[0233] The Wi-Fi module returns the result of establishing a direct network with the target projection host.
[0234] S424, p2p connection failed or only a second wireless network exists.
[0235] If the client fails to establish a direct network connection with the target projection host, or if the target projection host only has a Wi-Fi network, then the connection will be established using the target projection host's Wi-Fi network.
[0236] S425, Return the result of the second wireless network connection.
[0237] The Wi-Fi module returns the result of establishing a Wi-Fi network with the target projection host.
[0238] S426, Second wireless network connection failed, screen casting code recognition for screen casting.
[0239] After a user selects a host, if the host has both Wi-Fi and P2P network information, a P2P network connection will be prioritized. If the P2P network connection fails, or if only a Wi-Fi network is available, a Wi-Fi connection will be established. If the Wi-Fi network connection fails, screen mirroring via a QR code will be used.
[0240] This application provides a screen mirroring method. Please refer to [link / reference]. Figure 10 This is an optional flowchart illustrating the screen projection method provided in this application embodiment, which will be combined with... Figure 10 The steps shown are explained.
[0241] S201. Send the target acoustic wave signal and the target network signal to the client; wherein; the client determines the N local screen projection hosts in the current area and their corresponding wireless network signals based on M wireless network signals and N identification information; the M wireless network signals come from M screen projection hosts; the acoustic wave data sent by the local screen projection hosts includes at least the corresponding identification information;
[0242] In this embodiment of the application, the target projection host broadcasts the target acoustic signal and the target network signal to the client within the current area.
[0243] S202. Receive screen mirroring data sent by the client through the wireless network between the client and the client, and use the screen mirroring data to perform screen mirroring.
[0244] In this embodiment, the target screen-casting host receives screen-casting data sent by the client through a wireless network hotspot and uses the screen-casting data for screen-casting.
[0245] In this embodiment, the target screen-casting host receives screen-casting data sent by the client through the network hotspot corresponding to the first target wireless network signal, and uses the screen-casting data for screen casting. The first target wireless network signal is a direct network signal.
[0246] In this embodiment, the target screen-casting host receives screen-casting data sent by the client through the network hotspot corresponding to the second target wireless network signal, and uses the screen-casting data for screen casting. The second target wireless network signal is a Wi-Fi network signal.
[0247] This application provides a screen mirroring method. Please refer to [link / reference]. Figure 11 This is an interactive schematic diagram of the screen projection method provided in the embodiments of this application, which will be combined with Figure 11 The steps shown are explained.
[0248] S301. The client receives N sound wave signals from the current area, and each sound wave signal includes at least the identification information of the corresponding local projection host.
[0249] For a detailed implementation of S301, please refer to S101; it will not be elaborated upon here.
[0250] S302. The client receives M wireless network signals from M screen-projecting hosts.
[0251] The specific implementation of S302 can be found in S102, and will not be elaborated here.
[0252] S303. The client determines the N local screen projection hosts in the current area and their corresponding wireless network signals based on N identification information and M wireless network signals.
[0253] For a detailed implementation of S303, please refer to S103; it will not be elaborated upon here.
[0254] S304. The client selects the target screen projection host from N local screen projection hosts according to the user's instructions.
[0255] The specific implementation of S304 can be found in S104, and will not be elaborated here.
[0256] S305, The client sends screen projection data to the target screen projection host via the wireless network between the client and the target screen projection host.
[0257] For a detailed implementation of S305, please refer to S105; it will not be elaborated upon here.
[0258] Please see Figure 12 This is a schematic diagram of the screen projection device provided in the embodiments of this application. Figure 1 .
[0259] This application also provides a screen projection device 600, applied to a client, including: a first receiving unit 601, a determining unit 602, a selecting unit 603, and a first sending unit 604.
[0260] The first receiving unit 601 is used to receive N sound wave signals from the current area, each of the sound wave signals including at least the identification information of the corresponding local projection host; N is an integer;
[0261] The first receiving unit 601 is also used to receive M wireless network signals from M screen projection hosts; M is an integer and M is not less than N;
[0262] The determining unit 602 is used to determine, based on N identification information and M wireless network signals, the N local screen projection hosts in the current area and their corresponding wireless network signals;
[0263] Selection unit 603 is used to select a target projection host from N local projection hosts according to user instructions;
[0264] The first sending unit 604 is used to send screen projection data to the target screen projection host through a wireless network between the target screen projection host and the target screen projection host.
[0265] In this embodiment of the application, the determining unit 602 in the screen projection device 600 is used to filter out K first predetermined fields containing predetermined device information from the predetermined fields included in the M wireless network signals; the first predetermined fields correspond to the first screen projection host; K is an integer, and K is not greater than M;
[0266] Screen projection identification information is extracted from the load data fields included in the K first predetermined fields; the screen projection identification information is the identification information of the corresponding first screen projection host;
[0267] A host identifier set is constructed based on the K screen projection identifiers; the host identifier set includes: the correspondence between each screen projection identifier and the corresponding first screen projection host and the wireless network signal;
[0268] Based on the N identification information, N local screen projection hosts and their corresponding wireless network signals are matched and filtered out from the host identification set.
[0269] In this embodiment, the M wireless network signals include: T first wireless network signals and Q second wireless network signals; T and Q are both integers, and neither T nor Q is greater than M; the data transmission rate of the first wireless network signals is greater than that of the second wireless network signals; the M predetermined fields include: T first network fields and Q second network fields; the first network fields belong to the corresponding first wireless network signals, and the second network fields belong to the corresponding second wireless network signals; the K first predetermined fields include: t second predetermined fields and q third predetermined fields; t and q are both integers, and t is not greater than T, and q is not greater than Q;
[0270] The determining unit 602 in the projection device 600 is used to filter out t second predetermined fields containing the predetermined device information from T first network fields; and to filter out q third predetermined fields containing the predetermined device information from Q second network fields.
[0271] In this embodiment of the application, the determining unit 602 in the screen projection device 600 is used to extract the first screen projection identification information from the load data fields included in the t second predetermined fields respectively; and to extract the second screen projection identification information from the load data fields included in the q third predetermined fields respectively.
[0272] In this embodiment of the application, the determining unit 602 in the screen projection device 600 is used to construct a first correspondence between each of the t first screen projection identification information and the corresponding first wireless network signal and the first screen projection host for each of the first screen projection identification information; construct a second correspondence between each of the q second screen projection identification information and the corresponding second wireless network signal and the first screen projection host for each of the second screen projection identification information; merge the first correspondence and the second correspondence that include the same first screen projection host to form a third correspondence; and obtain the host identifier set by combining the t first correspondences, the q second correspondences and the third correspondence.
[0273] In this embodiment of the application, the determining unit 602 in the screen projection device 600 is used to filter out a fourth correspondence that matches the first identification information from t first correspondences, q second correspondences and the third correspondences using the first identification information, until the last identification information is used to complete the matching and filtering in the host identification set, and N fourth correspondences are determined. The first screen projection host included in each fourth correspondence is determined as the local screen projection host, and N local screen projection hosts and their corresponding wireless network signals are obtained.
[0274] In this embodiment of the application, each of the identification information includes at least one of the following for the corresponding local screen casting host: physical address, product serial number, screen casting code, host name, and hotspot name; the screen casting identification information in the corresponding fourth correspondence relationship matches at least one of the physical address, product serial number, screen casting code, host name, and hotspot name.
[0275] In this embodiment of the application, the first sending unit 604 in the screen projection device 600 is used to establish a connection with the target screen projection host using the first target wireless network corresponding to the first target wireless network signal if the fourth correspondence corresponding to the target screen projection host includes a first target wireless network signal; and after successfully establishing a connection with the target screen projection host based on the first target wireless network, to send the screen projection data to the target screen projection host using the first target wireless network.
[0276] In this embodiment of the application, the first sending unit 604 in the screen projection device 600 is used to establish a connection with the target screen projection host using the second target wireless network corresponding to the second target wireless network signal when the connection between the first target wireless network and the target screen projection host fails to be established, and a second target wireless network signal exists in one of the fourth correspondences corresponding to the target screen projection host; and after the connection between the second target wireless network and the target screen projection host is successfully established, the screen projection data is sent to the target screen projection host using the second target wireless network.
[0277] In this embodiment of the application, the first receiving unit 601 in the screen projection device 600 is used to decode and decapsulate the sound wave signal to obtain the identification information of the local screen projection host corresponding to the sound wave signal.
[0278] In this embodiment of the application, the screen projection device 600 is used to display identification information controls corresponding to N local screen projection hosts on the current page; wherein, the identification information controls include the host name of the corresponding local screen projection host; the selection unit 603 in the screen projection device 600 is used to obtain the user instruction triggered by the target control among the N identification information controls, and determine the target screen projection host among the N local screen projection hosts.
[0279] Because the acoustic signal in this application includes at least the identification information of the corresponding local projection host, the number of transmitted byte streams of the acoustic signal is reduced, the transmission efficiency of the acoustic signal is improved, and the reliability of the acoustic signal collected by the client is increased. Furthermore, the method by which the client determines N local projection hosts through M wireless network signals and N identification information combines multiple technical points to identify local projection hosts, thereby improving the accuracy of local projection host identification, reducing the occurrence of repeated identification by the client, and thus improving the projection efficiency of the client.
[0280] It should be noted that, in the embodiments of this application, if the above-described screen projection method is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiments of this application, or the part that contributes to the related technology, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause an electronic device (which may be a personal computer, etc.) to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), magnetic disks, or optical disks. Thus, the embodiments of this application are not limited to any specific hardware and software combination.
[0281] Correspondingly, embodiments of this application provide a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps in the method on the client side.
[0282] Correspondingly, this application provides an electronic device 700, including a first communication interface 703, a first memory 702, and a first processor 701. The first communication interface 703 performs communication steps between the client and the target projection host. The first memory 702 stores a computer program that can run on the first processor 701. When the first processor 701 executes the program, it implements the steps in the above method.
[0283] It should be noted that the descriptions of the storage medium and device embodiments above are similar to the descriptions of the method embodiments above, and have similar beneficial effects. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.
[0284] It should be noted that, Figure 13 A hardware entity illustration of an electronic device provided in the embodiments of this application. Figure 1 ,like Figure 13 As shown, the hardware entity of the electronic device 700 includes: a first communication interface 703, a first processor 701, and a first memory 702, wherein;
[0285] The first processor 701 typically controls the overall operation of the electronic device 700.
[0286] The first memory 702 is configured to store instructions and applications executable by the first processor 701, and can also cache data to be processed or already processed by the first processor 701 and various modules in the electronic device 700 (e.g., image data, audio data, voice communication data, and video communication data). It can be implemented using flash memory or random access memory (RAM). The first communication interface 703 is used to execute communication steps between the client and the target projection host.
[0287] See Figure 14 , Figure 14 Schematic diagram of the projection device provided in the embodiments of this application Figure 2 .
[0288] This application embodiment also provides a screen projection device 800, applied to a target screen projection host, wherein the target screen projection host belongs to N local screen projection hosts in the current area, including: a second sending unit 801 and a second receiving unit 802.
[0289] The second transmitting unit 801 is used to transmit the target acoustic wave signal and the target network signal to the client.
[0290] Wherein; the client determines the N local screen projection hosts in the current area and their corresponding wireless network signals based on M wireless network signals and N identification information; the M wireless network signals come from the M screen projection hosts; the sound wave signal sent by the local screen projection host includes at least the corresponding identification information; N is an integer; M is an integer, and M is not less than N;
[0291] The second receiving unit 802 is used to receive screen projection data sent by the client through a wireless network between the client and the client, and to perform screen projection using the screen projection data.
[0292] Because the acoustic signal in this application includes at least the identification information of the corresponding local projection host, the number of transmitted byte streams of the acoustic signal is reduced, the transmission efficiency of the acoustic signal is improved, and the reliability of the acoustic signal collected by the client is increased. Furthermore, the method by which the client determines N local projection hosts through M wireless network signals and N identification information combines multiple technical points to identify local projection hosts, thereby improving the accuracy of local projection host identification, reducing the occurrence of repeated identification by the client, and thus improving the projection efficiency of the client.
[0293] Correspondingly, embodiments of this application provide a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps in the method on the target host side.
[0294] Correspondingly, this application provides an electronic device 900, including a second communication interface 903, a second memory 902, and a second processor 901. The second communication interface 903 executes communication steps between the client and the target projection host. The second memory 902 stores a computer program that can run on the second processor 901. When the second processor 901 executes the program, it implements the steps in the above method.
[0295] It should be noted that the descriptions of the storage medium and device embodiments above are similar to the descriptions of the method embodiments above, and have similar beneficial effects. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.
[0296] It should be noted that, Figure 15 A hardware entity illustration of an electronic device provided in the embodiments of this application. Figure 2 ,like Figure 15 As shown, the hardware entity of the electronic device 900 includes: a second communication interface 903, a second processor 901, and a second memory 902, wherein;
[0297] The second processor 901 typically controls the overall operation of the electronic device 900.
[0298] The second memory 902 is configured to store instructions and applications executable by the second processor 901, and can also cache data to be processed or already processed by the second processor 901 and various modules in the electronic device 900 (e.g., image data, audio data, voice communication data, and video communication data). It can be implemented using flash memory or random access memory (RAM). The second communication interface 903 executes the communication steps between the client and the target projection host.
[0299] It should be understood that the phrase "one embodiment" or "an embodiment" throughout the specification means that a specific feature, structure, or characteristic related to the embodiment is included in at least one embodiment of this application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It should be understood that in the various embodiments of this application, the sequence numbers of the above-described processes do not imply a sequential order of execution; the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application. The sequence numbers of the above-described embodiments are merely descriptive and do not represent the superiority or inferiority of the embodiments.
[0300] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.
[0301] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. The apparatus embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods, such as: multiple units or components can be combined, or integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the various components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the apparatus or units can be electrical, mechanical, or other forms.
[0302] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units. They may be located in one place or distributed across multiple network units. Some or all of the units may be selected to achieve the purpose of this embodiment according to actual needs.
[0303] In addition, each functional unit in the various embodiments of this application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the integrated unit can be implemented in hardware or in the form of hardware plus software functional units.
[0304] Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium includes various media that can store program code, such as mobile storage devices, read-only memory (ROM), magnetic disks, or optical disks.
[0305] Alternatively, if the integrated units described above are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the parts that contribute to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, ROMs, magnetic disks, or optical disks.
[0306] The above description is merely an embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A screen projection method, characterized in that, Applied to the client side, including: Receive N sound wave signals from the current area, each of the sound wave signals including at least the identification information of the corresponding local projection host; N is an integer; Receive M wireless network signals from M screen-projecting hosts; M is an integer, and M is not less than N; Extract the identification information of K first screen projection hosts from the M wireless network signals. Based on the matching between the N identification information and the K first screen projection host identification information, determine the N local screen projection hosts in the current area and their corresponding wireless network signals; K is an integer, and K is not greater than M. According to user instructions, select the target projection host from the N local projection hosts; Screen projection data is sent to the target screen projection host via a wireless network.
2. The screen projection method according to claim 1, characterized in that, The step of extracting the identification information of K first projection hosts from M wireless network signals, and determining the N local projection hosts in the current area and their corresponding wireless network signals based on the matching between N identification information and the K first projection host identification information, includes: From the predetermined fields included in the M wireless network signals, K first predetermined fields containing predetermined device information are selected; the first predetermined fields correspond to the first projection host; K is an integer, and K is not greater than M; Screen projection identification information is extracted from the load data fields included in the K first predetermined fields; the screen projection identification information is the identification information of the corresponding first screen projection host; A host identifier set is constructed based on the K screen projection identifiers; the host identifier set includes: the correspondence between each screen projection identifier and the corresponding first screen projection host and the wireless network signal; Based on the N identification information, N local screen projection hosts and their corresponding wireless network signals are matched and filtered out from the host identification set.
3. The screen projection method according to claim 2, characterized in that, The M wireless network signals include: T first wireless network signals and Q second wireless network signals; T and Q are both integers, and neither T nor Q is greater than M; the data transmission rate of the first wireless network signals is greater than that of the second wireless network signals; the M predetermined fields include: T first network fields and Q second network fields; the first network fields belong to the corresponding first wireless network signals, and the second network fields belong to the corresponding second wireless network signals; the K first predetermined fields include: t second predetermined fields and q third predetermined fields; t and q are both integers, and t is not greater than T, and q is not greater than Q; The step of filtering out K first predetermined fields containing predetermined device information from the predetermined fields included in the M wireless network signals includes: Filter out t second predetermined fields containing the predetermined device information from the T first network fields; Filter out q third predetermined fields containing the predetermined device information from the Q second network fields.
4. The screen projection method according to claim 3, characterized in that, The step of extracting the projection identification information from the load data fields included in the K first predetermined fields includes: Extract the first projection identification information from the load data fields included in the t second predetermined fields respectively; The second projection identification information is extracted from the load data fields included in the q third predetermined fields respectively.
5. The screen projection method according to claim 4, characterized in that, The host identifier set constructed based on the K screen projection identifiers includes: For each of the t first projection identification information, construct a first correspondence between each first projection identification information and the corresponding first wireless network signal and the first projection host; For each of the q second projection identification information, construct a second correspondence between each second projection identification information and the corresponding second wireless network signal and the first projection host; The first and second correspondences, which contain the same first projection host, are merged and integrated to form a third correspondence; The host identifier set is obtained by combining t first correspondences, q second correspondences, and the third correspondence.
6. The screen projection method according to claim 5, characterized in that, The step of matching and filtering N local screen-casting hosts and their corresponding wireless network signals from the host identifier set based on N identifier information includes: Using the first identification information, a fourth correspondence that matches the first identification information is selected from t first correspondences, q second correspondences, and the third correspondences. This process continues until the last identification information is used to complete the matching and filtering in the host identification set, resulting in N fourth correspondences. The first projection host included in each fourth correspondence is then identified as the local projection host, resulting in N local projection hosts and their corresponding wireless network signals.
7. The screen projection method according to claim 6, characterized in that, Each of the identification information includes at least one of the following for the corresponding local screen mirroring host: physical address, product serial number, screen mirroring code, host name, and hotspot name; The screen casting identifier information in the corresponding fourth correspondence relationship matches at least one of the physical address, the product serial number, the screen casting code, the host name, and the hotspot name.
8. A screen projection method, characterized in that, This applies to a target screen-casting host, which belongs to N local screen-casting hosts within the current area, including: Send the target acoustic signal and the target network signal to the client; Wherein; the client extracts the identification information of K first screen-projecting hosts from M wireless network signals, and determines the N local screen-projecting hosts and their corresponding wireless network signals in the current area based on the matching between N identification information and the K identification information of the first screen-projecting hosts; the M wireless network signals come from M screen-projecting hosts; the sound wave signal sent by the local screen-projecting host includes at least the corresponding identification information; N is an integer; M is an integer and M is not less than N; K is an integer and K is not greater than M; The system receives screen mirroring data sent by the client via a wireless network and uses the screen mirroring data to perform screen mirroring.
9. A screen projection device, characterized in that, Applied to the client side, including: The first receiving unit is used to receive N sound wave signals from the current area, each of the sound wave signals including at least the identification information of the corresponding local projection host; N is an integer; The first receiving unit is further configured to receive M wireless network signals from M screen projection hosts; M is an integer and M is not less than N; The determining unit is used to extract the identification information of K first screen projection hosts from the M wireless network signals, and determine the N local screen projection hosts in the current area and their corresponding wireless network signals based on the matching between the N identification information and the K first screen projection host identification information; K is an integer, and K is not greater than M; The selection unit is used to select a target projection host from the N local projection hosts according to user instructions; The first sending unit is used to send screen projection data to the target screen projection host through a wireless network between the unit and the target screen projection host.
10. A screen projection device, characterized in that, This applies to a target screen-casting host, which belongs to N local screen-casting hosts within the current area, including: The second transmitting unit is used to transmit the target acoustic wave signal and the target network signal to the client. Wherein; the client extracts the identification information of K first screen-projecting hosts from M wireless network signals, and determines the N local screen-projecting hosts and their corresponding wireless network signals in the current area based on the matching between N identification information and the K identification information of the first screen-projecting hosts; the M wireless network signals come from M screen-projecting hosts; the sound wave signal sent by the local screen-projecting host includes at least the corresponding identification information; N is an integer; M is an integer and M is not less than N; K is an integer and K is not greater than M; The second receiving unit is used to receive screen projection data sent by the client through a wireless network between the client and the client, and to perform screen projection using the screen projection data.
11. An electronic device, characterized in that, The device includes a communication interface, a memory, and a processor. The communication interface performs communication steps between the client and the target projection host. The memory stores a computer program that can run on the processor. When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 7, or implements the steps of the method according to claim 8.
Citation Information
Patent Citations
Screen transmission method and device and storage medium
CN111459433A
Communication method, device and equipment and storage medium
CN111970063A