Projection screen connection establishment method and related equipment

Abstract

The invention discloses a method for establishing projection screen connection, which is applied to accurately selecting a target display terminal from a plurality of display terminals to establish the projection screen connection. In the method, when a screen projection terminal requests to establish a screen projection connection, the screen projection terminal is indicated to cooperate to complete positioning so as to obtain the position of the screen projection terminal in a target area. Then, based on the position of the projection screen terminal in the target area, the positions of the projection screen terminal and the multiple display terminals supporting projection screen display in the target area are fed back to the projection screen terminal, so that visual relative position information between the projection screen terminal and the multiple display terminals is provided for a user; a user can accurately determine the target display terminal actually needing screen projection based on the position information between the terminals, and it is guaranteed that the screen projection terminal can rapidly establish screen projection connection with the target display terminal.

Description

[0001] This application claims the priority of the Chinese patent application filed with the China Patent Office on June 20, 2023, with application number 202310738269.9 and invention name “A method for screen projection”, the entire contents of which are incorporated by reference in this application. Technical Field

[0002] The present application relates to the field of computer technology, and in particular to a method for establishing a screen projection connection and related equipment. Background Art

[0003] At present, with the rapid popularization of mobile terminals and large-screen terminals, screen projection has become one of the many needs of users. Based on the screen projection technology, users can transmit the content displayed on the mobile terminal to the large screen for display in a wireless or wired manner. The mobile terminal is often called a screen projection terminal, and the large-screen terminal is called a display terminal. For example, when a user uses a small-screen screen projection terminal for office work, playing games or watching videos, the screen projection function can be used to project the content displayed on the projection terminal to the large screen of the display terminal to improve the viewing effect.

[0004] In conference rooms, discussion rooms, or classrooms, multiple large-screen terminals are usually deployed for remote meetings, on-site discussions, and interactions. In this scenario where multiple large-screen terminals are deployed, when users need to project the content on the projection terminal to the large-screen terminal, they often cannot quickly select the large-screen terminal that actually needs to be projected. Specifically, during the projection startup process, users will search for the names of multiple large-screen terminals on the projection terminal. Users often find it difficult to confirm which large-screen terminal is the terminal that actually needs to be projected based on the name of the large-screen terminal, and thus cannot accurately select the target large-screen terminal for projection.

[0005] Based on this, there is an urgent need for a method that can accurately select a target display terminal for performing screen projection from multiple display terminals. Summary of the invention

[0006] The present application provides a method for establishing a screen projection connection, which can accurately select a target display terminal for performing screen projection from multiple display terminals.

[0007] The first aspect of the present application provides a method for establishing a screen projection connection, which is applied to a first electronic device that serves as a screen projection content sender (hereinafter referred to as a screen projection terminal). The method includes: first, the first electronic device sends a first request to any electronic device that supports screen projection display in a target area, and the first request is used to request the establishment of a screen projection connection. The target area is the area where the first electronic device is located, such as a conference room, discussion room, or classroom where the first electronic device is located. In addition, a plurality of electronic devices that support screen projection display (i.e., electronic devices that support serving as screen projection content receivers) are deployed in the target area.

[0008] Then, the first electronic device receives a positioning request, which is used to instruct the first electronic device to cooperate in completing the positioning of the first electronic device. That is, the electronic devices in the target area need to position the first electronic device to determine the position of the first electronic device in the target area.

[0009] Secondly, after the first electronic device completes the positioning process, the first electronic device receives and displays the location information so that the user can observe the displayed location information on the first electronic device. The location information is used to indicate the location of the first electronic device and multiple electronic devices in the target area.

[0010] Finally, in response to the first instruction sent by the user, the first electronic device establishes a screen projection connection with the target device, and the first instruction is used to instruct the first electronic device to establish a screen projection connection with the target device among the multiple electronic devices. Specifically, after the first electronic device displays the location information, the user can determine which electronic device in the target area is the device that actually needs to be projected (i.e., the target device) based on the displayed location information, so the user can send a first instruction to the first electronic device to instruct the first electronic device to establish a screen projection connection with the target device selected by the user.

[0011] In this solution, when the first electronic device requests to establish a screen projection connection, the first electronic device is first instructed to cooperate to complete the positioning to obtain the position of the first electronic device in the target area. Then, based on the position of the first electronic device in the target area, the positions of the first electronic device and multiple electronic devices that can project screens in the target area are fed back to the first electronic device, thereby providing the user with intuitive relative position information between the first electronic device and multiple electronic devices, so that the user can accurately determine the target device that actually needs to project screens based on the position information between the electronic devices, and ensure that the first electronic device can quickly establish a screen projection connection with the target device.

[0012] In a possible implementation, the location information includes a layout diagram of the target area, where the layout diagram is, for example, a two-dimensional plan view or a three-dimensional stereoscopic view, and the layout diagram is used to indicate the locations of the first electronic device and the multiple electronic devices in the target area.

[0013] In this solution, the positions of the first electronic device and multiple electronic devices in the target area are presented in the form of a layout diagram, which can facilitate the user to quickly determine the mapping relationship between the layout diagram and the actual environment, thereby determining the electronic device that each electronic device presented in the layout diagram actually corresponds to in the real environment, ensuring that the user can accurately determine the electronic device that needs to be projected.

[0014] In a possible implementation, the layout diagram is also used to indicate the position of a reference object in the target area. The reference object may refer to an object that is fixedly set in the target area, such as a door, a podium, a conference table, a window, and the like. By indicating the position of the reference object in the target area in the layout diagram, it is possible for the user to more accurately determine the mapping relationship between the object in the layout diagram and the object in the real environment, thereby avoiding the situation where the user cannot determine the mapping relationship between the layout diagram and the real environment when multiple electronic devices are symmetrically arranged in the target area.

[0015] In one possible implementation, the target area is a closed indoor space (such as a conference room, discussion room, or classroom), that is, multiple electronic devices in the target area that support screen projection are all in the closed indoor space. In the case where the target area is a closed indoor space, the layout diagram based on the target area can more easily match the objects in the target area with the objects in the real environment, ensuring that the user can accurately determine the device to be projected.

[0016] In one possible implementation, a first electronic device establishes a screen projection connection with a target device, which may specifically include: the first electronic device sends a second request to a second electronic device, the second request is used to request to establish a screen projection connection with the target device, wherein the second electronic device is a sender of location information, and the second electronic device is used to forward the second request to the target device; in response to the target device obtaining the second request, the first electronic device establishes a screen projection connection with the target device.

[0017] In one possible implementation, the location information is also used to indicate device information of the target device, such as an Internet Protocol (IP) address or a projection code of the target device. The first electronic device establishes a projection connection with the target device, which may specifically include: the first electronic device establishes a projection connection with the target device based on the device information of the target device.

[0018] A second aspect of the present application provides a method for establishing a screen projection connection, including: a second electronic device obtains a first request from a first electronic device, the first request is used to request to establish a screen projection connection; the second electronic device sends a positioning request to the first electronic device, the positioning request is used to instruct the first electronic device to cooperate in completing the positioning of the first electronic device; after the first electronic device cooperates to complete the positioning process, the second electronic device obtains the positioning result of the first electronic device, and based on the positioning result, sends location information to the first electronic device, the location information is used to indicate the locations of the first electronic device and multiple electronic devices in a target area, the location information is used for the first electronic device to establish a screen projection connection with a target device selected from multiple electronic devices, and the target area is the area where the first electronic device is located.

[0019] In a possible implementation manner, the location information includes a layout diagram of the target area, where the layout diagram is used to indicate the locations of the first electronic device and the multiple electronic devices in the target area.

[0020] In a possible implementation, the layout map is also used to indicate the position of a reference object in the target area.

[0021] In a possible implementation, the target area is a closed indoor space, and the multiple electronic devices are all in the closed indoor space.

[0022] In one possible implementation, the method also includes: the second electronic device sends an ultrasonic signal; the second electronic device receives a feedback signal sent by at least one electronic device, the feedback signal is used to indicate the content in the ultrasonic signal, wherein the multiple electronic devices include the second electronic device and at least one electronic device; the second electronic device establishes a networking connection with the at least one electronic device, and the networking connection is used for message transmission between the second electronic device and the at least one electronic device.

[0023] In this solution, by having an electronic device in the target area send an ultrasonic signal and receiving feedback signals returned by other electronic devices based on the content of the ultrasonic signal, the characteristic that ultrasonic signals cannot penetrate walls can be effectively utilized to enable the electronic device to determine other electronic devices located in the same target area, thereby ensuring that multiple electronic devices in the target area can establish a networking connection and eliminating the influence of other electronic devices outside the target area.

[0024] In one possible implementation, the method also includes: the second electronic device searches for pairable devices via Bluetooth and generates a list of candidate networking devices, the list of candidate networking devices including device information of multiple electronic devices; based on the feedback signal received by the second electronic device, the second electronic device selects at least one device from the list of candidate networking devices to establish a networking connection.

[0025] In this solution, since Bluetooth search devices are more efficient, the method of searching for pairable devices based on Bluetooth can quickly obtain device information. In this way, a list of candidate networking devices is first established through Bluetooth search devices, and then the characteristic that ultrasonic signals cannot penetrate walls is used to further filter electronic devices in the target area from the list of candidate networking devices, which can effectively improve the efficiency of networking multiple electronic devices in the target area.

[0026] In a possible implementation, the method also includes: the second electronic device sends a positioning indication message to at least one electronic device, the positioning indication message is used to instruct at least one electronic device to participate in positioning between devices; after the positioning between devices is completed, the second electronic device obtains positioning results of multiple electronic devices, wherein the positioning results of multiple electronic devices are used to generate location information.

[0027] In this solution, by triggering the positioning between multiple electronic devices in the target area by the second electronic device, the second electronic device can obtain the positions of each electronic device fixedly deployed in the target area in advance, ensuring that the second electronic device can quickly generate and return location information indicating the positions of each electronic device in the target area after obtaining the positioning result of the first electronic device, thereby improving the efficiency of establishing the screen projection connection.

[0028] In a possible implementation, after the second electronic device establishes a networking connection with at least one electronic device in the target area, the second electronic device may also obtain a reference object location message sent by at least one electronic device, the reference object location message being used to indicate the location of the reference object identified by at least one electronic device in the target area. In this way, based on the received reference object location message, the second electronic device may generate location information that is also used to indicate the location of the reference object in the target area, so that the location information returned by the second electronic device to the first electronic device simultaneously indicates the locations of the electronic device and the reference object in the target area.

[0029] In one possible implementation, the method also includes: the second electronic device receives a second request sent by the first electronic device, the second request is used to indicate establishing a screen projection connection with a target device among multiple electronic devices; and the second electronic device forwards the second request to the target device.

[0030] In a possible implementation, the location information is also used to indicate device information of multiple devices, and the device information of the multiple devices is used for the first electronic device to establish a screen projection connection with the selected target device.

[0031] The third aspect of the present application provides an electronic device, including: a sending module, used to send a first request, the first request is used to request to establish a screen projection connection; a receiving module, used to receive a positioning request, the positioning request is used to instruct the electronic device to cooperate in completing the positioning of the electronic device; after the electronic device cooperates to complete the positioning process, the receiving module is also used to receive and display location information, the location information is used to indicate the location of the first electronic device and multiple electronic devices in a target area, the target area is the area where the first electronic device is located; a processing module, used to establish a screen projection connection with the target device in response to a first instruction, the first instruction is used to instruct the electronic device to establish a screen projection connection with the target device among multiple electronic devices.

[0032] In a possible implementation manner, the location information includes a layout diagram of the target area, where the layout diagram is used to indicate the locations of the electronic device and the multiple electronic devices in the target area.

[0033] In a possible implementation, the layout map is also used to indicate the position of a reference object in the target area.

[0034] In a possible implementation, the target area is a closed indoor space, and the multiple electronic devices are all in the closed indoor space.

[0035] The fourth aspect of the present application provides an electronic device, including: an acquisition module, used to acquire a first request from a first electronic device, the first request is used to request to establish a screen projection connection; a sending module, used to send a positioning request to the first electronic device, the positioning request is used to instruct the first electronic device to cooperate in completing the positioning of the first electronic device; a processing module, used to obtain the positioning result of the first electronic device after the first electronic device cooperates to complete the positioning process, and the sending module is also used to control the sending module to send location information to the first electronic device based on the positioning result, the location information is used to indicate the location of the first electronic device and multiple electronic devices in a target area, the location information is used for the first electronic device to establish a screen projection connection with a target device selected from multiple electronic devices, and the target area is the area where the first electronic device is located.

[0036] In a possible implementation manner, the location information includes a layout diagram of the target area, where the layout diagram is used to indicate the locations of the first electronic device and the multiple electronic devices in the target area.

[0037] In a possible implementation, the layout map is also used to indicate the position of a reference object in the target area.

[0038] In a possible implementation, the target area is a closed indoor space, and the multiple electronic devices are all in the closed indoor space.

[0039] In one possible implementation, the sending module is also used to send ultrasonic signals; the acquiring module is also used to receive a feedback signal sent by at least one electronic device, the feedback signal is used to indicate the content in the ultrasonic signal, wherein the multiple electronic devices include a second electronic device and at least one electronic device; the processing module is also used to establish a networking connection with at least one electronic device, and the networking connection is used for message transmission between the second electronic device and the at least one electronic device.

[0040] In one possible implementation, the processing module is also used to: search for pairable devices via Bluetooth and generate a list of candidate networking devices, the list of candidate networking devices including device information of multiple electronic devices; based on the feedback signal received by the second electronic device, the second electronic device selects at least one device from the list of candidate networking devices to establish a networking connection.

[0041] In one possible implementation, the sending module is further used to send a positioning indication message to at least one electronic device, where the positioning indication message is used to instruct at least one electronic device to participate in inter-device positioning; the acquiring module is further used to enable the second electronic device to acquire positioning results of multiple electronic devices after the inter-device positioning is completed, where the positioning results of multiple electronic devices are used to generate location information.

[0042] In one possible implementation, the acquisition module is also used to acquire a reference object location message sent by at least one electronic device, the reference object location message is used to indicate the location of a reference object identified by at least one electronic device in a target area, the reference object location message is used to generate location information, and the location information is also used to indicate the location of the reference object in the target area.

[0043] In a fifth aspect, the present application provides an electronic device, comprising: a processor and a memory; the memory is used to store computer instructions, and when the processor executes the instructions, the electronic device executes any of the above methods. The electronic device can be the electronic device in the third to fourth aspects.

[0044] A sixth aspect of the present application provides a computer-readable storage medium, in which instructions are stored. When the instructions are executed on an electronic device, the electronic device can execute any of the methods described above.

[0045] A seventh aspect of the present application provides a computer program product comprising instructions, which, when executed on an electronic device, enables the electronic device to execute any of the methods described above.

[0046] In an eighth aspect, the present application provides a chip, which includes a processor and a communication interface, the communication interface is used to communicate with modules outside the chip shown, and the processor is used to run computer programs or instructions so that a device equipped with the chip can execute any of the methods described above.

[0047] A ninth aspect of the present application provides a screen projection system, comprising an electronic device as in any implementation of the third aspect and an electronic device as in any implementation of the fourth aspect.

[0048] Among them, the technical effects brought about by any design method in the third to ninth aspects can refer to the technical effects brought about by different implementation methods in the above-mentioned first and second aspects, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 A schematic diagram of selecting a terminal for screen projection from multiple conference tablet terminals provided in an embodiment of the present application;

[0050] Figure 2 A schematic diagram of establishing a screen projection connection provided in an embodiment of the present application;

[0051] Figure 3 A schematic diagram of an application scenario architecture provided for an embodiment of the present application;

[0052] Figure 4 A schematic diagram of the structure of an electronic device 401 provided in an embodiment of the present application;

[0053] Figure 5 A schematic diagram of a flow chart of a method for establishing a screen projection connection provided in an embodiment of the present application;

[0054] Figure 6 A schematic diagram of a layout diagram provided in an embodiment of the present application;

[0055] Figure 7 A schematic diagram of another layout diagram provided in an embodiment of the present application;

[0056] Figure 8 A schematic diagram of establishing a screen projection connection between a smart phone and a conference tablet terminal provided in an embodiment of the present application;

[0057] Fig. 9 A schematic diagram of an application scenario of the method for establishing a screen projection connection provided in an embodiment of the present application;

[0058] Fig.10 A schematic diagram of a process for establishing a networking connection between conference tablet terminals provided in an embodiment of the present application;

[0059] Fig.11A schematic diagram of a process for a conference tablet terminal to generate a conference room layout diagram provided in an embodiment of the present application;

[0060] Fig.12 A schematic diagram of a conference tablet terminal measuring the relative angle between the conference tablet terminal and other conference tablet terminals provided in an embodiment of the present application;

[0061] Fig.13 A schematic diagram of the principle of a sound source localization method provided in an embodiment of the present application;

[0062] Fig.14 A schematic diagram of the principle of a TOA positioning method provided in an embodiment of the present application;

[0063] Fig.15 A schematic diagram of the principle of a TOA ranging method provided in an embodiment of the present application;

[0064] Fig.16 A schematic diagram of determining the location of a conference tablet terminal provided in an embodiment of the present application;

[0065] Fig.17 A schematic diagram of a preliminary generated conference room layout provided in an embodiment of the present application;

[0066] Fig.18 A schematic diagram of a process for establishing a screen projection connection between a screen projection terminal and a conference tablet terminal in a conference room provided in an embodiment of the present application;

[0067] Fig.19 A schematic diagram of positioning a screen projection terminal provided in this embodiment;

[0068] Fig. 20 A schematic diagram of positioning based on signal strength provided in an embodiment of the present application;

[0069] Fig.21 A schematic diagram of the structure of an electronic device 2100 provided in an embodiment of the present application;

[0070] Fig. 22 A schematic diagram of the structure of an electronic device 2200 provided in an embodiment of the present application. DETAILED DESCRIPTION

[0071] The following describes the embodiments of the present application in conjunction with the accompanying drawings. Obviously, the described embodiments are only embodiments of a part of the present application, rather than all embodiments. It is known to those skilled in the art that with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0072] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged where appropriate, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein.

[0073] In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or modules is not necessarily limited to those steps or modules that are clearly listed, but may include other steps or modules that are not clearly listed or inherent to these processes, methods, products or devices. The naming or numbering of steps in this application does not mean that the steps in the method flow must be executed in the time / logical sequence indicated by the naming or numbering. The named or numbered process steps can change the execution order according to the technical purpose to be achieved, as long as the same or similar technical effects can be achieved.

[0074] For ease of understanding, the technical terms involved in the embodiments of the present application are introduced below.

[0075] (1) Screen projection technology

[0076] Screen projection technology refers to the process of transmitting the content displayed on the display screen of electronic device A to electronic device B by means of data transmission, and synchronously displaying the content displayed on the display screen of electronic device A on the display screen of electronic device B. For example, the content displayed on a mobile device such as a mobile phone, tablet computer or laptop is transmitted wirelessly or wired to a device with a larger display screen such as a TV, projector or splicing screen, and the content transmitted by the mobile device is displayed on the TV, projector or splicing screen.

[0077] (2) Screen projection terminal

[0078] A screen projection terminal refers to an electronic device that generates and sends projection content during the screen projection process.

[0079] (3) Display terminal

[0080] The display terminal refers to an electronic device that receives the projection content sent by the projection terminal during the projection process and synchronously displays the projection content.

[0081] (4) Ultrasound

[0082] Ultrasonic waves are mechanical waves with extremely short wavelengths, which are generally shorter than 2 cm in air. Ultrasonic waves must rely on a medium to propagate and cannot exist in a vacuum. Ultrasonic waves propagate farther in water than in air, but because of their short wavelengths, they are easily lost and scattered in air, and are not as far-reaching as audible sound and infrasound. However, the short wavelength makes it easier for ultrasonic waves to obtain anisotropic sound energy, which can be used for cleaning, stone crushing, sterilization, etc.

[0083] The "ultra" in ultrasound comes from the fact that the lower limit of the frequency band of ultrasound exceeds human hearing, that is, ultrasound usually refers to sound waves with a frequency higher than the upper limit of human average hearing. In most cases, the ultrasound frequency band used by humans is above 20 kilohertz (kHz). In daily life, ultrasound has a large number of applications, such as distance measurement, object detection, and data transmission. Specifically, ultrasonic sensors can detect whether an object exists by measuring the changes in the sound wave echo. In data transmission, ultrasound can be used as a carrier to transmit information wirelessly over a short distance, which is applied to wireless payment systems, mobile messaging, and location-based services. In general, ultrasound is a versatile technology that has a large number of applications in modern communication systems and has become an important tool in modern communication technology.

[0084] In conference rooms, discussion rooms, or classrooms, multiple large-screen terminals are usually deployed for remote meetings, on-site discussions, and interactions. In such a scenario where multiple large-screen terminals are deployed, when users need to project content from a projection terminal to a large-screen terminal, they often cannot quickly select the large-screen terminal that actually needs to be projected.

[0085] For example, see Figure 1 , Figure 1 A schematic diagram of selecting a terminal for screen projection from multiple conference tablet terminals provided in an embodiment of the present application. Figure 1 As shown, in the conference room scenario, the conference room includes four conference tablet terminals, namely conference tablet terminal A, conference tablet terminal B, conference tablet terminal C, and conference tablet terminal D. The user needs to project the content in the smartphone to the conference tablet terminal A. However, when the user operates the smartphone to start the screen projection, the names of multiple terminals that can project the screen are searched on the smartphone, which are IdeaHub 1, IdeaHub 2, IdeaHub5, IdeaHub 3, and IdeaHub 4. Obviously, the names of the multiple terminals that can project the screen displayed on the smartphone do not reveal the characteristic information of the multiple conference tablet terminals in the current conference room. It is difficult for the user to determine which terminal name is the conference tablet terminal A that actually needs to be projected based on the terminal name displayed on the smartphone.

[0086] As a result, users often need to verify one by one which terminal name they searched for in their smartphones corresponds to the conference tablet terminal that actually needs to be projected. Figure 2 , Figure 2 A schematic diagram of establishing a screen projection connection provided in an embodiment of the present application. Figure 2 As shown, suppose the user clicks on the first terminal name searched in the smartphone, i.e., "IdeaHub1". At this time, since "IdeaHub 1" corresponds to conference tablet terminal C, the smartphone will establish a projection connection with conference tablet terminal C. When the user finds that the smartphone is actually establishing a projection connection with conference tablet terminal C, the user disconnects the projection connection between the smartphone and conference tablet terminal C, and continues to click on other terminal names to try to establish a projection connection with conference tablet terminal A. That is, the user may need to repeatedly establish projection connections with different conference tablet terminals, and may eventually be able to successfully establish a projection connection with the conference tablet terminal that actually needs to be connected, resulting in low efficiency in establishing the projection connection and requiring the user to perform a large number of cumbersome operation steps.

[0087] In general, in a scenario where multiple display terminals are deployed, when a user establishes a projection connection between a projection terminal and a display terminal, it is often difficult for the user to accurately select the target display terminal for projection because the name of the display terminal searched by the user on the projection terminal may not be mapped to the display terminal in the actual scenario. Generally speaking, the name of the display terminal searched by the user in the projection stage is usually the model of the display terminal. Therefore, when the models of multiple display terminals deployed in the same conference room are the same, the names of the multiple display terminals searched by the user in the projection stage are usually very close. If the user has not connected to the display terminal in advance, it is impossible to determine the mapping relationship between the name of the display terminal and the display terminal in the actual scenario.

[0088] In view of this, an embodiment of the present application provides a method for establishing a screen projection connection. When the first electronic device requests to establish a screen projection connection, it first instructs the first electronic device to cooperate in completing positioning to obtain the position of the first electronic device in the target area. Then, based on the position of the first electronic device in the target area, the positions of the first electronic device and multiple electronic devices capable of screen projection in the target area are fed back to the first electronic device, thereby providing the user with intuitive relative position information between the first electronic device and multiple electronic devices, facilitating the user to accurately determine the target device that actually needs to be projected based on the position information between the electronic devices, and ensuring that the first electronic device can quickly establish a screen projection connection with the target device.

[0089] To facilitate understanding, the following first introduces the scenarios in which the method for establishing a screen projection connection provided in an embodiment of the present application is applied.

[0090] See also Figure 3 , Figure 3 A schematic diagram of an application scenario architecture provided for an embodiment of the present application.

[0091] like Figure 3 As shown, multiple electronic devices 200 are deployed in the same area. The electronic device 100 can select one or more electronic devices 200 that need to be connected from multiple electronic devices 200 based on the method provided in this embodiment, and then establish a wireless connection with the selected electronic device 200 through wireless communication methods such as Wi-Fi and Bluetooth. After the electronic device 100 establishes a connection with the electronic device 200, the electronic device 100 projects the content to be displayed to the electronic device 200 so that the projected content is displayed on the electronic device 200. The specific process may be that the electronic device 100 generates projection data and sends the projection data to the electronic device 200. After receiving the projection data, the electronic device 200 parses the projection data, obtains the corresponding projection content, and displays the projection content on the display screen of the electronic device 200.

[0092] In a possible screen projection method, the electronic device 100 can be used as a master device, and the electronic device 200 can be used as a mirror device of the electronic device 100. After the electronic device 100 and the electronic device 200 are connected, the electronic device 100 sends the corresponding screen projection content to the electronic device 200 according to the content displayed on its own display screen, so that the electronic device 200 can display the same content as the electronic device 100 at the same time.

[0093] In another possible screen projection method, the electronic device 100 can be used as a master device, and the electronic device 200 can be used as a slave device of the electronic device 100. After the electronic device 100 and the electronic device 200 establish a connection, the electronic device 100 is equivalent to having two displays, one is the display screen of the electronic device 100 itself, and the other is the display screen of the electronic device 200 connected thereto. Among them, the screen projection content sent by the electronic device 100 to the electronic device 200 may be different from the content displayed on the display screen of the electronic device 100, that is, different contents are displayed on the electronic device 100 and the electronic device 200 respectively. For example, the content of document A can be displayed on the display screen of the electronic device 100, and the screen projection content sent by the electronic device 100 to the electronic device 200 is the content of document B, so the content of document B is displayed on the display screen of the electronic device 200.

[0094] The above introduces the scenarios in which the method for establishing a screen projection connection provided in the embodiments of the present application is applied. The following will introduce the electronic device in which the method for establishing a screen projection connection provided in the embodiments of the present application is applied.

[0095] The method provided in the embodiment of the present application can be applied to electronic devices that can realize the screen projection function, such as a screen projection terminal responsible for sending the screen projection content or a display terminal responsible for receiving and displaying the screen projection content. Exemplarily, the electronic device in the embodiment of the present application can be a smart phone (mobile phone), a personal computer (personal computer, PC), a laptop, a tablet computer, a conference tablet terminal, a smart TV, a spliced ​​screen, a projector, a wearable device (such as a smart watch, smart glasses or a smart helmet, etc.), a virtual reality (virtual reality, VR) device, an augmented reality (augmentedreality, AR) device, a wireless electronic device in industrial control (industrial control), a wireless electronic device in unmanned driving, a wireless electronic device in remote medical surgery, a wireless electronic device in a smart grid (smartgrid), a wireless electronic device in a smart home (smart home), etc. The following embodiments do not impose any special restrictions on the specific form of the electronic device.

[0096] by Figure 3 Taking the application scenario shown as an example, the electronic device 100 serving as the sender of projection content may be, for example, a smart phone, a laptop computer, a tablet computer, a personal computer or other device; the electronic device 200 serving as the receiver of projection content may be, for example, a large-screen display device such as a conference tablet terminal, a smart TV, a projector or a spliced ​​screen.

[0097] See also Figure 4 , Figure 4 This is a schematic diagram of the structure of an electronic device 401 provided in an embodiment of the present application. Figure 4 The electronic device 401 shown in the figure may be the electronic device 100 or the electronic device 200 described above. Figure 4As shown, the electronic device 401 includes a processor 403, and the processor 403 is coupled to a system bus 405. The processor 403 can be one or more processors, each of which can include one or more processor cores. A display adapter (video adapter) 407, the display adapter can drive a display 409, and the display 409 is coupled to the system bus 405. The system bus 405 is coupled to an input-output (I / O) bus via a bus bridge 411. An I / O interface 415 is coupled to the I / O bus. The I / O interface 415 communicates with a variety of I / O devices, such as an input device 417 (such as a touch screen, etc.), an external memory 421 (for example, a hard disk, a floppy disk, an optical disk or a USB flash drive), a multimedia interface, etc.). A transceiver 423 (which can send and / or receive radio communication signals), a camera 455 (which can capture static and dynamic digital video images) and an external USB port 425. Optionally, the interface connected to the I / O interface 415 can be a USB interface.

[0098] The processor 403 may be any conventional processor, including a reduced instruction set computing (RISC) processor, a complex instruction set computing (CISC) processor, or a combination thereof. Alternatively, the processor may be a dedicated device such as an ASIC.

[0099] The electronic device 401 can communicate with other electronic devices through the network interface 429 to achieve data transmission during the screen projection process.

[0100] The processor 403 can communicate with the memory 435 through the system bus 405, and fetch instructions and data in the application program from the memory 435, thereby implementing the execution of the program.

[0101] See also Figure 5 , Figure 5 A flowchart of a method for establishing a screen projection connection provided in an embodiment of the present application. Figure 5 As shown, the method for establishing a screen projection connection provided in this embodiment includes the following steps 501-505.

[0102] Step 501: A first electronic device sends a first request to any electronic device in a target area that supports screen projection display, where the first request is used to request to establish a screen projection connection.

[0103] In this embodiment, the target area is the area where the first electronic device is located, such as a conference room, discussion room, or classroom where the first electronic device is located. In addition, multiple electronic devices that support screen projection display (i.e., electronic devices that support being the receiver of screen projection content) are deployed in the target area. In actual application scenarios, the user of the first electronic device needs to select one or more electronic devices from the multiple electronic devices in the target area to perform screen projection, so as to project the content on the first electronic device to the selected electronic device for display.

[0104] Optionally, the target area is a closed indoor space (such as a conference room, discussion room or classroom, etc.), that is, multiple electronic devices supporting screen projection display in the target area are all in the closed indoor space.

[0105] During the process of starting screen projection, the first electronic device can search for electronic devices in the target area that support screen projection display through wireless communication methods such as Wi-Fi and Bluetooth, and then the first electronic device can send a first request to the searched electronic device to request to establish a screen projection connection.

[0106] That is to say, when the first electronic device sends a first request to any electronic device in the target area that supports screen projection display, the method for establishing the screen projection connection provided in this embodiment can be triggered.

[0107] In some embodiments, multiple electronic devices supporting screen projection display in the target area may have pre-established networking connections, that is, the multiple electronic devices are interconnected. In this way, when the first electronic device searches for electronic devices supporting screen projection display in the target area, the device information returned to the first electronic device by any electronic device searched among the multiple electronic devices is the networking identification number corresponding to the multiple electronic devices. That is, when the first electronic device searches for devices supporting screen projection display in the target area, what is searched is no longer the device names corresponding to the multiple electronic devices, but the networking identification numbers corresponding to the multiple electronic devices. For example, the networking identification number is specifically "screen projection number of XX conference room". After the user clicks on the networking identification number displayed on the first electronic device, the first electronic device sends the above-mentioned first request to the electronic devices in the target area.

[0108] For example, after the user clicks on the networking identification number, the first electronic device may send a first request to the searched electronic device (i.e., the electronic device that returns the networking identification number to the first electronic device). Alternatively, when the multiple electronic devices are composed of a master device and at least one slave device, the networking identification number may point to the master device among the multiple electronic devices, and the first electronic device sends the first request to the master device among the multiple electronic devices based on the networking identification number.

[0109] Step 502: The second electronic device sends a positioning request to the first electronic device, where the positioning request is used to instruct the first electronic device to cooperate in completing the positioning of the first electronic device.

[0110] In this embodiment, the second electronic device may be a device that receives the first request sent by the first electronic device, that is, the second electronic device is a device that supports screen projection display in the target area. After receiving the first request, the second electronic device may trigger a positioning request to the first electronic device to determine the position of the first electronic device in the target area.

[0111] Optionally, when multiple electronic devices in the target area are composed of a master device and at least one slave device, the second electronic device can be a master device among the multiple electronic devices. For example, when the first electronic device sends a first request to the second electronic device based on the networking identification number, the second electronic device can trigger the sending of a positioning request to the first electronic device based on the received first request. For another example, after a slave device among the multiple electronic devices receives the first request sent by the first electronic device, the slave device forwards the first request to the second electronic device, and the second electronic device sends a positioning request to the first electronic device.

[0112] Since the target area includes multiple electronic devices and at least two electronic devices are required to complete the positioning of the first electronic device, the positioning request is actually used to request the first electronic device to cooperate with at least two electronic devices among the multiple electronic devices to complete the positioning of the first electronic device.

[0113] There may be a variety of methods for the electronic device in the target area to locate the first electronic device, such as acoustic wave positioning method, Bluetooth positioning method, WiFi positioning method, infrared positioning method or ultra-wideband positioning method, etc. This embodiment does not specifically limit this.

[0114] In addition, in the process of positioning the first electronic device, the first electronic device may be positioned by two or more electronic devices pre-designated in the target area, for example, the first electronic device may be positioned by an electronic device located at a specific position in the target area, or the first electronic device may be positioned by an electronic device with higher positioning accuracy in the target area. This embodiment does not specifically limit the devices involved in the positioning of the first electronic device.

[0115] Step 503, after the first electronic device cooperates to complete the positioning process, the second electronic device obtains the positioning result of the first electronic device, and sends location information to the first electronic device based on the positioning result, where the location information is used to indicate the locations of the first electronic device and multiple electronic devices in the target area.

[0116] After the first electronic device cooperates to complete the positioning process, the second electronic device can obtain the positioning result of the first electronic device from the device that performs positioning on the first electronic device, thereby determining the specific position of the first electronic device in the target area. In addition, the second electronic device obtains the positions of multiple electronic devices in the target area in advance, so combined with the specific position of the first electronic device in the target area, the second electronic device can generate location information and send the location information to the first electronic device. Among them, the location information sent by the second electronic device can indicate the positions of the first electronic device and multiple electronic devices that support screen projection display in the target area.

[0117] Optionally, the location information sent by the second electronic device is, for example, text information, a two-dimensional plane map, or a three-dimensional stereogram. This embodiment does not specifically limit the form of the location information.

[0118] In a possible embodiment, when the location information sent by the second electronic device is text information and the target area is a conference room, the text information is, for example, "the first electronic device is located in the center of the conference room, electronic device A is located at the podium of the conference room, electronic device B is located on the side of the conference room near the door, and electronic device C is located on the side of the conference room away from the door." In this way, based on the location information sent by the second electronic device, the user can accurately determine the electronic device that actually needs to be projected.

[0119] In another possible embodiment, the location information sent by the second electronic device includes a layout diagram of the target area, which is, for example, a two-dimensional plan view or a three-dimensional stereoscopic view, and is used to indicate the locations of the first electronic device and multiple electronic devices in the target area.

[0120] For example, see Figure 6 , Figure 6 A schematic diagram of a layout diagram provided in an embodiment of the present application. Figure 6As shown, when the target area is a rectangular conference room, in the layout diagram of the conference room, conference tablet terminal A and conference tablet terminal B are deployed side by side on one side of the conference room (and the side where conference tablet terminal A and conference tablet terminal B are deployed belongs to the long side of the rectangular conference room); conference tablet terminal D is deployed on the opposite side of conference tablet terminal A and conference tablet terminal B; conference tablet terminal C is deployed on the side adjacent to conference tablet terminal A and conference tablet terminal B (that is, the side where conference tablet terminal C is deployed belongs to the short side of the rectangular conference room). In addition, the electronic device held by the user (that is, "my device" marked in the layout diagram) is located in front of conference tablet terminal A and is closest to conference tablet terminal A. Based on the layout diagram, the user can clearly know the mapping relationship between each conference tablet terminal in the layout diagram and each conference tablet terminal in the actual conference room, so as to accurately select the conference tablet terminal that actually needs to be projected.

[0121] In this solution, the positions of the first electronic device and multiple electronic devices in the target area are presented in the form of a layout diagram, which can facilitate the user to quickly determine the mapping relationship between the layout diagram and the actual environment, thereby determining the electronic device that each electronic device presented in the layout diagram actually corresponds to in the real environment, ensuring that the user can accurately determine the electronic device that needs to be projected.

[0122] Optionally, the layout diagram sent by the second electronic device is also used to indicate the position of a reference object in the target area. The reference object may refer to an object that is fixedly set in the target area, such as a door, a podium, a conference table, a window, and the like. By indicating the position of the reference object in the target area in the layout diagram, it is possible for the user to more accurately determine the mapping relationship between the object in the layout diagram and the object in the real environment, thereby avoiding the situation where the user cannot determine the mapping relationship between the layout diagram and the real environment when multiple electronic devices are symmetrically arranged in the target area.

[0123] For example, see Figure 7 , Figure 7 A schematic diagram of another layout diagram provided in an embodiment of the present application. Figure 7 As shown, when the target area is a rectangular conference room, in the layout diagram of the conference room, conference tablet terminal A and conference tablet terminal B are deployed side by side on one side of the conference room; conference tablet terminal C and conference tablet terminal D are deployed side by side on the other side of the conference room (i.e., opposite to conference tablet terminal A and conference tablet terminal B). In addition, conference tablet terminal A and conference tablet terminal C are symmetrically arranged, and conference tablet terminal B and conference tablet terminal D are stacked. In the absence of a reference object, it may be difficult for the user to match the conference tablet terminal in the layout diagram with the conference tablet terminal in the actual conference room. Based on this, Figure 7The positions of the reference objects (door and podium) are also marked in the layout diagram in the figure, that is, the door is located on the side where conference tablet terminal A and conference tablet terminal B are located, and the podium is located in the middle of the conference room and close to conference tablet terminal B and conference tablet terminal D. In addition, the device held by the user (that is, "my device" in the layout diagram) is located between conference tablet terminal A and conference tablet terminal C, and is closer to conference tablet terminal A.

[0124] In addition, the electronic device held by the user (i.e., "my device" marked in the layout diagram) is located in front of the conference tablet terminal A and is closest to the conference tablet terminal A. Based on the layout diagram, the user can clearly know the mapping relationship between each conference tablet terminal in the layout diagram and each conference tablet terminal in the actual conference room, so as to accurately select the conference tablet terminal that actually needs to be projected.

[0125] Step 504: The first electronic device displays the received location information.

[0126] After the first electronic device receives the location information, the received location information is displayed on the display screen of the first electronic device. For example, if the location information received by the first electronic device includes a layout diagram of the target area, the first electronic device displays the layout diagram of the target area on the display screen.

[0127] Step 505: The first electronic device receives a first instruction and establishes a screen projection connection with a target device in response to the first instruction. The first instruction is used to instruct the first electronic device to establish a screen projection connection with a target device among multiple electronic devices.

[0128] After the first electronic device displays the location information, the user can determine which electronic device in the target area is the device that actually needs to project the screen (i.e., the target device) based on the displayed location information. Therefore, the user can send a first instruction to the first electronic device to instruct the first electronic device to establish a screen projection connection with the target device selected by the user.

[0129] For example, see Figure 8 , Figure 8 A schematic diagram of establishing a screen projection connection between a smart phone and a conference tablet terminal provided in an embodiment of the present application. Figure 8 As shown in (a) in the figure, the first electronic device held by the user is a smartphone, and the first electronic device displays a layout diagram of the conference room, which indicates the location of each conference tablet terminal in the conference room and the user's smartphone. When the user clicks on the conference tablet terminal B in the layout diagram, the user sends a first instruction to the smartphone to instruct it to establish a screen projection connection with the conference tablet terminal B. Figure 8As shown in (b), after the user's smartphone obtains the first instruction, it establishes a screen projection connection with the conference tablet terminal B so that the content on the smartphone can be projected to the conference tablet terminal B for display.

[0130] Among them, there are multiple ways to establish a screen projection connection between the first electronic device and the target device.

[0131] In one possible implementation, the first electronic device returns a screen projection request to a device among multiple electronic devices that interact with the first electronic device, and the device forwards the screen projection request to the target device, thereby establishing a screen projection connection between the first electronic device and the target device.

[0132] Exemplarily, after confirming the need to establish a screen projection connection with the target device based on the location information, the first electronic device sends a second request to the second electronic device, and the second request is used to request to establish a screen projection connection with the target device. Among them, the second electronic device is the sender of the location information, and the second electronic device is used to forward the second request to the target device. For example, the second electronic device can be the main control device of multiple electronic devices in the target area, and it is the device among multiple electronic devices responsible for interacting with the screen projection terminal (i.e., the first electronic device); for another example, the second electronic device can be the device first searched by the first electronic device, and the second electronic device receives the first request sent by the first electronic device.

[0133] In this way, after the target device obtains the second request, the target device confirms to establish a screen projection connection with the first electronic device, thereby triggering the establishment of a screen projection connection between the target device and the first electronic device, and finally enabling the first electronic device to establish a screen projection connection with the target device.

[0134] In addition, since the second electronic device is also a device among the multiple electronic devices in the target area, the second electronic device may also be the target device selected by the first electronic device. Then, when the second electronic device is the target device, the second electronic device no longer needs to forward the second request to other devices, but can directly establish a screen projection connection with the first electronic device.

[0135] In another possible implementation, for the location information received by the first electronic device, the location information is also used to indicate the device information of the target device. That is, based on the location information, in addition to being able to confirm the locations of multiple electronic devices in the target area, the first electronic device can also obtain the device information of each of the multiple electronic devices, such as the Internet Protocol (IP) address or the projection code of each electronic device. In this way, when the device information of each electronic device in the multiple electronic devices is obtained, the first electronic device can establish a projection connection with the target device based on the device information of the target device. For example, the first electronic device can send a projection request to the target device based on the projection code or IP address of the target device, thereby establishing a projection connection with the target device.

[0136] The above describes the process of establishing a screen projection connection between the first electronic device as the screen projection content sender and the target device in the target area in the method for establishing a screen projection connection provided in an embodiment of the present application. In order to ensure that the first electronic device can eventually establish a screen projection connection with the selected target device when interacting with any electronic device, in this embodiment, a networking connection between multiple electronic devices in the target area can be established in advance to ensure that messages can be transmitted between multiple electronic devices.

[0137] For example, during the process of establishing a network connection between multiple electronic devices in the target area, the second electronic device sends an ultrasonic signal, and the ultrasonic signal can carry specific content, such as a device code of the second electronic device or information randomly generated by the second electronic device. After the second electronic device sends the ultrasonic signal, other electronic devices in the target area can receive the ultrasonic signal and obtain the content carried in the ultrasonic signal by parsing the ultrasonic signal.

[0138] Then, the electronic device that receives the ultrasonic signal can send a feedback signal to the second electronic device. In this way, the second electronic device can receive the feedback signal sent by at least one electronic device, and the feedback signal is used to indicate the content in the ultrasonic signal. The multiple electronic devices in the target area include the second electronic device and the at least one electronic device that sends the feedback signal.

[0139] Since ultrasonic signals cannot penetrate walls, when the target area is a closed space, electronic devices outside the target area will not receive ultrasonic signals, that is, electronic devices that receive ultrasonic signals are all devices within the target area. In this way, after the second electronic device receives the feedback signal sent by the at least one electronic device, the second electronic device can determine that the at least one electronic device is an electronic device within the target area. Therefore, the second electronic device establishes a networking connection with at least one electronic device, and the networking connection is used for message transmission between the second electronic device and at least one electronic device. After the second electronic device establishes a networking connection with at least one electronic device, it can ensure that a plurality of electronic devices in the target area are connected to each other.

[0140] In this solution, by having an electronic device in the target area send an ultrasonic signal and receiving feedback signals returned by other electronic devices based on the content of the ultrasonic signal, the characteristic that ultrasonic signals cannot penetrate walls can be effectively utilized to enable the electronic device to determine other electronic devices located in the same target area, thereby ensuring that multiple electronic devices in the target area can establish a networking connection and eliminating the influence of other electronic devices outside the target area.

[0141] Optionally, in order to improve the efficiency of establishing a networking connection between multiple electronic devices in the target area, before the second electronic device sends an ultrasonic signal, the second electronic device can search for a pairable device via Bluetooth and generate a list of candidate networking devices, which includes device information of multiple electronic devices searched by the second electronic device. Since Bluetooth signals have the ability to penetrate walls, the electronic devices searched by the second electronic device may include electronic devices outside the target area, so the second electronic device subsequently sends an ultrasonic signal to confirm the electronic devices within the target area.

[0142] That is, after receiving the feedback signal, the second electronic device selects at least one device that sends the feedback signal from the list of candidate networking devices based on the received feedback signal to establish a networking connection.

[0143] Since Bluetooth search devices are highly efficient, searching for pairable devices based on Bluetooth can quickly obtain device information. This way, a list of candidate networking devices is first established through Bluetooth search devices, and then the characteristic that ultrasonic signals cannot penetrate walls is used to further filter electronic devices in the target area from the list of candidate networking devices. This can effectively improve the efficiency of networking multiple electronic devices in the target area.

[0144] In addition, after multiple electronic devices in the target area establish a networking connection, the multiple electronic devices can also determine the position of each electronic device in the target area by performing inter-device positioning, thereby obtaining the position of each electronic device deployed in the target area in advance.

[0145] Exemplarily, after the second electronic device establishes a networking connection with at least one electronic device in the target area, the second electronic device sends a positioning indication message to the at least one electronic device, and the positioning indication message is used to instruct the at least one electronic device to participate in inter-device positioning. Based on the positioning indication message, the second electronic device and the at least one electronic device begin to perform inter-device positioning. In this way, after the inter-device positioning is completed, the second electronic device can obtain the positioning results of multiple electronic devices in the target area, and the positioning results of the multiple electronic devices are used to subsequently cooperate with the positioning results of the first electronic device to generate location information.

[0146] In this solution, by triggering the positioning between multiple electronic devices in the target area by the second electronic device, the second electronic device can obtain the positions of each electronic device fixedly deployed in the target area in advance, ensuring that the second electronic device can quickly generate and return location information indicating the positions of each electronic device in the target area after obtaining the positioning result of the first electronic device, thereby improving the efficiency of establishing the screen projection connection.

[0147] Optionally, after the second electronic device establishes a networking connection with at least one electronic device in the target area, the second electronic device may also obtain a reference object location message sent by at least one electronic device, the reference object location message being used to indicate the location of the reference object identified by at least one electronic device in the target area. In this way, based on the received reference object location message, the second electronic device may generate location information that is also used to indicate the location of the reference object in the target area, so that the location information returned by the second electronic device to the first electronic device simultaneously indicates the locations of the electronic device and the reference object in the target area.

[0148] The second electronic device and the at least one electronic device mentioned above may both be equipped with a camera, and the second electronic device and the at least one electronic device mentioned above may use the camera to identify reference objects in the target area and determine the positions of these reference objects in the target area. In this way, the second electronic device may determine the positions of the reference objects in the target area based on the image of the target area captured by itself and the reference object position message fed back by the at least one electronic device.

[0149] For example, the reference object location message sent by at least one electronic device to the second electronic device may indicate the location of the reference object relative to the electronic device (such as the angle of the reference object relative to the electronic device). In this way, the second electronic device may determine the location of the reference object in the target area based on the location of the same reference object relative to each electronic device.

[0150] by Figure 7 Taking the conference room shown as the target area as an example, assuming that conference tablet terminal A is the second electronic device, conference tablet terminal B, conference tablet terminal C and conference tablet terminal D all send reference object location messages to conference tablet terminal A. Among them, the reference object location message 1 sent by conference tablet terminal B may indicate "the podium is on the left side of conference tablet terminal B and is located on the central axis between conference tablet terminal B and conference tablet terminal D"; the reference object location message 2 sent by conference tablet terminal C may indicate "the podium is on the right side of conference tablet terminal C and is located on the central axis between conference tablet terminal A and conference tablet terminal C; the door is on the right side of conference tablet terminal C and is close to conference tablet terminal B"; the reference object location message 3 sent by conference tablet terminal D may indicate "the podium is on the right side of conference tablet terminal D and is located on the central axis between conference tablet terminal B and conference tablet terminal D; the door is on the right side of conference tablet terminal D and is close to conference tablet terminal B". After receiving the above-mentioned reference object location message 1-reference object location message 3, conference tablet terminal A can combine the position of the podium identified by the camera of this device to determine that the podium is in the middle of the conference room and close to the right side of the conference room, and the door is in the upper right corner of the conference room.

[0151] Alternatively, the reference object location message sent by conference tablet terminal B, conference tablet terminal C, and conference tablet terminal D to conference tablet terminal A may indicate the angle of the reference object relative to the present device. For example, the reference object location message sent by conference tablet terminal B may include the relative angle between the podium and conference tablet terminal B, the reference object location message sent by conference tablet terminal C may include the relative angle between the podium and the door and conference tablet terminal C, and the reference object location message sent by conference tablet terminal D may include the relative angle between the podium and the door and conference tablet terminal D. In this way, when conference tablet terminal A determines the relative angle between each reference object and other conference tablet terminals whose positions are known, it can calculate the position of each reference object.

[0152] Alternatively, the reference object location message sent by at least one electronic device to the second electronic device may include an image of the target area captured by at least one electronic device. In this way, when the second electronic device has determined the location of each electronic device, the location of each reference object in the target area can be determined based on the image captured by the second electronic device itself and the images captured by other electronic devices.

[0153] It should be noted that the above is an introduction to the second electronic device determining the location of other electronic devices by executing a positioning process, and determining the location of a reference object by receiving a reference object location message sent by the other electronic device, thereby generating location information (such as a layout map of the target area) subsequently provided to the first electronic device. In some embodiments, the user may also determine the location of each electronic device and reference object that is fixedly deployed in the target area in advance, and send the locations of these electronic devices and reference objects to the second electronic device, so that the second electronic device no longer needs to execute the above process to obtain the location of the electronic device and the reference object.

[0154] The above introduces the method for establishing a screen projection connection provided by the present embodiment. For ease of understanding, the implementation process of the method for establishing a screen projection connection provided by the present embodiment in an actual application scenario will be described in detail below with reference to specific examples.

[0155] See also Fig. 9 , Fig. 9 Schematic diagram of an application scenario of the method for establishing a screen projection connection provided in an embodiment of the present application. Fig. 9 As shown, taking the method for establishing a screen projection connection applied in a conference room scenario as an example, two or more display terminals supporting screen projection display are deployed in the conference room (such as Fig. 9 In addition, Fig. 9 Each conference flat panel terminal shown in FIG. 1 is equipped with a microphone array, a camera, a speaker, a Bluetooth module, and a WiFi module. Optionally, each conference flat panel terminal may also be equipped with an ultrasonic sound generator.

[0156] To implement the method for establishing the screen projection connection provided in this embodiment, it can specifically include the following three stages: 1. Establishing a networking connection between conference tablet terminals; 2. Performing positioning and environmental scanning between conference tablet terminals to determine the position of each conference tablet terminal and the position of the reference object; 3. The conference tablet terminal performs positioning on the user's screen projection terminal, determines the position of the screen projection terminal and returns the position of each device and reference object in the conference room for the user to select the conference tablet terminal to be projected.

[0157] The following first introduces the specific process of establishing a networking connection between conference tablet terminals in the first stage.

[0158] See also Fig.10 , Fig.10 A schematic diagram of a process for establishing a network connection between conference tablet terminals provided in an embodiment of the present application. Fig.10 As shown, the process of establishing a networking connection between conference tablet terminals includes the following steps 1001-1010.

[0159] Step 1001: The conference tablet terminal as the master device searches for nearby pairable devices via Bluetooth and broadcasts the device code of the device via Bluetooth.

[0160] First, the user can select one of the multiple conference tablet terminals in the conference room as the master device in advance, and the other conference tablet terminals in the conference room as slave devices. The conference tablet terminal as the master device can continuously search for nearby pairable devices via Bluetooth. At the same time, the conference tablet terminal as the master device also sends a Bluetooth broadcast signal, and carries the device code of the device (that is, the device code of the master device) in the Bluetooth broadcast signal.

[0161] Step 1002: The conference tablet terminal as a slave device backs up the device code of the master device carried in the Bluetooth broadcast signal.

[0162] While the conference tablet terminal as the master device sends a Bluetooth broadcast signal, the conference tablet terminal as the slave device receives the Bluetooth broadcast signal through the Bluetooth module and backs up the device code of the master device carried in the Bluetooth broadcast signal.

[0163] Step 1003: The master device generates a list of candidate networking devices based on the searched pairable devices.

[0164] Since Bluetooth has the ability to penetrate walls, and there may be other devices inside and outside the conference room besides slave devices, the list of alternative networking devices generated by the master device may include other electronic devices (such as smartphones outside the conference room, laptops, or conference tablet terminals in other conference rooms) in addition to the conference tablet terminal that serves as a slave device.

[0165] Step 1004: The master device notifies the devices in the candidate networking device list via Bluetooth to enter the sound wave monitoring mode.

[0166] After generating the candidate networking device list, the master device may also notify the devices in the candidate networking device list to enter the sound wave monitoring mode through Bluetooth broadcasting, so as to prepare to receive the ultrasonic wave signal sent by the master device.

[0167] Step 1005: The master device sends an ultrasonic signal, which carries the device code of the master device.

[0168] The ultrasonic signal sent by the main device has the characteristic of not being able to penetrate walls, that is, other devices outside the conference room cannot receive the ultrasonic signal sent by the main device.

[0169] Step 1006, the slave device determines whether an ultrasonic signal is received.

[0170] After receiving the Bluetooth broadcast signal sent by the master device for notifying the entry into the sound wave monitoring mode, the slave device enters the sound wave monitoring mode and continuously monitors whether an ultrasonic signal is received.

[0171] Step 1007: If an ultrasonic signal is received from the device, it is determined whether the device code in the ultrasonic signal matches the backup device code.

[0172] When the slave device receives the ultrasonic signal, it analyzes the ultrasonic signal to obtain the device code carried in the ultrasonic signal, and compares the device code in the ultrasonic signal with the previously backed-up device code to determine whether the two device codes match.

[0173] Step 1008: If the device code in the ultrasonic signal matches the backup device code, the slave device sends a feedback message to the master device.

[0174] If the device code in the ultrasonic signal matches the backup device code, it means that the ultrasonic signal received by the slave device is sent by the master device, so the slave device can send a feedback message to the master device to indicate that the slave device successfully received the ultrasonic signal from the master device. Optionally, the feedback message sent by the slave device carries the device code in the ultrasonic signal received by the slave device.

[0175] The slave device may send a feedback message to the master device via a Bluetooth broadcast signal or an ultrasonic signal, which is not specifically described in this embodiment.

[0176] Step 1009: The master device continuously receives feedback signals sent by the slave devices, and removes the devices that have not generated any feedback messages within a period of time from the list of candidate networking devices.

[0177] After sending the ultrasonic signal, the master device can continue to receive the feedback signal sent by the slave device, and update the list of candidate networking devices based on the received feedback signal. Specifically, if the master device can receive the feedback signal sent by a certain device within a period of time, the master device will retain the device in the list of candidate networking devices; if the master device cannot receive the feedback signal sent by a certain device within a period of time, it can be considered that the device cannot receive the ultrasonic signal sent by the master device, so the master device removes the device from the list of candidate networking devices.

[0178] Step 1010: The master device completes the networking connection with the slave device based on the updated list of candidate networking devices.

[0179] In general, through Bluetooth broadcasting and sending ultrasonic signals, the main device can quickly identify other conference tablet terminals located in the same conference room, avoid interference from other devices outside the conference room, and complete the networking between conference tablet terminals in the same conference room.

[0180] Next, the specific process of performing positioning and environmental scanning between conference tablet terminals in the second stage to determine the position of each conference tablet terminal and the position of the reference object, thereby generating a conference room layout map, is introduced.

[0181] See also Fig.11 , Fig.11 A schematic diagram of a flow chart of a conference room layout generated by a conference tablet terminal according to an embodiment of the present application. Fig.11 As shown, the process of the conference tablet terminal generating a conference room layout diagram includes the following steps 1101-1107.

[0182] Step 1101: A conference tablet terminal as a master device and a conference tablet terminal as a slave device perform clock synchronization.

[0183] In this embodiment, in order to facilitate the subsequent master device to accurately measure the position of the slave device, the clock synchronization between the master device and each slave device can be performed first to ensure that the master device and the slave device can achieve time synchronization. The method of performing clock synchronization between the master device and the slave device can refer to the existing clock synchronization method, which will not be described in detail here.

[0184] Step 1102: The master device measures the relative angle between itself and the slave device.

[0185] Among them, the master device can measure the relative angle between itself and the slave device through methods such as sound source positioning method, time of arrival (TOA) positioning method, Bluetooth-based angle of arrival (AOA) positioning method and Bluetooth-based angle of departure (AOD) positioning method.

[0186] For example, see Fig.12 , Fig.12 A schematic diagram of a conference tablet terminal measuring the relative angle between the conference tablet terminal and other conference tablet terminals provided in an embodiment of the present application. Fig.12 As shown, the conference tablet terminal A as the main device can measure the relative angle between itself and other conference tablet terminals, where the relative angle between conference tablet terminal A and conference tablet terminal C is α1, the relative angle between conference tablet terminal A and conference tablet terminal D is α2, and the relative angle between conference tablet terminal A and conference tablet terminal B is α3.

[0187] Taking the sound source localization method as an example, the master device can first notify each slave device to enter the sound source localization mode. Then, the master device sends out a sound wave signal, allowing each slave device to locate the master device according to the sound wave signal sent by the master device. Among them, the sound wave signal can select a high-frequency band, which can reduce the impact of other environmental sounds on the one hand, and reduce the impact on other people in the room on the other hand. Finally, after each slave device locates the sound source of the master device, it can feed back the angle of the sound source localization to the master device, so that the master device can obtain the relative angle between it and each slave device.

[0188] See also Fig.13 , Fig.13 The following is a schematic diagram of the principle of a sound source localization method provided in an embodiment of the present application. Fig.13 As shown, an audio signal is sent from a speaker or ultrasonic sounder of one conference flat panel terminal, and another conference flat panel terminal enters the sound source localization mode to measure the relative angle θ between the current conference flat panel terminal and the conference flat panel terminal serving as the sound source.

[0189] Take the sound source localization method as an example, specifically the sound source localization algorithm based on phase transform weighted controllable response power (Steered Response Power-Phase Transform, SRP-PHAT). The basic principle of the SRP-PHAT algorithm is to calculate the sum of the generalized cross correlation-phase transform method (Generalized Cross Correlation Phase Transformation, GCC-PHAT) functions of all microphones for the received signals at the imaginary sound source position, and find the point in the entire sound source space that maximizes the SRP value, which is the sound source position. SRP-PHAT is highly robust to reverberation, but its positioning performance is poor in a low signal-to-noise ratio (SNR) environment. The position accuracy of the search space of the SRP-PHAT algorithm can be adjusted according to the needs of the actual scene.

[0190] Specifically, the SRP-PHAT calculation formula is shown in the following formula 1:

[0191]

[0192] Among them, X m (k) represents the fast Fourier transform value of the k-band of the m-th microphone, and s(θ) represents the steering vector corresponding to the sound source. The steering vector can be calculated in advance according to the layout of the microphone array and the required search space. The calculation formula is shown in the following formula 2:

[0193]

[0194] The above formula uses the first microphone as the reference microphone, d m represents the distance from the mth microphone to the first microphone, d m cosθ represents the distance difference between the sound source reaching the mth microphone and the reference microphone.

[0195] Thus, by searching the SRP-PAHT value within the range of 0 to 180 degrees, θ corresponding to the maximum value is the azimuth of the sound source.

[0196] See also Fig.14 , Fig.14 The schematic diagram of the principle of a TOA positioning method provided in the embodiment of the present application. Fig.14 As shown, assuming that the clocks on the microphone arrays of the conference flat panel terminals are synchronized, the speakers or ultrasonic sounders on the conference flat panel terminals transmit sound wave pulse signals, assuming that the transmission time is t1, and the receiving times of the two microphones on the microphone array side of another conference flat panel terminal are t2 and t3 respectively. According to t1, t2 and t3, the distances L1 and L2 between the two microphones of the distributed microphone array can be calculated, and the angle θ between the two conference flat panel terminals can be calculated according to the cosine theorem. Specifically, the calculation method based on the TOA positioning method is shown in the following formula 3.

[0197]

[0198] Step 1103: The master device measures the distance between itself and the slave device.

[0199] There are many ways for the master device to measure the distance between itself and the slave device, such as using a TOA ranging method, which is not specifically limited in this embodiment.

[0200] See also Fig.15 , Fig.15 The schematic diagram of the principle of a TOA ranging method provided in the embodiment of the present application. Fig.15 As shown in the figure, assuming that the clocks on the microphone arrays of the conference tablet terminals are synchronized, the speaker or ultrasonic sounder of the conference tablet terminal as the master device transmits a sound wave pulse signal, and records the transmission time T0. The microphone of the conference tablet terminal as the slave device receives the sound wave pulse signal at the timestamp T1. Then, the slave device can receive the timestamp T1 of the sound wave pulse signal and feed it back to the master device. The master device can calculate the distance between the two devices in combination with the sound speed c:

[0201] Step 1104: The master device determines the position of each slave device based on the relative angle and distance between the master device and the slave device.

[0202] In the case where the master device can determine the relative angle and distance between itself and each slave device, the master device can use itself as the starting point, make a ray based on the relative angle between itself and the slave device, and determine a point on the ray based on the distance between itself and the slave device. This point is the position of the slave device. In other words, the master device can uniquely determine the position of each slave device based on the relative angle and distance between itself and the slave device.

[0203] For example, see Fig.16 , Fig.16 A schematic diagram of determining the location of a conference tablet terminal provided in an embodiment of the present application. Fig.16 As shown in FIG. 1 , conference tablet terminal A is the master device, and conference tablet terminal B, conference tablet terminal C, and conference tablet terminal D are slave devices. Assume that the coordinates of conference tablet terminal A are (x A ,y A ), the relative angle between conference tablet terminal A and conference tablet terminal C is α1, and the distance is L1. Then the coordinates of conference tablet terminal C can be determined by raycasting as (x C ,y C ). Similarly, based on the relative angle α2 and the distance L2 between the conference tablet terminal A and the conference tablet terminal D, the coordinates of the conference tablet terminal D can be determined as (x D ,y D ); Based on the relative angle α3 and distance L3 between conference tablet terminal A and conference tablet terminal B, the coordinates of conference tablet terminal B can be determined as (x B ,y B ).

[0204] Step 1105 : The master device and the slave device scan reference objects in the conference room through cameras.

[0205] In this embodiment, the master device and the slave device can acquire an image of the conference room environment by turning on the camera, and detect the image of the conference room environment in combination with the target recognition algorithm, thereby scanning and determining the reference object in the conference room. In addition, after the master device and the slave device recognize the reference object in the image, the angle of the reference object relative to the present device (i.e., the relative angle between the reference object and the present device) can be determined based on the position of the reference object in the image. Alternatively, in the case where the master device and the slave device are equipped with an infrared transmitting module, infrared rays can be emitted to the reference object through the infrared transmitting module, thereby determining the relative angle between the reference object and the present device.

[0206] The reference objects in the conference room may be some pre-set objects, such as doors, podiums, windows, tables, chairs, green plants and other objects fixedly deployed in the conference room, and this embodiment does not make any specific limitation on this.

[0207] Step 1106: The slave device feeds back the position of the scanned reference object in the conference room to the master device.

[0208] After the slave device determines the position of the reference object in the conference room, the slave device can feedback the scanned position of the reference object in the conference room to the master device, so that the master device can determine the precise position of the reference object by combining the positions of the reference objects fed back by each slave device.

[0209] Step 1107: The master device generates a layout diagram of the conference room based on the position of each device and the position of the reference object.

[0210] The layout of the conference room initially generated by the master device includes the positions of the master device and each slave device, as well as the positions of the reference objects. That is, before the screen projection officially starts, the layout of the conference room only includes the display terminals fixedly deployed in the conference room and the positions of the reference objects, but does not include the position of the projection terminal.

[0211] For example, see Fig.17 , Fig.17 A schematic diagram of a preliminary generated conference room layout diagram provided in an embodiment of the present application. Fig.17 As shown in the figure, the conference room layout diagram initially generated by the main device includes the positions of conference tablet terminals A-D, as well as the positions of the door and the podium as reference objects. In this way, after obtaining the initially generated conference room layout diagram, when starting the screen projection, you only need to determine the position of the projection terminal to return the entire conference room layout diagram to the projection terminal, so that the user of the projection terminal can clearly determine the mapping relationship between the objects in the conference room layout diagram and the objects in the actual conference room.

[0212] Next, we will introduce the process in which the conference tablet terminal locates the user's projection terminal in the third stage, determines the location of the projection terminal and returns the location of each device and reference object in the conference room for the user to select the conference tablet terminal to be projected.

[0213] See also Fig.18 , Fig.18 A schematic diagram of a process for establishing a screen projection connection between a screen projection terminal and a conference tablet terminal in a conference room provided in an embodiment of the present application. Fig.18 As shown, the process of establishing a screen projection connection between the screen projection terminal and the conference tablet terminal in the conference room includes the following steps 1801-1809.

[0214] Step 1801: The screen projection terminal searches for screen projection devices in the conference room and obtains the network identification number corresponding to the conference tablet terminal in the conference room.

[0215] In this embodiment, when the user needs to start screen projection, the user can control the screen projection terminal to search for screen projection devices in the conference room. Since the conference tablet terminals in the conference room have established a networking connection, any conference tablet terminal after the networking connection is established will return a unified network identification number to the screen projection terminal that searches for screen projection devices. The network identification number corresponds to multiple conference tablet terminals that have established a networking connection. In other words, after multiple conference tablet terminals establish a networking connection, these multiple conference tablet terminals no longer display their respective device information to the outside world, but uniformly display a network identification number as a virtual device that can be projected. For example, the network identification number is "screen projection device group for XX conference room".

[0216] Step 1802: The screen projection terminal sends a screen projection request based on the networking identification number.

[0217] Among them, when the user selects the networking identification number to perform screen projection, the screen projection terminal can send a screen projection request to the conference tablet terminal in the conference room based on the networking identification number. The screen projection request is, for example, the first request in the above embodiment. For example, when the multiple conference tablet terminals in the conference room are composed of a master device and multiple slave devices, the networking identification number points to the master device among the multiple conference tablet terminals. Therefore, the screen projection terminal actually sends a screen projection request to the conference tablet terminal as the master device based on the networking identification number. For another example, the screen projection terminal can send the networking identification number to the nearest conference tablet terminal or a searched conference tablet terminal based on the networking identification number.

[0218] Step 1803: The conference tablet terminal sends a positioning request to the projection terminal.

[0219] After obtaining the networking identification number sent by the projection terminal, the conference tablet terminal can send a positioning request to the projection terminal to request the projection terminal to cooperate with multiple conference tablet terminals to realize the positioning of the projection terminal. Among them, the conference tablet terminal that sends the positioning request to the projection terminal can be the main device among multiple conference tablet terminals, or it can be the conference tablet terminal that receives the projection request sent by the projection terminal. This embodiment does not make specific limitations on this.

[0220] Step 1804: The projection terminal cooperates with multiple conference tablet terminals to complete the positioning of the projection terminal.

[0221] There are many ways for multiple conference tablet terminals to locate the projection terminal, such as acoustic positioning, Bluetooth positioning, etc. Moreover, the number of conference tablet terminals required for different types of positioning methods is not necessarily the same. For example, some positioning methods may only require two conference tablet terminals to complete the positioning of the projection terminal, while other positioning methods may require three or more conference tablet terminals to complete the positioning of the projection terminal. The following will briefly introduce some ways for multiple conference tablet terminals to locate the projection terminal.

[0222] Exemplarily, the process of positioning the projection terminal based on the sound wave frequency division method includes the following steps A1-A4.

[0223] In step A1, the conference tablet terminal and the projection terminal negotiate to obtain multiple frequency bands (such as frequency band F1, frequency band F2...frequency band Fn) for sending audio signals.

[0224] Step A2: The screen projection terminal sends audio signals on multiple frequency bands obtained through negotiation.

[0225] In step A3, the multiple conference tablet terminals participating in the positioning enter the sound source positioning mode and measure the relative angle between the device and the projection terminal according to the negotiated frequency band.

[0226] Each conference tablet terminal corresponds to a frequency band, and different conference tablet terminals are used to receive audio signals in different frequency bands, and then determine the relative angle between themselves and the projection terminal. Fig.19 , Fig.19 A schematic diagram of positioning a projection terminal provided in this embodiment. Fig.19 As shown, conference tablet terminal A receives audio signals under frequency band F1 and determines the relative angle α1 between the device and the projection terminal; conference tablet terminal B receives audio signals under frequency band F2 and determines the relative angle α2 between the device and the projection terminal; conference tablet terminal C receives audio signals under frequency band F3 and determines the relative angle α3 between the device and the projection terminal; conference tablet terminal D receives audio signals under frequency band F4 and determines the relative angle α4 between the device and the projection terminal.

[0227] Step A4, based on the relative angle between each conference tablet terminal and the projection terminal, calculate the coordinate information of the projection terminal.

[0228] Since the position of each conference tablet terminal is known, the specific position of the screen projection terminal can be determined based on the relative angle between each conference tablet terminal and the screen projection terminal.

[0229] Exemplarily, the process of positioning the projection terminal based on the sound wave time-sharing method includes the following steps B1-B4.

[0230] In step B1, the conference tablet terminal negotiates with the projection terminal to obtain a frequency band and multiple time periods (such as frequency band F and time period T1, time period T2...time period Tn) for sending audio signals.

[0231] Step B2: The projection terminal sends audio signals in multiple time periods based on the negotiated frequency band.

[0232] In step B3, the multiple conference tablet terminals participating in the positioning enter the sound source positioning mode and measure the relative angle between the device and the projection terminal according to the negotiated frequency band and time period.

[0233] Among them, each conference flat panel terminal corresponds to a time period, and different conference flat panel terminals are used to receive audio signals in the same frequency band in different time periods, and then determine the relative angle between themselves and the projection terminal.

[0234] Step B4, based on the relative angle between each conference tablet terminal and the projection terminal, calculate the coordinate information of the projection terminal.

[0235] For example, see Fig. 20 , Fig. 20 A schematic diagram of positioning based on signal strength provided in an embodiment of the present application. Fig. 20 As shown, Fig. 20 In fact, it is a schematic diagram of the positioning principle based on the received signal strength indicator (RSSI) method. Three or more conference tablet terminals send signals (such as Bluetooth signals) to the projection terminal, and the projection terminal measures the strength of each received signal to determine the distance between the projection terminal and each conference tablet terminal. Fig. 20 As shown, the distance between the projection terminal and the conference tablet terminal A is L1, the distance between the projection terminal and the conference tablet terminal B is L2, and the distance between the projection terminal and the conference tablet terminal C is L3. In this way, based on the distance between the projection terminal and the conference tablet terminal, a circle can be drawn with the conference tablet terminal as the center and the distance between the conference tablet terminal and the projection terminal as the diameter. Finally, the position of the projection terminal can be determined by finding the intersection of the circles corresponding to different conference tablet terminals.

[0236] Step 1805: The conference tablet terminal adds the location of the projection terminal to the initially generated layout of the conference room to obtain an updated layout of the conference room.

[0237] Among them, the updated layout diagram of the conference room indicates the location of the projection terminal, the location of each conference tablet terminal, and the location of the reference object.

[0238] Step 1806: The conference tablet terminal sends the layout diagram of the conference room to the projection terminal.

[0239] Step 1807: The screen projection terminal displays the received layout diagram of the conference room on the display screen, so that the user can select the conference tablet terminal to be projected.

[0240] The layout of the conference room displayed by the projection terminal can be as follows: Figure 7 shown.

[0241] Step 1808, in response to the instruction issued by the user, the screen projection terminal sends a screen projection request for the designated display terminal to the conference tablet terminal.

[0242] Specifically, based on the layout of the conference room, the user can select one or more conference tablet terminals to project the screen, and then send an instruction to the projection terminal, which instructs the projection conference terminal to send a projection request to the specified display terminal. The display terminal specified by the user for projection display can be one or more conference tablet terminals in the layout of the conference room.

[0243] Step 1809: The screen projection terminal establishes a screen projection connection with the designated display terminal.

[0244] When the projection terminal requests to establish a projection connection with the designated display terminal, the conference tablet terminal that receives the projection request from the projection terminal will forward the projection request to the designated display terminal, thereby enabling the designated display terminal to establish a projection connection with the projection terminal.

[0245] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the method. It is understandable that, in order to realize the above functions, the electronic device includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the modules and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0246] The embodiment of the present application can divide the functional modules of the electronic device according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0247] The electronic device in the embodiment of the present application is described in detail below.

[0248] See also Fig.21 , Fig.21 Schematic diagram of the structure of an electronic device 2100 provided in an embodiment of the present application. Fig.21 As shown, the electronic device 2100 includes: a sending module 2101, used to send a first request, the first request is used to request to establish a screen projection connection; a receiving module 2102, used to receive a positioning request, the positioning request is used to instruct the electronic device to cooperate in completing the positioning of the electronic device; after the electronic device cooperates to complete the positioning process, the receiving module 2102 is also used to receive and display location information, the location information is used to indicate the positions of the first electronic device and multiple electronic devices in the target area, the target area is the area where the first electronic device is located; a processing module 2103, used to establish a screen projection connection with the target device in response to a first instruction, the first instruction is used to instruct the electronic device to establish a screen projection connection with the target device among multiple electronic devices.

[0249] In a possible implementation manner, the location information includes a layout diagram of the target area, where the layout diagram is used to indicate the locations of the electronic device and the multiple electronic devices in the target area.

[0250] In a possible implementation, the layout map is also used to indicate the position of a reference object in the target area.

[0251] In a possible implementation, the target area is a closed indoor space, and the multiple electronic devices are all in the closed indoor space.

[0252] See also Fig. 22 , Fig. 22 Schematic diagram of the structure of an electronic device 2200 provided in an embodiment of the present application. Fig. 22As shown, the electronic device 2200 includes: an acquisition module 2201, used to acquire a first request from a first electronic device, the first request is used to request to establish a screen projection connection; a sending module 2202, used to send a positioning request to the first electronic device, the positioning request is used to instruct the first electronic device to cooperate in completing the positioning of the first electronic device; a processing module 2203, used to obtain the positioning result of the first electronic device after the first electronic device cooperates to complete the positioning process, the sending module 2202 is also used to control the sending module 2202 to send location information to the first electronic device based on the positioning result, the location information is used to indicate the location of the first electronic device and multiple electronic devices in the target area, the location information is used for the first electronic device to establish a screen projection connection with a target device selected from multiple electronic devices, and the target area is the area where the first electronic device is located.

[0253] In a possible implementation manner, the location information includes a layout diagram of the target area, where the layout diagram is used to indicate the locations of the first electronic device and the multiple electronic devices in the target area.

[0254] In a possible implementation, the layout map is also used to indicate the position of a reference object in the target area.

[0255] In a possible implementation, the target area is a closed indoor space, and the multiple electronic devices are all in the closed indoor space.

[0256] In one possible implementation, the sending module 2202 is also used to send an ultrasonic signal; the acquiring module 2201 is also used to receive a feedback signal sent by at least one electronic device, the feedback signal is used to indicate the content in the ultrasonic signal, wherein the multiple electronic devices include a second electronic device and at least one electronic device; the processing module 2203 is also used to establish a networking connection with at least one electronic device, and the networking connection is used for message transmission between the second electronic device and the at least one electronic device.

[0257] In one possible implementation, the processing module 2203 is also used to: search for pairable devices via Bluetooth and generate a list of candidate networking devices, the list of candidate networking devices including device information of multiple electronic devices; based on the feedback signal received by the second electronic device, the second electronic device selects at least one device from the list of candidate networking devices to establish a networking connection.

[0258] In one possible implementation, the sending module 2202 is further used to send a positioning indication message to at least one electronic device, where the positioning indication message is used to instruct at least one electronic device to participate in inter-device positioning; the acquiring module 2201 is further used for the second electronic device to acquire positioning results of multiple electronic devices after the inter-device positioning is completed, where the positioning results of multiple electronic devices are used to generate location information.

[0259] In one possible implementation, the acquisition module 2201 is also used to obtain a reference object location message sent by at least one electronic device, the reference object location message is used to indicate the location of a reference object identified by at least one electronic device in the target area, the reference object location message is used to generate location information, and the location information is also used to indicate the location of the reference object in the target area.

[0260] It should be noted that the information interaction, execution process, etc. between the units / or components of the electronic device are different from those in this application. Figure 5-Figure 20 The corresponding method embodiments are based on the same concept. For specific contents, please refer to the description in the method embodiments shown above in this application, which will not be repeated here.

[0261] It should be noted that for the specific implementation of the electronic device and the beneficial effects brought about, reference can be made to Figure 5-Figure 20 The descriptions in the corresponding method embodiments will not be repeated here one by one.

[0262] The present application also provides a screen projection system, comprising: Figure 21-22 The electronic device in the corresponding embodiment.

[0263] An embodiment of the present application also provides a computer-readable storage medium, including instructions, which, when executed on a computer, enables the computer to control an electronic device to execute any one of the implementation methods shown in the aforementioned method embodiments.

[0264] An embodiment of the present application also provides a computer program product, which includes a computer program code. When the computer program code runs on a computer, the computer executes any one of the implementation methods shown in the aforementioned method embodiments.

[0265] An embodiment of the present application also provides a chip system, including a memory and a processor, the memory is used to store computer programs, and the processor is used to call and run computer programs from the memory, so that the chip executes any one of the implementation methods shown in the aforementioned method embodiments.

[0266] It should also be noted that the device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, in the drawings of the device embodiments provided by the present application, the connection relationship between the modules indicates that there is a communication connection between them, which may be specifically implemented as one or more communication buses or signal lines.

[0267] Through the description of the above implementation methods, the technicians in the relevant field can clearly understand that the present application can be implemented by means of software plus necessary general hardware, and of course, it can also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components, etc. In general, all functions completed by computer programs can be easily implemented with corresponding hardware, and the specific hardware structures used to implement the same function can also be various, such as analog circuits, digital circuits or special circuits. However, for the present application, software program implementation is a better implementation method in more cases. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, a U disk, a mobile hard disk, a ROM, a RAM, a disk or an optical disk, etc., including a number of instructions to enable a computer device to execute the methods described in each embodiment of the present application.

[0268] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0269] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, a computer, a communication device, a computing device, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, communication device, computing device, or data center. The computer-readable storage medium may be any available medium that a computer can store or a communication device, a data center, or other data storage device that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)), etc.

[0270] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.

[0271] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

Claims

1. A method for establishing a screen projection connection, characterized in that: include: The first electronic device sends a first request, where the first request is used to request to establish a screen projection connection; The first electronic device receives a positioning request, where the positioning request is used to instruct the first electronic device to cooperate in completing positioning of the first electronic device; After the first electronic device cooperates to complete the positioning process, the first electronic device receives and displays location information, where the location information is used to indicate the locations of the first electronic device and multiple electronic devices in a target area, where the target area is an area where the first electronic device is located; In response to a first instruction, the first electronic device establishes a screen projection connection with a target device, and the first instruction is used to instruct the first electronic device to establish a screen projection connection with the target device among the multiple electronic devices.

2. The method according to claim 1, characterized in that The location information includes a layout diagram of the target area, where the layout diagram is used to indicate the locations of the first electronic device and the multiple electronic devices in the target area.

3. The method according to claim 2, characterized in that The layout map is also used to indicate the location of reference objects in the target area.

4. The method according to any one of claims 1 to 3, characterized in that: The target area is a closed indoor space, and the multiple electronic devices are all located in the closed indoor space.

5. The method according to any one of claims 1 to 4, characterized in that: The first electronic device establishes a screen projection connection with the target device, including: The first electronic device sends a second request to the second electronic device, where the second request is used to request to establish a screen projection connection with the target device, wherein the second electronic device is a sender of the location information, and the second electronic device is used to forward the second request to the target device; In response to the target device acquiring the second request, the first electronic device establishes a screen projection connection with the target device.

6. The method according to any one of claims 1 to 4, characterized in that: The location information is also used to indicate device information of the target device; The first electronic device establishes a screen projection connection with the target device, including: The first electronic device establishes a screen projection connection with the target device based on the device information of the target device.

7. A method for establishing a screen projection connection, characterized in that: include: The second electronic device obtains a first request from the first electronic device, where the first request is used to request to establish a screen projection connection; The second electronic device sends a positioning request to the first electronic device, where the positioning request is used to instruct the first electronic device to cooperate in completing the positioning of the first electronic device; After the first electronic device cooperates to complete the positioning process, the second electronic device obtains the positioning result of the first electronic device, and sends location information to the first electronic device based on the positioning result, the location information is used to indicate the positions of the first electronic device and multiple electronic devices in the target area, the location information is used for the first electronic device to establish a screen projection connection with a target device selected from the multiple electronic devices, and the target area is the area where the first electronic device is located.

8. The method according to claim 7, characterized in that The location information includes a layout diagram of the target area, where the layout diagram is used to indicate the locations of the first electronic device and the multiple electronic devices in the target area.

9. The method according to claim 8, characterized in that The layout map is also used to indicate the location of reference objects in the target area.

10. The method according to any one of claims 7 to 9, characterized in that: The target area is a closed indoor space, and the multiple electronic devices are all located in the closed indoor space.

11. The method according to any one of claims 7 to 10, characterized in that: The method further comprises: The second electronic device sends an ultrasonic signal; The second electronic device receives a feedback signal sent by at least one electronic device, the feedback signal being used to indicate content in the ultrasonic signal, wherein the plurality of electronic devices include the second electronic device and the at least one electronic device; The second electronic device establishes a networking connection with the at least one electronic device, and the networking connection is used for exchanging messages between the second electronic device and the at least one electronic device.

12. The method according to claim 11, characterized in that The method further comprises: The second electronic device searches for a pairable device via Bluetooth and generates a list of candidate networking devices, wherein the list of candidate networking devices includes device information of a plurality of electronic devices; Based on the feedback signal received by the second electronic device, the second electronic device selects the at least one device from the list of networking candidate devices to establish a networking connection.

13. The method according to claim 11 or 12, characterized in that: The method further comprises: The second electronic device sends a positioning indication message to the at least one electronic device, where the positioning indication message is used to instruct the at least one electronic device to participate in inter-device positioning; After the positioning between the devices is completed, the second electronic device obtains the positioning results of the multiple electronic devices, wherein the positioning results of the multiple electronic devices are used to generate the location information.

14. The method according to claim 13, characterized in that The method further comprises: The second electronic device obtains a reference object location message sent by the at least one electronic device, wherein the reference object location message is used to indicate the location of the reference object identified by the at least one electronic device in the target area, and the reference object location message is used to generate the location information, and the location information is also used to indicate the location of the reference object in the target area.

15. The method according to any one of claims 7 to 14, characterized in that: The method further comprises: The second electronic device receives a second request sent by the first electronic device, where the second request is used to instruct to establish a screen projection connection with a target device among the multiple electronic devices; The second electronic device forwards the second request to the target device.

16. The method according to any one of claims 7 to 14, characterized in that: The location information is also used to indicate device information of the multiple devices, and the device information of the multiple devices is used for the first electronic device to establish a screen projection connection with a selected target device.

17. An electronic device, characterized in that: include: A sending module, used to send a first request, where the first request is used to request to establish a screen projection connection; A receiving module, used for receiving a positioning request, wherein the positioning request is used for instructing the electronic device to cooperate in completing the positioning of the electronic device; After the electronic device cooperates to complete the positioning process, the receiving module is further used to receive and display location information, where the location information is used to indicate the locations of the first electronic device and multiple electronic devices in a target area, where the target area is an area where the first electronic device is located; A processing module is used to establish a screen projection connection with a target device in response to a first instruction, wherein the first instruction is used to instruct the electronic device to establish a screen projection connection with the target device among the multiple electronic devices.

18. The electronic device according to claim 17, characterized in that: The location information includes a layout diagram of the target area, where the layout diagram is used to indicate the locations of the electronic device and the multiple electronic devices in the target area.

19. The electronic device according to claim 18, characterized in that: The layout map is also used to indicate the location of reference objects in the target area.

20. The electronic device according to any one of claims 17 to 19, characterized in that: The target area is a closed indoor space, and the multiple electronic devices are all located in the closed indoor space.

21. An electronic device, characterized in that: include: An acquisition module, used to acquire a first request from a first electronic device, where the first request is used to request to establish a screen projection connection; a sending module, configured to send a positioning request to the first electronic device, wherein the positioning request is used to instruct the first electronic device to cooperate in completing the positioning of the first electronic device; The processing module is used to obtain the positioning result of the first electronic device after the first electronic device cooperates to complete the positioning process. The sending module is also used to control the sending module to send location information to the first electronic device based on the positioning result. The location information is used to indicate the positions of the first electronic device and multiple electronic devices in the target area. The location information is used for the first electronic device to establish a screen projection connection with a target device selected from the multiple electronic devices. The target area is the area where the first electronic device is located.

22. The electronic device according to claim 21, characterized in that: The location information includes a layout diagram of the target area, where the layout diagram is used to indicate the locations of the first electronic device and the multiple electronic devices in the target area.

23. The electronic device according to claim 22, characterized in that: The layout map is also used to indicate the location of reference objects in the target area.

24. The electronic device according to any one of claims 21 to 23, characterized in that: The target area is a closed indoor space, and the multiple electronic devices are all located in the closed indoor space.

25. The electronic device according to any one of claims 21 to 24, characterized in that: The sending module is also used to send ultrasonic signals; The acquisition module is further used to receive a feedback signal sent by at least one electronic device, wherein the feedback signal is used to indicate the content of the ultrasonic signal, wherein the plurality of electronic devices include the second electronic device and the at least one electronic device; The processing module is further used to establish a networking connection with the at least one electronic device, and the networking connection is used for message transmission between the second electronic device and the at least one electronic device.

26. The electronic device according to claim 25, characterized in that: The processing module is further used for: Searching for pairable devices via Bluetooth and generating a list of candidate networking devices, wherein the list of candidate networking devices includes device information of multiple electronic devices; Based on the feedback signal received by the second electronic device, the second electronic device selects the at least one device from the list of networking candidate devices to establish a networking connection.

27. The electronic device according to claim 25 or 26, characterized in that: The sending module is further used to send a positioning indication message to the at least one electronic device, where the positioning indication message is used to instruct the at least one electronic device to participate in inter-device positioning; The acquisition module is further used for, after the positioning between the devices is completed, the second electronic device to acquire the positioning results of the multiple electronic devices, wherein the positioning results of the multiple electronic devices are used to generate the position information.

28. The electronic device according to claim 27, characterized in that: The acquisition module is further used to acquire a reference object location message sent by the at least one electronic device, wherein the reference object location message is used to indicate the location of the reference object identified by the at least one electronic device in the target area, and the reference object location message is used to generate the location information, and the location information is also used to indicate the location of the reference object in the target area.

29. An electronic device, characterized in that: The electronic device comprises a memory and a processor; the memory stores codes, the processor is configured to execute the codes, and when the codes are executed, the electronic device executes the method according to any one of claims 1 to 16.

30. A screen projection system, characterized in that: The invention comprises an electronic device as described in any one of claims 17 to 20 and an electronic device as described in any one of claims 21 to 28.

31. A computer storage medium, characterized in that The computer storage medium stores instructions, which, when executed by a computer, cause the computer to implement the method of any one of claims 1 to 16.

32. A computer program product, characterized in that The computer program product stores instructions, which, when executed by a computer, cause the computer to implement the method according to any one of claims 1 to 16.

Images