Equipment interaction method and device, medium and electronic equipment

Abstract

The invention belongs to the technical field of computers, and particularly relates to an equipment interaction method, an equipment interaction device, a computer readable medium, electronic equipment and a computer program product. The method comprises the steps of obtaining a spatial position of a mobile terminal relative to a display device, wherein the display device is used for displaying interaction content capable of interacting with the mobile terminal; identifying whether the mobile terminal enters an interaction range of the display equipment or not according to the spatial position, wherein the interaction range is a spatial range in which the display equipment can interact with the mobile terminal; and if the mobile terminal enters the interaction range, displaying an interaction interface corresponding to the interaction content on the mobile terminal according to the interaction content displayed on the display equipment. The embodiment of the invention can shorten the interaction process and improve the interaction efficiency.

Description

Technical Field

[0001] The present application belongs to the field of computer technology, and specifically relates to a device interaction method, a device interaction apparatus, a computer-readable medium, an electronic device, and a computer program product. Background Art

[0002] In shopping malls, shopping malls, supermarkets and other public business places, there are usually some electronic screens to display commercial advertisements or commercial activities. At the same time, in order to further spread information to users, the QR code of the application or web page can also be displayed on the electronic screen; when the user scans the QR code with a mobile phone, the detailed content of the advertisement or activity can be viewed on the mobile phone. This interactive method requires users to actively scan the QR code, which has problems such as long interactive process and low interactive efficiency. Summary of the invention

[0003] The present application provides a device interaction method, a device interaction apparatus, a computer-readable medium, an electronic device, and a computer program product, the purpose of which is to shorten the interaction process and improve the interaction efficiency.

[0004] According to one aspect of an embodiment of the present application, a device interaction method is provided, which includes: obtaining a spatial position of a mobile terminal relative to a display device, wherein the display device is used to display interactive content that can interact with the mobile terminal; identifying whether the mobile terminal enters an interactive range of the display device based on the spatial position, wherein the interactive range is a spatial range in which the display device can interact with the mobile terminal; if the mobile terminal enters the interactive range, displaying an interactive interface corresponding to the interactive content on the mobile terminal based on the interactive content displayed on the display device.

[0005] According to one aspect of an embodiment of the present application, a device interaction apparatus is provided, the device interaction apparatus comprising:

[0006] A positioning module, configured to obtain a spatial position of a mobile terminal relative to a display device, wherein the display device is used to display interactive content that can interact with the mobile terminal;

[0007] an identification module configured to determine, according to the spatial position, whether the mobile terminal enters an interaction range of the display device, wherein the interaction range is a spatial range within which the display device can interact with the mobile terminal;

[0008] The display module is configured to display an interaction interface corresponding to the interaction content on the mobile terminal according to the interaction content displayed on the display device if the mobile terminal enters the interaction range.

[0009] In some embodiments of the present application, based on the above technical solution, the positioning module further includes:

[0010] A position acquisition module, configured to acquire position information of one or more positioning devices relative to the display device, wherein the positioning device has a fixed position relationship with the display device;

[0011] a distance determination module, configured to determine a straight-line distance between the positioning device and the mobile terminal according to data communication between the positioning device and the mobile terminal;

[0012] The position determination module is configured to determine the spatial position of the mobile terminal relative to the display device according to the positional relationship between the positioning device and the display device and the straight-line distance between the positioning device and the mobile terminal.

[0013] In some embodiments of the present application, based on the above technical solution, the distance determination module further includes:

[0014] A first timing module is configured to obtain a first sending timestamp and a first receiving timestamp of first positioning data sent by the mobile terminal to the positioning device, wherein the first sending timestamp is a timestamp recorded when the mobile terminal sends the first positioning data, and the first receiving timestamp is a timestamp recorded when the mobile terminal receives the first positioning data;

[0015] A second timing module is configured to obtain a second sending timestamp and a second receiving timestamp of second positioning data sent by the positioning device to the mobile terminal, wherein the second sending timestamp is a timestamp recorded when the positioning device sends the second positioning data, and the second receiving timestamp is a timestamp recorded when the mobile terminal receives the second positioning data;

[0016] The distance calculation module is configured to determine the straight-line distance between the positioning device and the mobile terminal according to the first sending timestamp, the first receiving timestamp, the second sending timestamp and the second receiving timestamp.

[0017] In some embodiments of the present application, based on the above technical solution, the first positioning data and the second positioning data are positioning data carried by a carrier signal having a frequency bandwidth greater than a preset width threshold.

[0018] In some embodiments of the present application, based on the above technical solution, the distance calculation module further includes:

[0019] A first time difference calculation module, configured to determine a communication time difference of the mobile terminal according to the first sending timestamp and the second receiving timestamp;

[0020] A second time difference calculation module is configured to determine the communication time difference of the positioning device according to the second sending timestamp and the first receiving timestamp;

[0021] The straight-line distance calculation module is configured to determine the straight-line distance between the positioning device and the mobile terminal according to the communication time difference of the mobile terminal and the communication time difference of the positioning device.

[0022] In some embodiments of the present application, based on the above technical solution, the straight-line distance calculation module is further configured to: perform at least two data communications between the mobile terminal and the positioning device to obtain at least two communication time differences of the mobile terminal and at least two communication time differences of the positioning device; determine the straight-line distance between the positioning device and the mobile terminal based on multiple communication time differences.

[0023] In some embodiments of the present application, based on the above technical solution, the device interaction device further includes a range selection module, and the range selection module is configured to: collect environmental images within a preset spatial distance around the display device; construct a virtual space for describing the surrounding environment of the display device based on the environmental image; and select an interaction range in the virtual space that can interact with the display device.

[0024] In some embodiments of the present application, based on the above technical solution, the range selection module is further configured to: identify fixed obstacles in the virtual space that can block the line of sight of the display device; determine the line of sight blocking range of the fixed obstacle based on the positional relationship between the fixed obstacle and the display device; and select other spatial areas in the virtual space except the line of sight blocking range as the interactive range that can interact with the display device.

[0025] In some embodiments of the present application, based on the above technical solution, the display module further includes:

[0026] a request acquisition module, configured to acquire an interaction request sent by the display device to the mobile terminal;

[0027] a request parsing module configured to parse the interaction request to obtain interaction information carried in the interaction request and generated according to the interaction content displayed on the display device;

[0028] The interface display module is configured to display an interaction interface corresponding to the interaction content on the mobile terminal according to the interaction information.

[0029] In some embodiments of the present application, based on the above technical solution, the display module further includes:

[0030] an obstacle identification module, configured to identify whether there is an obstacle between the display device and the mobile terminal according to the interaction request;

[0031] The request discarding module is configured to discard the interaction request if there is an obstacle between the display device and the mobile terminal.

[0032] In some embodiments of the present application, based on the above technical solution, the obstacle identification module is further configured to: obtain the signal strength of the carrier signal carrying the interaction request; if the signal strength is greater than a preset strength threshold, determine that there is no obstacle between the display device and the mobile terminal; if the signal strength is less than the strength threshold, determine that there is an obstacle between the display device and the mobile terminal.

[0033] In some embodiments of the present application, based on the above technical solution, the display module further includes:

[0034] A state acquisition module is configured to acquire an operating state of the mobile terminal, wherein the operating state includes an active state in which a foreground application is running or an inactive state in which a foreground application is not running;

[0035] The information discarding module is configured to discard the interaction information if the running state of the mobile terminal is the inactive state.

[0036] According to one aspect of an embodiment of the present application, a computer-readable medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the device interaction method in the above technical solution is implemented.

[0037] According to one aspect of an embodiment of the present application, an electronic device is provided, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the executable instructions to implement a device interaction method as in the above technical solution.

[0038] According to one aspect of an embodiment of the present application, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the device interaction method in the above technical solution is implemented.

[0039] In the technical solution provided in the embodiment of the present application, by acquiring the spatial position of the mobile terminal relative to the display device, it is possible to identify whether the mobile terminal has entered the interaction range of the display device based on the spatial position, and the display device can display the interaction content to the mobile terminal within a certain interaction range; if the mobile terminal enters the interaction range, an interaction interface corresponding to the interaction content can be displayed on the mobile terminal based on the interaction content displayed on the display device; the interaction solution implemented based on the embodiment of the present application can determine the user's interaction intention based on the spatial movement behavior of the user on the mobile terminal, actively form an interaction pairing with the mobile terminal, and directly display the interaction interface corresponding to the interaction content on the mobile terminal, thereby reducing the interaction process of the user operating the mobile terminal and improving the interaction efficiency between the user and the display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0041] Figure 1 A flow chart showing the interaction between a user and an offline screen in the related art of the present application is shown.

[0042] Figure 2 An exemplary system architecture block diagram applying the technical solution of the embodiment of the present application is shown.

[0043] Figure 3 A flow chart of a device interaction method in one embodiment of the present application is shown.

[0044] Figure 4 A schematic diagram showing the principle of calculating straight-line distance based on a single two-way data communication in one embodiment of the present application is shown.

[0045] Figure 5 A schematic diagram showing the principle of calculating straight-line distance based on two bidirectional data communications in one embodiment of the present application is shown.

[0046] Figure 6 A schematic diagram showing device interaction in an application scenario according to an embodiment of the present application is shown.

[0047] Figure 7 A two-way communication layered architecture for implementing two-way interaction in one embodiment of the present application is shown.

[0048] Figure 8 The structural block diagram of the device interaction apparatus provided in an embodiment of the present application is schematically shown.

[0049] Fig. 9 The structure block diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present application is schematically shown. DETAILED DESCRIPTION

[0050] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more comprehensive and complete and fully convey the concept of the example embodiments to those skilled in the art.

[0051] In addition, described feature, structure or characteristic can be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present application. However, those skilled in the art will appreciate that the technical scheme of the present application can be put into practice without one or more of the specific details, or other methods, components, devices, steps, etc. can be adopted. In other cases, known methods, devices, realizations or operations are not shown or described in detail to avoid blurring the various aspects of the application.

[0052] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0053] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0054] In the specific implementation of this application, related data such as user account registration information and application permissions of the mobile terminal are involved. When the various embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0055] In the related technologies of the present application, electronic screens in public business places such as traditional shopping malls, shopping malls, and overtime can usually only be used to display information. If merchants want to interact socially with users through electronic screens, they will generally display the merchant's mini-program QR code to guide users to scan the code with their mobile phones, and then jump to display the corresponding mini-program on the user's mobile phone.

[0056] Figure 1FIG. 1 shows a flow chart of the user interacting with the offline screen in the related technology of this application. Figure 1 As shown, the process of the user interacting with the two advertising screens includes the following steps.

[0057] S101: Advertising screen A displays a QR code.

[0058] The QR code may be, for example, a mini-program QR code of a merchant, and based on the mini-program QR code, the merchant's mini-program may be displayed.

[0059] S102: The user opens the application.

[0060] The application opened by the user on the mobile phone may be various programs with a code scanning function, such as social software or instant messaging software installed on the user's mobile phone.

[0061] S103: Open the code scanning interface and scan the QR code.

[0062] The user uses the scanning function provided in the application to open the scanning interface and scans the QR code displayed on the advertising screen A in the scanning interface.

[0063] S104: Jump to display applet.

[0064] After the user completes scanning the QR code, the mini program corresponding to the QR code can be displayed on the user's mobile phone.

[0065] S105: Register as a member of the mini program.

[0066] After the user enters the mini program interface, he can register as a merchant member under the guidance of the program.

[0067] From the above interaction process, we can see that the interaction process between users and offline electronic screens depends on users to operate their mobile phones multiple times to complete steps such as scanning codes and registering. There are defects such as complicated operation links and lengthy interaction processes. Users may give up at multiple process nodes due to troublesome operations, resulting in user loss. Especially when there are multiple electronic screens, such as Figure 1 As shown in the advertisement screen B, if the user wants to continue to interact with the advertisement screen B, he needs to return to the original application and repeat the same scanning and registration steps as the advertisement screen A, which further lengthens the user's operation process. It can be seen that this interaction method wastes the interactive properties of offline electronic screens and is not conducive to user interaction and retention.

[0068] In view of the defects existing in the above-mentioned related technologies, the embodiments of the present application provide an automated device interaction solution, which can significantly simplify the interaction process between users and offline electronic screens and improve user interaction efficiency.

[0069] Figure 2An exemplary system architecture block diagram applying the technical solution of the embodiment of the present application is shown.

[0070] like Figure 2 As shown, the system architecture applying the embodiment of the present application may include a mobile terminal 201 , a display device 202 and a server 203 .

[0071] The mobile terminal 201 may include various electronic devices such as smart phones, tablet computers, smart wearable devices, smart vehicle-mounted devices, and smart payment terminals.

[0072] The display device 202 may be a display screen installed at a fixed location, for example, an electronic screen distributed in squares, streets, shopping malls, supermarkets, or transportation stations (such as subway stations, bus stations), etc.

[0073] Server 203 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, as well as big data and artificial intelligence platforms.

[0074] The display device 202 may be connected to the server 203 via a wired communication link or a wireless communication link, and the server 203 controls the display device 202 to display content such as advertisements and activity information.

[0075] According to implementation requirements, the system architecture in the embodiments of the present application may have any number of mobile terminals and display devices, and the present application does not impose any special limitation on this.

[0076] For example, in an application scenario of an embodiment of the present application, a user moves a mobile terminal 201 in a certain space, such as walking in a shopping mall. Multiple display devices 202 are distributed in the space, and for example, each merchant in the shopping mall can display advertising information or promotional activity information to the user by configuring an electronic screen.

[0077] During the user's movement, by acquiring the spatial position of the mobile terminal 201 relative to the display device 202, it is possible to identify whether the mobile terminal 201 has entered the interactive range of the display device 202, which is the spatial range in which the display device 202 can interact with the mobile terminal 201. When the mobile terminal 201 enters the interactive range of the display device 202, an interactive interface corresponding to the interactive content displayed on the display device 202 may be displayed on the mobile terminal 201.

[0078] For example, after seeing the promotional content displayed on a merchant's electronic screen, a user wishes to register to become a member of the merchant, and can point the mobile phone at the electronic screen so that the user's mobile phone enters the interactive range of the electronic screen. When the user's mobile phone enters the interactive range of the electronic screen, the merchant's mini program can be directly displayed on the user's mobile phone based on the data communication between the user's mobile phone and the electronic screen, and the user can be guided to complete the member registration based on the mini program.

[0079] In the interactive process of the above example, the user does not need to operate the mobile phone to open the application, nor does the user need to perform a code scanning operation, which can greatly simplify the interaction process between the user and the electronic screen and improve the interaction efficiency.

[0080] The following describes in detail the technical solutions such as the device interaction method, device interaction apparatus, computer-readable medium, electronic device, and computer program product provided by the present application in combination with specific implementation methods.

[0081] Figure 3 A flow chart of a device interaction method in one embodiment of the present application is shown. The device interaction method can be performed by Figure 2 The mobile terminal 201 shown is executed, and may also be executed by the display device 202, or may also be executed by the server 203. The embodiment of the present application takes the device interaction method executed by the mobile terminal 201 as an example for description.

[0082] like Figure 3 As shown, the device interaction method in the embodiment of the present application may include the following steps S310 to S330.

[0083] S310: Acquire a spatial position of a mobile terminal relative to a display device, where the display device is used to display interactive content that can interact with the mobile terminal.

[0084] S320: Identify whether the mobile terminal enters an interactive range of the display device according to the spatial position, where the interactive range is a spatial range in which the display device can interact with the mobile terminal.

[0085] S330: If the mobile terminal enters the interaction range, an interaction interface corresponding to the interaction content is displayed on the mobile terminal according to the interaction content displayed on the display device.

[0086] In the device interaction method provided in the embodiment of the present application, by acquiring the spatial position of the mobile terminal relative to the display device, it is possible to identify whether the mobile terminal has entered the interaction range of the display device based on the spatial position, and the display device can display the interaction content to the mobile terminal within a certain interaction range; if the mobile terminal enters the interaction range, an interaction interface corresponding to the interaction content can be displayed on the mobile terminal based on the interaction content displayed on the display device; the interaction scheme implemented based on the embodiment of the present application can determine the user's interaction intention based on the spatial movement behavior of the user on the mobile terminal, actively form an interaction pairing with the mobile terminal, and directly display the interaction interface corresponding to the interaction content on the mobile terminal, thereby reducing the interaction process of the user operating the mobile terminal and improving the interaction efficiency between the user and the display device.

[0087] The following is a detailed description of each method step in the embodiments of the present application in combination with a variety of different implementation methods.

[0088] In S310, a spatial position of a mobile terminal relative to a display device is obtained, and the display device is used to display interactive content that can interact with the mobile terminal.

[0089] The spatial position of the mobile terminal relative to the display device can be a relative position in spatial orientation. For example, a three-dimensional spatial coordinate system is established with a specified position point of the display device as the coordinate origin. By obtaining the position coordinates of the mobile terminal in the coordinate system, the relative position of the mobile terminal and the display device can be determined.

[0090] The display device can communicate data with the terminal device or server in the background, so as to display interactive content that can interact with the mobile terminal under the control of the background. The interactive content includes business information related to the scene where the display device is located. For example, display devices distributed in squares, shopping malls and other places can be used to display advertising information or promotional information; display devices distributed in parking lots, transportation stations and other places can be used to display parking fee information or ride fee information; display devices distributed in conference rooms, exhibition halls and other places can be used to display check-in information or identity verification information.

[0091] In one embodiment of the present application, a method for obtaining the spatial position of a mobile terminal relative to a display device may include: obtaining position information of one or more positioning devices relative to the display device, the positioning device and the display device having a fixed positional relationship; determining a straight-line distance between the positioning device and the mobile terminal based on data communication between the positioning device and the mobile terminal; and determining the spatial position of the mobile terminal relative to the display device based on the positional relationship between the positioning device and the display device and the straight-line distance between the positioning device and the mobile terminal.

[0092] The positioning device may be a component unit of the display device, or may be an independent unit separated from the display device. The positioning device may communicate data with the mobile terminal by sending or receiving positioning data, thereby calculating the straight-line distance between the mobile terminal and the positioning device based on the positioning data, and then predicting the spatial position of the mobile terminal relative to the display device based on the straight-line distance and the positional relationship between the positioning device and the display device.

[0093] For example, an embodiment of the present application can establish a three-dimensional space coordinate system by taking a specified position point of the display device (e.g., the center point of the device) as the coordinate origin. Since the positioning device and the display device have a fixed positional relationship, the position coordinates of the positioning device in the coordinate system can be directly determined. By communicating data between the positioning device and the mobile terminal, the straight-line distance between the positioning device and the mobile terminal can be measured, and the position direction of the mobile terminal relative to the positioning device can also be determined based on the directionality of data signal propagation. After moving the position coordinates of the positioning device by the above-mentioned straight-line distance along the position direction, the position coordinates of the mobile terminal can be obtained, and the spatial position of the mobile terminal relative to the display device can be determined based on the position coordinates of the mobile terminal.

[0094] In one embodiment of the present application, determining the straight-line distance between the positioning device and the mobile terminal according to data communication between the positioning device and the mobile terminal may include the following steps:

[0095] Acquire a first sending timestamp and a first receiving timestamp of first positioning data sent by the mobile terminal to the positioning device, wherein the first sending timestamp is a timestamp recorded when the mobile terminal sends the first positioning data, and the first receiving timestamp is a timestamp recorded when the mobile terminal receives the first positioning data;

[0096] Acquire a second sending timestamp and a second receiving timestamp of the second positioning data sent by the positioning device to the mobile terminal, where the second sending timestamp is a timestamp recorded when the positioning device sends the second positioning data, and the second receiving timestamp is a timestamp recorded when the mobile terminal receives the second positioning data;

[0097] The straight-line distance between the positioning device and the mobile terminal is determined according to the first sending timestamp, the first receiving timestamp, the second sending timestamp and the second receiving timestamp.

[0098] In the embodiment of the present application, the mobile terminal sends the first positioning data to the positioning device, and the positioning device sends the second positioning data to the mobile terminal, and the straight-line distance between the positioning device and the mobile terminal is calculated based on the sending timestamp and receiving timestamp recorded by the two devices, which can reduce the distance error caused by single-direction ranging and improve the distance measurement accuracy. Moreover, by adopting the two-way ranging method, there is no need to align the positioning device and the mobile terminal in time, and even if there is a difference in the clock references of the two devices, the distance can be accurately measured, thereby improving the distance measurement efficiency.

[0099] In one embodiment of the present application, determining the straight-line distance between the positioning device and the mobile terminal based on the first sending timestamp, the first receiving timestamp, the second sending timestamp and the second receiving timestamp can include the following steps: determining the communication time difference of the mobile terminal based on the first sending timestamp and the second receiving timestamp; determining the communication time difference of the positioning device based on the second sending timestamp and the first receiving timestamp; determining the straight-line distance between the positioning device and the mobile terminal based on the communication time difference of the mobile terminal and the communication time difference of the positioning device.

[0100] Figure 4 A schematic diagram showing the principle of calculating straight-line distance based on a single two-way data communication in an embodiment of the present application is shown.

[0101] like Figure 4 As shown, when the mobile terminal sends the first positioning data to the positioning device, the first sending timestamp t11 can be recorded; when the positioning device receives the first positioning data, the first receiving timestamp t21 can be recorded. When the positioning device sends the second positioning data to the mobile terminal, the second sending timestamp t22 can be recorded; when the mobile terminal receives the second positioning data, the second receiving timestamp t12 can be recorded.

[0102] According to the first sending timestamp t11 and the second receiving timestamp t12, the communication time difference of the mobile terminal can be determined as T1 = (t12-t11). According to the second sending timestamp t21 and the first receiving timestamp t22, the communication time difference of the positioning device can be determined as T2 = (t22-t21).

[0103] On this basis, it can be determined that the data propagation time for a single one-way data communication between the mobile terminal and the positioning device is (T1-T2) / 2. Based on the propagation time and the propagation speed of the data signal, the straight-line distance between the mobile terminal and the positioning device can be calculated.

[0104] In one embodiment of the present application, in order to further improve the distance measurement accuracy, multiple data communications may be performed between the mobile terminal and the positioning device. That is, determining the straight-line distance between the positioning device and the mobile terminal according to the communication time difference of the mobile terminal and the communication time difference of the positioning device may further include: performing at least two data communications between the mobile terminal and the positioning device to obtain at least two communication time differences of the mobile terminal and at least two communication time differences of the positioning device; and determining the straight-line distance between the positioning device and the mobile terminal according to the multiple communication time differences.

[0105] Figure 5 A schematic diagram showing the principle of calculating straight-line distance based on two bidirectional data communications in one embodiment of the present application is shown.

[0106] like Figure 5 As shown, when the mobile terminal sends the first positioning data to the positioning device, the first sending timestamp t11 can be recorded; when the positioning device receives the first positioning data, the first receiving timestamp t21 can be recorded. When the positioning device sends the second positioning data to the mobile terminal, the second sending timestamp t22 can be recorded; when the mobile terminal receives the second positioning data, the second receiving timestamp t12 can be recorded.

[0107] According to the first sending timestamp t11 and the second receiving timestamp t12, the communication time difference of the mobile terminal can be determined as T1 = (t12-t11). According to the second sending timestamp t21 and the first receiving timestamp t22, the communication time difference of the positioning device can be determined as T2 = (t22-t21).

[0108] By repeating the above process and performing two-way data communication again between the mobile terminal and the positioning device, it can be determined that the second communication time difference of the positioning device is T3 = (t24-t23), and the second communication time difference of the terminal device is T4 = (t14-t13).

[0109] On this basis, it can be determined that the data propagation time for a single one-way data communication between the mobile terminal and the positioning device is (T1*T3-T2*T4) / (T1+T2+T3+T4). Based on the propagation time and the propagation speed of the data signal, the straight-line distance between the mobile terminal and the positioning device can be calculated.

[0110] In one embodiment of the present application, the first positioning data and the second positioning data are positioning data carried by a carrier signal whose bandwidth is greater than a preset width threshold, for example, wireless carrier communication can be performed based on ultra-wideband technology UWB (Ultra Wide Band). The positioning accuracy of UWB technology can reach 10-30 cm, and it has a very strong direction perception capability. UWB technology can occupy a bandwidth of more than 500Mhz within a relatively large frequency band, such as the range of about 3G-10GHz. In contrast, the bandwidth of Wi-Fi is usually only 20-80Mhz, and the latest technology can only allow Wi-Fi to have a bandwidth of 160Mhz. Moreover, unlike the sinusoidal carrier signal used by Wi-Fi, Bluetooth, or radio wireless signals, UWB uses a very fast pulse signal, a bit like radar, which gives it a unique advantage in directional positioning.

[0111] Continue to refer Figure 1 As shown, in S320, it is identified whether the mobile terminal enters the interactive range of the display device according to the spatial position, and the interactive range is the spatial range in which the display device can interact with the mobile terminal.

[0112] The embodiment of the present application can predefine the interactive range that can interact with the mobile terminal for the display device. The mobile terminal within the interactive range can interact with the display device, while the mobile terminal outside the interactive range cannot interact with the display device. By controlling the interactive range, it is possible to interact with the user only when it is determined that the user has the intention to interact, avoiding excessive interference with users who have no intention to interact.

[0113] In one embodiment of the present application, a method for defining an interaction range for a display device may include: collecting an environmental image within a preset spatial distance around the display device; constructing a virtual space for describing the surrounding environment of the display device based on the environmental image; and selecting an interaction range in the virtual space that can interact with the display device.

[0114] The embodiment of the present application adopts a method of capturing images of the surrounding environment of the display device, so as to construct a virtual space describing the surrounding environment for each display device, and then define the interaction range of the display device according to the scope and content of the virtual space.

[0115] In one embodiment of the present application, a method for selecting an interaction range in a virtual space that can interact with a display device may include: identifying a fixed obstacle in the virtual space that can block the line of sight of the display device; determining the line of sight blocking range of the fixed obstacle based on the positional relationship between the fixed obstacle and the display device; and selecting other spatial areas in the virtual space except the line of sight blocking range as the interaction range that can interact with the display device.

[0116] Fixed obstacles may be, for example, fixed buildings or fixed facilities distributed around the display device, such as walls, furniture, etc. When the user is within the line of sight obstruction range of a fixed obstacle, the user will be blocked by the fixed obstacle and will not be able to see the complete display device, thereby determining that the user cannot directly interact with the display device. Therefore, the embodiment of the present application, by means of the positioning of fixed obstacles and the division of the line of sight obstruction range in the virtual space, can select other spatial areas in the virtual space except the line of sight obstruction range as the interaction range that can interact with the display device.

[0117] Continue to refer Figure 1 As shown, in S330, if the mobile terminal enters the interaction range, an interaction interface corresponding to the interaction content is displayed on the mobile terminal according to the interaction content displayed on the display device.

[0118] In one embodiment of the present application, a method for displaying an interactive interface corresponding to interactive content on a mobile terminal based on interactive content displayed on a display device may include: obtaining an interactive request sent by the display device to the mobile terminal; parsing the interactive request to obtain interactive information carried in the interactive request and generated based on the interactive content displayed on the display device; and displaying an interactive interface corresponding to the interactive content on the mobile terminal based on the interactive information.

[0119] For example, if the interactive content displayed on the display device is a promotional advertisement of a merchant, the interactive request sent by the display device to the mobile terminal may carry interactive information generated based on the promotional advertisement, for example, the interactive information may be a mini-program jump link of the merchant. After the mobile terminal parses the mini-program jump link of the merchant from the interactive request, it may directly open the mini-program interface of the merchant based on the mini-program jump link, so that the user can browse the merchant information and purchase goods in the mini-program interface.

[0120] In one embodiment of the present application, before parsing the interaction request, it can be identified whether there is an obstacle between the display device and the mobile terminal according to the interaction request; if there is an obstacle between the display device and the mobile terminal, the interaction request is discarded.

[0121] When there is an obstacle between the display device and the mobile terminal, it means that the user has not accurately pointed the mobile terminal at the display device. Therefore, it can be determined that the user's real intention is not to interact with the display device, thereby avoiding the problem of pushing erroneous data to the user.

[0122] In one embodiment of the present application, a method for identifying whether there is an obstacle between a display device and a mobile terminal based on an interaction request may include: obtaining the signal strength of a carrier signal carrying the interaction request; if the signal strength is greater than a preset strength threshold, determining that there is no obstacle between the display device and the mobile terminal; if the signal strength is less than the strength threshold, determining that there is an obstacle between the display device and the mobile terminal.

[0123] For example, according to the communication protocol between the mobile terminal and the positioning device, a carrier signal with a specified signal strength P can be used to carry communication data. When there is an obstacle between the mobile terminal and the positioning device, the carrier signal will be attenuated to a certain extent due to the obstruction of the obstacle. For example, the strength threshold is set to 0.9P; if the signal strength of the carrier signal carrying the interaction request is attenuated to below 0.9P, it means that there is an obstacle between the mobile terminal and the positioning device; and if the signal strength of the carrier signal carrying the interaction request is greater than 0.9P, it can be determined that there is no obstacle between the mobile terminal and the positioning device.

[0124] In one embodiment of the present application, before displaying an interactive interface corresponding to the interactive content on the mobile terminal according to the interactive information, the running state of the mobile terminal can be obtained, and the running state includes an active state in which a foreground application is running or an inactive state in which the foreground application is not running; if the running state of the mobile terminal is an inactive state, the interactive information is discarded. The foreground application refers to an application with a visual interface on the mobile terminal, such as a software program that the user directly opens and uses, or a system desktop program. When the running state of the mobile terminal is an inactive state, it means that the user is not currently using the mobile phone, and it can be determined that the user's true intention is not to interact with the display device, thereby further avoiding the problem of pushing erroneous data to the user.

[0125] Figure 6 A schematic diagram showing device interaction in an application scenario according to an embodiment of the present application is shown.

[0126] like Figure 6 As shown, taking interactive lucky draw as an example, merchants can display membership benefits to users through display devices, such as members can participate in lucky draws organized by merchants. When the user points the mobile phone to the display device, it can be determined that the user's mobile phone has entered the interactive range of the display device, so that based on the interactive request sent by the display device to the user's mobile phone, the merchant's applet can be opened on the user's mobile phone to guide the user to register as a member of the merchant. At the same time, the display device can further display guidance information to guide users to participate in member lucky draws. After the lucky draw is completed, the user's mobile phone can be notified of the lucky draw results.

[0127] As shown in the example of the application scenario above, users only need to point their mobile phone at the screen to jump to the associated mini program. The screen will then guide the next step of interaction, achieving two-way interaction and further tapping the value of offline large screens.

[0128] In one embodiment of the present application, a mobile terminal and a display device may perform bidirectional interaction based on the IEEE 802.15.4z standard.

[0129] Figure 7 A two-way communication layered architecture for implementing two-way interaction in one embodiment of the present application is shown.

[0130] like Figure 7 As shown, the bidirectional communication layered architecture for realizing bidirectional interaction in the embodiment of the present application may include a business function layer (ie, business layer), an event control layer (ie, application layer), a protocol interface layer (ie, transport layer), and a link layer.

[0131] The link layer is used to process the underlying adaptation logic of data communication, such as packet sending or packet parsing based on UWB, USB, or Socket communication methods.

[0132] The protocol interface layer is used for data encapsulation or data parsing, and can also implement functions such as packet loss retransmission, packet receipt confirmation, heartbeat management, large data packet congestion control, and legality checking.

[0133] The event control layer is used to distribute messages through the observer mode to implement functions such as sending task management, request task management, and data monitoring.

[0134] The business function layer is used to process specific instructions, such as implementing business functions such as face recognition, member management, and launching merchant mini-programs.

[0135] In one embodiment of the present application, in order to ensure that data leakage, security attacks and other problems will not occur during the process of two-way interaction between users, the present application can also add a security layer to the original communication structure to improve the confidentiality and integrity of two-way interactive communication.

[0136] The security layer can include multiple functional modules such as functional logic, protocol management, key management, and cryptographic suites. It is flexible and scalable in structure, achieving high modularity, high cohesion and low coupling. The cryptographic suite can be dynamically configured and flexibly tailored. The sub-protocol management is isolated and uncoupled, and easy to expand. It is safe and robust in function, achieving two-way authentication and data protection, and improving overall security.

[0137] In terms of two-way authentication, identity authentication can be achieved based on algorithms such as CTR-DRBG, ECDSA, X.509, and RSA.

[0138] In terms of data protection, key negotiation can be achieved based on algorithms such as CTR-DRBG, DH, and ECDH, key calculation can be achieved based on the HMAC algorithm, and transmission protection can be achieved based on algorithms such as AES, AES-CBC, CHACHA20, and AES-GCM.

[0139] In one embodiment of the present application, the protocol packet format used in a two-way interaction may include the following multiple fields.

[0140] Message header (16 bytes), message header, 16 bytes of 0xFF. This header may appear garbled, so the parsing process should start with the magic header appearing as the packet content.

[0141] Magic header (5 bytes), magic header, marked as a custom message. The ASCII code of wjifxc is 0x77, 0x6A, 0x6A, 0x66, 0x78, 0x63.

[0142] message version (4 bytes), message version, Big-Endian int.

[0143] tcp package id (8 bytes), the package id of the TCP protocol packet contained in this message is used for fast detection, packet loss logic, Big-Endian long.

[0144] message bodylen (4 bytes), the overall length of the message body, marking the length of the content from the next field after this field to the end of the message, Big-Endian int.

[0145] body begin pos (4 bytes), the offset of the bodydigestlen content in the message body from the beginning of the message, which is the data length of message header+magic header+tcp package id+messagebody len+body beginpos+custominfo, Big-Endian int.

[0146] custominfo(>=0bytes), customized data content, used for protocol upgrade, compatible with future communication protocol expansion, no content yet.

[0147] body diges len (4 bytes) message (body content) summary length, Big-Endian int.

[0148] body digest, message (body content) digest MD5 digest algorithm.

[0149] body content len ​​(4 bytes), message (body content) length, Big-Endian int.

[0150] body content, message content.

[0151] magic tail (3 bytes), magic tail, used to mark the end of a message. The content is the ASCII code of cxfjjw 0x63, 0x78, 0x66, 0x6A, 0x6A, 0X77.

[0152] Based on the introduction of the above embodiments and application scenarios, it can be seen that two-way interaction between offline screens and mobile phones is achieved. Users only need to point their mobile phones at the screen to jump to the associated mini-program. The screen will then guide the next step of interaction, achieving two-way interaction and further tapping the value of offline large screens. According to membership business statistics, this solution is estimated to effectively reduce user churn rate by 6%. In addition, richer interactions will bring better new customer acquisition effects and brand stickiness.

[0153] It should be noted that although the steps of the method in the present application are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.

[0154] The following introduces an apparatus embodiment of the present application, which can be used to execute the device interaction method in the above-mentioned embodiment of the present application. Figure 8 The structure block diagram of the device interaction apparatus provided in the embodiment of the present application is schematically shown. Figure 8 As shown, the device interaction apparatus 800 may include:

[0155] A positioning module 810 is configured to obtain a spatial position of a mobile terminal relative to a display device, wherein the display device is used to display interactive content that can interact with the mobile terminal;

[0156] An identification module 820 is configured to determine whether the mobile terminal enters an interaction range of the display device according to the spatial position, where the interaction range is a spatial range in which the display device can interact with the mobile terminal;

[0157] The display module 830 is configured to display an interaction interface corresponding to the interaction content on the mobile terminal according to the interaction content displayed on the display device if the mobile terminal enters the interaction range.

[0158] In some embodiments of the present application, based on the above technical solution, the positioning module further includes:

[0159] A position acquisition module, configured to acquire position information of one or more positioning devices relative to the display device, wherein the positioning device has a fixed position relationship with the display device;

[0160] a distance determination module, configured to determine a straight-line distance between the positioning device and the mobile terminal according to data communication between the positioning device and the mobile terminal;

[0161] The position determination module is configured to determine the spatial position of the mobile terminal relative to the display device according to the positional relationship between the positioning device and the display device and the straight-line distance between the positioning device and the mobile terminal.

[0162] In some embodiments of the present application, based on the above technical solution, the distance determination module further includes:

[0163] A first timing module is configured to obtain a first sending timestamp and a first receiving timestamp of first positioning data sent by the mobile terminal to the positioning device, wherein the first sending timestamp is a timestamp recorded when the mobile terminal sends the first positioning data, and the first receiving timestamp is a timestamp recorded when the mobile terminal receives the first positioning data;

[0164] A second timing module is configured to obtain a second sending timestamp and a second receiving timestamp of second positioning data sent by the positioning device to the mobile terminal, wherein the second sending timestamp is a timestamp recorded when the positioning device sends the second positioning data, and the second receiving timestamp is a timestamp recorded when the mobile terminal receives the second positioning data;

[0165] The distance calculation module is configured to determine the straight-line distance between the positioning device and the mobile terminal according to the first sending timestamp, the first receiving timestamp, the second sending timestamp and the second receiving timestamp.

[0166] In some embodiments of the present application, based on the above technical solution, the first positioning data and the second positioning data are positioning data carried by a carrier signal having a frequency bandwidth greater than a preset width threshold.

[0167] In some embodiments of the present application, based on the above technical solution, the distance calculation module further includes:

[0168] A first time difference calculation module, configured to determine a communication time difference of the mobile terminal according to the first sending timestamp and the second receiving timestamp;

[0169] A second time difference calculation module is configured to determine the communication time difference of the positioning device according to the second sending timestamp and the first receiving timestamp;

[0170] The straight-line distance calculation module is configured to determine the straight-line distance between the positioning device and the mobile terminal according to the communication time difference of the mobile terminal and the communication time difference of the positioning device.

[0171] In some embodiments of the present application, based on the above technical solution, the straight-line distance calculation module is further configured to: perform at least two data communications between the mobile terminal and the positioning device to obtain at least two communication time differences of the mobile terminal and at least two communication time differences of the positioning device; determine the straight-line distance between the positioning device and the mobile terminal based on multiple communication time differences.

[0172] In some embodiments of the present application, based on the above technical solution, the device interaction device further includes a range selection module, and the range selection module is configured to: collect environmental images within a preset spatial distance around the display device; construct a virtual space for describing the surrounding environment of the display device based on the environmental image; and select an interaction range in the virtual space that can interact with the display device.

[0173] In some embodiments of the present application, based on the above technical solution, the range selection module is further configured to: identify fixed obstacles in the virtual space that can block the line of sight of the display device; determine the line of sight blocking range of the fixed obstacle based on the positional relationship between the fixed obstacle and the display device; and select other spatial areas in the virtual space except the line of sight blocking range as the interactive range that can interact with the display device.

[0174] In some embodiments of the present application, based on the above technical solution, the display module further includes:

[0175] a request acquisition module, configured to acquire an interaction request sent by the display device to the mobile terminal;

[0176] a request parsing module configured to parse the interaction request to obtain interaction information carried in the interaction request and generated according to the interaction content displayed on the display device;

[0177] The interface display module is configured to display an interaction interface corresponding to the interaction content on the mobile terminal according to the interaction information.

[0178] In some embodiments of the present application, based on the above technical solution, the display module further includes:

[0179] an obstacle identification module, configured to identify whether there is an obstacle between the display device and the mobile terminal according to the interaction request;

[0180] The request discarding module is configured to discard the interaction request if there is an obstacle between the display device and the mobile terminal.

[0181] In some embodiments of the present application, based on the above technical solution, the obstacle identification module is further configured to: obtain the signal strength of the carrier signal carrying the interaction request; if the signal strength is greater than a preset strength threshold, determine that there is no obstacle between the display device and the mobile terminal; if the signal strength is less than the strength threshold, determine that there is an obstacle between the display device and the mobile terminal.

[0182] In some embodiments of the present application, based on the above technical solution, the display module further includes:

[0183] a state acquisition module, configured to acquire an operating state of the mobile terminal, wherein the operating state includes an active state in which a foreground application is running or an inactive state in which a foreground application is not running;

[0184] The information discarding module is configured to discard the interaction information if the running state of the mobile terminal is the inactive state.

[0185] The specific details of the device interaction apparatus provided in each embodiment of the present application have been described in detail in the corresponding method embodiments and will not be repeated here.

[0186] Fig. 9 The structure block diagram of a computer system for implementing an electronic device according to an embodiment of the present application is schematically shown.

[0187] It should be noted that Fig. 9 The computer system 900 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0188] like Fig. 9As shown, the computer system 900 includes a central processing unit 901 (CPU), which can perform various appropriate actions and processes according to the program stored in the read-only memory 902 (ROM) or the program loaded from the storage part 908 to the random access memory 903 (RAM). Various programs and data required for system operation are also stored in the random access memory 903. The central processing unit 901, the read-only memory 902 and the random access memory 903 are connected to each other through a bus 904. An input / output interface 905 (Input / Output interface, i.e., I / O interface) is also connected to the bus 904.

[0189] The following components are connected to the input / output interface 905: an input section 906 including a keyboard, a mouse, etc.; an output section 907 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 908 including a hard disk, etc.; and a communication section 909 including a network interface card such as a LAN card, a modem, etc. The communication section 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to the input / output interface 905 as needed. A removable medium 911, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 910 as needed so that a computer program read therefrom is installed into the storage section 908 as needed.

[0190] In particular, according to an embodiment of the present application, the process described in each method flow chart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer readable medium, and the computer program contains a program code for executing the method shown in the flow chart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 909, and / or installed from the removable medium 911. When the computer program is executed by the central processor 901, various functions defined in the system of the present application are executed.

[0191] It should be noted that the computer-readable medium shown in the embodiment of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by an instruction execution system, device or device or used in combination with it. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a computer-readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer readable signal media may also be any computer readable medium other than computer readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0192] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the above-mentioned module, program segment or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0193] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0194] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the implementation methods of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the implementation methods of the present application.

[0195] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary technical means in the art that are not disclosed in the present application.

[0196] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A device interaction method, characterized in that: include: Acquiring a spatial position of a mobile terminal relative to a display device, wherein the display device is used to display interactive content that can interact with the mobile terminal; Identify, according to the spatial position, whether the mobile terminal has entered an interaction range of the display device, where the interaction range is a spatial range within which the display device can interact with the mobile terminal; If the mobile terminal enters the interaction range, an interaction interface corresponding to the interaction content is displayed on the mobile terminal according to the interaction content displayed on the display device.

2. The device interaction method according to claim 1, characterized in that: Obtain the spatial position of the mobile terminal relative to the display device, including: Acquire position information of one or more positioning devices relative to the display device, wherein the positioning device has a fixed position relationship with the display device; determining a straight-line distance between the positioning device and the mobile terminal according to data communication between the positioning device and the mobile terminal; The spatial position of the mobile terminal relative to the display device is determined according to the positional relationship between the positioning device and the display device and the straight-line distance between the positioning device and the mobile terminal.

3. The device interaction method according to claim 2, characterized in that: Determining a straight-line distance between the positioning device and the mobile terminal according to data communication between the positioning device and the mobile terminal includes: Acquire a first sending timestamp and a first receiving timestamp of first positioning data sent by the mobile terminal to the positioning device, wherein the first sending timestamp is a timestamp recorded when the mobile terminal sends the first positioning data, and the first receiving timestamp is a timestamp recorded when the mobile terminal receives the first positioning data; Acquire a second sending timestamp and a second receiving timestamp of second positioning data sent by the positioning device to the mobile terminal, wherein the second sending timestamp is a timestamp recorded when the positioning device sends the second positioning data, and the second receiving timestamp is a timestamp recorded when the mobile terminal receives the second positioning data; The straight-line distance between the positioning device and the mobile terminal is determined according to the first sending timestamp, the first receiving timestamp, the second sending timestamp, and the second receiving timestamp.

4. The device interaction method according to claim 3, characterized in that: The first positioning data and the second positioning data are positioning data carried by a carrier signal having a frequency bandwidth greater than a preset bandwidth threshold.

5. The device interaction method according to claim 3, characterized in that: Determining a straight-line distance between the positioning device and the mobile terminal according to the first sending timestamp, the first receiving timestamp, the second sending timestamp, and the second receiving timestamp includes: Determine a communication time difference of the mobile terminal according to the first sending timestamp and the second receiving timestamp; Determine a communication time difference of the positioning device according to the second sending timestamp and the first receiving timestamp; The straight-line distance between the positioning device and the mobile terminal is determined according to the communication time difference of the mobile terminal and the communication time difference of the positioning device.

6. The device interaction method according to claim 5, characterized in that: Determining the straight-line distance between the positioning device and the mobile terminal according to the communication time difference of the mobile terminal and the communication time difference of the positioning device includes: Perform at least two data communications between the mobile terminal and the positioning device to obtain at least two communication time differences of the mobile terminal and at least two communication time differences of the positioning device; The straight-line distance between the positioning device and the mobile terminal is determined according to the plurality of communication time differences.

7. The device interaction method according to claim 1, characterized in that: Before identifying whether the mobile terminal enters the interactive range of the display device according to the spatial position, the method further includes: Collecting an environmental image within a preset spatial distance around the display device; constructing a virtual space for describing the surrounding environment of the display device according to the environment image; An interaction range capable of interacting with the display device is selected in the virtual space.

8. The device interaction method according to claim 7, characterized in that: Selecting an interactive range in the virtual space that can interact with the display device includes: Identifying fixed obstacles in the virtual space that can block the line of sight of the display device; Determining a sight-blocking range of the fixed obstacle according to a positional relationship between the fixed obstacle and the display device; Other spatial areas in the virtual space except the sight-blocking range are selected as the interaction range that can interact with the display device.

9. The device interaction method according to claim 1, characterized in that: Displaying an interactive interface corresponding to the interactive content on the mobile terminal according to the interactive content displayed on the display device includes: Acquiring an interaction request sent by the display device to the mobile terminal; Parsing the interaction request to obtain interaction information carried in the interaction request and generated according to the interaction content displayed on the display device; An interaction interface corresponding to the interaction content is displayed on the mobile terminal according to the interaction information.

10. The device interaction method according to claim 9, characterized in that: Before parsing the interaction request, the method further includes: identifying, according to the interaction request, whether there is an obstacle between the display device and the mobile terminal; If there is an obstacle between the display device and the mobile terminal, the interaction request is discarded.

11. The device interaction method according to claim 10, characterized in that: Identifying whether there is an obstacle between the display device and the mobile terminal according to the interaction request includes: Acquire the signal strength of the carrier signal carrying the interaction request; If the signal strength is greater than a preset strength threshold, it is determined that there is no obstacle between the display device and the mobile terminal; If the signal strength is less than the strength threshold, it is determined that there is an obstacle between the display device and the mobile terminal.

12. The device interaction method according to claim 9, characterized in that: Before displaying an interaction interface corresponding to the interaction content on the mobile terminal according to the interaction information, the method further includes: Acquiring the running state of the mobile terminal, the running state including an active state in which a foreground application is running or an inactive state in which a foreground application is not running; If the running state of the mobile terminal is the inactive state, the interaction information is discarded.

13. A device interaction apparatus, characterized in that: include: A positioning module, configured to obtain a spatial position of a mobile terminal relative to a display device, wherein the display device is used to display interactive content that can interact with the mobile terminal; an identification module configured to identify, according to the spatial position, whether the mobile terminal enters an interaction range of the display device, wherein the interaction range is a spatial range within which the display device can interact with the mobile terminal; The display module is configured to display an interaction interface corresponding to the interaction content on the mobile terminal according to the interaction content displayed on the display device if the mobile terminal enters the interaction range.

14. A computer readable medium, characterized in that The computer-readable medium stores a computer program, and when the computer program is executed by a processor, the device interaction method according to any one of claims 1 to 12 is implemented.

15. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; Wherein, the processor is configured to execute the executable instructions to implement the device interaction method as described in any one of claims 1 to 12.

16. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the device interaction method described in any one of claims 1 to 12 is implemented.

Images