Interaction system, interaction method, and electronic device

Abstract

The present application provides an interaction system, an interaction method, and an electronic device. The interaction system comprises a first electronic device and a second electronic device, wherein the first electronic device is used for determining at least three electronic devices as positioning reference points in response to a selection operation of a user, and determining that the second electronic device is used for obtaining first position information; the second electronic device is used for sending the first position information to the first electronic device; the first electronic device is also used for receiving the first position information, and displaying a game interface on the basis of the first position information. In embodiments of the present application, positioning reference points and a positioning device can be customized, a fixed positioning reference point is not required, and the positioning reference points and the positioning device can be any electronic devices having distance sensing capabilities, such that a user can conveniently select the positioning reference points and the positioning device, and the application scenario and the user interaction mode are expanded.

Description

Interactive system, interactive method and electronic device

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on January 29, 2024, with application number 202410120830.1 and application name “An interactive system, interactive method and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of electronic devices, and more specifically, to an interaction system, an interaction method and an electronic device. Background Art

[0003] With the development of communication, electronics, display and other technologies, users have an increasing demand for somatosensory games with rich and direct input forms. When users play somatosensory games, the electronic devices running the somatosensory games need to obtain the user's position to better expand the application scenarios of somatosensory games. However, current electronic devices mainly capture user movements through handheld devices such as handles and fitness rings, and use depth cameras to obtain the user's position. Since the depth camera is fixed and does not have mobile properties, and the position judgment of the depth camera is limited to the visual range of the depth camera, the judgment range is small and the flexibility is poor. Based on this, how to provide a better interactive method has become a technical problem that needs to be solved urgently.

[0004] Summary of the Invention

[0005] The present application provides an interactive system, an interactive method, and an electronic device, which can customize positioning reference points and positioning devices, and determine the user's real-time location through the positioning device, and then render and display a game interface based on the user's real-time location. There is no need for a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities, which facilitates the user to select the positioning reference point and positioning device.

[0006] In a first aspect, an interactive system is provided, which includes a first electronic device and a second electronic device, wherein the first electronic device is used to determine at least three electronic devices as positioning reference points to establish a spatial coordinate system in response to a user's selection operation, and to determine the second electronic device for obtaining first position information, and the at least three electronic devices do not include the first electronic device and the second electronic device; the second electronic device is used to send the first position information to the first electronic device, and the first position information is used to indicate the spatial coordinates of the second electronic device in the spatial coordinate system; the first electronic device is also used to receive the first position information and display a game interface according to the first position information.

[0007] In an embodiment of the present application, the first electronic device can customize the positioning reference point and positioning device, and determine the user's real-time location through the positioning device, and then render and display the game interface based on the user's real-time location. The interactive method provided by this application does not require a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities. This facilitates the user to select the positioning reference point and positioning device, greatly expands the application scenarios and user interaction methods, and helps to improve the user experience.

[0008] In some embodiments, the first electronic device and the at least three electronic devices may be devices in an intelligent driving device, and the second electronic device may be a mobile terminal carried by a user (for example, a mobile phone, a tablet, a wearable device, etc.).

[0009] In combination with the first aspect, in certain implementations of the first aspect, the second electronic device is further used to send first action information to the first electronic device based on its own computing power; the first electronic device is specifically used to display the game interface based on the first action information and the first position information.

[0010] In an embodiment of the present application, the positioning device can also collect the user's movements, and the first electronic device can then render and display the game interface based on the user's real-time location and the user's real-time movements. The interactive method provided by this application does not require a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities. This facilitates the user to select the positioning reference point and positioning device, greatly expanding the application scenarios and user interaction methods, and helping to improve the user experience.

[0011] In combination with the first aspect, in some implementations of the first aspect, the first action information is used to directly indicate an action of the first user.

[0012] In combination with the first aspect, in certain implementations of the first aspect, the first action information includes action data of a motion sensor, and the first electronic device is specifically used to: determine the action of the first user based on the first action information; and display the game interface based on the action of the first user and the first position information.

[0013] In combination with the first aspect, in certain implementations of the first aspect, the second electronic device is further used to send first action information to one or more electronic devices among the at least three electronic devices, and the first action information includes action data of the action sensor; one or more electronic devices among the at least three electronic devices are used to determine the action of the first user based on the first action information; one or more electronic devices among the at least three electronic devices are also used to send first indication information to the first electronic device, and the first indication information is used to directly indicate the action of the first user; the first electronic device is specifically used to display a game interface based on the action of the first user and the first position information.

[0014] For example, the at least three electronic devices include a fourth electronic device, and the computing power of the fourth electronic device is stronger than that of the second electronic device. The second electronic device can send first action information including action data of a motion sensor to the fourth electronic device. The fourth electronic device determines the action of the first user based on the first action information, and sends indication information for indicating the action of the first user to the first electronic device. Then, the first electronic device can display a game interface based on the action of the first user and the first position information.

[0015] In an embodiment of the present application, after the second electronic device collects the user's motion data, it can determine the user's motion based on the user's motion data, or it can send the motion data to other electronic devices with computing power in the network, and let other electronic devices determine the user's motion, thereby fully utilizing the capabilities of distributed networking, reducing the performance requirements for the second electronic device, improving the applicability of the method, and helping to enhance the user experience.

[0016] In combination with the first aspect, in certain implementations of the first aspect, the first electronic device is also used to determine the spatial coordinates of the first electronic device in the spatial coordinate system; the first electronic device is specifically used to display the game interface based on the first action information, the first position information and the spatial coordinates of the first electronic device in the spatial coordinate system.

[0017] In an embodiment of the present application, the first electronic device can also determine the positional relationship between itself and the user, and can then render and display the game interface based on the positional relationship between itself and the user and the user's real-time actions. The interactive method provided by this application does not require a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities, which facilitates the user to select the positioning reference point and positioning device, greatly expands the application scenarios and user interaction methods, and helps to improve the user experience.

[0018] In combination with the first aspect, in certain implementations of the first aspect, the first electronic device is specifically configured to, in response to a user's selection operation, confirm that the at least three electronic devices are the positioning reference points when it is determined that the at least three electronic devices are not collinear.

[0019] In combination with the first aspect, in some implementations of the first aspect, the first electronic device is further used to output prompt information when it is determined that the at least three electronic devices are collinear, where the prompt information is used to prompt how to determine the positions of the at least three electronic devices.

[0020] Illustratively, the first electronic device may determine whether the at least three electronic devices are collinear based on distances between the at least three electronic devices.

[0021] In combination with the first aspect, in certain implementations of the first aspect, the system also includes a third electronic device, and the first electronic device is further used to determine that the third electronic device is used to obtain second position information in response to a user's selection operation; the third electronic device is used to send the second position information to the first electronic device, and the second position information is used to indicate the spatial coordinates of the third electronic device in the spatial coordinate system; the first electronic device is specifically used to display a game interface based on the first position information and the second position information.

[0022] In an embodiment of the present application, the first electronic device can customize the positioning reference point and multiple positioning devices, and determine the real-time locations of multiple users through the multiple positioning devices, and then render and display the game interface based on the real-time locations of the multiple users. The interactive method provided by this application does not require a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities. This facilitates the user to select the positioning reference point and positioning device, greatly expands the application scenarios and user interaction methods, and helps to improve the user experience.

[0023] In combination with the first aspect, in some implementations of the first aspect, the second electronic device is further used to send first action information to the first electronic device; the third electronic device is further used to send second action information to the first electronic device; and the first electronic device is specifically used to display the game interface based on the first action information, the first position information, the second action information, and the second position information.

[0024] In combination with the first aspect, in certain implementations of the first aspect, the first electronic device is also used to determine the spatial coordinates of the first electronic device in the spatial coordinate system; the first electronic device is specifically used to display the game interface based on the first action information, the first position information, the second action information, the second position information and the spatial coordinates of the first electronic device in the spatial coordinate system.

[0025] In an embodiment of the present application, the first electronic device can also determine the positional relationship between itself and multiple users, and then the first electronic device can render and display the game interface based on the positional relationship between itself and the multiple users and the real-time actions of the multiple users. The interactive method provided by this application does not require a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities, which facilitates the user to select the positioning reference point and positioning device, greatly expands the application scenarios and user interaction methods, and helps to improve the user experience.

[0026] In combination with the first aspect, in certain implementations of the first aspect, the system also includes a third electronic device, and the first electronic device is further used to determine, in response to a user's selection operation, that the third electronic device is used to obtain second position information; the second electronic device is further used to send first action information to the first electronic device; the first electronic device is specifically used to display a first game interface based on the first position information and the first action information; the third electronic device is used to send the second position information and second action information to the first electronic device, and the second position information is used to indicate the spatial coordinates of the third electronic device in the spatial coordinate system; the first electronic device is also used to update the first game interface to a second game interface based on the second position information and the second action information.

[0027] In combination with the first aspect, in certain implementations of the first aspect, the at least three electronic devices include a fourth electronic device, a fifth electronic device, and a sixth electronic device, the first electronic device is one of a computer, a television, and a mobile phone, the second electronic device and the third electronic device are wearable devices, and the fourth electronic device, the fifth electronic device, and the sixth electronic device are Internet of Things (IoT) devices or wearable devices.

[0028] In a second aspect, an interaction method is provided, which is applied to a first electronic device, and the method includes: in response to a user's selection operation, determining at least three electronic devices as positioning reference points to establish a spatial coordinate system, and determining a second electronic device for obtaining first position information, the at least three electronic devices do not include the first electronic device and the second electronic device; receiving the first position information sent by the second electronic device, the first position information being used to indicate the spatial coordinates of the second electronic device in the spatial coordinate system; and displaying a game interface according to the first position information.

[0029] In combination with the second aspect, in some implementations of the second aspect, the method also includes: receiving first action information sent by the second electronic device; and displaying the game interface based on the first position information, including: displaying the game interface based on the first action information and the first position information.

[0030] In combination with the second aspect, in some implementations of the second aspect, the first action information is used to directly indicate an action of the first user.

[0031] In combination with the second aspect, in certain implementations of the second aspect, the first action information includes action data of a motion sensor, and displaying a game interface based on the first position information includes: determining the action of the first user based on the first action information; and displaying the game interface based on the action of the first user and the first position information.

[0032] In combination with the second aspect, in certain implementations of the second aspect, the method also includes: determining the spatial coordinates of the first electronic device in the spatial coordinate system; displaying the game interface based on the first action information and the first position information includes: displaying the game interface based on the first action information, the first position information and the spatial coordinates of the first electronic device in the spatial coordinate system.

[0033] In combination with the second aspect, in certain implementations of the second aspect, in response to a user's selection operation, determining at least three electronic devices as positioning reference points to establish a spatial coordinate system includes: in response to a user's selection operation, when it is determined that the at least three electronic devices are not collinear, confirming the at least three electronic devices as positioning reference points.

[0034] In combination with the second aspect, in some implementations of the second aspect, the method further includes: when it is determined that the at least three electronic devices are collinear, outputting prompt information, where the prompt information is used to prompt how to determine the positions of the at least three electronic devices.

[0035] In combination with the second aspect, in certain implementations of the second aspect, the method further includes: in response to a user's selection operation, determining that a third electronic device is used to obtain second position information; receiving the second position information sent by the third electronic device, the second position information being used to indicate the spatial coordinates of the third electronic device in the spatial coordinate system; and displaying a game interface based on the first position information, including: displaying a game interface based on the first position information and the second position information.

[0036] In combination with the second aspect, in some implementations of the second aspect, the method also includes: receiving first action information sent by the second electronic device; receiving second action information sent by the third electronic device; and displaying the game interface based on the first position information and the second position information, including: displaying the game interface based on the first action information, the first position information, the second action information, and the second position information.

[0037] In combination with the second aspect, in certain implementations of the second aspect, the method also includes: determining the spatial coordinates of the first electronic device in the spatial coordinate system; displaying the game interface based on the first action information, the first position information, the second action information, and the second position information, including: displaying the game interface based on the first action information, the first position information, the second action information, the second position information and the spatial coordinates of the first electronic device in the spatial coordinate system.

[0038] In combination with the second aspect, in certain implementations of the second aspect, the method further includes: in response to a user's selection operation, determining that a third electronic device is used to obtain second position information; receiving first action information sent by the second electronic device; displaying a game interface based on the first position information, including: displaying a first game interface based on the first position information and the first action information; the method further includes: receiving the second position information and second action information sent by the third electronic device, the second position information being used to indicate the spatial coordinates of the third electronic device in the spatial coordinate system; updating the first game interface to the second game interface based on the second position information and the second action information.

[0039] In combination with the second aspect, in certain implementations of the second aspect, the at least three electronic devices include a fourth electronic device, a fifth electronic device, and a sixth electronic device, the first electronic device is one of a computer, a television, and a mobile phone, the second electronic device and the third electronic device are wearable devices, and the fourth electronic device, the fifth electronic device, and the sixth electronic device are Internet of Things (IoT) devices or wearable devices.

[0040] It should be understood that the description of the beneficial effects of the second aspect can refer to the description of the beneficial effects of the first aspect, and for the sake of brevity, they will not be repeated here.

[0041] In a third aspect, an interaction method is provided, which is applied to a first electronic device, and includes: determining a second electronic device as an interactive device in response to a user's selection operation, and determining a distance between the first electronic device and the second electronic device; and displaying a game interface according to the distance between the first electronic device and the second electronic device.

[0042] In an embodiment of the present application, the first electronic device can run an online game and dynamically adjust the game interface according to the real-time distance between it and the second electronic device, thereby expanding the application scenarios and user interaction methods and helping to enhance the user experience.

[0043] In combination with the third aspect, in some implementations of the third aspect, the method further includes: synchronizing the game interface to the second electronic device so that the second electronic device displays the game interface.

[0044] In combination with the third aspect, in certain implementations of the third aspect, the game interface includes one or more controls, and the method further includes: updating the game interface in response to user operations on the one or more controls.

[0045] In a fourth aspect, an interaction method is provided, which includes: in response to a user's selection, determining a first device, a second device, and a third device as positioning reference points to establish a spatial coordinate system, and determining a first electronic device to obtain first position information, wherein the first device, the second device, and the third device are devices in a vehicle; receiving the first position information sent by the first electronic device, the first position information being used to indicate the spatial coordinates of the first electronic device in the spatial coordinate system; and displaying a game interface based on the first position information.

[0046] In an embodiment of the present application, the user can select multiple devices within the vehicle as positioning reference points, and the first electronic device as a positioning device, so that the vehicle can determine the user's position and display the game interface in real time based on the user's position, which greatly expands the way the vehicle interacts with the user and helps to improve the user experience.

[0047] In combination with the fourth aspect, in certain implementations of the fourth aspect, the method further includes: receiving first action information sent by the first electronic device; and displaying the game interface based on the first position information, including: displaying the game interface based on the first action information and the first position information.

[0048] In combination with the fourth aspect, in certain implementations of the fourth aspect, the first action information is used to directly indicate an action of the first user.

[0049] In combination with the fourth aspect, in certain implementations of the fourth aspect, the first action information includes action data of a motion sensor, and displaying a game interface based on the first position information includes: determining the action of the first user based on the first action information; and displaying the game interface based on the action of the first user and the first position information.

[0050] In combination with the fourth aspect, in certain implementations of the fourth aspect, the first display device displays the game interface, and the method also includes: determining the spatial coordinates of the first display device in the spatial coordinate system; displaying the game interface based on the first action information and the first position information includes: displaying the game interface based on the first action information, the first position information and the spatial coordinates of the first display device in the spatial coordinate system.

[0051] In combination with the fourth aspect, in certain implementations of the fourth aspect, the method further includes: in response to a user's selection operation, determining that a user of the second electronic device obtains second location information; receiving the second location information sent by the second electronic device, the second location information being used to indicate the spatial coordinates of the second electronic device in the spatial coordinate system; and displaying a game interface based on the first location information, including: displaying a game interface based on the first location information and the second location information.

[0052] In combination with the fourth aspect, in certain implementations of the fourth aspect, the method further includes: receiving first action information sent by the second electronic device; receiving second action information sent by the second electronic device; and displaying a game interface based on the first position information and the second position information, including: displaying the game interface based on the first action information, the first position information, the second action information, and the second position information.

[0053] In combination with the fourth aspect, in certain implementations of the fourth aspect, the game interface includes a first game interface and a second game interface, the first display device displays the first game interface, and the second display device displays the second game interface, and the method also includes: determining the spatial coordinates of the first display device and the second display device in the spatial coordinate system; displaying the game interface according to the first action information, the first position information, the second action information, and the second position information, including: displaying the first game interface according to the first action information, the first position information and the spatial coordinates of the first display device in the spatial coordinate system, and displaying the second game interface according to the second action information, the second position information and the spatial coordinates of the second display device in the spatial coordinate system.

[0054] In conjunction with the fourth aspect, in certain implementations of the fourth aspect, the method further includes: determining an auxiliary positioning reference point, so that the first electronic device calibrates the spatial coordinates of the first electronic device in the spatial coordinate system according to the coordinates of the auxiliary positioning reference point;

[0055] In combination with the fourth aspect, in certain implementations of the fourth aspect, the first device, the second device, and the third device are audio devices and / or display devices, and the first electronic device is a wearable device.

[0056] In a fifth aspect, an electronic device is provided, which includes one or more processors; one or more memories; the one or more memories store one or more computer programs, and the one or more computer programs include instructions, which, when executed by the one or more processors, enable the above aspects or any possible implementation of the above aspects to be executed.

[0057] In a sixth aspect, a computer-readable storage medium is provided, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the first aspect and any possible implementation method of the first aspect are executed.

[0058] In a seventh aspect, a computer program product is provided, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the first aspect and any possible implementation method of the first aspect are executed.

[0059] In an eighth aspect, a computer program is provided, which, when executed on a computer, enables the method in the first aspect and any possible implementation thereof to be executed.

[0060] The ninth aspect is an electronic device according to an embodiment of the present application, which includes modules / units for executing the above aspects or any possible design method of the above aspects; these modules / units can be implemented through hardware, or corresponding software can be implemented through hardware.

[0061] In the tenth aspect, a device is provided, comprising at least one processor coupled to at least one memory, and the at least one processor is used to execute a computer program or instruction stored in the at least one memory so that the device executes the fourth aspect or any possible implementation of the fourth aspect.

[0062] In the eleventh aspect, an intelligent driving device is provided, which includes an apparatus as in any possible implementation of the tenth aspect.

[0063] In combination with the eleventh aspect, in certain implementations of the eleventh aspect, the intelligent driving device is a vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] FIG1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application.

[0065] FIG2 is a block diagram of the software structure of the electronic device provided in an embodiment of the present application.

[0066] FIG3 is a schematic diagram of ranging provided in an embodiment of the present application.

[0067] FIG4 is an architecture diagram of an electronic device provided in an embodiment of the present application.

[0068] FIG5 is a set of GUIs provided in an embodiment of the present application.

[0069] FIG6 is another set of GUIs provided in an embodiment of the present application.

[0070] FIG7 is another set of GUIs provided in an embodiment of the present application.

[0071] FIG8 is another set of GUIs provided in an embodiment of the present application.

[0072] FIG9 is another set of GUIs provided in an embodiment of the present application.

[0073] FIG10 is another set of GUIs provided in an embodiment of the present application.

[0074] FIG11 is another set of GUIs provided by an embodiment of the present application.

[0075] FIG12 is another set of GUIs provided by an embodiment of the present application.

[0076] FIG13 is a schematic flowchart of the interaction method provided in an embodiment of the present application.

[0077] FIG14 is a schematic diagram of establishing a spatial coordinate system provided in an embodiment of the present application.

[0078] FIG15 is a schematic flowchart of another interaction method provided in an embodiment of the present application.

[0079] Figure 16 is a functional block diagram of a vehicle provided in an embodiment of the present application.

[0080] FIG17 is another set of GUIs provided by an embodiment of the present application.

[0081] FIG18 is another set of GUIs provided by an embodiment of the present application.

[0082] FIG19 is another set of GUIs provided by an embodiment of the present application.

[0083] FIG20 is another set of GUIs provided by an embodiment of the present application.

[0084] Figure 21 is a schematic flowchart of the interaction method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0085] The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

[0086] The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification of this application and the appended claims, the singular expressions "a", "an", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one, two or more. The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship.

[0087] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0088] The following describes an electronic device, a user interface for such an electronic device, and embodiments for using such an electronic device. In some embodiments, the electronic device may be a portable electronic device that also includes other functions such as a personal digital assistant and / or a music player, such as a mobile phone, a tablet computer, a wearable electronic device with wireless communication functions (such as a smart watch), etc. Exemplary embodiments of portable electronic devices include but are not limited to devices equipped with Or a portable electronic device with other operating systems. The portable electronic device may also be other portable electronic devices, such as a laptop computer. It should also be understood that in some other embodiments, the electronic device may not be a portable electronic device, but a desktop computer.

[0089] 1 shows a schematic structural diagram of an electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0090] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0091] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0092] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0093] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0094] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0095] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0096] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0097] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0098] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0099] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0100] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-CDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0101] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0102] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0103] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0104] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0105] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0106] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0107] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0108] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0109] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0110] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0111] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0112] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0113] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A.

[0114] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.

[0115] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.

[0116] The pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a device comprising at least two parallel plates with conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation based on the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the alarm application icon, the instruction to create a new alarm is executed.

[0117] Fingerprint sensor 180H is used to collect fingerprints. Electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, and so on. For example, when the phone detects a user's touch operation on the lock screen, the phone can collect the user's fingerprint information through fingerprint sensor 180H and match the collected fingerprint information with the fingerprint information pre-set in the phone. If the match is successful, the phone can enter the non-lock screen interface from the lock screen interface.

[0118] The touch sensor 180K is also called a "touch panel." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, in a location different from that of the display screen 194.

[0119] Figure 2 is a software structure diagram of the electronic device 100 according to an embodiment of the present application. The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer, from top to bottom. The application layer can include a series of application packages.

[0120] As shown in Figure 2, the application layer may include camera, settings, third-party applications, etc. Among them, the third-party applications may include gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0121] The application framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer may include some predefined functions.

[0122] As shown in FIG2 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0123] The window manager manages windowed applications. It can determine the display size, determine whether a status bar is present, lock the screen, and take screenshots. Content providers store and retrieve data and make it accessible to applications. This data can include video, images, audio, incoming and outgoing calls, browsing history and bookmarks, and phone books.

[0124] The view system includes visual controls, such as controls for displaying text and images, such as the instructions for prompting a virtual shutter button in the embodiments of this application. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0125] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0126] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0127] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0128] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for scheduling and management of the Android system.

[0129] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0130] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0131] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (such as OpenGL ES), and a 2D graphics engine (such as SGL).

[0132] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0133] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0134] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0135] A 2D graphics engine is a drawing engine for 2D drawings.

[0136] In addition, the system library can also include status monitoring service modules, such as a physical status recognition module for analyzing and identifying user gestures; a sensor service module for monitoring sensor data uploaded by various sensors at the hardware layer to determine the physical status of the electronic device 100.

[0137] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0138] The hardware layer may include various sensors, such as the various sensors introduced in FIG. 1 , the acceleration sensor, gyroscope sensor, touch sensor, etc. involved in the embodiments of the present application.

[0139] Before introducing the embodiments of the present application, several concepts related to the embodiments of the present application are first introduced.

[0140] Wireless positioning technology uses communication and parameter measurement to determine the direction and distance of the target. Wireless positioning technologies include acoustic source positioning, ultra-wideband (UWB) positioning, Bluetooth positioning, Wi-Fi positioning, infrared positioning, and radio frequency identification (RFID) positioning.

[0141] It is understood that the above positioning technologies do not constitute a specific limitation on the positioning technologies used by the electronic devices in the embodiments of the present application. The electronic devices in the embodiments of the present application may adopt one or more of the above positioning technologies, or one or more positioning technologies other than the above positioning technologies.

[0142] Distance measurement: An electronic device measures the distance between itself and another electronic device. As shown in Figure 3, electronic device #1 transmits an ultrasonic signal. When the ultrasonic wave is emitted, electronic device #1 begins counting. When the ultrasonic wave hits electronic device #2, it reflects back to electronic device #1. Electronic device #1 receives the reflected ultrasonic wave and stops counting. This allows the distance between electronic devices #1 and #2 to be determined based on the speed and duration of sound propagation.

[0143] It should be understood that the embodiment of the present application uses ultrasonic measurement of the distance between an electronic device and a target to be measured as an example, but is not limited to this. The electronic device in the embodiment of the present application can also measure the distance between it and other electronic devices through UWB, Bluetooth, millimeter wave and other technologies.

[0144] Networking: Multiple electronic devices can form a network. In a dynamic network, the communication and service capabilities of each device can be effectively managed. Networking can also be called distributed networking.

[0145] Specifically, first, any electronic device can discover the presence of other electronic devices in its vicinity. The electronic device can be an active discoverer, a passive discoverer, or both. The electronic device can discover other electronic devices via different media, such as Bluetooth, Ethernet, and Wi-Fi. Depending on the capabilities of different electronic devices, the electronic device can select different discovery media.

[0146] After any electronic device discovers another electronic device, it can connect to the other electronic device and select a suitable communication medium and the most appropriate communication connection technology based on the capabilities and service requirements of the other electronic device.

[0147] After any electronic device is connected to other electronic devices, they can authenticate each other. The embodiment of the present application does not limit the authentication method between each electronic device.

[0148] In one example, various electronic devices can authenticate each other using the same account.

[0149] For example, in a communication system consisting of electronic device #1, electronic device #2 and electronic device #3, if account #1 is logged in to electronic device #1, electronic device #2 and electronic device #3, then electronic device #1, electronic device #2 and electronic device #3 can authenticate each other by logging in to the same account #1.

[0150] In another example, electronic devices can authenticate each other without an account.

[0151] For example, in a communication system consisting of electronic device #1 and electronic device #2, if electronic device #1 is logged in to account #1 and electronic device #2 is not logged in to an account, then electronic device #1 and electronic device #2 can authenticate each other through a personal identification number (PIN).

[0152] In another example, electronic devices can authenticate each other through cross-account authentication.

[0153] For example, in a communication system consisting of electronic device #1, electronic device #2, and electronic device #3, if electronic device #1 is logged in to account #1, electronic device #2 is logged in to account #2, and electronic device #3 is logged in to account #2, and account #1 and account #2 are two accounts bound to each other, then electronic device #1 and electronic device #2 can be authenticated through the two bound accounts, and electronic device #1 and electronic device #3 can also be authenticated through the two bound accounts.

[0154] After each electronic device completes authentication, it can be considered that the electronic devices that have completed mutual authentication are called trusted devices or that a trusted relationship exists between the electronic devices that have completed mutual authentication.

[0155] In some embodiments, after each electronic device completes authentication, the electronic devices may exchange information (eg, device name, address, type, etc.) with each other.

[0156] Generally speaking, the process of establishing a connection between electronic devices, the process of authentication, and the process of exchanging information between each other can be called a networking process.

[0157] In some embodiments, electronic devices can also complete the networking process without going through the authentication process. In other words, electronic devices can communicate after being connected.

[0158] In some embodiments, electronic devices in the network can sense the distance between each other.

[0159] FIG4 shows an architecture diagram of an electronic device provided in an embodiment of the present application.

[0160] As shown in FIG4 , the electronic device includes a device management module, a distance sensing module, a control module, a communication module, a calculation and display module, a data acquisition module, and a distance measurement module.

[0161] The device management module is used to discover other electronic devices and join the same network.

[0162] The distance sensing module provides one-to-many and many-to-one distance subscription capabilities, and obtains the distance between other electronic devices in the network and the electronic device in real time.

[0163] The ranging module is a hardware module of the electronic device, which is used to send a ranging signal. In the embodiment of the present application, there is no limitation on the type of the ranging signal. For example, the ranging signal can be a Bluetooth signal, an ultrasonic signal, etc.

[0164] The control module selects the electronic devices that need to sense the distance in the network, connects to the distance sensing module port to implement subscription, obtains the distance value returned by the distance sensing module and calculates the spatial coordinates, etc. It can also report the calculation results to the communication module and game interaction module.

[0165] Communication module for transmitting position data and sensor data.

[0166] The calculation and display module is used to fit the game data according to the reported data (for example, position data, action data), draw and display the game interface.

[0167] The data acquisition module runs a positioning algorithm (e.g., a triangulation algorithm) to calculate spatial coordinates based on the distance data from the positioning reference point. It can also obtain sensor data to generate player movement information.

[0168] For the different electronic devices described below, each electronic device may include more or fewer of the modules described above to implement the functions provided by each electronic device. For example, in the example shown in Figure 5, electronic device #1 may include all of the modules shown in Figure 4, electronic devices #2, #3, and #4 may only include a device management module, a ranging module, a distance sensing module, and a communication module, and electronic device #5 may include a communication module, a control module, a device management module, a ranging module, a distance sensing module, and a data acquisition module.

[0169] The following first introduces the interaction method provided in the embodiment of the present application in conjunction with a graphical user interface (GUI).

[0170] FIG5 shows a set of GUIs provided by an embodiment of the present application.

[0171] As shown in (a) of Figure 5 , electronic device #1 displays interface 501, which is the interface of the game application. Interface 501 includes information of electronic device #2, electronic device #3, electronic device #4, and electronic device #5. The information of the above electronic devices may include the name of the electronic device and a session identifier (session identity, SessionID), which is used to identify the electronic device. For example, as shown in the figure, the device name of electronic device #2 is: Bracelet B7, SessionID is: 45178, the device name of electronic device #3 is: Bracelet B7, SessionID is: 33541, the device name of electronic device #4 is: Watch GT3, SessionID is: 65279, and the device name of electronic device #5 is: Watch GT3, SessionID is: 98472. In response to the user selecting electronic device #2, electronic device #3, and electronic device #4 and clicking on control 502, electronic device #1 can display a GUI as shown in (b) of Figure 5 .

[0172] When electronic device #1 is not networked with electronic device #2, electronic device #3, and electronic device #4, electronic device #1 can use the SessionIDs of electronic device #2, electronic device #3, and electronic device #4 as parameters to establish a network.

[0173] Electronic device #1 can generate verification codes corresponding to electronic devices #2, #3, and #4 and send mutual trust verification requests to electronic devices #2, #3, and #4. As shown in Figure 5(b), electronic device #1 can display interface 503, which includes the verification codes corresponding to electronic devices #2, #3, and #4. For example, the verification code corresponding to electronic device #2 is 27693, the verification code corresponding to electronic device #3 is 45672, and the verification code corresponding to electronic device #4 is 41782.

[0174] After receiving the mutual trust verification request sent by electronic device #1, electronic device #2, electronic device #3, and electronic device #4 may display a GUI as shown in (c) of FIG. 5 .

[0175] As shown in FIG5 (c), after receiving the mutual trust verification request sent by electronic device #1, electronic device #2, electronic device #3, and electronic device #4 can display interface 504, which includes prompt information prompting the user to determine whether to establish a mutual trust network. In response to the user clicking control 505, electronic device #2, electronic device #3, and electronic device #4 can display the GUI shown in FIG5 (d).

[0176] As shown in Figure 5 (d), electronic devices #2, #3, and #4 can display interface 506 in response to a user clicking control 505, which is used to enter a verification code. When electronic devices #2, #3, and #4 enter a verification code and click control 507, they can establish a network and display the GUI shown in Figure 5 (e). In other words, after establishing the network, electronic devices #1, #2, #3, and #4 belong to the same communication network.

[0177] It should be noted that the above-mentioned process of establishing a network is merely an example and should not be construed as a specific limitation on the embodiments of the present application. For example, in other embodiments of the present application, after electronic device #2, electronic device #3, and electronic device #4 receive the mutual trust verification request sent by electronic device #1, they can directly display a GUI as shown in (d) of Figure 5.

[0178] As shown in FIG5(e), electronic device #1 displays interface 508, which includes information about electronic device #5, where the device name of electronic device #5 is Watch GT3 and the Session ID is 98472. In response to the user selecting electronic device #5 and clicking control 509, electronic device #1 may display the GUI shown in FIG5(f).

[0179] When electronic device #1 is not networked with electronic device #5, electronic device #1 may use the SessionID of electronic device #5 as a parameter to establish a network.

[0180] Electronic device #1 may generate a verification code corresponding to electronic device #5 and send a mutual trust verification request to electronic device #5. As shown in FIG5(f), electronic device #1 may display an interface 510 including a verification code 18242 corresponding to electronic device #5.

[0181] After receiving the mutual trust verification request sent by electronic device #1, electronic device #5 may display a GUI as shown in (g) of FIG. 5 .

[0182] As shown in FIG5(g), after receiving the mutual trust verification request sent by electronic device #1, electronic device #5 may display interface 511, which includes prompt information prompting the user to determine whether to establish a mutual trust network. In response to the user clicking control 512, electronic device #5 may display the GUI shown in FIG5(h).

[0183] As shown in FIG5(h), electronic device #5 may display interface 513 for inputting a verification code in response to a user clicking control 512. When electronic device #5 responds to the user inputting the verification code and clicking control 514, a network may be established.

[0184] It should be noted that the above-mentioned process of establishing a network is merely an example and should not be construed as a specific limitation on the embodiments of the present application. For example, in other embodiments of the present application, after electronic device #5 receives the mutual trust verification request sent by electronic device #1, it may directly display a GUI as shown in (h) of FIG5 .

[0185] In some embodiments, electronic device #1 has been networked with electronic device #2, electronic device #3, electronic device #4 and electronic device #5. In this embodiment, electronic device #1 can determine electronic device #2, electronic device #3, electronic device #4 as positioning reference points and electronic device #5 as positioning device #1 in response to the user's selection operations on interfaces 501 and 508.

[0186] In some embodiments, electronic device #1 may also determine that electronic device #6 is positioning device #2.

[0187] It should be understood that the description of electronic device #1 determining electronic device #6 as positioning device #2 can refer to the description of electronic device #1 determining electronic device #5 as positioning device #1, which will not be repeated for the sake of brevity.

[0188] After electronic device #1 determines the positioning reference point, it can establish a spatial coordinate system based on the positioning reference point and send the spatial coordinate system information to electronic device #5. Electronic device #5 then determines its spatial coordinates in the spatial coordinate system based on the distances between it and electronic devices #2, #3, and #4. It then sends these spatial coordinates to electronic device #1, allowing electronic device #1 to determine the position of electronic device #5. Detailed instructions for establishing the spatial coordinate system and determining the spatial coordinates are provided below and are not detailed here.

[0189] FIG6 shows another set of GUIs provided by an embodiment of the present application.

[0190] As shown in Figure 6(a), electronic device #1 displays interface 601, which is the start interface of a game application. This game application is an airplane shooting game. At time T1, when electronic device #1 detects a user clicking control 602, it can start the game in response to this action, and the airplane begins automatic shooting, i.e., the GUI shown in Figure 6(b) is displayed.

[0191] When electronic device #1 starts running the game, it can establish a mapping between the position of electronic device #5 and the position of the aircraft in interface 601. For example, at time T1, the coordinates of electronic device #5 are (40, 40, 50), and the coordinates of the aircraft in interface 601 are (0, 0). The coordinates of the aircraft in interface 601 can be the screen coordinates of the center of the aircraft. Since the aircraft does not have a z coordinate in interface 801, electronic device #1 can ignore the z coordinate when rendering the game interface.

[0192] As shown in (b) and (c) of FIG6 , when the coordinates of electronic device #5 change to (50, 40, 50) at time T2, electronic device #1 can synchronously change the position of the aircraft in interface 601 according to the change in the coordinates of electronic device #5.

[0193] It should be noted that in the example shown in Figure 6, electronic device #1 can control the aircraft to perform automatic shooting. When electronic device #1 determines that the position of electronic device #5 has changed, that is, the position of user #1 has changed, it can synchronously control the aircraft to move in the direction of user #1 according to the direction of the change in user #1's position.

[0194] In the embodiment of the present application, electronic device #1 can customize its positioning reference point and positioning device, and determine the user's real-time location through the positioning device, thereby rendering and displaying the game interface based on the user's real-time location. The interactive method provided by this application does not require a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities. This facilitates the user's selection of positioning reference points and positioning devices, greatly expanding application scenarios and user interaction methods, and helping to enhance the user experience.

[0195] In some embodiments, electronic device #5 can also collect the actions of user #1, so electronic device #1 can also display the game interface according to the actions of user #1.

[0196] FIG7 shows another set of GUIs provided by an embodiment of the present application.

[0197] As shown in (a) of FIG7 , electronic device #1 displays an interface 701 , which is a start interface of a game application program, and the game application program is an airplane shooting game.

[0198] At time T1, when electronic device #1 detects the user clicking on control 702, the game can be started in response to the operation.

[0199] It should be noted that, unlike the example shown in FIG6 , in the example shown in FIG7 , the aircraft does not start shooting at time T1 .

[0200] As shown in Figure 7 (a)-(c), electronic device #1 starts running the game and can establish a mapping relationship between the position of electronic device #5 and the position of the aircraft in interface 701. For example, at time T1, the coordinates of electronic device #5 are (40, 40, 50), and the coordinates of the aircraft in interface 701 are (0, 0). When the coordinates of electronic device #5 change to (50, 40, 50) at time T2, electronic device #1 can synchronize the position of the aircraft in interface 701 based on the change in the coordinates of electronic device #5.

[0201] As shown in Figure 7 (c) and (d), at time T3, electronic device #5 detects user #1's action (for example, user #1 flips their palm) through a motion sensor. Electronic device #5 then sends the motion information to electronic device #1, which indicates user #1's action. Based on the motion information sent by electronic device #5, electronic device #1 can render a game interface for shooting airplanes. Motion sensors include, but are not limited to, gyroscopes, accelerometers, and inertial sensors.

[0202] In the embodiment of the present application, the positioning device can also collect user movements, and electronic device #1 can then render and display the game interface based on the user's real-time location and movements. The interactive method provided by this application does not require a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities. This facilitates user selection of positioning reference points and positioning devices, greatly expanding application scenarios and user interaction methods, and helping to enhance the user experience.

[0203] In some embodiments, electronic device #5 may not determine the action of user #1, but instead send the action data collected by the motion sensor to electronic device #1, and electronic device #1 determines the action of user #1 based on the action data collected by the motion sensor.

[0204] In some embodiments, electronic device #1 can also determine its spatial coordinates in the spatial coordinate system. Therefore, electronic device #1 can also display the game interface based on its spatial coordinates in the spatial coordinate system, the spatial coordinates of electronic device #5 in the spatial coordinate system, and the actions of user #1.

[0205] FIG8 shows another set of GUIs provided by an embodiment of the present application.

[0206] As shown in FIG8( a ), electronic device #1 displays an interface 801 , which is an interface of a basketball shooting game application program and includes a basket 802 .

[0207] Electronic device #1 can determine its position in the spatial coordinate system, as well as the position of electronic device #5 in the spatial coordinate system, and thus can determine the positional relationship between it and electronic device #5, that is, the positional relationship between it and user #1.

[0208] After electronic device #5 collects the user's shooting action and sends the action information to electronic device #1, electronic device #1 can calculate and fit the basketball's motion trajectory based on the shooting strength, shooting position, and direction of user #1, and judge whether the basketball is thrown into the basket 802 based on the relative position relationship between it and electronic device #5. When it is determined that the basketball is thrown into the basket 802, the game interface of the goal can be displayed on interface 801, as shown in (b) in Figure 8. When it is determined that the basketball is not thrown into the basket 802, the game interface of the goal cannot be displayed on interface 801, as shown in (c) in Figure 8.

[0209] Similar to the description above, electronic device #5 can also send the motion data collected by the motion sensor to electronic device #1, which determines the shooting strength, direction, etc. of user #1 and fits the basketball motion trajectory based on the position of electronic device #5 in the spatial coordinate system.

[0210] In the embodiment of the present application, electronic device #1 can also determine the positional relationship between itself and the user, and thus can render and display the game interface based on the positional relationship between itself and the user and the user's real-time actions. The interactive method provided by this application does not require a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities. This facilitates the user's selection of positioning reference points and positioning devices, greatly expanding application scenarios and user interaction methods, and helping to enhance the user experience.

[0211] The game application running on electronic device #1 may be a multiplayer game, in which case electronic device #1 may determine multiple electronic devices as positioning devices and display a game interface based on the spatial coordinates of the multiple positioning devices in the spatial coordinate system, or based on the spatial coordinates of the multiple positioning devices in the spatial coordinate system and the actions of multiple users collected by the multiple positioning devices, or based on the spatial coordinates of the multiple positioning devices in the spatial coordinate system, the actions of multiple users collected by the multiple positioning devices, and the coordinates of electronic device #1 in the spatial coordinate system.

[0212] FIG9 shows another set of GUIs provided by an embodiment of the present application.

[0213] As shown in (a) of Figure 9 , electronic device #1 displays interface 901, which is the start interface of a game application, which is an airplane shooting game. In this GUI, electronic device #1 is running the two-player mode of the airplane shooting game. It is understandable that in this two-player mode, electronic device #1 can determine that two electronic devices (e.g., electronic device #5 and electronic device #6) are positioning device #1 and positioning device #2, respectively. At time T1, when electronic device #1 detects the user clicking on control 902, in response to this operation, the game can be started, and the airplane starts to automatically shoot, i.e., a GUI as shown in (b) of Figure 9 is displayed, wherein the airplane on the left side of interface 901 corresponds to positioning device #1, and the airplane on the right side corresponds to positioning device #2, i.e., positioning device #1 is used to control the airplane on the left, and positioning device #2 is used to control the airplane on the right.

[0214] Electronic device #1 starts running the game and can establish a mapping relationship between the position of electronic device #5 and the position of the left aircraft on interface 901, and a mapping relationship between electronic device #6 and the position of the right aircraft on interface 901. For example, at time T1, the coordinates of electronic device #5 are (40, 40, 50), the coordinates of the left aircraft on interface 901 are (-40, 0), and the coordinates of electronic device #6 are (80, 80, 50), and the coordinates of the right aircraft on interface 901 are (40, 0).

[0215] As shown in (b) and (c) in Figure 9, when the coordinates of electronic device #5 become (50, 40, 50) and the coordinates of electronic device #6 become (70, 80, 50) at time T2, electronic device #1 can synchronously change the positions of the left aircraft and the right side in interface 901 according to the changes in the coordinates of electronic device #5 and electronic device #6.

[0216] It should be noted that in the example shown in FIG9 , electronic device #1 can control the left and right aircraft to automatically fire. In other embodiments, electronic device #1 can control the left and right aircraft to fire based on user actions captured by electronic devices #5 and #6. For details, please refer to FIG7 , which illustrates electronic device #1 controlling aircraft to fire based on user actions captured by electronic device #5. This description is omitted here.

[0217] In an embodiment of the present application, electronic device #1 can customize positioning reference points and multiple positioning devices, and determine the real-time locations of multiple users through multiple positioning devices, thereby rendering and displaying a game interface based on the real-time locations of multiple users. The interactive method provided by this application does not require a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities. This facilitates user selection of positioning reference points and positioning devices, greatly expanding application scenarios and user interaction methods, and helping to enhance the user experience.

[0218] FIG10 shows another set of GUIs provided by an embodiment of the present application.

[0219] As shown in FIG10( a ), electronic device #1 displays interface 1001, which is the interface of a basketball shooting game application. Interface 1001 displays baskets 1002 and 1003. Similar to the GUI shown in FIG9 , electronic device #1 is running a two-player mode of the basketball shooting game. It is understood that in this two-player mode, electronic device #1 can determine that two electronic devices (e.g., electronic device #5 and electronic device #6) are positioning device #1 and positioning device #2, respectively, with positioning device #1 corresponding to basket 1002 and positioning device #2 corresponding to basket 1003.

[0220] Electronic device #1 can determine its position in the spatial coordinate system, the position of electronic device #5 in the spatial coordinate system, and the position of electronic device #6 in the spatial coordinate system, and then determine the positional relationship between it and electronic device #5, and the positional relationship between it and electronic device #6, that is, determine the positional relationship between it and user #1, and the positional relationship between it and user #2.

[0221] After electronic device #5 collects the user's shooting action and sends the action information to electronic device #1, electronic device #1 can determine whether the basketball is thrown into basket 1002 based on the shooting strength of user #1 and the positional relationship between it and electronic device #5, and determine whether the basketball is thrown into basket 1003 based on the shooting strength of user #2 and the positional relationship between it and electronic device #6. When it is determined that the basketball is thrown into baskets 1002 and 1003, the game interface of the goal can be displayed on interface 1001, as shown in (b) in Figure 10. When it is determined that the basketball is not thrown into baskets 1002 and 1003, the game interface of the goal cannot be displayed on interface 1001, as shown in (c) in Figure 10.

[0222] It is understandable that basket 1002 and basket 1003 may correspond to the same spatial coordinate, ie, the coordinate of electronic device #1 in the spatial coordinate system.

[0223] In the embodiment of the present application, electronic device #1 can also determine the positional relationship between itself and multiple users. This allows electronic device #1 to render and display a game interface based on the positional relationship between itself and the multiple users and the real-time actions of the multiple users. The interactive method provided by this application does not require a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities. This facilitates user selection of positioning reference points and positioning devices, greatly expanding application scenarios and user interaction methods, and helping to enhance the user experience.

[0224] In the example introduced above, electronic device #1 is used as an example to run a game application. In other embodiments of the present application, multiple electronic devices can also play online games. In this scenario, multiple electronic devices can display game interfaces based on the distance between them and other electronic devices.

[0225] FIG11 shows another set of GUIs provided by an embodiment of the present application.

[0226] As shown in Figure 11(a), electronic device #1 displays interface 1101, which is the start interface of a game application. Electronic device #1 can display multiple controls on interface 1101, for example, control 1102 corresponds to standalone mode, and control 1103 corresponds to online mode. Electronic device #1 detects a user clicking control 1103 and, in response, displays a GUI as shown in Figure 11(b).

[0227] As shown in FIG11( b ), electronic device #1 displays interface 1104 in response to detecting a user click on control 1103. Electronic device #1 may display multiple game setting options on interface 1104. Electronic device #1 detects a user click on control 1105 and, in response to this, may search for electronic devices on the same local area network and / or electronic devices already networked with it that are also running the same game application.

[0228] If electronic device #1 searches for electronic device #2 and is not already networked with it, electronic device #1 can first establish a network with electronic device #2. Electronic device #1 can generate a verification code corresponding to electronic device #2 and send a mutual trust verification request to electronic device #2. As shown in Figure 11(c), electronic device #1 can display interface 1106, which includes the verification code corresponding to electronic device #2. For example, the verification code corresponding to electronic device #2 is 27693.

[0229] After receiving the mutual trust verification request sent by electronic device #1, electronic device #2 may display a GUI as shown in (d) of FIG11 .

[0230] It is understandable that electronic device #2 is also running the same game application as electronic device #1 at this time.

[0231] As shown in FIG11(d), after receiving the mutual trust verification request sent by electronic device #1, electronic device #2 may display interface 1107, which includes prompt information prompting the user to determine whether to establish a mutual trust network. In response to the user clicking control 1108, electronic device #2 may display the GUI shown in FIG12(e).

[0232] As shown in FIG11(e), electronic device #2 may display interface 1109 for entering a verification code in response to the user clicking control 1208. When electronic device #2 enters the verification code and clicks control 1110 in response to the user entering the verification code, a network may be established.

[0233] It is understandable that when the electronic device #2 searched by the electronic device #1 is an electronic device that has already been networked, the electronic device #1 and the electronic device #2 do not need to be authenticated again.

[0234] When electronic device #2 enters the room created by electronic device #1, electronic device #1 and electronic device #2 may display a GUI as shown in (f) of FIG. 11 .

[0235] As shown in (f) in FIG11 , electronic device #1 and electronic device #2 display interface 1111. When electronic device #1 and electronic device #2 both detect the user clicking on control 1112, the game can be started in response to the operation.

[0236] FIG12 shows another set of GUIs provided by an embodiment of the present application.

[0237] Electronic device #1 and electronic device #2 have entered an online mode of a game application, which is a tank game.

[0238] As shown in Figure 12(a), electronic device #1 displays interface 1201, which corresponds to the tank game. Interface 1201 includes tanks 1202 and 1203. Electronic device #1 controls tank 1202, while electronic device #2 controls tank 1203. At time T1, the distance between tanks 1202 and 1203 is d1.

[0239] It is understandable that electronic device #2 also displays the same game interface as interface 1201.

[0240] Electronic device #1 can control tank 1202 based on the real-time distance between it and electronic device #2 to adjust the distance between tank 1202 and tank 1203. As shown in Figures 12(a) and 12(b), at time T1, the distance between electronic device #1 and electronic device #2 is 30 cm, and the distance between tank 1202 and tank 1203 is d1. When electronic device #1 detects that the distance between it and electronic device #2 is 20 cm, electronic device #1 can control tank 1202 to move right, so that the distance between tank 1202 and tank 1203 becomes d2.

[0241] In some embodiments, electronic device #1 can synchronize the game interface of interface 1201 to electronic device #2. In these embodiments, electronic device #2 does not need to obtain the distance between itself and electronic device #1.

[0242] In some embodiments, electronic device #2 can also obtain the distance between itself and electronic device #1, and control tank 1203 according to the distance to adjust the distance between tank 1203 and tank 1202.

[0243] In some embodiments, electronic device #1 may further display controls 1204 and / or 1205 on interface 1201, where control 1204 is used to move tank 1202. In other words, in addition to moving tank 1202 by changing the distance between electronic device #1 and electronic device #2, the user of electronic device #1 may also move tank 1202 using control 1204.

[0244] Control 1205 is used to control tank 1202 to shoot. When electronic device #1 detects the user clicking on control 1205, in response to the operation, tank 1202 can be controlled to shoot.

[0245] In other embodiments of the present application, electronic device #1 may not display control 1205. In these embodiments, electronic device #1 can control tank 1202 to automatically fire, and the user of electronic device #1 only needs to change the distance between electronic device #1 and electronic device #2, or control control 1204.

[0246] In an embodiment of the present application, electronic device #1 can run an online game and dynamically adjust the game interface according to the real-time distance between it and electronic device #2, thereby expanding the application scenarios and user interaction methods and helping to enhance the user experience.

[0247] It is understood that the game application scenario shown in FIG12 can also be applied to the interaction methods described in FIG5-10. Specifically, electronic device #1 can run the game application and determine electronic devices #2, #3, and #4 as positioning reference points, and electronic devices #5 and #6 as positioning devices. This allows user #1 to control the movement or firing of tank 1202 using electronic device #5, and user #2 to control the movement or firing of tank 1203 using electronic device #6.

[0248] The above describes the interaction method provided in the embodiment of the present application in conjunction with the GUI, and the following describes the interaction method provided in the embodiment of the present application in conjunction with the flowchart.

[0249] FIG13 shows a schematic flow chart of an interaction method provided in an embodiment of the present application. As shown in FIG13 , the method includes:

[0250] S1301: Electronic device #1 determines electronic device #2, electronic device #3, and electronic device #4 as positioning reference points.

[0251] When electronic device #1 runs a game application, it can request permissions for the device management module and the distance sensing module. Therefore, electronic device #1 can scan and discover electronic devices #2, #3, #4, and #5 on the same local area network. In response to a user's selection, the electronic devices can determine electronic devices #2, #3, and #4 as positioning reference points.

[0252] In some embodiments, before electronic device #1 executes step S1301, electronic device #1 has not been networked with electronic device #2, electronic device #3, and electronic device #4. Then, when electronic device #1 executes step S1301, it can first be networked with electronic device #2, electronic device #3, and electronic device #4, and after networking, electronic device #2, electronic device #3, and electronic device #4 are determined as positioning reference points.

[0253] For example, as shown in FIG5 , electronic device #1 determines electronic device #2, electronic device #3, and electronic device #4 as positioning reference points in response to a user's selection operation.

[0254] In some embodiments, before executing step S1301, electronic device #1 has already formed a network with electronic device #2, electronic device #3, electronic device #4 and electronic device #5. In this embodiment, electronic device #1 can determine electronic device #2, electronic device #3, and electronic device #4 as positioning reference points in response to the user's selection operation on interface 501, and there is no need for mutual trust authentication.

[0255] It should be noted that all electronic devices in the same network can quickly and securely transmit data and remotely call interfaces with each other.

[0256] It should also be noted that while the embodiments of this application illustrate the example of electronic device #1 determining other electronic devices as positioning reference points while running a gaming application, this embodiment of the application is not specifically limited to this. For example, in other embodiments of this application, the function of electronic device #1 determining other electronic devices as positioning reference points is also integrated into the system settings.

[0257] S1302, electronic device #2 sends distance indication information #1 to electronic device #1.

[0258] Correspondingly, electronic device 1 receives distance indication information #1 sent by electronic device #2, where the distance indication information #1 is used to indicate the distance between electronic device #2 and electronic device #3 and / or the distance between electronic device #2 and electronic device #4.

[0259] Electronic device #1 may create a polling thread through a game application, and periodically call the interface of electronic device #2 through the polling thread to obtain the distance between electronic device #2 and electronic device #3 and / or electronic device #4 reported by electronic device #2.

[0260] S1303, electronic device #3 sends distance indication information #2 to electronic device #1.

[0261] Correspondingly, electronic device 1 receives distance indication information #2 sent by electronic device #3, where the distance indication information #2 is used to indicate the distance between electronic device #3 and electronic device #2 and / or the distance between electronic device #3 and electronic device #4.

[0262] S1304, electronic device #4 sends distance indication information #3 to electronic device #1.

[0263] Correspondingly, electronic device 1 receives distance indication information #3 sent by electronic device #4, where the distance indication information #3 is used to indicate the distance between electronic device #4 and electronic device #2 and / or the distance between electronic device #4 and electronic device #3.

[0264] It should be understood that the description of S1303 and S1304 can refer to the description of S1302, and for the sake of brevity, they are not repeated here.

[0265] S1305 , electronic device # 1 determines whether electronic device # 2 , electronic device # 3 , and electronic device # 4 are collinear based on distance indication information # 1 , distance indication information # 2 , and distance indication information # 3 .

[0266] After electronic device #1 obtains the distances between electronic devices #2, #3, and #4, it can determine whether electronic devices #2, #3, and #4 are collinear based on the distances. If it is determined that electronic devices #2, #3, and #4 are not collinear, step S1306 can be performed. If it is determined that electronic devices #2, #3, and #4 are collinear, step S1307 can be performed.

[0267] For example, the distance between electronic device #2 and electronic device #3 is a, the distance between electronic device #2 and electronic device #4 is b, the distance between electronic device #3 and electronic device #4 is c, and c>a, c>b. When a+b=c, electronic device #2, electronic device #3 and electronic device #4 are collinear, and when a+b>c, electronic device #2, electronic device #3 and electronic device #4 are not collinear.

[0268] In some embodiments, electronic device #1 can also determine whether electronic device #2, electronic device #3 and electronic device #4 meet the placement requirements based on distance indication information #1, distance indication information #2 and distance indication information #3. In these embodiments, when it is determined that electronic device #2, electronic device #3 and electronic device #4 meet the placement requirements, step S1306 can be performed; when it is determined that electronic device #2, electronic device #3 and electronic device #4 do not meet the placement requirements, step S1307 can be performed.

[0269] For example, if the placement requirement is that three electronic devices must form an isosceles right triangle, when electronic device #1 determines, based on the three distance indications, that electronic devices #2, #3, and #4 can form an isosceles right triangle, step S1306 may be performed. If electronic device #1 determines, based on the three distance indications, that electronic devices #2, #3, and #4 cannot form an isosceles right triangle, step S1307 may be performed.

[0270] Exemplarily, the right-angled side of the isosceles right triangle is 20 cm.

[0271] S1306: Electronic device #1 establishes a space coordinate system based on electronic device #2, electronic device #3, and electronic device #4.

[0272] Since electronic device #2, electronic device #3 and electronic device #4 are not collinear, electronic device #1 can determine a plane based on electronic device #2, electronic device #3 and electronic device #4. After determining the plane, the normal perpendicular to the plane can also be determined, and then a spatial coordinate system can be established.

[0273] It is understandable that after electronic device #1 proposes a spatial coordinate system, the coordinates of electronic devices #2, #3, and #4 in the spatial coordinate system can be determined.

[0274] FIG14 shows a schematic diagram of establishing a spatial coordinate system provided in an embodiment of the present application.

[0275] As shown in (a) and (b) of Figure 14, electronic device #2, electronic device #3 and electronic device #4 can form an equilateral triangle with a side length of 20 cm. Electronic device #1 can determine the plane where electronic device #2, electronic device #3 and electronic device #4 are located as the xy plane. After determining the xy plane, electronic device #1 can determine the coordinates of electronic device #2, electronic device #3 and electronic device #4 in the xy plane based on the distance relationship between electronic device #2, electronic device #3 and electronic device #4. For example, electronic device #2 can be used as the coordinate origin, then the coordinates of electronic device #3 can be (20,0), and the coordinates of electronic device #4 can be The electronic device can also determine the normal perpendicular to the xy plane, and then establish a spatial coordinate system. In this spatial coordinate system, the coordinates of electronic device #2 are (0,0,0), the coordinates of electronic device #3 are (20,0,0), and the coordinates of electronic device #4 can be

[0276] It can be understood that the coordinates of electronic device #2, electronic device #3 and electronic device #4 may be different due to the differences in the triangles formed by electronic device #2, electronic device #3 and electronic device #4.

[0277] As shown in (c) and (d) of Figure 14, electronic devices #2, #3, and #4 can form an isosceles right triangle with a side length of 20 cm. Electronic device #1 can determine the plane in which electronic devices #2, #3, and #4 are located as the xy plane. After determining the xy plane, electronic device #1 can determine the coordinates of electronic devices #2, #3, and #4 in the xy plane based on the distance relationship between electronic devices #2, #3, and #4. For example, with electronic device #2 as the coordinate origin, the coordinates of electronic device #3 can be (20, 0), and the coordinates of electronic device #4 can be (0, 20). The electronic device can also determine the normal perpendicular to the xy plane to establish a spatial coordinate system. In this spatial coordinate system, the coordinates of electronic device #2 are (0, 0, 0), the coordinates of electronic device #3 are (20, 0, 0), and the coordinates of electronic device #4 can be (0, 20, 0).

[0278] It should be noted that, in FIG14 , the spatial coordinate system established by electronic device #1 is taken as an example of a spatial rectangular coordinate system, but the embodiment of the present application does not make any specific limitation on this. For example, the spatial coordinate system established by electronic device #1 can also be a cylindrical coordinate system, a spherical coordinate line, etc.

[0279] S1307, electronic device #1 outputs prompt information.

[0280] When electronic device #1 determines that electronic device #2, electronic device #3, and electronic device #4 are in the same line or do not meet the placement requirements, it can output prompt information to prompt the user how to place electronic device #2, electronic device #3, and electronic device #4.

[0281] For example, electronic device #1 can display a teaching animation on the interface on how to place electronic device #2, electronic device #3, and electronic device #4.

[0282] For another example, electronic device #1 may output prompt information through voice commands to instruct the user how to place electronic device #2, electronic device #3, and electronic device #4.

[0283] S1308, electronic device #1 determines that electronic device #5 is positioning device #1.

[0284] In addition to determining the positioning reference point, electronic device #1 also needs to determine positioning device #1, which is used to determine the position of user #1.

[0285] In some embodiments, the positioning device #1 is also used to collect the actions of the user #1.

[0286] In some embodiments, before executing step S1308, electronic device #1 has not yet formed a network with electronic device #5. In this case, when executing step S1308, electronic device #1 may first form a network with electronic device #5, and after forming a network with electronic device #5, determine that electronic device #5 is positioning device #1.

[0287] For example, as shown in FIG5 , electronic device #1 determines electronic device #5 as positioning device #1 in response to a user's selection operation.

[0288] In some embodiments, before executing step S1308, electronic device #1 has already formed a network with electronic device #5. In this embodiment, electronic device #1 can determine that electronic device #5 is positioning device #1 in response to the user's selection operation on interface 508.

[0289] It should be understood that step S1308 and step S1301 do not necessarily follow a specific order of execution. For example, electronic device #1 may execute step S1308 first or step S1301 first, and this embodiment of the application does not specifically limit this.

[0290] It should also be understood that when electronic device #1 determines electronic device #2, electronic device #3 and electronic device #4 as positioning reference points and determines electronic device #5 as a positioning device, electronic device #1, electronic device #2, electronic device #3, electronic device #4 and electronic device #5 can belong to the same network.

[0291] S1309 , electronic device #5 determines spatial coordinate #1 based on the distances from electronic device #2, electronic device #3, and electronic device #4.

[0292] After electronic device #1 establishes a spatial coordinate system, it can share the information of the spatial coordinate system with electronic device #5, and then electronic device #5 obtains the distance between itself and electronic device #2, electronic device #3 and electronic device #4, and determines its spatial coordinate #1 in the spatial coordinate system based on the distance between itself and electronic device #2, electronic device #3 and electronic device #4.

[0293] It is understandable that when the user moves the electronic device #5, the spatial coordinate #1 may change accordingly.

[0294] When determining the spatial coordinates of electronic device #5, it can be assumed that the coordinates of electronic device #5 in the spatial coordinate system are (x, y, z), and the coordinates of electronic device #2, electronic device #3, and electronic device #4 in the spatial coordinate system are known, namely (x1, y1, z1), (x2, y2, z2), and (x3, y3, z3), respectively. Based on the distances d1, d2, and d3 between electronic device #5 and electronic device #2, electronic device #3, and electronic device #4, respectively, the following system of equations can be established. After electronic device #5 establishes the system of equations, the coordinates of electronic device #5 in the spatial coordinate system can be obtained by solving the system of equations.

[0295] In some embodiments, when electronic device #5 solves the above set of equations, it may obtain two spatial coordinates. Electronic device #5 can remove the erroneous spatial coordinates according to preset rules.

[0296] For example, when electronic device #1 starts a game application, it can prompt the user to place the positioning reference point below the positioning device. In this case, electronic device #5 can remove spatial coordinates with negative z coordinates.

[0297] It can be understood that the position of the electronic device #5 in the spatial coordinate system can also be understood as the position of the user in the spatial coordinate system.

[0298] S1310, electronic device #5 sends location information #1 to electronic device #1.

[0299] Correspondingly, electronic device #1 receives location information #1 sent by electronic device #5, where the location information #1 is used to indicate the spatial coordinates of electronic device #5.

[0300] It is understandable that by sending location information from electronic device #5 to electronic device #1, electronic device #1 can determine the location of user #1 in real time.

[0301] S1311, electronic device #1 displays a game interface according to location information #1.

[0302] After receiving location information #1, electronic device #1 can determine the change in the user's location, and then electronic device #1 can render the game interface and display it on the screen based on the change in the user's location.

[0303] For example, as shown in FIG6 , electronic device #1 can control the aircraft in interface 601 based on location information #1 sent by electronic device #5.

[0304] In the embodiment of the present application, electronic device #1 can customize its positioning reference point and positioning device, and determine the user's real-time location through the positioning device, thereby rendering and displaying the game interface based on the user's real-time location. The interactive method provided by this application does not require a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities. This facilitates the user's selection of positioning reference points and positioning devices, greatly expanding application scenarios and user interaction methods, and helping to enhance the user experience.

[0305] It can be understood that in the interactive method diagram shown in Figure 13, only three electronic devices are selected as positioning reference points, but this should not be understood as a specific limitation of the present application. In other embodiments of the present application, more than three electronic devices can also be selected for positioning.

[0306] It can also be understood that the electronic device serving as the positioning device and the electronic device serving as the positioning reference point are not the same electronic device.

[0307] In some embodiments, the method further includes: electronic device #5 collecting motion data of user #1.

[0308] Electronic device #5 can collect motion data of user #1 through motion sensors such as gyroscopes, acceleration sensors, and inertial sensors.

[0309] For example, electronic device #5 can collect motion data of user #1 waving one hand.

[0310] In some embodiments, the method further includes: electronic device #5 determining the action of user #1 based on the action data of user #1.

[0311] For example, the action of user #1 is to turn over the palm, and the electronic device #5 can determine that the action of user #1 is to turn over the palm through the motion data collected by the motion sensor.

[0312] In some embodiments, the method further includes: electronic device #5 sending action information #1 to electronic device #1.

[0313] Correspondingly, electronic device #1 receives action information #1 sent by electronic device #5.

[0314] There are two possible implementations for action information #1:

[0315] In one possible implementation, action information #1 is used to directly indicate the action of user #1. In other words, after electronic device #5 determines the action of user #1 based on the action captured by the motion sensor, it sends action information #1 to electronic device #1 to inform electronic device #1 of the action of user #1.

[0316] In one possible implementation, the action information #1 includes action data collected by the action sensor. In other words, the electronic device #5 sends the action data collected by the action sensor to the electronic device #1, and the electronic device #1 determines the action of the user #1.

[0317] In the embodiment of the present application, electronic device #1 and electronic device #5 can negotiate to adopt either of the two possible implementation methods described above, or electronic device #5 can determine to adopt either of the two possible implementation methods described above based on its own computing power. For example, when electronic device #5 has a stronger computing power, electronic device #5 can upload motion information that directly indicates the action of user #1; when electronic device #5 has a weaker computing power, electronic device #5 can upload motion information that includes motion data from a motion sensor. Alternatively, electronic device #5 can determine to adopt either of the two possible implementation methods described above based on its own computing power.

[0318] In the embodiments of the present application, the parameters for measuring computing power are not specifically limited. For example, the computing power of an electronic device can be measured by the number of million instructions per second (MIPS), operations per second (OPS), floating-point operations per second (FLOPS), and hash operations per second (Hash / s). When the parameter measuring the computing power of an electronic device reaches a certain threshold, it can be determined that the computing power of the electronic device is strong. When it is less than the threshold, it can be determined that the computing power of the electronic device is weak. Alternatively, in other embodiments of the present application, electronic device #5 can send action information #1 including action data of a motion sensor to any one or more of electronic devices #2, electronic device #3, and electronic device #4. Any one or more of electronic devices #2, electronic device #3, and electronic device #4 determine the action of the first user based on action information #1, and send indication information for indicating the action of user #1 to electronic device #1, so that electronic device #1 can display a game interface based on the action of user #1 and location information #1.

[0319] In some embodiments, S1311, electronic device #1 displays a game interface according to location information #1, including: electronic device #1 displays a game interface according to action information #1 and location information #1.

[0320] After receiving action information #1 and location information #1, electronic device #1 can determine the change in user #1's location and the action of user #1, and then electronic device #1 can render the game interface and display it on the screen based on the change in user #1's location and the action of user #1.

[0321] For example, as shown in FIG. 7 , electronic device #1 can control the aircraft in interface 701 to shoot according to action information #1 sent by electronic device #5.

[0322] In the embodiment of the present application, the positioning device can also collect user movements, and electronic device #1 can then render and display the game interface based on the user's real-time location and movements. The interactive method provided by this application does not require a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities. This facilitates user selection of positioning reference points and positioning devices, greatly expanding application scenarios and user interaction methods, and helping to enhance the user experience.

[0323] In some embodiments, the method further includes: electronic device #1 determining spatial coordinate #2 based on the distances from electronic device #2, electronic device #3, and electronic device #4.

[0324] After electronic device #1 establishes the spatial coordinate system, electronic device #1 obtains the distance between itself and electronic device #2, electronic device #3, and electronic device #4, and determines its spatial coordinate #2 in the spatial coordinate system based on the distance between itself and electronic device #2, electronic device #3, and electronic device #4.

[0325] It should be understood that the description of determining the spatial coordinate #2 for the electronic device #1 can be found above, and for the sake of brevity, it will not be repeated here.

[0326] In some embodiments, electronic device #1 displays a game interface based on action information #1 and position information #1, including: electronic device #1 displays a game interface based on action information #1, position information #1 and spatial coordinates #2.

[0327] For example, as shown in FIG8 , electronic device #1 can determine whether the basketball enters the basket 802 based on the distance between it and electronic device #5, and the motion information #1 and position information #1 sent by electronic device #5.

[0328] In the embodiment of the present application, electronic device #1 can also determine the positional relationship between itself and the user, and thus can render and display the game interface based on the positional relationship between itself and the user and the user's real-time actions. The interactive method provided by this application does not require a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities. This facilitates the user's selection of positioning reference points and positioning devices, greatly expanding application scenarios and user interaction methods, and helping to enhance the user experience.

[0329] In some embodiments, the method further includes: electronic device #1 determining electronic device #6 as positioning device #2.

[0330] Electronic device #6 sends location information #2 to electronic device #1. Correspondingly, electronic device #1 receives location information #2 sent by electronic device #6, where the location information #2 indicates the spatial coordinates of electronic device #6.

[0331] In some embodiments, S1311, electronic device #1 displays a game interface according to location information #1, including: electronic device #1 displays a game interface according to location information #1 and location information #2.

[0332] For example, as shown in FIG9 , electronic device #1 can control the aircraft on the left side of interface 901 based on location information #1 sent by electronic device #5, and control the aircraft on the right side of interface 901 based on location information #2 sent by electronic device #6.

[0333] In an embodiment of the present application, electronic device #1 can customize positioning reference points and multiple positioning devices, and determine the real-time locations of multiple users through multiple positioning devices, thereby rendering and displaying a game interface based on the real-time locations of multiple users. The interactive method provided by this application does not require a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities. This facilitates user selection of positioning reference points and positioning devices, greatly expanding application scenarios and user interaction methods, and helping to enhance the user experience.

[0334] In some embodiments, the method further includes: electronic device #6 collecting motion data of user #2.

[0335] In some embodiments, the method further includes: electronic device #6 determining the action of user #2 based on the action data of user #2.

[0336] In some embodiments, the method further includes: electronic device #6 sending action information #2 to electronic device #1.

[0337] Correspondingly, electronic device #1 receives action information #2 sent by electronic device #6.

[0338] It should be understood that the description of action information #2 can be the same as the description of action information #1 above. For the sake of brevity, it will not be repeated here.

[0339] In some embodiments, S1311, electronic device #1 displays a game interface according to position information #1, including: electronic device #1 displays a game interface according to action information #1, position information #1, action information #2 and position information #2.

[0340] In some embodiments, S1311, electronic device #1 displays a game interface according to position information #1, including: electronic device #1 displays a game interface according to action information #1, position information #1, action information #2, position information #2 and spatial coordinates #2.

[0341] For example, as shown in FIG10 , electronic device #1 can determine whether a basketball has entered the basket 1002 based on the distance between electronic device #5 and electronic device #5, as well as motion information #1 and position information #1 sent by electronic device #5. It can also determine whether a basketball has entered the basket 1003 based on the distance between electronic device #1 and electronic device #6, as well as motion information #2 and position information #2 sent by electronic device #6.

[0342] In the embodiment of the present application, electronic device #1 can also determine the positional relationship between itself and multiple users. This allows electronic device #1 to render and display a game interface based on the positional relationship between itself and the multiple users and the real-time actions of the multiple users. The interactive method provided by this application does not require a fixed positioning reference point, and the positioning reference point and positioning device can be any electronic device with distance perception capabilities. This facilitates user selection of positioning reference points and positioning devices, greatly expanding application scenarios and user interaction methods, and helping to enhance the user experience.

[0343] In some embodiments, electronic device #1 is a computer, a television, or a mobile phone, electronic device #2, electronic device #3, and electronic device #4 are Internet of Things (IOT) devices or wearable devices, and electronic device #5 and electronic device #6 are wearable devices.

[0344] FIG15 shows a schematic flow chart of another interaction method provided in an embodiment of the present application. As shown in FIG15 , the method includes:

[0345] S1501, electronic device #1 determines that electronic device #2 is an interactive device.

[0346] The game application running on electronic device #1 may have an online function, and electronic device #1 may determine electronic device #2 as an interactive device in response to a user's selection operation.

[0347] For example, as shown in FIG11 , electronic device #1 determines that electronic device #2 is an interactive device in response to a user's selection operation, that is, electronic device #2 is an electronic device connected to electronic device #1.

[0348] S1502: Electronic device #1 determines the distance between itself and electronic device #2.

[0349] S1503, electronic device #1 displays a game interface according to the distance between electronic device #1 and electronic device #2.

[0350] Electronic device #1 can determine the distance between itself and electronic device #2, and then render and display the game interface in real time based on the distance.

[0351] For example, as shown in FIG. 12 , electronic device #1 may move tank 1202 according to the distance between electronic device #1 and electronic device #2 to adjust the distance between tank 1202 and tank 1203 .

[0352] In some embodiments, the method further comprises:

[0353] S1504, electronic device #1 synchronizes the game interface to electronic device #2.

[0354] S1505, electronic device #2 displays the game interface.

[0355] After electronic device #1 renders and generates the game interface, it can synchronize the game interface to electronic device #2, so that electronic device #2 does not need to subscribe to the distance between it and electronic device #1, avoiding possible data conflicts.

[0356] In other embodiments, electronic device #2 can also obtain the distance between itself and electronic device #1, and render and display the game interface based on the distance.

[0357] In some embodiments, the interface includes one or more controls, and the method further includes:

[0358] Electronic device #1 updates the game interface in response to the user's operation on the one or more controls.

[0359] For example, as shown in Figure 12, control 1205 is used to control tank 1202 to shoot. When electronic device #1 detects the user's operation of clicking control 1205, in response to the operation, tank 1202 can be controlled to shoot.

[0360] In some embodiments, electronic device #1 may also synchronize the updated game interface to electronic device #2.

[0361] In an embodiment of the present application, electronic device #1 can run an online game and dynamically adjust the game interface according to the real-time distance between it and electronic device #2, thereby expanding the application scenarios and user interaction methods and helping to enhance the user experience.

[0362] In some embodiments, the game interface includes one or more controls, and electronic device #1 detects a user's operation on the one or more controls and can update the game interface in response to the operation.

[0363] For example, as shown in FIG12 , electronic device #1 detects an operation of a user clicking on control 1205 , and in response to this operation, it can control tank 1202 to shoot.

[0364] In some embodiments, electronic device #1 and electronic device #2 are computers, televisions, and mobile phones.

[0365] In the above, the interaction method provided in the embodiment of the present application can be applicable to a system composed of multiple electronic devices, but the embodiment of the present application is not limited to this. In other embodiments of the present application, the interaction method provided in the embodiment of the present application can also be applicable to a vehicle. The following is an introduction using a vehicle as an example.

[0366] Figure 16 is a functional block diagram of a vehicle 1600 according to an embodiment of the present application. Vehicle 1600 may include a device management system 1610, a computing platform 1620, and a display device 1630. The device management system 1610 may be networked with electronic devices and communicate with the networked electronic devices.

[0367] Some or all functions of vehicle 1600 may be controlled by computing platform 1620. Computing platform 1620 may include one or more processors, such as processors 1621 to 162n (n is a positive integer). A processor is a circuit capable of processing signals. In one implementation, the processor may be a circuit capable of reading and executing instructions, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor may implement certain functions through the logical relationships of hardware circuits. The logical relationships of the hardware circuits may be fixed or reconfigurable. For example, the processor may be a hardware circuit implemented as an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of the processor loading a configuration file to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, the processor may also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc. In addition, the computing platform 120 may also include a memory for storing instructions, and some or all of the processors 1621 to 162n may call the instructions in the memory to implement corresponding functions.

[0368] The in-cabin display devices 1630 are primarily categorized into two types: in-vehicle display screens; and projected display screens, such as heads-up displays (HUDs). An in-vehicle display screen is a physical display and a crucial component of the in-vehicle infotainment system. Multiple displays can be installed in the cockpit, including the digital instrument panel, the center console, the display in front of the front passenger (also known as the front passenger), the display in front of the left rear passenger, and the display in front of the right rear passenger. Even the windows can function as display screens. A head-up display, also known as a head-up display system, primarily displays driving information such as speed and navigation on a display device in front of the driver (e.g., the windshield). This reduces the driver's gaze shift time, avoids pupil changes caused by this shift, and improves driving safety and comfort. Examples of HUDs include combined head-up displays (C-HUDs), windshield heads-up displays (W-HUDs), and augmented reality heads-up displays (AR-HUDs). It should be understood that other types of HUD systems may appear as technology evolves, and this application is not limited to this.

[0369] The above display device 1630 is described by taking a vehicle display screen and a projection display screen as examples, and the embodiments of the present application are not limited thereto. For example, the display device 1630 can also be a light display screen or a projection screen.

[0370] Unlike a system composed of multiple electronic devices, which requires multiple electronic devices to be determined as positioning reference points, in a vehicle, the inherent audio device and / or display device in the cabin can be used as the positioning reference point.

[0371] In some embodiments, the audio devices and / or display devices used as positioning reference points are preset. For example, a vehicle includes audio device #1, audio device #2, audio device #3, and audio device #4. Audio device #1 is located above the driver's seat, audio device #2 is located above the left armrest in the second row, audio device #3 is located above the passenger seat, and audio device #4 is located above the right armrest in the second row. The vehicle can preset audio device #1, audio device #2, and audio device #3 as positioning reference points.

[0372] In some embodiments, the audio device and / or display device used as the positioning reference point is user-selected.

[0373] FIG17 shows another set of GUIs provided by an embodiment of the present application.

[0374] As shown in Figure 17 , the vehicle displays interface 1701, which is the interface of a gaming application. This interface 1701 includes information about audio devices that can serve as positioning reference points. In response to a user selecting and clicking control 1702, the vehicle can identify the audio units located above the driver's seat, above the left armrest of the second row, and above the passenger seat as positioning reference points. Other audio units can serve as auxiliary positioning reference points. A description of these auxiliary positioning reference points is provided below and is not detailed here.

[0375] Similar to the description above, the vehicle can also be networked with electronic devices, and the electronic devices can determine their spatial coordinates in the spatial coordinate system, so that the vehicle can render and display the game interface based on the spatial coordinates of the electronic devices in the spatial coordinate system.

[0376] FIG18 shows another set of GUIs provided by an embodiment of the present application.

[0377] As shown in Figure 18(a), a vehicle displays interface 1801, which is the interface for an airplane shooting game. The vehicle can move the airplane in interface 1801 based on the coordinates of its networked electronic device in the spatial coordinate system. The vehicle can also control the airplane in interface 1801 to shoot based on user motion information collected by the electronic device.

[0378] It should be understood that the specific description is similar to that of Figures 6 and 7, and for the sake of brevity, it will not be repeated here.

[0379] As shown in FIG18( b ), the vehicle displays interface 1802, which is an interface for a basketball shooting game and includes a basket 1803. The vehicle can determine whether the basketball has entered basket 1803 based on the positional relationship between the display device of interface 1802 and the electronic device, and the user's motion information collected by the electronic device.

[0380] It should be understood that the specific description is similar to that of FIG8 , and for the sake of brevity, it will not be repeated here.

[0381] FIG19 shows another set of GUIs provided by an embodiment of the present application.

[0382] As shown in Figure 19(a), the vehicle displays interface 1901, which is the interface for an airplane shooting game. The vehicle can move the airplane on the left side of interface 1901 based on the spatial coordinates of electronic device #1, which is networked with it, and can move the airplane on the right side of interface 1901 based on the spatial coordinates of electronic device #2, which is networked with it. The vehicle can also control the airplanes on the left and right sides of interface 1901 to shoot based on user motion information collected by electronic devices #1 and #2, respectively.

[0383] It should be understood that the specific description is similar to that of FIG9 , and for the sake of brevity, it will not be repeated here.

[0384] As shown in FIG19( b ), the vehicle displays interface 1902, which is an interface for a basketball shooting game and includes baskets 1903 and 1904. The vehicle can determine whether the basketball has entered baskets 1903 and 1904 based on the positional relationship between the display device of interface 1902 and electronic device #1, the positional relationship between the display device of interface 1902 and electronic device #2, and user motion information collected by electronic devices #1 and #2.

[0385] It should be understood that the specific description is similar to that of FIG10 , and for the sake of brevity, it will not be repeated here.

[0386] It should also be understood that when the vehicle displays basket 1903 and basket 1904 on two display devices respectively, the vehicle can determine whether the basketball enters basket 1903 based on the positional relationship between the display device displaying basket 1903 and electronic device #1 and the user's motion information collected by electronic device #1, and determine whether the basketball enters basket 1904 based on the positional relationship between the display device displaying basket 1904 and electronic device #2 and the user's motion information collected by electronic device #2.

[0387] FIG20 shows another set of GUIs provided by an embodiment of the present application.

[0388] As shown in Figure 20, the vehicle displays interface 2001 on display device #1 and interface 2002 on display device #2. Both interfaces 2001 and 2002 are table tennis game interfaces. Interface 2001 uses the first side of the table tennis table as the primary viewing angle, while interface 2002 uses the second side of the table tennis table as the primary viewing angle, with the first and second sides facing each other. Interfaces 2001 and 2002 include rackets 2003 and 2004, respectively. Rack 2003 corresponds to electronic device #1, while racket 2004 corresponds to electronic device #2. In other words, user #1 can control racket 2003 to hit the table tennis ball using electronic device #1, and user #2 can control racket 2004 to hit the table tennis ball using electronic device #2. Electronic devices #1 and #2 are already networked with the vehicle.

[0389] The vehicle can map the spatial coordinates in the spatial coordinate systems of electronic device #1 and electronic device #2 to interface 2001 and interface 2002, and sense the changes in the positions of electronic device #1 and electronic device #2 in real time to move racket 2003 and racket 2004.

[0390] In some embodiments, electronic device #1 and electronic device #2 can also collect the actions of user #1 and user #2 respectively, and then the vehicle can determine the running trajectory, movement speed and other parameters of the table tennis ball based on the action information #1 sent by electronic device #1 and the action information #2 sent by electronic device #2 and display them in interface 2001 and interface 2002.

[0391] It is understandable that in other embodiments, the vehicle may also display interface 2001 and interface 2002 simultaneously on one display device (for example, displaying interface 2001 on the left half of a display device and displaying interface 2002 on the right half).

[0392] It can also be understood that when the vehicle is running the game, it will update the game interface in real time. For example, user #1 first performs the serve operation. The vehicle can determine the motion trajectory and motion speed and other parameters of the table tennis ball after being hit by racket 2003 based on the position and action of user #1, generate a game interface, and display it in interface 2001 and interface 2002. After seeing it, user #2 can perform the hitting operation, so that the vehicle can determine the motion estimation and motion parameters of the table tennis ball after being hit by racket 2004 based on the position and action of user #2, and update the game interface.

[0393] It should also be understood that the game application scenario shown in FIG20 is also applicable to the interaction methods described in FIG5-10. Specifically, electronic device #1 can run the game application and determine electronic devices #2, #3, and #4 as positioning reference points, and electronic devices #5 and #6 as positioning devices. This allows user #1 to control racket 2003 to hit the ping-pong ball using electronic device #5, while user #2 can control racket 2004 to hit the ping-pong ball using electronic device #6. During the game, electronic device #1 can update the game interface in real time based on the actions of user #1 and user #2. For details, see the previous paragraph.

[0394] FIG21 shows a schematic flow chart of an interactive method provided by an embodiment of the present application. The method can be executed by the vehicle 1600, or the computing platform 1620, or the system consisting of the computing platform 1620 and the display device 1630, or the system-on-a-chip (SoC) in the computing platform 1620, or the processor, chip, or circuit in the computing platform 1620. The method is described below using a vehicle as an example. The method includes:

[0395] S2101, the vehicle determines that electronic device #1 is a positioning device.

[0396] It should be understood that the method by which the vehicle determines that electronic device #1 is a positioning device is similar to the method by which electronic device #1 determines that electronic device #5 is a positioning device described above, and will not be repeated here.

[0397] S2102, electronic device #1 determines spatial coordinate #1 based on the distances between electronic device #1 and positioning reference point #1, positioning reference point #2, and positioning reference point #3.

[0398] In some embodiments, positioning reference point #1, positioning reference point #2, and positioning reference point #3 are preset positioning reference points.

[0399] In some embodiments, positioning reference point #1, positioning reference point #2, and positioning reference point #3 are user-selected positioning reference points.

[0400] S2103, electronic device #1 sends location information #1 to the vehicle.

[0401] Correspondingly, the vehicle receives the location information #1 sent by the electronic device #1, where the location information #1 is used to indicate the spatial coordinate #1 of the electronic device #1.

[0402] S2104, the vehicle displays the game interface according to position information #1.

[0403] For example, as shown in (a) of FIG. 18 , the vehicle may move the aircraft in the interface 1801 according to the position information #1.

[0404] In some embodiments, the method further includes: the electronic device #1 sending action information #1 to the vehicle. Correspondingly, the vehicle receives the action information #1 sent by the electronic device #1.

[0405] In some embodiments, S2105, the vehicle displays a game interface based on location information #1, including: the vehicle displays a game interface based on location information #1 and action information #1.

[0406] For example, as shown in (a) of FIG18 , when the vehicle determines that the user is waving his hands based on the action information #1 uploaded by the electronic device #1, it controls the aircraft to start shooting.

[0407] In some embodiments, the vehicle displays the game interface based on position information #1 and action information #1, including: the vehicle displays the game interface based on position information #1, action information #1 and the position of the display device displaying the game interface in the spatial coordinate system.

[0408] For example, as shown in (b) of FIG18 , the vehicle can determine whether the basketball enters the basket 1803 based on the positional relationship between the display device of the display interface 1802 and the electronic device #1 and the user's motion information collected by the electronic device.

[0409] In some embodiments, the method further includes: the vehicle determining that electronic device #2 is a positioning device.

[0410] Electronic device #2 determines spatial coordinate #2 based on the distances between electronic device #2 and positioning reference point #1, positioning reference point #2, and positioning reference point #3.

[0411] Electronic device #2 sends location information #2 to the vehicle, where the location information #2 is used to indicate the spatial coordinates #2 of electronic device #2.

[0412] In some embodiments, S2105, the vehicle displays a game interface based on location information #1, including: the vehicle displays a game interface based on location information #1 and location information #2.

[0413] For example, as shown in (a) in Figure 19, the vehicle can move the aircraft on the left side of the interface 1901 according to the spatial coordinates of the electronic device #1 networked with it in the spatial coordinate system, and move the aircraft on the right side of the interface 1901 according to the spatial coordinates of the electronic device #2 networked with it in the spatial coordinate system.

[0414] In some embodiments, the method further includes: electronic device #2 sending action information #2 to the vehicle. Correspondingly, the vehicle receives the action information #2 sent by electronic device #2.

[0415] In some embodiments, S2105, the vehicle displays a game interface based on location information #1, including: the vehicle displays a game interface based on location information #1, action information #1, location information #2, and action information #2.

[0416] For example, as shown in (a) of FIG19 , the vehicle can also control the aircraft on the left and right sides of the interface 1901 to shoot according to the user's action information collected by electronic device #1 and electronic device #2, respectively.

[0417] In some embodiments, S2105, the vehicle displays the game interface based on position information #1, including: the vehicle displays the game interface based on position information #1, action information #1, position information #2 and action information #2, including: the vehicle displays the game interface based on position information #1, including: the vehicle displays the game interface based on position information #1, action information #1, position information #2 and action information #2 and the spatial coordinates of the display device displaying the game interface in the spatial coordinate system.

[0418] For example, as shown in (b) in Figure 19, the vehicle can determine whether the basketball enters basket 1903 and basket 1904 based on the positional relationship between the display device of display interface 1902 and electronic device #1, the positional relationship between the display device of display interface 1902 and electronic device #2, and the user's motion information collected by electronic device #1 and electronic device #2.

[0419] In some embodiments, the game interface includes game interface #1 and game interface #2, and the vehicle displays game interface #1 on display device #1 and displays game interface #2 on display device #2.

[0420] For example, as shown in Figure 20 , a vehicle can display a game interface with different perspectives on two display devices. Here, racket 2003 is associated with electronic device #1, and racket 2004 is associated with electronic device #2. This means that user #1 can control racket 2003 to hit a ping-pong ball using electronic device #1, and user #2 can control racket 2004 to hit a ping-pong ball using electronic device #2.

[0421] In some embodiments, the method further includes: the vehicle may also perform coordinate offset calibration based on the user's body size parameters.

[0422] Since different users have different body size parameters (e.g., arm span, sitting height, etc.), in order to ensure the user's gaming experience, the vehicle can perform coordinate offset calibration based on the user's body size parameters.

[0423] Exemplarily, taking the airplane shooting game shown in (a) of Figure 18 as an example, the vehicle can pre-establish a mapping relationship, which is established based on a wingspan of 1.4m. For example, the length of interface 1801 from the leftmost end to the rightmost end is 5000 pixels. Assuming that under this mapping relationship, when the electronic device #1 worn by the user shifts 1cm to the left, the aircraft can shift 20 pixels to the left, and when the electronic device #1 worn by the user shifts 1cm to the right, the aircraft can shift 20 pixels to the right. The vehicle can perform coordinate offset calibration based on this mapping relationship and the user's actual wingspan. Taking the user's actual wingspan of 1.75m as an example, the ratio of the user's actual wingspan to the vehicle's pre-set wingspan is 1.25, then when the electronic device #1 worn by the user shifts 1cm to the left, the aircraft can shift 20 / 1.25=16 pixels to the left. Taking the user's actual arm span as 1 meter as an example, and the ratio of the vehicle's pre-set arm span to the user's actual arm span is 1.4, then if the user's electronic device #1 shifts 1 cm to the left, the aircraft can shift 20*1.4=28 pixels to the left.

[0424] For example, taking the table tennis game shown in FIG20 as an example, the vehicle determines the sitting heights of user #1 and user #2 respectively. When the sitting heights of user #1 and user #2 are different, the vehicle can map the sitting heights of user #1 and user #2 to the same height. For example, the heights of user #1 and user #2 in the table tennis game can be 50 pixels higher than the table.

[0425] The vehicle can also determine the arm spans of user #1 and user #2 respectively, and can establish a mapping relationship based on the arm span of one of the users. For example, the length of interface 2001 from the leftmost end to the rightmost end is 5000 pixels, the arm span of user #1 is 1.4m, and the arm span of user #2 is 1.75m, and a mapping relationship is established based on the arm span of user #1. Assuming that under this mapping relationship, when the electronic device #1 worn by user #1 shifts 1cm to the left, racket 2003 can shift 20 pixels to the left, and when the electronic device #1 worn by user #1 shifts 1cm to the right, racket 2003 can shift 20 pixels to the right. The vehicle can perform coordinate offset calibration based on this mapping relationship and the actual arm span of user #2. The ratio of the arm span of user #2 to the arm span of user #1 is 1.25. If the electronic device #2 worn by user #2 is offset 1 cm to the left, the racket 2004 can be offset 20 / 1.25=16 pixels to the left. If the electronic device #2 worn by user #2 is offset 1 cm to the right, the racket 2004 can be offset 16 pixels to the right.

[0426] In some embodiments, the method further includes: electronic device #1 calibrating the spatial coordinates of electronic device #1 according to the auxiliary positioning reference point.

[0427] For example, taking the number of auxiliary positioning reference points as 1, when electronic device #1 determines the spatial coordinates, it can be assumed that the coordinates of electronic device #1 in the spatial coordinate system are (x, y, z), and the coordinates of positioning reference point #1, positioning reference point #2, positioning reference point #3, and the auxiliary positioning reference points in the spatial coordinate system are known, namely (x1, y1, z1), (x2, y2, z2), (x3, y3, z3), (x3, y3, z3), and electronic device #1 can establish the following set of equations based on the distances d1, d2, d3, and d4 between it and positioning reference point #1, positioning reference point #2, positioning reference point #3, and the auxiliary positioning reference points. After electronic device #1 establishes the set of equations, the spatial coordinates of electronic device #1 in the spatial coordinate system can be obtained by solving the set of equations.

[0428] When calculating the above-mentioned set of equations, an approximate solution can be performed. In the embodiment of the present application, there is no specific limitation on the algorithm for the approximate solution. For example, it can be a weighted method, a least squares method, a centroid method, etc.

[0429] In some embodiments, electronic device #1 and electronic device #2 may be wearable devices.

[0430] The above mainly introduces an interaction method provided by an embodiment of the present application from the perspective of electronic equipment and vehicles. It is understandable that, in order to realize the above functions, electronic equipment and vehicles include hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0431] In the embodiments of the present application, the processors in electronic devices and vehicles can be divided into functional modules (or units) according to the above-mentioned method examples. For example, each functional module (or unit) can be divided according to each function, or two or more functions can be integrated into one processing module (or unit). The above-mentioned integrated modules (or units) can be implemented in the form of hardware or software functional modules (or units).

[0432] The present application provides a computer program product that, when executed on an electronic device, enables the electronic device to execute the technical solution in the above embodiment. The implementation principle and technical effects are similar to those of the above method-related embodiments and will not be described in detail here.

[0433] The embodiment of the present application provides a readable storage medium, which contains instructions. When the instructions are executed on an electronic device, the electronic device executes the technical solution of the above embodiment. The implementation principle and technical effect are similar and will not be repeated here.

[0434] The present application provides a chip for executing instructions. When the chip is running, the technical solution of the above embodiment is executed. The implementation principle and technical effect are similar and will not be described here.

[0435] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of this application.

[0436] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0437] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0438] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0439] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0440] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0441] The above description is merely a specific implementation of the embodiments of the present application, but the scope of protection of the embodiments of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the embodiments of the present application should be included in the scope of protection of the embodiments of the present application. Therefore, the scope of protection of the embodiments of the present application should be based on the scope of protection of the claims.

Claims

1. An interactive system, characterized in that: The system includes a first electronic device and a second electronic device, wherein: The first electronic device is configured to, in response to a user selection operation, determine at least three electronic devices as positioning reference points to establish a spatial coordinate system, and determine the second electronic device to be used for acquiring first position information, the at least three electronic devices not including the first electronic device and the second electronic device; The second electronic device is configured to send the first position information to the first electronic device, where the first position information indicates the spatial coordinates of the second electronic device in the spatial coordinate system; The first electronic device is further configured to receive the first position information and display a game interface according to the first position information.

2. The interactive system according to claim 1, characterized in that The second electronic device is further configured to send first action information to the first electronic device based on its own computing power; The first electronic device is specifically configured to display the game interface according to the first action information and the first position information.

3. The interactive system according to claim 2, characterized in that The first action information is used to directly indicate an action of the first user.

4. The interactive system according to claim 2, characterized in that The first motion information includes motion data of a motion sensor, and the first electronic device is specifically configured to: determining an action of the first user according to the first action information; The game interface is displayed according to the action of the first user and the first position information.

5. The interactive system according to any one of claims 1 to 4, characterized in that: The first electronic device is further configured to determine the spatial coordinates of the first electronic device in the spatial coordinate system; The first electronic device is specifically configured to display the game interface according to the first action information, the first position information, and the spatial coordinates of the first electronic device in the spatial coordinate system.

6. The interactive system according to any one of claims 1 to 5, characterized in that: The first electronic device is specifically configured to, in response to a user's selection operation, confirm that the at least three electronic devices are the positioning reference points when it is determined that the at least three electronic devices are not collinear.

7. The interactive system according to claim 6, characterized in that The first electronic device is further configured to output prompt information when it is determined that the at least three electronic devices are collinear, where the prompt information is used to prompt how to determine the positions of the at least three electronic devices.

8. The interactive system according to claim 1, characterized in that The system further includes a third electronic device, wherein the first electronic device is further configured to, in response to a user's selection operation, determine that the third electronic device is used to obtain the second location information; The third electronic device is configured to send second location information to the first electronic device, where the second location information is used to indicate the spatial coordinates of the third electronic device in the spatial coordinate system; The first electronic device is specifically configured to display a game interface according to the first position information and the second position information.

9. The interactive system according to claim 8, characterized in that: The second electronic device is further configured to send first action information to the first electronic device; The third electronic device is further configured to send second action information to the first electronic device; The first electronic device is specifically configured to display the game interface according to the first action information, the first position information, the second action information, and the second position information.

10. The interactive system according to claim 9, characterized in that: The first electronic device is further configured to determine the spatial coordinates of the first electronic device in the spatial coordinate system; The first electronic device is specifically configured to display the game interface according to the first action information, the first position information, the second action information, the second position information, and the spatial coordinates of the first electronic device in the spatial coordinate system.

11. The interactive system according to claim 1, characterized in that: The system further includes a third electronic device, wherein the first electronic device is further configured to, in response to a user's selection operation, determine that the third electronic device is used to obtain the second location information; The second electronic device is further configured to send first action information to the first electronic device; The first electronic device is specifically configured to display a first game interface according to the first position information and the first action information; The third electronic device is configured to send the second position information and the second action information to the first electronic device, where the second position information indicates the spatial coordinates of the third electronic device in the spatial coordinate system; The first electronic device is further configured to update the first game interface to Second game interface.

12. The interactive system according to any one of claims 1 to 11, characterized in that: The at least three electronic devices include a fourth electronic device, a fifth electronic device and a sixth electronic device, the first electronic device is one of a computer, a television, and a mobile phone, the second electronic device is a wearable device, and the fourth electronic device, the fifth electronic device and the sixth electronic device are Internet of Things (IoT) devices or wearable devices.

13. An interactive method, characterized in that The method is applied to a first electronic device, and includes: In response to a user selection operation, determining at least three electronic devices as positioning reference points to establish a spatial coordinate system, and determining a second electronic device to obtain first location information, the at least three electronic devices not including the first electronic device and the second electronic device; receiving the first location information sent by the second electronic device, where the first location information is used to indicate the spatial coordinates of the second electronic device in the spatial coordinate system; A game interface is displayed according to the first position information.

14. The method according to claim 13, wherein: The method further comprises: receiving first action information sent by the second electronic device; The displaying of the game interface according to the first position information includes: The game interface is displayed according to the first action information and the first position information.

15. The method according to claim 14, characterized in that The first action information is used to directly indicate an action of the first user.

16. The method according to claim 14, characterized in that The first motion information includes motion data of a motion sensor, and the displaying of a game interface according to the first position information includes: determining an action of the first user according to the first action information; The game interface is displayed according to the action of the first user and the first position information.

17. The method according to any one of claims 13 to 16, characterized in that The method further comprises: determining the spatial coordinates of the first electronic device in the spatial coordinate system; The displaying of the game interface according to the first action information and the first position information includes: The game interface is displayed according to the first action information, the first position information, and the spatial coordinates of the first electronic device in the spatial coordinate system.

18. The method according to any one of claims 13 to 17, characterized in that The method of determining at least three electronic devices as positioning reference points to establish a spatial coordinate system in response to a user's selection operation includes: in response to a user's selection operation, when it is determined that the at least three electronic devices are not collinear, confirming the at least three electronic devices as the positioning reference points.

19. The method according to claim 18, characterized in that The method further includes: when it is determined that the at least three electronic devices are collinear, outputting prompt information, where the prompt information is used to prompt how to determine the positions of the at least three electronic devices.

20. The method according to claim 13, wherein The method further comprises: In response to a selection operation by the user, determining that a third electronic device is used to obtain the second location information; receiving the second position information sent by the third electronic device, where the second position information is used to indicate the spatial coordinates of the third electronic device in the spatial coordinate system; The displaying of the game interface according to the first position information includes: A game interface is displayed according to the first position information and the second position information.

21. The method according to claim 20, characterized in that The method further comprises: receiving first action information sent by the second electronic device; receiving second action information sent by the third electronic device; The displaying of the game interface according to the first position information and the second position information includes: The game interface is displayed according to the first action information, the first position information, the second action information, and the second position information.

22. The method according to claim 21, characterized in that The method further comprises: determining the spatial coordinates of the first electronic device in the spatial coordinate system; Displaying the game interface according to the first action information, the first position information, the second action information, and the second position information includes: The game interface is displayed according to the first action information, the first position information, the second action information, the second position information, and the spatial coordinates of the first electronic device in the spatial coordinate system.

23. The method according to claim 13, wherein The method further includes: in response to a user's selection operation, determining that a third electronic device is used to obtain the second location information; receiving first action information sent by the second electronic device; The displaying of the game interface according to the first position information includes: displaying a first game interface according to the first position information and the first action information; The method further comprises: receiving the second position information and the second action information sent by the third electronic device, where the second position information is used to indicate the spatial coordinates of the third electronic device in the spatial coordinate system; The first game interface is updated to a second game interface according to the second position information and the second action information.

24. The method according to any one of claims 13 to 23, characterized in that The at least three electronic devices include a fourth electronic device, a fifth electronic device and a sixth electronic device, the first electronic device is one of a computer, a television, and a mobile phone, the second electronic device is a wearable device, and the fourth electronic device, the fifth electronic device and the sixth electronic device are Internet of Things (IOT) devices or wearable devices.

25. An electronic device, characterized in that: The method comprises one or more processors; one or more memories; the one or more memories storing one or more computer programs, the one or more computer programs comprising instructions, which, when executed by the one or more processors, cause the method according to any one of claims 13 to 24 to be executed.

26. A computer-readable storage medium, characterized in that Instructions are stored thereon, and when the instructions are executed by a processor, the processor is caused to implement the method according to any one of claims 13 to 24.

27. A chip, characterized in that: The chip comprises a circuit for performing the method according to any one of claims 13 to 24.

28. A computer program product, characterized in that When the computer program product is run on a computer, the computer is caused to perform the method according to any one of claims 13 to 24.

Images