Information prompting method, electronic equipment, storage medium and program product

Abstract

The invention relates to an information prompting method, electronic equipment, a storage medium and a program product, and the information prompting method comprises the steps: obtaining coordinate information of user equipment and a current user operation direction; extracting coordinate information of each peripheral device from a device information base; performing azimuth calculation based on the coordinate information of the user equipment and the coordinate information of each peripheral equipment to obtain the spatial azimuth of each peripheral equipment relative to the user equipment; based on the current user operation direction of the user equipment and the spatial orientation of each peripheral equipment relative to the user equipment, carrying out equipment screening so as to determine target peripheral equipment from each peripheral equipment; wherein the included angle between the spatial orientation of the target peripheral equipment and the current user operation direction is smaller than a preset angle threshold value.

Description

Technical Field

[0001] This application relates to the field of Internet of Things (IoT) technology, and in particular to an information prompting method, electronic device, storage medium, and program product. Background Technology

[0002] With the popularization of IoT and smart home technologies, users are increasingly demanding intuitive "what you point to is what you get" interaction between devices.

[0003] In related technologies, the system can obtain user device control information from the cloud in real time via the network. However, this solution relies on cloud communication, which not only causes interaction delays but also fails completely when the network is poor, resulting in poor real-time performance. In addition, users need to manually select the target device from the device list and then initiate control. This is inefficient and prone to errors in environments with dense devices, and the operation steps are cumbersome, which undermines the smooth experience that should be provided by the interaction. Summary of the Invention

[0004] This application provides an information prompting method, electronic device, storage medium, and program product, which can solve the problems of poor real-time interaction due to network interference, low efficiency and error-proneness in densely populated environments, cumbersome operation steps, and disruption of the smooth user experience that should be provided by interactive interfaces. The technical solution is as follows.

[0005] On the one hand, an information prompting method is provided, the method being executed by a user device, the method comprising: Obtain the coordinate information of the user equipment and the current user operation direction; Extract the coordinate information of each surrounding device from the device information database; Based on the coordinate information of the user equipment and the coordinate information of each of the surrounding devices, the spatial orientation of each of the surrounding devices relative to the user equipment is calculated. Based on the current user operation direction of the user equipment and the spatial orientation of each of the peripheral devices relative to the user equipment, device filtering is performed to determine the target peripheral device from the peripheral devices; wherein, the angle between the spatial orientation of the target peripheral device and the current user operation direction is less than a preset angle threshold. Read the service capability information of the target peripheral device from the device information database, and display the service capability information of the target peripheral device on the display interface of the user device.

[0006] On the other hand, an electronic device is provided, comprising a processor and a memory, the memory storing at least one computer program, the at least one computer program being loaded and executed by the processor to implement the above-described information prompting method.

[0007] On the other hand, a computer-readable storage medium is provided, wherein at least one computer program is stored in the computer-readable storage medium, the computer program being loaded and executed by a processor to implement the above-described information prompting method.

[0008] On the other hand, a computer program product is provided, the computer program product including a computer program stored on a non-transitory computer-readable storage medium, the computer program including program instructions, which, when executed by a computer, cause the computer to execute to implement the information prompting method provided in the various optional implementations described above.

[0009] The information prompting method provided in this application embodiment obtains the coordinate information of the user device and all surrounding devices, calculates and determines the spatial orientation of the surrounding devices relative to the user device; then, it compares the current user operation pointing with the spatial orientation of the surrounding devices, and filters out target surrounding devices whose orientation angle is within a preset range; finally, it directly reads and displays the service capability information of the target surrounding device from the local device information database. In the above solution, by pre-storing a device information database containing the coordinate information and service capability information of surrounding devices locally, the relevant information of the target surrounding device can be directly read without relying on cloud communication when the user points, overcoming the problem of interaction lag and failure caused by network latency or interruption, and ensuring high real-time performance and high reliability in offline environments; through coordinate-based spatial orientation calculation and automatic filtering of pointing angles, users can accurately lock onto the target through intuitive pointing even in dense device scenarios, greatly improving operation efficiency and accuracy, eliminating the risk of accidental touches, and ultimately achieving a seamless and smooth "what you point is what you get" interactive experience.

[0010] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0011] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0012] Figure 1 A flowchart of an exemplary embodiment of this application is shown; Figure 2 A schematic diagram of the display interface of a user device provided in an exemplary embodiment of this application is shown; Figure 3 A schematic diagram of a control panel provided in an exemplary embodiment of this application is shown; Figure 4 A schematic diagram illustrating the display interface of another user device provided in an exemplary embodiment of this application is shown; Figure 5 This illustration shows a schematic diagram of the device hardware configuration in a scenario provided by an exemplary embodiment of this application. Detailed Implementation

[0013] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of methods consistent with some aspects of this application as detailed in the appended claims.

[0014] To address the problems existing in the prior art, this application provides an information prompting method that can automatically identify and display device capabilities based on location, thus meeting the user's "what you point to is what you get" interactive needs. Figure 1 A flowchart of an exemplary embodiment of this application is shown, which can be executed by a user device, such as... Figure 1 As shown, the method may include the following steps.

[0015] Step 110: Obtain the coordinate information of the user device and the current user operation direction.

[0016] In one possible implementation, the coordinate information of the user equipment can be extracted from the device attribute information of the user equipment itself. This coordinate information can be calculated using a time-of-arrival (TOA) algorithm. The TOA algorithm involves deploying 3-4 anchor point devices with known coordinate information indoors. The user equipment emits a short pulse signal, and each anchor point device records the absolute time of signal arrival and feeds it back to the user equipment. The user equipment establishes a system of equations based on the time interval between the short pulse signal and each anchor point device. Solving this system of equations yields the coordinate information of the user equipment.

[0017] In one possible implementation, the process of calculating the coordinate information of each user device can be performed by each user device through its built-in indoor positioning module. In this case, each anchor point device returns a timestamp of the received short pulse signal to the corresponding user device. After receiving the timestamps returned by each anchor point device, the user device establishes a system of equations and obtains its own coordinate information by solving the equations. Alternatively, in another possible implementation, the process of calculating the coordinate information of each user device can be performed by an indoor positioning system independent of each user device. The indoor positioning system calculates the coordinate information of each user device through interaction with each user device and a time-of-arrival algorithm, and synchronizes the coordinate information of each user device to the corresponding user device so that each user device adds the coordinate information to its own device attribute information. The interaction between the indoor positioning system and each user device may include instructing each user device to send a short pulse signal and receiving the timestamps of the received short pulse signals from each user device returned by each anchor point device.

[0018] User equipment can determine the current user operation direction by collecting information from built-in sensors. For example, user equipment can collect angular velocity, acceleration, and / or geomagnetic data through the IMU (Inertial Measurement Unit) module and calculate the current user operation direction through the Kalman filter algorithm.

[0019] After the user equipment's location changes, the coordinate information and the current user operation direction are recalculated to reacquire the user equipment's coordinate information and the current user operation direction. For example, if the user equipment detects that its rotation angle exceeds an angle threshold, a reacquisition of the user operation direction is triggered.

[0020] Step 120: Extract the coordinate information of each peripheral device from the device information database.

[0021] The device information database is pre-built and updated based on real-time acquisition of dynamically released device information from various surrounding devices. This device information includes device attribute information and service capability information of the surrounding devices, with the device attribute information including the coordinate information of the surrounding devices. The coordinate information of the surrounding devices can be calculated by the surrounding devices themselves through their own indoor positioning modules, or it can be calculated by the indoor positioning system and synchronized to the corresponding device. The calculation method for the coordinate information of the surrounding devices can refer to the calculation method for the coordinate information of user devices, and will not be elaborated here. When the location of a surrounding device changes, it triggers a re-determination of the coordinate information of the surrounding device to update the corresponding device attribute information.

[0022] In this embodiment, the peripheral devices of the user equipment have the ability to dynamically publish service capabilities. These capabilities are updated in real time, exhibiting both real-time performance and scalability. In other words, when device functions change, the applications running on the peripheral devices dynamically adjust the broadcast service capability list based on the updated device functions, notifying the user equipment of their latest service capabilities. For example, if a smart TV adds support for a screen mirroring protocol, or a smart speaker may support new services due to firmware updates or application switching, it will dynamically adjust its broadcast service capability list based on the updated functions. Correspondingly, the user equipment receives the updated service capability list broadcast by the peripheral devices, parses it, and stores the updated service capability information of each peripheral device.

[0023] In one possible implementation, the peripheral device's processor can execute an embedded application to dynamically generate a GATT (Generic Attribute Profile) service tree and update broadcast content based on the GATT service tree. The GATT service tree is a hierarchical data structure used to organize the peripheral device's services, attributes, and descriptors. Services are defined containers, while attributes and descriptors are readable / writable data items. Dynamic generation refers to the peripheral device's software logic constructing the service tree in real-time based on the current device state and functional availability. For example, the processor periodically scans the peripheral device's functional modules, extracts supported service capabilities, and maps them to standard UUIDs (Universally Unique Identifiers). When device functionality changes, the software regenerates the service tree and triggers the communication module to update broadcast content. This broadcast-based dissemination of service function information allows for efficient information propagation without establishing a connection, reducing firmware re-flash requirements and improving flexibility and maintainability.

[0024] As an illustration, when the surrounding device is a smart TV, its corresponding GATT service tree can include screen mirroring service UUID:0x1812 (HID over GATT, extended to video), feature: mirroring control (UUID:0x2A4D). After the TV firmware is updated to support 4K screen mirroring, a new feature UUID:0x1813 (resolution setting) is added. Broadcast packet: integrates UUID, MAC (Media Access Control Address), and a brief description (such as bit values ​​indicating 4K support), automatically refreshed when the device restarts or features change.

[0025] When the peripheral device is a smart speaker, its corresponding GATT service tree can include audio service UUID:0x5678, with features including playback control (UUID:0x2A9D, value: play / pause / stop) and volume adjustment (UUID:0x2A9E, value 0-100). If a new device (such as Bluetooth headphones) is connected to the speaker, a multi-device audio synchronization service UUID:0x5679 is dynamically added. Broadcast packet encapsulation: contains a list of UUIDs [0x5678, 0x2A9D, 0x2A9E, 0x5679], MAC address, and service version number, ensuring that the user device obtains the latest capabilities during scanning.

[0026] When the surrounding device is a smart bulb, the processor detects that the current functions include brightness adjustment (range 0-100%), color temperature adjustment (2700K-6500K) and timer switch. The corresponding GATT service tree can include the main service UUID:0x180F (battery service, additional); and the custom lighting service UUID:0x1234, which includes the characteristics: brightness (UUID:0x2A19, value type uint8) and color temperature (UUID:0x2A6E, value type uint16). If a user adds an RGB color mode through App configuration, the processor updates the service tree, adds the new feature UUID:0x1236 (RGB value, type uint24), and pushes the updated broadcast example in the next broadcast cycle: [UUIDs:0x1234, 0x2A19, 0x1235, 0x2A6E, 0x1236; MAC:AA:BB:CC:DD:EE:FF; Flags:0x01 (indicating support for dynamic updates)], with a total length of less than 62 bytes.

[0027] In one possible scenario, peripheral devices can broadcast service capability information via a BLE (Bluetooth Low Energy) module according to a target broadcast cycle. When broadcasting service capability information, they can broadcast the UUID corresponding to the service capability information. Correspondingly, the user device can scan and receive the service UUID broadcast by the peripheral device through the BLE module, and obtain the service capability information of the peripheral device by parsing the service UUID.

[0028] In addition, peripheral devices can broadcast their own device attribute information. Correspondingly, user devices can automatically collect device attribute information of peripheral devices, such as device identification, coordinate information, signal strength, and functions provided. For example, smart bulbs provide the function of adjusting lights, speakers provide the function of playing music, and TVs provide the function of screen casting.

[0029] In one possible implementation, the user equipment can continuously scan via Bluetooth to receive device information broadcast by surrounding devices. This device information includes device attribute information and service capability information. Based on the received device information from each surrounding device, a device information database is constructed to store the correspondence between surrounding devices and their information. Illustratively, this device information database can be a JSON database. When the user equipment performs a Bluetooth scan, it receives broadcast packets from surrounding devices, parses and extracts the device identifier, signal strength, and service capability information, and stores it in JSON format (e.g., {ID:AA:BB:CC:DD:EE:FF, RSSI:-50, services:[0x1234, 0x2A19, 0x2A6E], coordinates:null}).

[0030] Furthermore, if more detailed device information, such as characteristic values, supported operating range, or current status, is required based on actual needs, the user device can also establish a communication connection with the scanned peripheral devices to initiate a service information retrieval request. This allows the user device to obtain more comprehensive device information from the peripheral devices and update the obtained device information in the locally stored device information database. For example, the user device can establish a GGATT (Generic Attribute Profile) connection with a peripheral device, sending a "Discover All PrimaryServices" request to obtain complete service capability information. Based on the service capability information returned by the peripheral device, the user device updates the device information of that peripheral device in the device information database, resulting in updated JSON format information: { "ID": "AA:BB:CC:DD:EE:FF", RSSI: -50, "coordinates": "(x_i, y_i, z_i)", "services": [ {"UUID": "0x1234", "name": "Lighting", "characteristics": [ {"UUID": "0x2A19", "name": "Brightness", "value": "50%", "range": "0-100%"}, {"UUID": "0x2A6E", "name": "ColorTemperature", "value": "4000K", "range": "2700K-6500K"} ]} ] } After the device information database is established, user devices can extract the coordinate information of each peripheral device from the device information stored in the database corresponding to each peripheral device.

[0031] Step 130: Based on the coordinate information of the user device and the coordinate information of each peripheral device, perform orientation calculation to obtain the spatial orientation of each peripheral device relative to the user device.

[0032] The user equipment can compare the coordinate information of each peripheral device with the coordinate information of the user equipment one by one to determine the difference between each peripheral device and the user equipment in the horizontal, vertical and depth directions, and obtain the spatial orientation used to describe the relative direction.

[0033] Step 140: Based on the current user operation direction of the user device and the spatial orientation of each peripheral device relative to the user device, device filtering is performed to determine the target peripheral device from the peripheral devices; wherein, the angle between the spatial orientation of the target peripheral device and the current user operation direction is less than a preset angle threshold.

[0034] When a user device determines a target peripheral device from various peripheral devices, it can compare the spatial orientation of each peripheral device relative to the user device with the current user operation direction to determine the directional difference between the two. This difference indicates whether the orientation of the user device is close to the straight line direction from the user device to the peripheral device. The user device can quantify the directional difference between the two into an angle. If the angle between the spatial orientation of a certain peripheral device and the current user operation direction is less than a preset angle threshold, under certain circumstances, the peripheral device can be determined as the target peripheral device.

[0035] Alternatively, in another possible scenario, if the angle between the spatial orientation of a certain peripheral device and the current user's pointing direction is less than a preset angle threshold, that peripheral device can be identified as a candidate for the target peripheral device. Further device filtering can then be performed based on these candidates to determine the target peripheral device. For example, device filtering can be further based on the distance between the peripheral device and the user's device. This process can be implemented as follows: Obtain the target distance between each peripheral device and the user device; In response to the existence of a set of surrounding devices where the target distance is less than a first distance threshold and the angle between the spatial orientation and the current user operation direction is less than a preset angle threshold, the target surrounding device is determined from the set of surrounding devices.

[0036] In other words, a user device can add a peripheral device to the peripheral device set if the distance between the user device and the peripheral device is less than a first distance threshold, and the angle between the spatial orientation of the peripheral device and the current user's operating direction is less than a preset angle threshold. For example, if the preset angle threshold is 15 degrees, the angle between the current user's operating direction and the spatial orientation of the TV relative to the user device is 10 degrees, the angle between the current user's operating direction and the spatial orientation of the speaker relative to the user device is 30 degrees, and the angle between the current user's operating direction and the spatial orientation of the smart light relative to the user device is 12 degrees, then filtering based on these angles can identify the TV and the smart light. If the first distance threshold is 5 meters, the distance between the TV and the user device is 3 meters, and the distance between the smart light and the user device is 8 meters, then it can be determined that the user device is pointing at the TV, and the device identifier corresponding to the TV can be added to the peripheral device set. It should be noted that the values ​​of the above thresholds are only illustrative and can be set differently based on different actual needs. This application does not impose any restrictions on this. In addition, the filtering order can also be set based on actual needs. That is, the user device can first filter devices based on the distance between itself and the user device, and then filter devices based on the angle between the spatial orientation of the surrounding devices and the current user operation direction.

[0037] In one possible implementation, the user equipment can identify a peripheral device in the peripheral device set as the target peripheral device, or, when the number of peripheral devices in the peripheral device set is 1, identify a peripheral device in the peripheral device set as the target peripheral device.

[0038] In another possible implementation, the device attribute information includes device signal strength. The user equipment can further filter the peripheral devices in the peripheral device set based on the device signal strength of each peripheral device to determine the target peripheral device. In this case, determining the target peripheral device from the peripheral device set includes: In response to the fact that the number of peripheral devices in the peripheral device set is multiple, the device signal strength of each peripheral device in the peripheral device set is extracted; The target peripheral device is determined from the n peripheral devices with the strongest signal strength in the peripheral device set, where n is a positive integer.

[0039] The user equipment can extract the signal strength of each peripheral device in the peripheral device set from the device information database. Then, the user equipment can sort the devices according to their signal strength, such as sorting from high to low or from low to high, to filter out the top n peripheral devices with the strongest signal strength, and to determine the target peripheral device from the top n peripheral devices. The value of n can be set based on actual needs, and this application does not impose any restrictions on it.

[0040] In one possible implementation, the user equipment can identify the n peripheral devices with the strongest signal strength as target peripheral devices; or, in another possible implementation, the user equipment can further filter peripheral devices based on signal strength differences. In this case, the user equipment can calculate the signal strength difference between the signal strength of each peripheral device and the strongest signal strength, and identify the peripheral devices with signal strength differences less than the strength difference threshold, as well as the peripheral device with the strongest signal strength, as target peripheral devices.

[0041] Step 150: Read the service capability information of the target surrounding devices from the device information database, and display the service capability information of the target surrounding devices on the display interface of the user device.

[0042] After identifying the target peripheral device, the user equipment can store the device identifier of the target peripheral device in a memory buffer. Then, the user equipment can directly read the pre-stored service capability information of the target peripheral device from the device information database from the device identifier read from the memory buffer. The reading process can be completed through memory indexing without additional data interaction. Therefore, the latency in the information acquisition process can be reduced and the information acquisition efficiency can be improved.

[0043] After obtaining the service capability information of the target peripheral device, the service capability information of the target peripheral device is transmitted to the display module of the user device so as to display the service capability information of the target peripheral device on the display interface. For example, if the target peripheral device is a smart bulb, after querying its pre-stored service capability information as "lighting service: brightness 50%, color temperature 4000K" from the device information database, the service capability information is displayed on the display interface of the user device.

[0044] In one possible implementation, to avoid misjudgments and improve interaction accuracy and user experience, before displaying service capability information on the display interface, the user device can also determine the duration of the user device being currently pointed at by the user. This ensures that the service capability information is displayed only if it is determined that the user intentionally selected a target device, thus avoiding misdisplays caused by the user unintentionally pointing at a target device while moving. In this case, displaying the service capability information of the target device on the user device's display interface includes: If the duration of the user device being in the current user operation direction exceeds a preset duration threshold, the service capability information of the target surrounding devices will be displayed on the user device's display interface.

[0045] Wherein, if the duration of the user device being in the current user operation direction is greater than a preset duration threshold, it indicates that the user intends to select a target surrounding device. In this case, the device service capability information of the target surrounding device is displayed on the display interface. The value of the preset duration threshold can be set based on actual needs, and this application does not impose any restrictions on it.

[0046] In one possible implementation, the service capability information of the target peripheral devices is displayed on the user device's display interface, including: When the distance between the target surrounding device and the user device is less than the second distance threshold, the service capability information of the target surrounding device is displayed in the form of a floating window list.

[0047] In one possible implementation, the method further includes: In response to the distance between the target peripheral device and the user device exceeding a second distance threshold, a distance prompt message is displayed, which indicates that the target peripheral device and the user device should be brought closer.

[0048] In other words, the user device can determine the content displayed on the interface based on the distance between the user device and the target surrounding device. When the distance between the target surrounding device and the user device is greater than a second distance threshold, the user device determines that the user is too far from the target surrounding device. To improve the accuracy of the interaction and the accuracy of the interaction object, the user device can prompt the user to move closer to the target surrounding device by displaying a distance prompt message to shorten the distance between the target surrounding device and the user device. For example, this distance prompt message can be "Far away, please move closer". When the distance between the target surrounding device and the user device is less than the second distance threshold, a floating window list displaying the service capability information of the target surrounding device will automatically pop up, thereby avoiding accidental triggering at long distances and improving the accuracy and security of operation. It should be noted that, depending on the interface settings, the user device can also display the service capability information of the target surrounding device in other forms, such as sidebar prompts, status bar prompts, etc.

[0049] When the service capability information of the target peripheral device is displayed in the form of a floating window list, the method further includes: in response to receiving an information adjustment operation based on the floating window list of the target peripheral device, sending an information update instruction to the target peripheral device, wherein the information update instruction contains the adjusted service capability feature value, so that the target peripheral device updates the service capability information.

[0050] In one possible implementation, the user equipment, in response to receiving an information adjustment operation based on a floating list of target peripheral devices, establishes a communication connection with the target peripheral devices, such as a GATT connection. That is, if no information adjustment operation is received, the user equipment displays the service capability information of the target peripheral devices based on information in the device information database without interacting with the target peripheral devices. However, if the service capability information of the target peripheral devices needs to be adjusted, a communication connection is established with the target peripheral devices to issue instructions.

[0051] This floating list has interactive functionality, allowing users to modify the service capability information of target peripheral devices displayed in the list based on user information adjustments. The user device can generate an information update command based on the adjusted service capability characteristic value and send it to the target peripheral device to instruct it to update its service capability information, thereby enabling interactive control with the target peripheral device.

[0052] In one possible implementation, the user device's display interface may show device icons for various peripheral devices, and the method further includes: Display device icons of devices surrounding the target in the primary form; Display the device icons of non-target peripheral devices in a second format.

[0053] The first form differs from the second form. The first form distinguishes the device icons of target peripheral devices from those of non-target peripheral devices, while the second form is the default display format. Illustratively, the first form may include highlighting, outline darkening, blinking, magnification, etc. This application does not limit this; taking highlighting as an example of the first form... Figure 2 A schematic diagram of the display interface of a user device provided in an exemplary embodiment of this application is shown, such as... Figure 2 As shown, after obtaining the coordinate information of each peripheral device in the current environment, the user device can map the coordinate information of each peripheral device to obtain, as shown in the figure. Figure 2 The location view shown displays device icons for various peripheral devices. If peripheral device 5 is identified as the target peripheral device, its corresponding device icon 210 is highlighted. Taking device 5 as an example of a smart speaker, if the distance between the user device and peripheral device 5 is less than a second distance threshold, the service capability information corresponding to peripheral device 5 can be further displayed on the display interface as a floating list, such as... Figure 2 As shown, the floating list 220 displays the service capability information of the smart speaker, including: Audio playback (UUID:0x5678) - Supported formats: MP3, WAV, FLAC; Current status: Paused; Operations: Play / Pause / Previous track / Next track / Progress adjustment.

[0054] Volume adjustment (UUID:0x2A9E) - Range: 0-100%; Current value: 50%; Operation: Adjust with slider or voice control.

[0055] Voice Assistant (UUID: 0x5679) - Supported commands: weather query, alarm clock setting; Integration: Siri / Alexa compatible; Operation: one-touch activation of microphone.

[0056] If the user selects "Audio Playback," the interface will display the "Audio Playback" control panel and establish a communication connection with the smart speaker. Figure 3 A schematic diagram of a control panel provided in an exemplary embodiment of this application is shown, such as... Figure 3 As shown, the control panel displays various controls corresponding to audio playback, such as audio playback control 310 and volume adjustment control 320. The audio playback function of the smart speaker can be controlled by interacting with each control, and information update instructions can be sent to the smart speaker through a communication connection so that the smart speaker can respond to the information change instructions. The user's selection operation can be a touch operation or a voice command, which is not limited in this application.

[0057] When there are multiple target peripheral devices, the user equipment can display device icons of multiple target peripheral devices in a first form. In one possible implementation, in response to receiving a selection operation based on the device icon, a floating window list of the corresponding target peripheral devices is displayed. Alternatively, in another possible implementation, the user equipment can automatically display a floating window list of the target peripheral devices with the highest signal strength. In response to receiving a selection operation by the user on the device icons of other target peripheral devices, the old floating window list is hidden, and a new floating window list corresponding to the selected target peripheral device is displayed.

[0058] Taking the display of a floating list based on a received selection of a device icon by the user device as an example, Figure 4 A schematic diagram illustrating the display interface of another user device provided in an exemplary embodiment of this application is shown, such as... Figure 4 As shown, if the signal strength values ​​of the surrounding devices are very similar, and both surrounding device 3 and surrounding device 6 are determined to be target surrounding devices, then the device icons of both surrounding device 3 and surrounding device 6 are highlighted. Afterwards, based on the user's selection of the device icon, a floating list of the corresponding device is displayed on the display interface. Taking surrounding device 6 as a smart TV as an example, ... Figure 4As shown, if a user selects the device icon 410 of the peripheral device 6, a floating list 420 of the peripheral devices 6 is displayed on the display interface. This floating list 420 displays the service capability information of the smart TV, including: Screen casting service (UUID:0x1812): Supports Miracast / AirPlay protocols. Current status: Standby. Operation: Start screen casting / pause screen casting.

[0059] Media playback (UUID:0x5678): Supports MP4 and AVI formats. Current status: Paused. Operations: Play / Pause / Fast forward / Volume adjustment.

[0060] Resolution settings (UUID:0x1813): Supports 1080p / 4K, current value: 1080p, operation: switch resolution or automatically adapt.

[0061] Taking a smart bulb as an example, if a user selects the device icon 430 of the smart bulb, a floating list 440 of the smart bulb will be displayed on the screen. This floating list 440 displays the service capability information of the smart bulb, including: Brightness adjustment (UUID:0x2A19) - Range: 0-100%; Current value: 70%; Operation: Slide to adjust or preset mode.

[0062] Color temperature adjustment (UUID:0x2A6E) - Range: 2700K-6500K; Current value: 4000K; Operation: Color wheel selection or automatic adjustment based on time.

[0063] Timer switch (UUID:0x1235) - Supported settings: daily timer / countdown; Current status: off; Operation: set time and confirm.

[0064] In one possible implementation, after the target peripheral device completes the service capability information update based on the information update command, it broadcasts the updated service capability information. When the user equipment receives a new broadcast packet, or detects that the service UUID in the broadcast packet has been updated, it refreshes the floating window list corresponding to the target peripheral device. Furthermore, it can also display service update prompt information, such as "Service updated".

[0065] In response to the detection of a change in the current user's operation and a change in the target peripheral device, the old floating window list is closed and a new floating window list is displayed.

[0066] In one possible implementation, the user equipment can also determine the display method of the floating window list based on the current power consumption mode of the user equipment. For example, in response to the user equipment being in low power mode, after receiving the user's selection operation on the device icon of the target peripheral device, the floating window list of the target peripheral device is displayed. In response to the user equipment being in non-low power mode, when the target peripheral device is determined and the number of target peripheral devices is 1, the floating window list of the target peripheral device is automatically displayed.

[0067] In summary, the information prompting method provided in this application obtains the coordinate information of the user device and all surrounding devices, calculates and determines the spatial orientation of the surrounding devices relative to the user device; then, it compares the current user operation pointing with the spatial orientation of the surrounding devices, and filters out target surrounding devices whose orientation angle is within a preset range; finally, it directly reads and displays the service capability information of the target surrounding device from the local device information database. In the above solution, by pre-storing a device information database containing the coordinate information and service capability information of surrounding devices locally, the relevant information of the target surrounding device can be directly read without relying on cloud communication when the user points, overcoming the problem of interaction lag and failure caused by network latency or interruption, and ensuring high real-time performance and high reliability in offline environments; through coordinate-based spatial orientation calculation and automatic filtering of pointing angles, users can accurately lock onto the target through intuitive pointing even in dense device scenarios, greatly improving operation efficiency and accuracy, eliminating the risk of accidental touches, and ultimately achieving a seamless and smooth "what you point is what you get" interactive experience.

[0068] The information prompting method provided in this application can be applied to IoT environments, such as indoor IoT environments, enabling user devices to automatically identify and display the service capabilities of peripheral devices. Taking a smart home scenario as an example, several peripheral devices can be deployed in this scenario, such as peripheral device B: a smart bulb supporting lighting services; peripheral device C: a wireless speaker supporting audio playback services; peripheral device D: a smart TV supporting screen mirroring services; and peripheral device A: a smart tablet supporting communication sharing services. User device A (such as a smart terminal) moves in space, 1-5 meters away from the peripheral devices. User interaction requirements include: when the user points to peripheral device B, peripheral device A automatically displays its lighting service capabilities and supports one-touch activation. To adapt to dynamic movement, the embodiments of this application can first limit the positioning accuracy to less than 10cm, the interaction delay to less than 100ms, and support multi-device conflict handling (such as prioritizing the nearest device via Bluetooth RSSI (Received Signal Strength Indicator)).

[0069] In smart home scenarios, the network environment needs to support low-power, reliable wireless communication and positioning to ensure real-time data exchange between user device A and surrounding devices, while covering the entire scene. The core network is a hybrid architecture, including a BLE network and a UWB (Ultra-Wideband) positioning network. The BLE network is a multi-hop, low-power network that supports inter-device relay forwarding, with a coverage range of 10-50m, suitable for device-dense scenarios. User device A acts as the central node, and surrounding devices (such as B, C, and D) act as leaf nodes, discovering each other through BLE broadcast packets. Surrounding devices publish service lists, and device A parses the broadcast packets to obtain the ID, RSSI, and service capabilities. Secondly, the UWB positioning network is a high-precision indoor positioning system, covering an indoor scene of 20-50㎡, with a range of 50m and an accuracy of less than 10cm, supporting 3D coordinate calculation. The core relies on 3-4 fixed UWB anchor point devices as reference nodes, providing TDoA (Time Difference of Arrival) or ToA (Time of Arrival) measurements. User device A and peripheral devices act as UWB tags, transmitting short pulse signals (6.5GHz or 8GHz band, pulse width <1ns). Anchor point devices receive these signals and calculate the time difference Δt_ij. Anchor points are deployed at different locations in the scene (e.g., corner (0,0,0), next to the sofa (5,0,0), ceiling (0,5,1), door edge (5,5,0)) to avoid collinearity / coplanarity and ensure geometric sparsity. User device A transmits a pulse every 10ms, and the anchor point calculates the distance difference d_ij = c·Δt_ij (where c is the speed of light 3×10^8m / s). The nonlinear equation is then solved to obtain the coordinates of each device, i.e., the coordinate information of the peripheral devices (x_i, y_i, z_i) or the coordinate information of the user device (x_A, y_A, z_A).

[0070] In order to implement the information prompting method provided in this application embodiment, each device in the scenario needs to have certain hardware configurations. Taking the establishment of a communication connection between the user device and peripheral devices via Bluetooth as an example, Figure 5 This illustration shows a schematic diagram of the device hardware configuration in a scenario provided by an exemplary embodiment of this application, such as... Figure 5As shown, user equipment 510 may include: a processor for performing angle calculation, service parsing, and UI (User Interface) rendering, and for processing IMU / UWB / BLE data fusion; a memory for storing a device information database; an IMU module containing a three-axis gyroscope, accelerometer, and magnetometer to generate the current user operation direction; a display module for displaying service capability information of the pointed peripheral device; a BLE communication module, such as a GATT client with an MTU (Maximum Transmission Unit) of 256 bytes, for scanning peripheral devices and initiating service queries; and an indoor positioning module, such as a Decawave DW3000 UWB chip with an accuracy of <10cm, supporting TDoA / ToA, and power consumption of <100mW, for transmitting, receiving, and processing signals.

[0071] Peripheral device 520 may include: a processor for dynamically generating a service capability list and controlling BLE / UWB communication; a BLE communication module, such as a GATT server, for broadcasting UUID services; a UWB tag module, such as a Decawave DW3000 UWB chip (as a UWB tag, supporting TDoA / ToA, accuracy <10cm, power consumption <50mW, for sending pulse signals to communicate with anchor points and calculate coordinates (x_i, y_i, z_i); and a service capability module for dynamically generating a UUID list, broadcasting via BLE, and supporting service update functions.

[0072] In addition, the scenario also requires anchor point devices 530: such as Decawave DW3000 UWB chips, 3-4 of which need to be configured, with pre-calibrated positions (e.g., (0, 0, 0), (5, 0, 0), (0, 5, 0)). The anchor point devices receive UWB pulse signals from user equipment and surrounding equipment, record arrival times, calculate the time difference Δt_ij, and transmit it to the device or central processing unit to calculate coordinates. They communicate with user equipment via Wi-Fi / Ethernet (IEEE 1588 synchronization, error <1ns) to provide positioning data.

[0073] In this system, the user equipment interacts with peripheral devices via the BLE module to achieve service discovery and connectivity, and communicates with anchor devices via the UWB chip to achieve device positioning. Data from the IMU / positioning module is sent to the processor, which then drives the display module to show service capabilities.

[0074] Peripheral devices broadcast service capabilities through the BLE module, and the UWB tag module sends positioning signals to the anchor point device.

[0075] Anchor devices transmit time difference data to corresponding devices (such as user devices or peripheral devices) via Wi-Fi / Ethernet.

[0076] In one exemplary embodiment, this application provides an electronic device that can be implemented as the user device described above. The electronic device includes a processor and a memory. The memory stores at least one computer program, which is loaded and executed by the processor to implement all or part of the steps in the information prompting method described above.

[0077] In one exemplary embodiment, a computer-readable storage medium is also provided, which stores at least one computer program that is loaded and executed by a processor to implement all or part of the steps in the information prompting method described above. For example, the computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), magnetic tape, floppy disk, or optical data storage device, etc.

[0078] In one exemplary embodiment, a computer program product is also provided, comprising a computer program stored on a non-transitory computer-readable storage medium. The computer program includes program instructions that, when executed by a computer, cause the computer to perform the above-described actions. Figure 1 All or part of the steps of the embodiments shown.

[0079] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the claims.

[0080] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. An information prompting method, characterized in that, The method is executed by a user equipment, and the method includes: Obtain the coordinate information of the user equipment and the current user operation direction; Extract the coordinate information of each surrounding device from the device information database; Based on the coordinate information of the user equipment and the coordinate information of each of the surrounding devices, the spatial orientation of each of the surrounding devices relative to the user equipment is calculated. Based on the current user operation direction of the user equipment and the spatial orientation of each of the peripheral devices relative to the user equipment, device filtering is performed to determine the target peripheral device from the peripheral devices; wherein, the angle between the spatial orientation of the target peripheral device and the current user operation direction is less than a preset angle threshold. Read the service capability information of the target peripheral device from the device information database, and display the service capability information of the target peripheral device on the display interface of the user device.

2. The method according to claim 1, characterized in that, The device information database is pre-built and updated based on the device information dynamically released by each of the surrounding devices in real time. The device information includes the device attribute information and service capability information of the surrounding devices, and the device attribute information includes the coordinate information of the surrounding devices.

3. The method according to claim 2, characterized in that, The step of filtering devices based on the current user operation direction of the user equipment and the spatial orientation of each of the surrounding devices relative to the user equipment, in order to determine the target surrounding device from among the surrounding devices, includes: Obtain the target distance between each of the peripheral devices and the user equipment; In response to the existence of a set of surrounding devices where the target distance is less than a first distance threshold and the angle between the spatial orientation and the current user operation direction is less than the preset angle threshold, the target surrounding device is determined from the set of surrounding devices.

4. The method according to claim 3, characterized in that, The device attribute information includes the device signal strength, and determining the target surrounding device from the surrounding device set includes: In response to the fact that the number of peripheral devices included in the peripheral device set is multiple, the device signal strength of each peripheral device in the peripheral device set is extracted; The target peripheral device is determined from the n peripheral devices with the strongest signal strength in the peripheral device set, where n is a positive integer.

5. The method according to claim 1, characterized in that, The display interface shows device icons for each of the peripheral devices, and the method further includes: Display the device icons of the surrounding devices of the target in a first form; Display the device icons of non-target peripheral devices in a second format.

6. The method according to claim 1, characterized in that, The step of displaying the service capability information of the target peripheral devices on the display interface of the user device includes: In response to the user equipment being in the current user operation for a duration exceeding a preset duration threshold, the service capability information of the target peripheral device is displayed on the user equipment's display interface.

7. The method according to claim 1, characterized in that, The step of displaying the service capability information of the target peripheral devices on the display interface of the user device includes: In response to the distance between the target peripheral device and the user device being less than a second distance threshold, the service capability information of the target peripheral device is displayed in the form of a floating window list.

8. The method according to claim 7, characterized in that, The method further includes: In response to receiving an information adjustment operation based on the floating window list of the target peripheral devices, an information update instruction is sent to the target peripheral devices. The information update instruction includes the adjusted service capability feature value so that the target peripheral devices update their service capability information.

9. The method according to claim 8, characterized in that, The method further includes: In response to the distance between the target peripheral device and the user device being greater than the second distance threshold, a distance prompt message is displayed, which is used to indicate that the distance between the target peripheral device and the user device should be reduced.

10. An electronic device, characterized in that, The electronic device includes a processor and a memory, the memory storing at least one computer program, which is loaded and executed by the processor to implement the information prompting method as described in any one of claims 1 to 9.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores at least one computer program, which is loaded and executed by a processor to implement the information prompting method as described in any one of claims 1 to 9.

12. A computer program product, characterized in that, The computer program product includes a computer program stored on a non-transitory computer-readable storage medium, the computer program including program instructions that, when executed by a computer, cause the computer to perform an information prompting method as described in any one of claims 1 to 9.

Images