Device interaction method, device and system

Through the combination of UWB base station and motion sensors, accurate detection of user position and limb movements is achieved, and interactive operation failure caused by insufficient position accuracy in the prior art is solved, and accurate device interaction is achieved.

CN112965592BActive Publication Date: 2025-05-16INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110204497.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-02-24
Publication Date
2025-05-16
Estimated Expiration
2041-02-24

AI Technical Summary

Technical Problem

The prior art is difficult to accurately judge the location of users and devices, resulting in the inability to complete interactive operations based on relative positions.

Method used

The UWB base station performs positioning detection on the UWB chip in the portable device carried by the user, obtains the user's three-dimensional position information, and uses the motion sensor to detect the user's body movements to determine the corresponding interactive equipment and operation instructions.

Benefits of technology

It realizes more accurate user position and limb movement detection, can accurately complete the device interaction based on user position and limb movement, and solves the problem of interactive operation failure caused by insufficient position accuracy in the prior art.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112965592B_ABST
    Figure CN112965592B_ABST
Patent Text Reader

Abstract

The present invention discloses a device interaction method, apparatus and system, which can be used in the financial field or other technical fields. The device interaction method includes: obtaining the position information of the user in a preset environment; obtaining the first body movement information of the user; determining the interaction device corresponding to the position information of the user according to the correspondence between the preset position and the interaction device; searching the operation instruction corresponding to the first body movement information of the user from the first operation instruction list of the corresponding interaction device, wherein the first operation instruction list records the correspondence between the first body movement and the operation instruction; sending the operation instruction corresponding to the first body movement information of the user to the interaction device corresponding to the operation instruction. The present invention can more accurately realize the scheme of interacting with the device based on the user's position and body movement.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of Internet of Things, and in particular to a device interaction method, device and system. Background Art

[0002] At present, with the rapid development of smart home and industrial Internet of Things, there is an increasing demand for perceptible, intelligent, real-time interactive remote operations. At present, due to the accuracy of indoor positioning technology, it is impossible to accurately judge the location of users and devices, resulting in a large number of interactive operations based on relative positions being unable to be completed. The existing technology lacks a more accurate method for interacting with devices based on user location. Summary of the invention

[0003] In order to solve the technical problems in the above-mentioned background technology, the present invention proposes a device interaction method, apparatus and system.

[0004] In order to achieve the above object, according to one aspect of the present invention, a device interaction method is provided, the method comprising:

[0005] Acquiring location information of a user in a preset environment, wherein the location information is obtained by performing positioning detection on a UWB chip in a portable device carried by the user by a UWB base station arranged in the preset environment;

[0006] Acquire first body movement information of the user, wherein the first body movement information is detected by a motion sensor in the portable device;

[0007] Determine the interactive device corresponding to the user's location information according to the correspondence between the preset location and the interactive device;

[0008] searching for an operation instruction corresponding to the first body movement information of the user from a first operation instruction list of the corresponding interactive device, wherein the first operation instruction list records the correspondence between the first body movement and the operation instruction;

[0009] The operation instruction corresponding to the first body movement information of the user is sent to the interactive device corresponding to the operation instruction.

[0010] Optionally, the device interaction method further includes:

[0011] Acquire image information of the user in the preset environment;

[0012] The second limb motion information of the user is identified according to the image information and a preset motion recognition model.

[0013] Optionally, the device interaction method further includes:

[0014] searching, from a second operation instruction list of the corresponding interactive device, an operation instruction corresponding to a combination of the first limb motion information and the second limb motion information of the user, wherein the second operation instruction list records a correspondence between the combination of the first limb motion and the second limb motion and the operation instruction;

[0015] An operation instruction corresponding to a combination of the first body movement information and the second body movement information of the user is sent to an interactive device corresponding to the operation instruction.

[0016] Optionally, the portable device includes at least one of a handheld device, a hand-wearable device, a wrist-wearable device, and an arm-wearable device.

[0017] Optionally, the position information is three-dimensional position information, and the position information is specifically obtained by performing positioning detection on the UWB chip by at least four UWB base stations that are fixed in the preset environment.

[0018] Optionally, the motion sensor includes: a nine-axis sensor.

[0019] In order to achieve the above object, according to another aspect of the present invention, a device interaction apparatus is provided, the apparatus comprising:

[0020] A location information acquisition module, used to acquire the location information of the user in a preset environment, wherein the location information is obtained by performing positioning detection on a UWB chip in a portable device carried by the user through a UWB base station set in the preset environment;

[0021] A first body movement information acquisition module, used to acquire first body movement information of the user, wherein the first body movement information is detected by a motion sensor in the portable device;

[0022] An interactive device determination module, used to determine the interactive device corresponding to the user's location information according to a preset correspondence between the location and the interactive device;

[0023] A first operation instruction determination module, configured to search a first operation instruction list of the corresponding interactive device for an operation instruction corresponding to the first body movement information of the user, wherein the first operation instruction list records a correspondence between the first body movement and the operation instruction;

[0024] The first operation instruction sending module is used to send the operation instruction corresponding to the first body movement information of the user to the interactive device corresponding to the operation instruction.

[0025] In order to achieve the above object, according to another aspect of the present invention, a device interaction system is provided, the system comprising: a portable device, a UWB base station and a data analysis system, wherein the portable device is provided with a UWB chip and a motion sensor;

[0026] The UWB base station is used to perform positioning detection on the UWB chip in the portable device carried by the user, obtain the location information of the user in a preset environment, and send the location information to the data analysis system;

[0027] The portable device is used to send the first limb movement information of the user detected by the motion sensor to the data analysis system;

[0028] The data analysis system is used to determine the interactive device corresponding to the user's position information based on the correspondence between the preset position and the interactive device; search for the operating instruction corresponding to the user's first physical movement information from the first operating instruction list of the corresponding interactive device, wherein the first operating instruction list records the correspondence between the first physical movement and the operating instruction; and send the operating instruction corresponding to the user's first physical movement information to the interactive device corresponding to the operating instruction.

[0029] In order to achieve the above-mentioned purpose, according to another aspect of the present invention, a computer device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps in the above-mentioned device interaction method when executing the computer program.

[0030] In order to achieve the above object, according to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed in a computer processor, the steps in the above device interaction method are implemented.

[0031] The beneficial effects of the present invention are as follows: the present invention can accurately obtain the user's position information in the environment by positioning and detecting the UWB chip in the portable device carried by the user through the UWB base station, and can accurately implement the solution of interacting with the device based on the user's position and body movements by detecting the user's body movements through the motion sensor, thereby solving the technical problem that the prior art cannot complete the interactive operation based on relative position due to the difficulty in accurately positioning the user's position indoors. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the prior art descriptions. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0033] Figure 1 is a first flow chart of the device interaction method according to an embodiment of the present invention;

[0034] Figure 2 is a second flow chart of the device interaction method according to an embodiment of the present invention;

[0035] Figure 3 is a third flow chart of the device interaction method according to an embodiment of the present invention;

[0036] Figure 4 is a schematic diagram of a device interaction system according to an embodiment of the present invention;

[0037] Figure 5 is a first structural block diagram of a device interaction apparatus according to an embodiment of the present invention;

[0038] Figure 6 is a second structural block diagram of the device interaction apparatus according to an embodiment of the present invention;

[0039] Figure 7 is a second structural block diagram of the device interaction apparatus according to an embodiment of the present invention;

[0040] Figure 8 It is a schematic diagram of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0041] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0042] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0043] It should be noted that the terms "including" and "having" and any variations thereof in the specification and claims of the present invention and the above-mentioned drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or apparatus comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or apparatuses.

[0044] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0045] It should be noted that the device interaction method, apparatus and system of the present invention can be used in the financial field, and can also be applied to other technical fields.

[0046] Figure 4 is a schematic diagram of a device interaction system according to an embodiment of the present invention. Figure 4 As shown, the device interaction system of the present invention includes: a portable device, a UWB base station and a data analysis system, wherein the portable device is provided with a UWB chip and a motion sensor.

[0047] The UWB base station is used to perform positioning detection on the UWB chip in the portable device carried by the user, obtain the location information of the user in a preset environment, and send the location information to the data analysis system.

[0048] The portable device is used to send the first limb movement information of the user detected by the motion sensor to the data analysis system.

[0049] The data analysis system is used to determine the interactive device corresponding to the user's position information based on the correspondence between the preset position and the interactive device; search for the operating instruction corresponding to the user's first physical movement information from the first operating instruction list of the corresponding interactive device, wherein the first operating instruction list records the correspondence between the first physical movement and the operating instruction; and send the operating instruction corresponding to the user's first physical movement information to the interactive device corresponding to the operating instruction.

[0050] like Figure 4 As shown, in one embodiment of the present invention, the device interaction system of the invention includes: an image acquisition device, which is used to acquire image information of the user in the preset environment and send the image information to the data analysis system. The data analysis system is also used to identify the second limb motion information of the user based on the image information and a preset motion recognition model.

[0051] In one embodiment of the present invention, the data analysis system is also used to search for the operation instruction corresponding to the combination of the user's first limb movement information and the second limb movement information from the second operation instruction list of the corresponding interactive device, wherein the second operation instruction list records the correspondence between the combination of the first limb movement and the second limb movement and the operation instruction; and send the operation instruction corresponding to the combination of the user's first limb movement information and the second limb movement information to the interactive device corresponding to the operation instruction.

[0052] Figure 1 This is the first flow chart of the device interaction method according to the embodiment of the present invention. The implementation subject of this flow is Figure 4 Data analysis systems in Figure 1 As shown, in one embodiment of the present invention, the device interaction method of the present invention includes steps S101 to S105.

[0053] Step S101, obtaining location information of a user in a preset environment, wherein the location information is obtained by performing positioning detection on a UWB chip in a portable device carried by the user through a UWB base station arranged in the preset environment.

[0054] In one embodiment of the present invention, the portable device includes: at least one of a handheld device (such as a mobile phone, etc.), a hand-worn device (such as a glove, etc.), a wrist-worn device (such as a watch, a smart bracelet, etc.), and an arm-worn device (such as an armband, etc.), and any combination thereof.

[0055] In one embodiment of the present invention, the position information is three-dimensional position information, and the position information is specifically obtained by performing positioning detection on the UWB chip by at least four UWB base stations that are fixed in the preset environment.

[0056] In an embodiment of the present invention, the present invention first performs three-dimensional modeling on the preset environment to obtain an environmental model. The UWB base station is fixedly arranged in the preset environment, and the three-dimensional position of each UWB base station is fixed. In one embodiment of the present invention, the number of UWB base stations is at least 4. The at least 4 UWB base stations with determined positions continuously maintain communication with the UWB chip, and complete the positioning of the three-dimensional position of the UWB chip in the current environment through continuous positioning in the X, Y, and Z directions in the environment, and obtain the three-dimensional position information of the portable device carried by the user in the environment, and use the three-dimensional position information of the portable device in the environment as the position information of the user in the environment.

[0057] Step S102: Acquire first body movement information of the user, wherein the first body movement information is detected by a motion sensor in the portable device.

[0058] In one embodiment of the present invention, the first limb movement is the movement of the user's hand, wrist and arm, that is, the first limb movement information includes: at least one of hand movements (such as hand gestures), wrist movements (such as raising hands) and arm movements, and any combination thereof.

[0059] In one embodiment of the present invention, the motion sensor may be a nine-axis sensor or a gyroscope or other devices. Preferably, the motion sensor may be a nine-axis sensor.

[0060] Step S103: determining the interactive device corresponding to the user's location information according to a preset correspondence relationship between the location and the interactive device.

[0061] In one embodiment of the present invention, after three-dimensional modeling of the environment is performed to obtain the environment model, the present invention further establishes a correspondence between positions and interactive devices, which describes the interactive devices that the user may interact with at a certain position.

[0062] In one embodiment of the present invention, there may be multiple corresponding interaction devices.

[0063] Step S104: searching for an operation instruction corresponding to the first physical movement information of the user from a first operation instruction list of the corresponding interactive device, wherein the first operation instruction list records the correspondence between the first physical movement and the operation instruction.

[0064] In one embodiment of the present invention, the present invention also pre-establishes a first operation instruction list for each interactive device.

[0065] When a user interacts with an interactive device, the present invention first determines the corresponding interactive device according to the user's position, obtains the first operation instruction list of the corresponding interactive device, and then searches for the corresponding operation instruction from the first operation instruction list according to the user's first body movement information.

[0066] If there are multiple interactive devices corresponding to the user's position, the corresponding operation instruction is searched from the first operation instruction list of each corresponding interactive device according to the user's first body movement information.

[0067] Step S105: sending the operation instruction corresponding to the first body movement information of the user to the interactive device corresponding to the operation instruction.

[0068] It can be seen that the present invention can relatively accurately obtain the user's position information in the environment by positioning and detecting the UWB chip in the portable device carried by the user through the UWB base station, and can relatively accurately implement the solution of interacting with the device based on the user's position and body movements by detecting the user's body movements through the motion sensor, thereby solving the technical problem that the prior art cannot complete interactive operations based on relative position due to the difficulty in accurately locating the user's position indoors.

[0069] Figure 2 This is the second flow chart of the device interaction method according to the embodiment of the present invention. The implementation subject of this flow is Figure 4 Data analysis systems in Figure 2 As shown, in one embodiment of the present invention, the device interaction method of the present invention further includes steps S201 to S202.

[0070] Step S201, obtaining image information of the user in the preset environment.

[0071] like Figure 4 As shown, in one embodiment of the present invention, the device interaction system of the invention includes: an image acquisition device for acquiring image information of the user in the preset environment and sending the image information to the data analysis system.

[0072] Step S202: Identify second limb motion information of the user according to the image information and a preset motion recognition model.

[0073] In one embodiment of the present invention, the data analysis system is further used to identify the second limb motion information of the user based on the image information and a preset motion recognition model.

[0074] In one embodiment of the present invention, the second body movement information may be a large body movement of the user, such as running, jumping, etc.

[0075] In one embodiment of the present invention, the action recognition model can be trained by using any machine learning model in the prior art.

[0076] Figure 3 This is the third flow chart of the device interaction method according to the embodiment of the present invention. The implementation subject of this flow is Figure 4 Data analysis systems in Figure 3 As shown, in one embodiment of the present invention, the device interaction method of the present invention further includes steps S301 to S302.

[0077] Step S301, searching for an operation instruction corresponding to a combination of the first limb movement information and the second limb movement information of the user from a second operation instruction list of the corresponding interactive device, wherein the second operation instruction list records the correspondence between the combination of the first limb movement and the second limb movement and the operation instruction.

[0078] In one embodiment of the present invention, the present invention also pre-establishes a first operation instruction list for certain interactive devices.

[0079] When a user interacts with an interactive device, the present invention first determines the corresponding interactive device according to the user's position, obtains the second operation instruction list of the corresponding interactive device, and then searches for the corresponding operation instruction from the second operation instruction list according to the user's second body movement information and the combination of the second body movement information.

[0080] Step S302: Send an operation instruction corresponding to a combination of the first body movement information and the second body movement information of the user to an interactive device corresponding to the operation instruction.

[0081] It can be seen from the above embodiments that the present invention integrates the existing hardware devices with functions such as UWB positioning, three-dimensional space perception, and video acquisition, including but not limited to UWB chips such as mobile phones and smart watches, nine-axis sensors, and high-definition network cameras in scene environments, and integrates the data collected by various hardware devices. It can be based on the user's precise position, combined with the user's body movements, user's fine operations (such as arm reversal and lifting), etc., to achieve corresponding application scenarios, such as smart homes, device control in industrial Internet of Things, etc., to achieve a good interactive experience and improve user operation convenience.

[0082] The present invention can greatly improve convenience in application scenarios such as smart home, industrial Internet, and precision marketing systems. Its specific advantages are as follows:

[0083] 1. This method is based on the software system. By combining the common modules of current hardware devices such as sensors and cameras, it realizes real-time intelligent interactive operations through software-related algorithms and rules;

[0084] 2. This method is based on a combination of existing mature technologies, such as the action judgment of VR's nine-axis sensor, the precise location information of UWB positioning technology, and video behavior detection, and has the conditions for rapid implementation;

[0085] 3. This method has a wide range of application scenarios and is highly replicable. It can also be used in a variety of hardware combinations to achieve a variety of permutations and combinations of three types of devices: handheld devices, wearable devices, and environmental collection devices, thus broadening the scope of application scenarios.

[0086] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0087] Based on the same inventive concept, an embodiment of the present invention also provides a device interaction apparatus, which can be used to implement the device interaction method described in the above embodiment, as described in the following embodiment. Since the principle of solving the problem by the device interaction apparatus is similar to that of the device interaction method, the embodiment of the device interaction apparatus can refer to the embodiment of the device interaction method, and the repeated parts will not be repeated. As used below, the term "unit" or "module" can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceived.

[0088] Figure 5 is a first structural block diagram of the device interaction apparatus according to an embodiment of the present invention, such as Figure 5 As shown, the device interaction apparatus according to the embodiment of the present invention includes:

[0089] A location information acquisition module 1 is used to acquire the location information of the user in a preset environment, wherein the location information is obtained by performing positioning detection on a UWB chip in a portable device carried by the user through a UWB base station set in the preset environment;

[0090] A first body movement information acquisition module 2, used to acquire first body movement information of the user, wherein the first body movement information is detected by a motion sensor in the portable device;

[0091] An interactive device determination module 3, used to determine the interactive device corresponding to the user's location information according to a preset correspondence relationship between the location and the interactive device;

[0092] A first operation instruction determination module 4 is used to search for an operation instruction corresponding to the first body movement information of the user from a first operation instruction list of the corresponding interactive device, wherein the first operation instruction list records the correspondence between the first body movement and the operation instruction;

[0093] The first operation instruction sending module 5 is used to send the operation instruction corresponding to the first body movement information of the user to the interactive device corresponding to the operation instruction.

[0094] Figure 6 is a second structural block diagram of the device interaction apparatus according to an embodiment of the present invention, such as Figure 6 As shown, the device interaction apparatus of the embodiment of the present invention further includes:

[0095] An image information acquisition module 6, used to acquire image information of the user in the preset environment;

[0096] The second limb motion information determination module 7 is used to identify the second limb motion information of the user according to the image information and a preset motion recognition model.

[0097] Figure 7 is a third structural block diagram of the device interaction apparatus according to an embodiment of the present invention, such as Figure 7 As shown, the device interaction apparatus of the embodiment of the present invention further includes:

[0098] A second operation instruction determination module 8 is used to search for an operation instruction corresponding to a combination of the first limb movement information and the second limb movement information of the user from a second operation instruction list of the corresponding interactive device, wherein the second operation instruction list records a correspondence between the combination of the first limb movement and the second limb movement and the operation instruction;

[0099] The second operation instruction sending module 9 is used to send the operation instruction corresponding to the combination of the first body movement information and the second body movement information of the user to the interactive device corresponding to the operation instruction.

[0100] In order to achieve the above object, according to another aspect of the present application, a computer device is also provided. Figure 8 As shown, the computer device includes a memory, a processor, a communication interface and a communication bus. A computer program that can be executed on the processor is stored in the memory. When the processor executes the computer program, the steps in the above-mentioned embodiment method are implemented.

[0101] The processor may be a central processing unit (CPU). The processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or a combination of the above chips.

[0102] The memory, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs, non-transitory computer executable programs and units, such as the corresponding program units in the above method embodiments of the present invention. The processor executes various functional applications of the processor and works data processing by running the non-transitory software programs, instructions and modules stored in the memory, that is, implementing the method in the above method embodiments.

[0103] The memory may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created by the processor, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory may optionally include a memory remotely arranged relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0104] The one or more units are stored in the memory, and when executed by the processor, the method in the above embodiment is performed.

[0105] The specific details of the above-mentioned computer device can be understood by referring to the corresponding related descriptions and effects in the above-mentioned embodiments, and will not be repeated here.

[0106] In order to achieve the above purpose, according to another aspect of the present application, a computer-readable storage medium is also provided, wherein the computer-readable storage medium stores a computer program, and the computer program implements the steps in the above-mentioned device interaction method when executed in a computer processor. Those skilled in the art can understand that the implementation of all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and the program can include the processes of the embodiments of the above-mentioned methods when executed. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), a flash memory (Flash Memory), a hard disk (Hard Disk Drive, abbreviated as: HDD) or a solid-state drive (SSD), etc.; the storage medium can also include a combination of the above-mentioned types of memory.

[0107] Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, and optionally, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.

[0108] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A device interaction method, characterized in that: include: Acquiring location information of a user in a preset environment, wherein the location information is obtained by performing positioning detection on a UWB chip in a portable device carried by the user by a UWB base station arranged in the preset environment; Acquire first limb motion information of the user, wherein the first limb motion information is detected by a motion sensor in the portable device, the portable device comprises: at least one of a handheld device, a hand-worn device, a wrist-worn device, and an arm-worn device; the first limb motion information comprises: at least one of a hand motion, a wrist motion, and an arm motion, and any combination thereof; Determine the interactive device corresponding to the user's location information according to the correspondence between the preset location and the interactive device; Searching for an operation instruction corresponding to the first body movement information of the user from a first operation instruction list of the corresponding interactive device, wherein the first operation instruction list records the correspondence between the first body movement and the operation instruction; Sending the operation instruction corresponding to the first body movement information of the user to the interactive device corresponding to the operation instruction; Acquire image information of the user in the preset environment; Identify second limb motion information of the user according to the image information and a preset motion recognition model, where the second limb motion information is a large limb motion of the user; searching, from a second operation instruction list of the corresponding interactive device, an operation instruction corresponding to a combination of the first limb motion information and the second limb motion information of the user, wherein the second operation instruction list records a correspondence between the combination of the first limb motion and the second limb motion and the operation instruction; An operation instruction corresponding to a combination of the first body movement information and the second body movement information of the user is sent to an interactive device corresponding to the operation instruction.

2. The device interaction method according to claim 1, characterized in that: The position information is three-dimensional position information, and the position information is specifically obtained by performing positioning detection on the UWB chip by at least four UWB base stations that are fixed in the preset environment.

3. The device interaction method according to claim 1, characterized in that: The motion sensor includes: a nine-axis sensor.

4. A device interaction apparatus, characterized in that: include: A location information acquisition module, used to acquire the location information of the user in a preset environment, wherein the location information is obtained by performing positioning detection on a UWB chip in a portable device carried by the user through a UWB base station set in the preset environment; a first limb motion information acquisition module, configured to acquire first limb motion information of the user, wherein the first limb motion information is detected by a motion sensor in the portable device, the portable device comprising: at least one of a handheld device, a hand-worn device, a wrist-worn device, and an arm-worn device; the first limb motion information comprises: at least one of a hand motion, a wrist motion, and an arm motion, and any combination thereof; An interactive device determination module, used to determine the interactive device corresponding to the user's location information according to a preset correspondence between the location and the interactive device; A first operation instruction determination module, configured to search a first operation instruction list of the corresponding interactive device for an operation instruction corresponding to the first body movement information of the user, wherein the first operation instruction list records a correspondence between the first body movement and the operation instruction; A first operation instruction sending module, used to send the operation instruction corresponding to the first body movement information of the user to the interactive device corresponding to the operation instruction; An image information acquisition module, used to acquire image information of the user in the preset environment; A second body movement information determination module, used to identify the second body movement information of the user according to the image information and a preset movement recognition model, where the second body movement information is a large body movement of the user; A second operation instruction determination module is used to search for an operation instruction corresponding to a combination of the first limb movement information and the second limb movement information of the user from a second operation instruction list of the corresponding interactive device, wherein the second operation instruction list records a correspondence between the combination of the first limb movement and the second limb movement and the operation instruction; The second operation instruction sending module is used to send the operation instruction corresponding to the combination of the first body movement information and the second body movement information of the user to the interactive device corresponding to the operation instruction.

5. A device interaction system, characterized in that: include: A portable device, a UWB base station and a data analysis system, wherein the portable device is provided with a UWB chip and a motion sensor; The UWB base station is used to perform positioning detection on the UWB chip in the portable device carried by the user, obtain the location information of the user in a preset environment, and send the location information to the data analysis system; The portable device is used to send the first limb motion information of the user detected by the motion sensor to the data analysis system, the portable device comprising: at least one of a handheld device, a hand-worn device, a wrist-worn device, and an arm-worn device; the first limb motion information comprises: at least one of a hand motion, a wrist motion, and an arm motion, and any combination thereof; The data analysis system is used to determine the interactive device corresponding to the user's position information according to the correspondence between the preset position and the interactive device; search for the operating instruction corresponding to the first body movement information of the user from the first operating instruction list of the corresponding interactive device, wherein the first operating instruction list records the correspondence between the first body movement and the operating instruction; and send the operating instruction corresponding to the first body movement information of the user to the interactive device corresponding to the operating instruction; An image acquisition device, used for acquiring image information of the user in the preset environment, and sending the image information to the data analysis system; The data analysis system is further used to identify second limb motion information of the user according to the image information and a preset motion recognition model, where the second limb motion information is a large limb motion of the user; The data analysis system is also used to search for the operation instruction corresponding to the combination of the user's first limb movement information and the second limb movement information from the second operation instruction list of the corresponding interactive device, wherein the second operation instruction list records the correspondence between the combination of the first limb movement and the second limb movement and the operation instruction; and send the operation instruction corresponding to the combination of the user's first limb movement information and the second limb movement information to the interactive device corresponding to the operation instruction.

6. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 3 is implemented.

7. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed in a computer processor, the computer program implements the method according to any one of claims 1 to 3.

Citation Information

Patent Citations

  • Equipment control method and device, storage medium and equipment

    CN108375911A

  • UWB positioning bracelet with heart rate measuring function

    CN209712883U