Interaction method, device, equipment and storage medium
By obtaining acceleration and distance information in the interactive device to generate control instructions, the problems of low user gesture interaction accuracy and inconvenient peripherals are solved, and convenient user interaction and efficient terminal device control are achieved.
Patent Information
- Application Number
- CN202011091797.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-10-13
- Publication Date
- 2025-01-14
- Estimated Expiration
- 2040-10-13
AI Technical Summary
In augmented reality technology and virtual reality technology, the accuracy of user gesture interaction is low and frequent operation leads to user fatigue, and traditional peripherals are not portable, affecting the user experience.
The acceleration and distance between the first control end and the second control end are obtained through the interactive device, control instructions are generated and sent to the terminal device to control the display screen, and interaction between the user and the terminal device is realized.
It reduces the difficulty of user operation, simplifies the interactive process, makes the interactive device small, portable, and improves the user experience.
Smart Images

Figure CN114356069B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to computer technology, and in particular to an interaction method, an interaction device, an interaction equipment and a computer-readable storage medium. Background Art
[0002] In the related art, the images presented by augmented reality (AR) or virtual reality (VR) are virtual images projected by AR devices or VR devices, and users can interact with the virtual images projected by AR devices or VR devices through gestures or by manipulating the corresponding peripheral control devices of the AR devices or VR devices. However, when users can interact through gestures, the accuracy of AR or VR device recognition is related to the accuracy of the user's gestures, which requires high user operation. In addition, frequent gesture operations can easily cause user fatigue and poor user experience. When users interact through peripheral control devices, the peripheral control devices are generally large in size and inconvenient to carry, which can easily cause a burden on users. Summary of the invention
[0003] The present application provides an interaction method, which is used for an interaction device, wherein the interaction device communicates with a terminal device, and the interaction device includes a first control terminal and a second control terminal. The interaction method includes:
[0004] Acquire a first acceleration of the first control end, a second acceleration of the second control end, and a distance between the first control end and the second control end;
[0005] generating a control instruction according to the first acceleration, the second acceleration and the distance between the first control end and the second control end; and
[0006] The control instruction is sent to the terminal device to control the display screen of the terminal device.
[0007] The present application also provides an interactive device, which is used for an interactive device, wherein the interactive device communicates with a terminal device, wherein the control device includes a first control terminal and a second control terminal, and wherein the interactive device includes:
[0008] Acquisition module: the acquisition module is used to acquire a first acceleration of the first control end, a second acceleration of the second control end, and a distance between the first control end and the second control end;
[0009] a generating module, the generating module being configured to generate a control instruction according to the first acceleration, the second acceleration and the distance between the first control end and the second control end; and
[0010] A sending module, wherein the sending module is used to send the control instruction to the terminal device to control the display screen of the terminal device.
[0011] The present application provides an interactive device,
[0012] The interactive device communicates with the terminal device, and the interactive device includes a first control terminal, a second control terminal, a processor and a communication module, the first control terminal includes a magnetic module and a first acceleration sensor, the second control terminal includes a Hall element and a second acceleration sensor; the processor is used to:
[0013] Acquire a first acceleration of the first control end detected by the first acceleration sensor, a second acceleration of the second control end detected by the second acceleration sensor, and a distance between the first control end and the second control end obtained by the Hall element detecting the magnetic module;
[0014] generating a control instruction according to the first acceleration, the second acceleration and the distance between the first control end and the second control end;
[0015] The communication module is used for:
[0016] The control instruction is sent to the terminal device to control the display screen of the terminal device.
[0017] The present application provides an interactive device, including one or more processors and a memory; and
[0018] One or more programs, wherein the one or more programs are stored in the memory and executed by the one or more processors, and the programs include instructions for executing the interaction method. The interaction method includes: obtaining a first acceleration of the first control terminal, a second acceleration of the second control terminal, and a distance between the first control terminal and the second control terminal; generating a control instruction according to the first acceleration, the second acceleration, and the distance between the first control terminal and the second control terminal; and sending the control instruction to the terminal device to control a display screen of the terminal device.
[0019] The present application provides a non-volatile computer-readable storage medium containing a computer program, and when the computer program is executed by one or more processors, the processors execute the interaction method. The interaction method includes: obtaining a first acceleration of the first control terminal, a second acceleration of the second control terminal, and a distance between the first control terminal and the second control terminal; generating a control instruction according to the first acceleration, the second acceleration, and the distance between the first control terminal and the second control terminal; and sending the control instruction to the terminal device to control a display screen of the terminal device.
[0020] In the interaction method, interaction apparatus, interaction device and computer-readable storage medium of the embodiments of the present application, by obtaining the distance between the first control end and the second control end in the interaction device and the first acceleration of the first control end and the second acceleration of the second control end, and according to the first acceleration, the direction and magnitude of the second acceleration and the distance between the first control end and the second control end, a variety of interaction instructions can be generated to interact with the terminal device, thereby realizing control of the display screen of the terminal device. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:
[0022] Figure 1 It is a flowchart of the interaction method of certain embodiments of the present application.
[0023] Figure 2 It is a module schematic diagram of an interactive device of certain embodiments of the present application.
[0024] Figure 3 It is a module schematic diagram of an interactive device in certain embodiments of the present application.
[0025] Figure 4 It is a module schematic diagram of an interactive device in certain embodiments of the present application.
[0026] Figure 5 It is a connection diagram of a processor and a computer-readable storage medium in certain embodiments of the present application.
[0027] Figure 6 A schematic diagram of a scenario of an interactive method according to certain embodiments of the present application.
[0028] Figure 7 It is a flowchart of the interaction method of certain embodiments of the present application.
[0029] Figure 8 It is a scene diagram of the interaction method of certain embodiments of the present application.
[0030] Fig. 9 It is a scene diagram of the interaction method of certain embodiments of the present application.
[0031] Fig.10 It is a flowchart of the interaction method of certain embodiments of the present application.
[0032] Fig.11 A flowchart of an interactive method according to certain embodiments of the present application.
[0033] Fig.12 It is a flowchart of the interaction method of certain embodiments of the present application.
[0034] Fig.13 It is a scene diagram of the interaction method of certain embodiments of the present application.
[0035] Fig.14 It is a flowchart of the interaction method of certain embodiments of the present application.
[0036] Fig.15 It is a scene diagram of the interaction method of certain embodiments of the present application.
[0037] Fig.16 It is a flowchart of the interaction method of certain embodiments of the present application. DETAILED DESCRIPTION
[0038] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and cannot be understood as limiting the present application.
[0039] In the description of the present application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the present application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.
[0040] In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection, an electrical connection, or can communicate with each other; it can be a direct connection, or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.
[0041] The disclosure below provides many different embodiments or examples to realize the different structures of the present application. In order to simplify the disclosure of the present application, the parts and settings of specific examples are described below. Of course, they are only examples, and the purpose is not to limit the present application. In addition, the present application can repeat reference numbers and / or reference letters in different examples, and this repetition is for the purpose of simplification and clarity, which itself does not indicate the relationship between the various embodiments and / or settings discussed.
[0042] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and cannot be understood as limiting the present application.
[0043] See also Figure 1 The embodiment of the present application provides an interaction method for an interaction device, wherein the interaction device communicates with a terminal device, and the interaction device includes a first control terminal and a second control terminal. The interaction method includes the steps of:
[0044] S12: Acquire a first acceleration of the first control end, a second acceleration of the second control end, and a distance between the first control end and the second control end;
[0045] S14: generating a control instruction according to the first acceleration and the second acceleration and the distance between the first control end and the second control end; and
[0046] S16: Sending a control instruction to the terminal device to control the display screen of the terminal device.
[0047] Please refer to Figure 2 The embodiment of the present application provides an interactive device 10. The interactive device 10 includes an acquisition module 12, a generation module 14 and a sending module 16.
[0048] Step S12 may be implemented by the acquisition module 12 , step S14 may be implemented by the generation module 14 , and step S16 may be implemented by the sending module 16 .
[0049] In other words, the acquisition module 12 can be used to acquire the first acceleration of the first control end, the second acceleration of the second control end, and the distance between the first control end and the second control end.
[0050] The generating module 14 may be configured to generate a control instruction according to the first acceleration, the second acceleration and the distance between the first control end and the second control end.
[0051] The sending module 16 may be used to send a control instruction to the terminal device to control a display screen of the terminal device.
[0052] Please combine Figure 3 The embodiment of the present application provides an interactive device 1, which communicates with a terminal device. The interactive method of the present application can be implemented by the interactive device 1. The interactive device 1 includes a first control terminal 20, a second control terminal 30, and a processor and communication module 50.
[0053] The processor can be used to obtain the first acceleration of the first control terminal 20, the second acceleration of the second control terminal 30, and the distance between the first control terminal 20 and the second control terminal 30, and generate a control instruction according to the first acceleration, the second acceleration, and the distance between the first control terminal 20 and the second control terminal 30. The communication module 50 can be used to send a control instruction to the terminal device to control the display screen of the terminal device.
[0054] See also Figure 4 The present application provides an interactive device 1, comprising one or more processors 40, a memory 60; and one or more programs 62, wherein the one or more programs 62 are stored in the memory 60 and executed by one or more processors, and the program 62 is executed by the processor 60 to execute instructions of the interactive method.
[0055] Please combine Figure 5 The present application provides a non-transitory computer-readable storage medium 70 that always contains a computer program 72, which, when executed by one or more processors, causes the processors to perform an interactive method.
[0056] The interactive method, interactive device 10, interactive device 1 and computer-readable storage medium 70 of these embodiments can generate multiple interactive instructions to interact with the terminal device and control the display screen of the terminal device by acquiring the distance between the first control terminal 20 and the second control terminal 30 in the interactive device 1 and the first acceleration of the first control terminal 20 and the second acceleration of the second control terminal 30, and according to the direction and magnitude of the first acceleration and the second acceleration and the distance between the first control terminal 20 and the second control terminal 30. In this way, the user can interact with the terminal device through the interactive device 1, and the user's operation difficulty can be reduced during the interaction, making the user's operation simple.
[0057] In some embodiments, the interactive device may be a mobile phone, a tablet, or an electronic device such as a wearable device such as a watch, a bracelet, a finger ring, etc. The terminal device may be a mobile phone, a computer, a smart wearable device (smart watch, smart bracelet, smart helmet, smart glasses, etc.), a virtual reality device or an augmented reality device, etc.
[0058] Please combine Figure 6 This embodiment can be described by taking the interactive device 1 as a finger ring as an example, wherein the first control terminal 20 and the second control terminal are both finger rings that can be worn on the user's fingers respectively. That is, the interactive method and the interactive device 10 are applied to finger rings but are not limited to finger rings. In this way, the interactive device is small in size and easy to carry.
[0059] In some implementations, the interaction device 10 may be a part of the interaction apparatus 1 . In other words, the interaction apparatus 1 includes the interaction device 10 .
[0060] In some embodiments, the interactive device 10 may be a discrete component assembled in a certain manner to have the aforementioned functions, or a chip in the form of an integrated circuit having the aforementioned functions, or a computer software code segment that enables the computer to have the aforementioned functions when running on the computer.
[0061] In some embodiments, as hardware, the interactive device 10 can be independently or as an additional peripheral component added to a computer or computer system. The interactive device 10 can also be integrated into a computer or computer system. For example, when the interactive device 10 is part of the interactive device 1, the interactive device 10 can be integrated into the processor 40.
[0062] In some embodiments where the interactive device 10 is a part of the interactive apparatus 1, as software, the code segments corresponding to the interactive device 10 can be stored in the memory and executed by the processor 40 to implement the aforementioned functions. In other words, the interactive device 10 includes the aforementioned one or more programs 62, or the aforementioned one or more programs 62 include the interactive device 10.
[0063] In some implementations, the computer-readable storage medium 70 may be a storage medium built into the interactive device 1 , such as the memory 60 .
[0064] In some implementations, the communication module 50 may be a wireless module such as a Bluetooth module, a Wi-Fi module, a Lora module, etc., to achieve wireless communication with a terminal device.
[0065] In some implementations, the display screen of the terminal device may be a screen displayed by a display screen of the terminal device, or may be a screen projected by the terminal device onto a space or a plane.
[0066] It should be noted that the control instruction refers to the content generated during the interaction between the user and the interactive device 1. For example, the content may include but is not limited to interactive actions such as moving, sliding, tapping, and pressing. Each interactive action may correspond to a control instruction. For example, a control instruction may be generated when the user presses the first control terminal 20 or the second control terminal, and a control instruction may also be generated when the first control terminal 20 or the second control terminal is moved.
[0067] When the user performs interactive actions such as moving, sliding, tapping, pressing, etc. on the interactive device 1, the processor 40 can generate corresponding control instructions according to the state of the interactive device 1. It can be understood that since the state of the interactive device 1 changes when the user moves, slides or presses the interactive device 1, the processor 40 can generate corresponding control instructions according to the state change of the interactive device 1.
[0068] For example, when the user moves the first control terminal 20 toward the second control terminal 30, the acceleration of the first control terminal 20 will change, and the distance between the first control terminal 20 and the second control terminal 30 will also change. The processor 40 can generate a control instruction according to the change in acceleration and distance.
[0069] Please read further Figure 3 Specifically, the first control end 20 includes a magnetic module 21 and a first acceleration sensor 22, and the second control end 30 includes a Hall element 31 and a second acceleration sensor 32. The first acceleration sensor 22 is used to detect the first acceleration of the first control end 20; the second acceleration sensor 32 is used to detect the second acceleration of the second control end 30; and the Hall element 31 is used to detect the magnetic induction intensity.
[0070] It should be noted that the magnetic module 21 is a component that can generate a magnetic field, and can be made of either hard magnetic material or soft magnetic material. The Hall element 31 is within the magnetic field generated by the magnetic module 21, that is, the Hall element 31 can sense the magnetism generated by the magnetic module 21. The first acceleration sensor 22 and the second acceleration sensor 32 can detect acceleration in any direction.
[0071] It should also be noted that the processor 40 may be pre-set with a mapping function, and the magnetic induction intensity detected by the Hall element 31 may be mapped into a corresponding distance through the mapping function, that is, there is a mapping relationship between the magnetic induction intensity detected by the Hall element 31 and the distance between the Hall element 31 and the magnetic module 21. It can be understood that the magnetic induction intensity detected by the Hall element 31 is negatively correlated with the distance between the Hall element 31 and the magnetic module 21, that is, the greater the magnetic induction intensity, the smaller the distance between the Hall element 31 and the magnetic module 21. Since the Hall element 31 is arranged at the second control end 30 and the magnetic module 21 is arranged at the first control end 20, the processor 40 can determine the distance between the second control end 30 and the second control end 30.
[0072] Those skilled in the art can understand that a mapping function refers to a function used to map one data into another data according to a certain mapping relationship, and the mapped another data is the mapping result. For example, there is a function y and data A, and data A can be mapped into data B through function y, then function y is the mapping function, and data B is the mapping result.
[0073] Furthermore, the processor 40 can also obtain the first acceleration or the second acceleration from the first acceleration sensor 22 and the second acceleration sensor 32 respectively, and generate corresponding control instructions according to the first acceleration or the second acceleration and the distance between the first control end 20 and the second control end 30, which are then sent to the terminal device by the communication module 50, thereby controlling the display screen of the terminal device and finally realizing interaction with the terminal device.
[0074] Please combine Figure 7 In some embodiments, step S14 comprises the steps of:
[0075] S141: Determine the magnitude and direction of the first acceleration and the second acceleration and the magnitude of the distance between the first control end and the second control end;
[0076] S142: Generate a first movement instruction when the first acceleration is greater than a first preset value and the direction is parallel to the first plane, and the second acceleration is less than or equal to the first preset value and the direction is parallel to the first plane; or
[0077] S143: Generate a first movement instruction when the first acceleration is less than or equal to a first preset value and the direction is parallel to the first plane, and the second acceleration is greater than the first preset value and the direction is parallel to the first plane.
[0078] Step S16 includes the steps of:
[0079] S161: Sending a first movement instruction to the terminal device to control the target object in the display screen to move according to the direction of the first acceleration and the distance between the first control terminal and the second control terminal.
[0080] Please read further Figure 2 In some embodiments, the generating module 14 includes a judging unit 141, a first generating unit 142, and a second generating unit 143. Step S141 can be implemented by the judging unit 142, step S142 can be implemented by the first generating unit 142, and step S143 can be implemented by the second generating unit 143. Step S161 can be implemented by the sending module 16.
[0081] In other words, the determination unit 141 is used to determine the magnitude and direction of the first acceleration and the second acceleration and the magnitude of the distance.
[0082] The first generating unit 142 is used for generating a first movement instruction when the first acceleration is greater than a first preset value and the direction is parallel to the first plane, and the second acceleration is less than or equal to the first preset value and the direction is parallel to the first plane.
[0083] The second generating unit 143 is used to generate a first movement instruction when the first acceleration is less than or equal to the first preset value and the direction is parallel to the first plane, and the second acceleration is greater than the first preset value and the direction is parallel to the first plane.
[0084] The sending module 16 is used to send a first movement instruction to the terminal device to control the target object in the display screen to move according to the direction of the second acceleration and the distance between the first control terminal 20 and the second control terminal 30 .
[0085] In some embodiments, the processor 40 is used to determine the magnitude and direction of the first acceleration and the second acceleration and the magnitude of the distance; the processor 40 is also used to generate a first movement instruction when the first acceleration is greater than a first preset value and the direction is parallel to the first plane, and the second acceleration is less than or equal to the first preset value and the direction is parallel to the first plane. The processor 40 can also be used to generate a first movement instruction when the first acceleration is less than or equal to the first preset value and the direction is parallel to the first plane, and the second acceleration is greater than the first preset value and the direction is parallel to the first plane. The communication module 50 can also be used to send the first movement instruction to the terminal device to control the target object in the display screen to move according to the direction of the first acceleration and the distance between the first control terminal 20 and the second control terminal 30.
[0086] It should be noted that, in the initial state, the first control terminal 20 and the second control terminal 30 are on a first plane, and the first plane can be a horizontal plane, a vertical plane, or a screen parallel to or perpendicular to the display screen, etc., without specific limitation. For example, in some embodiments, the first plane can be a horizontal plane. The first preset value is a value pre-set by the interactive device 1, which is used to compare with the first acceleration and the second acceleration. The first preset value is greater than zero, and the specific value is not limited. If the first acceleration or the second acceleration is greater than the first preset value, it is determined that the first control terminal 20 or the second control terminal 30 is moving in a direction parallel to the first plane.
[0087] Please combine Figure 6 , Figure 8 and Fig. 9 It should also be noted that the target object can be a movable cursor point that can be used to select an area of the display screen. The relative position of the first control terminal 20 and the second control terminal 30 is mapped to the relative position of the target object in the display screen and the center of the display screen. For example, the distance between the first control terminal 20 and the second control terminal 30 is a multiple of the distance between the target object in the display screen and the center of the display screen. If the distance between the first control terminal 20 and the second control terminal 30 is zero, the target object is in the center of the display screen. If the distance between the first control terminal 20 and the second control terminal 30 is greater than zero, the distance between the target object and the center of the display screen is also greater than zero and is a multiple of the distance between the first control terminal 20 and the second control terminal 30.
[0088] Furthermore, after the terminal device receives the first movement instruction, the target object can be controlled to move according to the relative position relationship between the first control terminal 20 and the second control terminal 30, so that the relative position of the target object and the center of the display screen is mapped to the relative position of the first control terminal 20 and the second control terminal 30.
[0089] Specifically, after the processor 40 obtains the first acceleration of the first acceleration sensor 22 and the second acceleration of the second acceleration sensor 32, it determines the magnitude and direction of the first acceleration and the second acceleration, and at the same time, it can also obtain and determine the magnitude of the distance between the first control terminal 20 and the second control terminal 30. If the first acceleration is less than or equal to the first preset value, the second acceleration is greater than the first preset value and the direction of the second acceleration is parallel to the first plane, or the second acceleration is less than or equal to the first preset value, the first acceleration is greater than the first preset value and the direction of the first acceleration is parallel to the first plane, then the processor 40 can generate a first movement instruction according to the distance between the first control terminal 20 and the second control terminal 30 and the direction of the first acceleration or the second acceleration, and the communication module 50 sends it to the terminal device.
[0090] It can be understood that when the first acceleration is greater than the first preset value and the direction of the first acceleration is parallel to the first plane, and the second preset value is less than or equal to the first preset value, it can be considered that the first control end 20 is moving and approaching or moving away from the first control end 20, and the second control end 30 is stationary. When the first acceleration is less than or equal to the first preset value, the second acceleration is greater than the first preset value and the direction of the second acceleration is parallel to the first plane, it can be considered that the first control end 20 is stationary, and the second control end 30 is moving and approaching or moving away from the first control end 20.
[0091] Furthermore, after the terminal device receives the first movement instruction, the target object can be controlled to move according to the relative position relationship between the first control terminal 20 and the second control terminal 30, so that the relative position of the target object and the center of the display screen corresponds to the relative position of the first control terminal 20 and the second control terminal 30.
[0092] Please combine Fig.10 In some embodiments, step S16 further comprises the steps of:
[0093] S162: if the first acceleration is greater than the second preset value and the direction is perpendicular to the first plane, and the second acceleration is less than or equal to the second preset value, a click instruction is generated and sent to the terminal device to control the area where the click target object is located;
[0094] S163: If the second acceleration is greater than the second preset value and the direction is perpendicular to the first plane, and the first acceleration is less than or equal to the second preset value, a click instruction is generated and sent to the terminal device to control the area where the click target object is located.
[0095] In some embodiments, step S162 and step S163 can be implemented by the generation module 16, or in other words, the generation module 16 can be used to generate a click instruction and send it to the terminal device to control the area where the click target object is located if the first acceleration is greater than the second preset value and the direction is perpendicular to the first plane, and the second acceleration is less than or equal to the second preset value. The generation module 16 can also be used to generate a click instruction and send it to the terminal device to control the area where the click target object is located if the second acceleration is greater than the second preset value and the direction is perpendicular to the first plane, and the first acceleration is less than or equal to the second preset value.
[0096] In some embodiments, the processor 40 is used to generate a click instruction and send it to the terminal device to control the area where the target object is located if the first acceleration is greater than the second preset value and the direction is perpendicular to the first plane, and the second acceleration is less than or equal to the second preset value. The processor 40 can also be used to generate a click instruction and send it to the terminal device to control the area where the target object is located if the second acceleration is greater than the second preset value and the direction is perpendicular to the first plane, and the first acceleration is less than or equal to the second preset value.
[0097] It should be noted that in this embodiment, the interactive device 1 can generate a click instruction when any one of the first control terminal 20 and the second control terminal 30 moves in a direction perpendicular to the first plane. If the terminal device receives the click instruction, it can control the target object to click the position of the target object in the display screen.
[0098] It can be understood that, since the acceleration is less than the first preset value, it can be considered as stationary. Therefore, if the processor 40 determines that the first acceleration is greater than the second preset value and the direction is perpendicular to the first plane, and the second acceleration is less than or equal to the second preset value, it means that the first control terminal 20 moves in a direction perpendicular to the first plane, and the second control terminal 30 is in a stationary state. If the processor 40 determines that the second acceleration is greater than the second preset value and the direction is perpendicular to the first plane, and the first acceleration is less than or equal to the second preset value, it means that the second control terminal 30 moves in a direction perpendicular to the first plane, and the first control terminal 20 is in a stationary state. Then, the processor 40 can generate a click instruction, and the communication module 50 can send the click instruction to the terminal device, so that the control clicks the area where the target object is located.
[0099] See also Fig.11 In some embodiments, step S14 further comprises the steps of:
[0100] S144: When the distance between the first control end and the second control end is greater than zero, and the first acceleration and the second acceleration are greater than a second preset value and the directions are perpendicular to the first plane, a first scaling instruction is generated.
[0101] Step S16 also includes the steps of:
[0102] S164: Send a first scaling instruction to the terminal device to control the area where the target object is located to scale according to the change in the distance between the first control terminal and the second control terminal.
[0103] Please read further Figure 2 In some implementations, step S144 may be implemented by the generation module 14. Step S164 may be implemented by the generation module 16.
[0104] In other words, the generating module 14 is used to generate a first scaling instruction when the distance is greater than zero, the first acceleration and the second acceleration are greater than the second preset value, and the direction is perpendicular to the first plane. The generating module 16 is used to send the first scaling instruction to the terminal device to control the area where the target object is located to scale according to the change in the distance between the first control terminal 20 and the second control terminal 30.
[0105] In some embodiments, the processor 40 can be used to generate a first scaling instruction when the distance is greater than zero, the first acceleration and the second acceleration are greater than a second preset value and the direction is perpendicular to the first plane. The processor 40 can also be used to send the first scaling instruction to the terminal device to control the area where the target object is located to scale according to the change in the distance between the first control end 20 and the second control end 30.
[0106] The second preset value is a value pre-set by the interactive device 1 and is used for comparison with the first acceleration and the second acceleration. The second preset value is greater than zero, and the specific value is not limited. The second preset value can be the same as the first preset value or different from the first preset value. If the first acceleration or the second acceleration is greater than the second preset value, it is determined that the first control end 20 or the second control end 30 is moving in a direction perpendicular to the first plane.
[0107] In the interactive device 1 and the terminal device of the present embodiment, when the distance between the first control terminal 20 and the second control terminal 30 is greater than zero, the simultaneous movement of the first control terminal 20 and the second control terminal 30 in a direction perpendicular to the first plane is defined as generating or starting a first zoom instruction. After receiving the first zoom instruction, the terminal device can control the area where the target object is located to be enlarged or reduced according to the change in the distance between the first control terminal 20 and the second control terminal 30.
[0108] Specifically, if the processor 40 determines that the distance between the first control end 20 and the second control end 30 obtained by detecting the magnetic module 21 according to the Hall element 31 is greater than zero, and the first acceleration and the second acceleration are greater than the second preset value in the direction perpendicular to the first plane, it means that the first control end 20 and the second control end 30 are moving in the direction perpendicular to the first plane at the same time. Then, the processor 40 generates a first scaling instruction, and the communication module 50 sends the first scaling instruction to the terminal device. After the terminal device receives the first scaling instruction, the area where the target object is located can be controlled to be enlarged or reduced according to the change in the distance between the first control end 20 and the second control end 30.
[0109] See also Fig.12 In some embodiments, step S14 comprises the steps of:
[0110] S145: When the distance between the first control end and the second control end is zero, and the first acceleration and the second acceleration are equal and greater than the first preset value and less than the third preset value, a second movement instruction is generated.
[0111] Step S16 also includes the steps of:
[0112] S165: Send a second movement instruction to the terminal device to control the target object in the display image to move according to the direction and magnitude of the first acceleration.
[0113] Please further combine Figure 2 In some implementations, step S145 may be implemented by the generating module 14. Step S165 may be implemented by the sending module 16.
[0114] In other words, the generating module 14 can be used to generate the second movement instruction when the distance between the first control end 20 and the second control end 30 is zero, and the first acceleration and the second acceleration are equal and greater than the first preset value and less than the third preset value.
[0115] The sending module 16 may be configured to send a second movement instruction to the terminal device to control the target object in the display screen to move according to the direction and magnitude of the first acceleration.
[0116] In some embodiments, the processor 40 is used to generate a second movement instruction when the distance between the first control end 20 and the second control end 30 is zero, and the first acceleration and the second acceleration are equal and greater than the first preset value and less than the third preset value. The communication module 50 can also be used to send the second movement instruction to the terminal device to control the target object in the display screen to move according to the direction and magnitude of the first acceleration.
[0117] It should be noted that the third preset value is a value preset by the interactive device 1 and is used for comparison with the first acceleration and the second acceleration. The third preset value is greater than the first preset value, and the specific value is not limited.
[0118] Please combine Fig.13 In the interactive device 1 and the terminal device of this embodiment, the distance between the first control terminal 20 and the second control terminal 30 is equal to zero, the first control terminal 20 and the second control terminal 30 move simultaneously, and when the movement speed of the first control terminal 20 and the second control terminal 30 is between the first preset value and the third preset value, it is defined as a second movement instruction. After receiving the second movement instruction, the terminal device can control the movement of the target object in the display screen according to the direction and magnitude of the first acceleration or the second acceleration.
[0119] Specifically, if the processor 40 determines that the distance between the first control end 20 and the second control end 30 is equal to zero, the first acceleration and the second acceleration are the same and are greater than the first preset value and less than or equal to the third preset value in the direction parallel to the first plane, then it means that the first control end 20 and the second control end 30 are moving in the direction parallel to the first plane at the same time. Then, the processor 40 generates a second movement instruction, and the communication module 50 sends the second movement instruction to the terminal device. After the terminal device receives the second movement instruction, it can control the target object to move according to the direction and magnitude of the first acceleration.
[0120] See also Fig.14 In some embodiments, step S14 further includes:
[0121] S146: if the distance between the first control end and the second control end is greater than zero, and the first acceleration and the second acceleration are greater than a first preset value and in opposite directions, generate a second scaling instruction;
[0122] Step S16 also includes:
[0123] S166: Send a second scaling instruction to the terminal device to control the area where the target object is located to scale according to the change in the distance between the first control terminal and the second control terminal 30 .
[0124] In some implementations, step S146 may be implemented by the generating module 14 . Step S166 may be implemented by the sending module 16 .
[0125] In other words, the generating module 14 can be used to generate a second scaling instruction if the distance between the first control end 20 and the second control end 30 is greater than zero, and the first acceleration and the second acceleration are greater than a first preset value and in opposite directions. The sending module 16 can also be used to send the second scaling instruction to the terminal device to control the area where the target object is located to scale according to the change in the distance between the first control end 20 and the second control end 30.
[0126] In some embodiments, the processor 40 can be used to generate a second scaling instruction if the distance is greater than zero, and the first acceleration and the second acceleration are greater than a first preset value and in opposite directions. The processor 40 can also be used to send the second scaling instruction to the terminal device to control the area where the target object is located to scale according to the change in the distance between the first control terminal 20 and the second control terminal 30.
[0127] Please combine Fig.15 In the interactive device 1 and the terminal device of this embodiment, after the processor 40 generates a second movement instruction, if the first control terminal 20 and the second control terminal 30 move in opposite directions so that the distance between the first control terminal 20 and the second control terminal 30 is greater than zero, it is defined as a second scaling instruction. After receiving the first scaling instruction, the terminal device can control the area where the target object is located to be enlarged or reduced according to the change in the distance between the first control terminal 20 and the second control terminal 30.
[0128] It should be noted that the movement direction of the first control end 20 and the second control end 30 can be parallel to the first plane or parallel to the first plane, and there is no restriction on the movement direction of the first control end 20 and the second control end 30. For example, in this embodiment, the movement direction of the first control end 20 and the second control end 30 is parallel to the first plane.
[0129] Specifically, if the processor 40 determines that the distance between the first control end 20 and the second control end 30 obtained by detecting the magnetic module 21 according to the Hall element 31 is greater than zero, the first acceleration and the second acceleration are greater than the first preset value in the direction parallel to the first plane, and the directions of the first acceleration and the second acceleration are opposite, then it means that the first control end 20 and the second control end 30 move in opposite directions on a plane parallel to the first plane. Then, the processor 40 generates a second scaling instruction, and the communication module 50 sends the second scaling instruction to the terminal device. After the terminal device receives the second scaling instruction, the area where the target object is located can be controlled to be enlarged or reduced according to the change in the distance between the first control end 20 and the second control end 30.
[0130] See also Fig.16 In some embodiments, step S14 further comprises the steps of:
[0131] S147: When the distance between the first control end and the second control end is zero and the first acceleration and the second acceleration are greater than or equal to a third preset value, generating a sliding instruction;
[0132] Step S16 also includes the steps of:
[0133] S167: Send a sliding instruction to the terminal device to control the display screen to slide according to the direction of the first acceleration.
[0134] In some embodiments, step S147 may be implemented by the generating module 14. Step S167 may be implemented by the sending module 16. In other words, the generating module 14 may be used to generate a sliding instruction according to the direction of the first acceleration when the distance between the first control terminal and the second control terminal 30 is zero and the first acceleration and the second acceleration are greater than or equal to a third preset value.
[0135] The sending module 16 may be configured to send a sliding instruction to the terminal device to control the display screen to slide in the direction of the first acceleration.
[0136] In some embodiments, the processor 40 is also used to generate a sliding instruction when the distance between the first control end 20 and the second control end 30 is zero and the first acceleration and the second acceleration are greater than or equal to a third preset value. The processor 40 can also be used to send a sliding instruction to the terminal device to control the display screen to slide according to the direction of the second acceleration.
[0137] In the interactive device 1 and the terminal device of the present embodiment, when the distance between the first control end 20 and the second control end 30 obtained by detecting the magnetic module 21 according to the Hall element 31 is zero, the first control end 20 and the second control end 30 move simultaneously, and the acceleration during the movement is greater than the third preset value, which is defined as a sliding instruction. That is, if the processor 40 detects that the distance between the first control end and the second control end is zero, and at the same time, detects that the first acceleration and the second acceleration are greater than the third preset value, a sliding instruction is generated. After receiving the sliding instruction, the terminal device can control the display screen to slide according to the direction of the first acceleration or the second acceleration.
[0138] It should be noted that the direction in which the display screen slides is the same as the direction of the first acceleration or the second acceleration, that is, each time the terminal device receives a sliding instruction, the direction in which the display screen slides is the same as the direction of the first acceleration or the second acceleration.
[0139] Specifically, if the processor 40 determines that the distance between the first control end 20 and the second control end 30 obtained by detecting the magnetic module 21 according to the Hall element 31 is equal to zero, the first acceleration and the second acceleration are the same and are greater than the first preset value and the third preset value in the direction parallel to the first plane, then it means that the first control end 20 and the second control end 30 are moving in the direction parallel to the first plane at the same time, and then, the processor 40 generates a first scaling instruction, and the communication module 50 sends the first scaling instruction to the terminal device. After the terminal device receives the first scaling instruction, the display screen can be controlled to slide according to the direction of the first acceleration or the second acceleration.
[0140] In some embodiments, the sliding distance of the display screen may be proportional to the magnitude of the first acceleration or the second acceleration, that is, the greater the first acceleration or the second acceleration, the farther the sliding distance of the display screen. For example, if the direction of the first acceleration or the second acceleration is to the left and the first acceleration or the second acceleration is 0.5 meters per second squared, the display screen slides to the left and the sliding distance is 5 centimeters.
[0141] In addition, in some other implementations, the sliding distance of the display screen may also be a preset distance, that is, each time the terminal device receives a sliding instruction, it slides the preset distance.
[0142] The above embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. An interactive method, using an interactive device, characterized in that: The interactive device communicates with the terminal device, the interactive device includes a first control terminal and a second control terminal, and the interactive method includes: Acquire a first acceleration of the first control end, a second acceleration of the second control end, and a distance between the first control end and the second control end; generating a control instruction according to the first acceleration, the second acceleration and the distance between the first control end and the second control end; and Sending the control instruction to the terminal device to control the display screen of the terminal device; The generating of the control instruction according to the first acceleration, the second acceleration and the distance between the first control end and the second control end comprises: Determining the magnitude and direction of the first acceleration and the second acceleration and the magnitude of the distance between the first control end and the second control end; When the first acceleration is greater than a first preset value and its direction is parallel to the first plane, and the second acceleration is less than or equal to the first preset value and its direction is parallel to the first plane, a first movement instruction is generated; or When the first acceleration is less than or equal to the first preset value and the direction is parallel to the first plane, and the second acceleration is greater than the first preset value and the direction is parallel to the first plane, the first movement instruction is generated; The sending the control instruction to the terminal device to control the display screen of the terminal device includes: The first movement instruction is sent to the terminal device to control the target object in the display screen to move according to the direction of the second acceleration and the distance between the first control end and the second control end, and the relative position of the first control end and the second control end is mapped to the relative position of the target object in the display screen and the center of the display screen.
2. The interactive method according to claim 1, characterized in that: After sending the first movement instruction to the terminal device to control the target object in the display screen to move according to the direction of the second acceleration and the distance between the first control end and the second control end, the interaction method further includes: If the first acceleration is greater than a second preset value and the direction is perpendicular to the first plane, and the second acceleration is less than or equal to the second preset value, a click instruction is generated and sent to the terminal device to control the click of the area where the target object is located; or If the second acceleration is greater than a second preset value and its direction is perpendicular to the first plane, and the first acceleration is less than or equal to the second preset value, the click instruction is generated and sent to the terminal device to control the click of the area where the target object is located.
3. The interactive method according to claim 2, characterized in that: The generating of the control instruction according to the first acceleration, the second acceleration and the distance between the first control end and the second control end further includes: When the distance between the first control end and the second control end is greater than zero, the first acceleration and the second acceleration are greater than a second preset value and the directions are perpendicular to the first plane, a first scaling instruction is generated; The sending the control instruction to the terminal device to control the display screen of the terminal device also includes: The first scaling instruction is sent to the terminal device to control the area where the target object is located to scale according to the change in the distance between the first control end and the second control end.
4. The interactive method according to claim 1, characterized in that: The generating of the control instruction according to the first acceleration, the second acceleration and the distance between the first control end and the second control end further includes: When the distance between the first control end and the second control end is zero, and the first acceleration is equal to the second acceleration and is greater than the first preset value and less than the third preset value, a second movement instruction is generated; The sending the control instruction to the terminal device to control the display screen of the terminal device also includes: The second movement instruction is sent to the terminal device to control the target object in the display screen to move according to the direction and magnitude of the first acceleration.
5. The interactive method according to claim 4, characterized in that: After sending the second movement instruction to the terminal device to control the target object in the display screen to move according to the direction and magnitude of the first acceleration, the interaction method further includes: If the distance between the first control end and the second control end is greater than zero, and the first acceleration and the second acceleration are greater than the first preset value and in opposite directions, a second scaling instruction is generated; The sending the control instruction to the terminal device to control the display screen of the terminal device also includes: The second scaling instruction is sent to the terminal device to control the area where the target object is located to scale according to the change in the distance between the first control end and the second control end.
6. The interactive method according to claim 4, characterized in that: The generating of the control instruction according to the first acceleration, the second acceleration and the distance between the first control end and the second control end further includes: When the distance between the first control end and the second control end is zero, and the first acceleration and the second acceleration are greater than or equal to the third preset value, generating a sliding instruction; The sending the control instruction to the terminal device to control the display screen of the terminal device also includes: The sliding instruction is sent to the terminal device to control the display screen to slide according to the direction of the first acceleration.
7. An interactive device, used for an interactive device, characterized in that: The interactive device communicates with the terminal device, the interactive device includes a first control terminal and a second control terminal, and the interactive device includes: Acquisition module: the acquisition module is used to acquire a first acceleration of the first control end, a second acceleration of the second control end, and a distance between the first control end and the second control end; a generating module, the generating module being configured to generate a control instruction according to the first acceleration, the second acceleration and the distance between the first control end and the second control end; and A sending module, the sending module is used to send the control instruction to the terminal device to control the display screen of the terminal device; The generation module comprises: a determination unit, configured to determine the magnitude and direction of the first acceleration and the second acceleration and the magnitude of the distance between the first control end and the second control end; A first generating unit, configured to generate a first movement instruction when the first acceleration is greater than a first preset value and the direction is parallel to the first plane, and the second acceleration is less than or equal to the first preset value and the direction is parallel to the first plane; A second generating unit, configured to generate the first movement instruction when the first acceleration is less than or equal to the first preset value and the direction is parallel to the first plane, and the second acceleration is greater than the first preset value and the direction is parallel to the first plane; The sending module is specifically used for: The first movement instruction is sent to the terminal device to control the target object in the display screen to move according to the direction of the second acceleration and the distance between the first control end and the second control end, and the relative position of the first control end and the second control end is mapped to the relative position of the target object in the display screen and the center of the display screen.
8. An interactive device, characterized in that: The interactive device communicates with the terminal device, and the interactive device includes a first control terminal, a second control terminal, a processor and a communication module, the first control terminal includes a magnetic module and a first acceleration sensor, the second control terminal includes a Hall element and a second acceleration sensor; the processor is used to: Acquire a first acceleration of the first control end detected by the first acceleration sensor, a second acceleration of the second control end detected by the second acceleration sensor, and a distance between the first control end and the second control end obtained by the Hall element detecting the magnetic module; generating a control instruction according to the first acceleration, the second acceleration and the distance between the first control end and the second control end; The communication module is used for: Sending the control instruction to the terminal device to control the display screen of the terminal device; The processor is specifically used for: Determining the magnitude and direction of the first acceleration and the second acceleration and the magnitude of the distance between the first control end and the second control end; When the first acceleration is greater than a first preset value and its direction is parallel to the first plane, and the second acceleration is less than or equal to the first preset value and its direction is parallel to the first plane, a first movement instruction is generated; or When the first acceleration is less than or equal to the first preset value and the direction is parallel to the first plane, and the second acceleration is greater than the first preset value and the direction is parallel to the first plane, the first movement instruction is generated; The first movement instruction is sent to the terminal device to control the target object in the display screen to move according to the direction of the second acceleration and the distance between the first control end and the second control end, and the relative position of the first control end and the second control end is mapped to the relative position of the target object in the display screen and the center of the display screen.
9. An interactive device, characterized in that: One or more processors, memory; and One or more programs, wherein the one or more programs are stored in the memory and executed by the one or more processors, and the programs include instructions for executing the interaction method according to any one of claims 1-6.
10. A non-volatile computer-readable storage medium containing a computer program, characterized in that: When the computer program is executed by one or more processors, the processors are enabled to perform the interactive method according to any one of claims 1 to 6.
Citation Information
Patent Citations
Wearable keyboard
CN210605644U