Interface switching method, device, computer equipment and storage medium for intelligent device

Abstract

The embodiments of this specification provide an interface switching method, device, computer device and storage medium for a smart device. The method is applied to a first smart device, which is connected to a smart ring. The method includes: obtaining position change information sent by the smart ring; wherein the position change information is the movement state of a finger obtained by an inertial measurement unit placed inside the smart ring; determining the target direction in which the interface of the first smart device needs to slide based on the position change information; and adjusting the content displayed on the interface of the first smart device based on the target direction. The technical solution provided in the embodiments of this specification can, to a certain extent, improve the convenience of adjusting the page content of the first smart device at a long distance.

Description

Technical Field

[0001] The embodiments of the present specification relate to the field of air mouse technology, and specifically to a method, device, computer device and storage medium for interface switching of a smart device. Background Art

[0002] When a user uses a smart device to listen to music or watch videos, if the content currently displayed on the smart device needs to be switched, the operation needs to be performed in the smart device. At this time, if the user places the smart device on a table or other place, and the distance between the user and the smart device is large, the user needs to walk near the smart device and then adjust the content of the smart device. For example, when a user is presenting a slide projected on another screen, if the user adjusts the slide on the smart device, the rhythm of the speech may be interrupted. Therefore, the above method of directly adjusting the page content in the smart device brings inconvenience to the user to a certain extent. Summary of the invention

[0003] In view of this, multiple embodiments of this specification are dedicated to providing an interface switching method, apparatus, computer device, storage medium and computer program product for a smart device, so as to improve the convenience of adjusting the page content of a first smart device at a long distance to a certain extent.

[0004] The embodiment of this specification proposes an interface switching method for a smart device, which is applied to a first smart device, and the first smart device is connected to a smart ring. The method includes: obtaining position change information sent by the smart ring; wherein the position change information is the movement state of a finger obtained by an inertial measurement unit placed inside the smart ring; determining a target direction in which the interface of the first smart device needs to slide according to the position change information; and adjusting the content displayed on the interface of the first smart device based on the target direction.

[0005] The embodiment of this specification proposes an interface switching method for a smart device, which is applied to a smart ring. The method includes: using an inertial measurement unit inside the smart ring to collect the movement state of a finger to obtain position change information of the smart ring; feeding back the position change information to a first smart device connected to the smart ring; wherein the position change information is used to indicate a page switching direction of the first smart device.

[0006] The embodiment of this specification proposes an interface switching device for a smart device, which is applied to a first smart device, and the first smart device is connected to a smart ring. The interface switching device for the smart device includes: a position information acquisition module, used to acquire position change information sent by the smart ring; wherein the position change information is the movement state of a finger acquired by an inertial measurement unit placed inside the smart ring; a direction determination module, used to determine the target direction in which the interface of the first smart device needs to slide according to the position change information; and a page adjustment module, used to adjust the content displayed on the interface of the first smart device based on the target direction.

[0007] The embodiment of this specification proposes an interface switching device for a smart device, which is applied to a smart ring. The interface switching device for the smart device includes: a position information acquisition module, which is used to use an inertial measurement unit inside the smart ring to collect the movement state of a finger to obtain position change information of the smart ring; a position information feedback module, which is used to feed back the position change information to a first smart device connected to the smart ring; wherein the position change information is used to indicate a page switching direction of the first smart device.

[0008] An embodiment of the present specification provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the method described in the above embodiment when executing the computer program.

[0009] The embodiments of this specification provide a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the method described in the above embodiments is implemented.

[0010] The embodiments of this specification provide a computer program product, including computer instructions, and the computer instructions are used to enable a computer to execute the method described in the above embodiments.

[0011] The implementation method of this specification determines the target direction in which the interface of the first smart device needs to slide by obtaining the position change information sent by the smart ring, and then adjusts the content displayed on the interface of the first smart device according to the target direction, thereby eliminating the need for the user to manually slide the screen of the first smart device or use an external device to adjust the content displayed on the page of the first smart device, which can improve the convenience of adjusting the content of the page of the first smart device at a long distance to a certain extent. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 The figure is a schematic flow chart of an interface switching method for a smart device provided in one embodiment.

[0013] Figure 2 The figure is a schematic flow chart of an interface switching method for a smart device provided in one embodiment.

[0014] Figure 3 Shown is a schematic diagram of an interface switching device for a smart device provided in one embodiment.

[0015] Figure 4 Shown is a schematic diagram of an interface switching device for a smart device provided in one embodiment.

[0016] Figure 5 Shown is a schematic diagram of a computer device provided by an embodiment. DETAILED DESCRIPTION

[0017] In order to enable those skilled in the art to better understand the solution of this specification, the technical solution in the implementation of this specification will be clearly and completely described below in conjunction with the drawings in the implementation of this specification. Obviously, the described implementation is only a part of the implementation of this specification, not all of the implementations. Based on the implementation in this specification, all other implementations obtained by ordinary technicians in this field without creative work are within the scope of protection of this specification.

[0018] When a user uses a smart device to listen to music or watch videos, if the content currently displayed on the smart device needs to be switched, the operation needs to be performed in the smart device. At this time, if the user places the smart device on a table or other place, and the distance between the user and the smart device is large, the user needs to walk near the smart device and then adjust the content of the smart device. For example, when a user is presenting a slide projected on another screen, if the user adjusts the slide on the smart device, the rhythm of the speech may be interrupted. Therefore, the above method of directly adjusting the page content in the smart device brings inconvenience to the user to a certain extent.

[0019] Therefore, the smart device can be connected to the smart ring, and the position change information of the inertial measurement unit inside the smart ring can be obtained. Then, based on the position change information, it can be determined whether the interface of the smart device needs to be switched. In this way, the smart device can be quickly adjusted when the distance from the smart device is far, thereby improving the convenience of adjusting the content of the smart device page to a certain extent.

[0020] See also Figure 1 The embodiment of this specification provides an interface switching method for a smart device, the method is applied to a first smart device, the first smart device is connected to a smart ring, and the method may include the following steps.

[0021] Step S110: Acquire the position change information sent by the smart ring; wherein the position change information is the movement state of the finger acquired by an inertial measurement unit placed inside the smart ring.

[0022] In this embodiment, the first smart device may be an electronic device such as a mobile phone, a computer, a server, a tablet computer, etc. The first smart device may have one or more of the following functions: video playback, music playback, text browsing, slide show playback, etc. Specifically, the first smart device may be used to play videos, and the videos may be switched by sliding the screen of the first smart device or clicking a mouse, etc.

[0023] In this embodiment, the smart ring is a small smart device worn on the finger, which usually has multiple functions and can connect and interact with other electronic devices (such as mobile phones, computers, etc.). Through built-in sensors, the smart ring can track the micro-motion data of the user's finger movements. For example, the micro-motion data of the finger can be obtained through the built-in inertial measurement unit (IMU).

[0024] In this embodiment, the position change information may be the movement direction of the finger. It may be equivalent to the current position changing to the left, right, upward, downward, etc. Among them, the IMU includes three single-axis accelerometers and three single-axis gyroscopes. The accelerometer detects the acceleration signal of the object in the independent three-axis of the carrier coordinate system, and the gyroscope detects the angular velocity signal of the carrier relative to the navigation coordinate system, measures the angular velocity and acceleration of the object in three-dimensional space, and uses this to calculate the posture of the finger.

[0025] In this embodiment, the method for obtaining the location information sent by the smart ring can connect the smart ring and the first smart device via Bluetooth, so that when data transmission is required, the smart ring can send the location change information to the first smart device in a timely manner. Of course, the first smart device and the smart ring can also be connected via WiFi or other methods, which is not limited in this embodiment of the specification.

[0026] Step S120: determining a target direction in which the interface of the first smart device needs to slide according to the position change information.

[0027] In this embodiment, the target direction can be based on the acquired position change information. For different application software, a comparison table can be set for comparison, in which the movement direction of the smart ring and the interface switching method of the application software are set one by one, so as to determine the target direction to be switched. For example, when a user uses a smart device to watch a short video, when the position change information is characterized by upward movement, the user can flip up to the previous video; when the position change information standard is downward movement, the user can flip down to the next video. When the position change information is characterized by left and right movement, it can be set to adjust the volume or play the video at a fast or slow speed.

[0028] Step S130: In some implementations, based on the target direction, the content displayed on the first smart device interface is adjusted.

[0029] In this embodiment, after determining the content to be adjusted by the first smart device, the corresponding adjustment is made. Specifically, for example, when the user is watching short videos, if the content is adjusted to flip up to the previous video, the content currently displayed on the screen of the first smart device is adjusted to the video that the user was watching last time. When the content is adjusted to flip down to the next video, the content currently displayed on the screen of the first smart device is adjusted to the next video to be watched by the user. When the content is adjusted to other content, it is adjusted accordingly, which will not be repeated here.

[0030] In some implementations, the smart ring is provided with a trigger module, and the method may further include: when the trigger module is activated, acquiring the position change information sent by the smart ring.

[0031] In this embodiment, the trigger module is used to activate the IMU of the smart ring. First, when there is no need to use the smart bracelet for remote guidance, the impact of accidental touch of finger movements can be avoided; second, when there is no need to use smart after-sales for remote guidance, the IMU function can be turned off, thereby reducing the power consumption of the smart ring to a certain extent. The trigger module can exist in the form of a physical button or in the form of fingerprint touch. For example, when the smart ring is worn on the index finger or middle finger, the fingerprint of the thumb can be used to touch it, so as to trigger the IMU of the smart ring.

[0032] In some implementations, when the first smart device is in pairing connection with the second smart device, pairing connection information is sent to the smart ring.

[0033] In this embodiment, the second smart device may be a smart TV, a projector, a computer, a smart speaker or the like, which is connected to the first smart device via Bluetooth, WiFi or the like.

[0034] In this embodiment, when the first smart device is a small smart device such as a mobile phone or a tablet, when it is used to watch short videos or play music, the first smart device can generally be touched by reaching out, without the need to use a smart ring for control. When these devices are paired and connected with the second smart device, such as using a TV screen to play movies and TV series, slides, or using a Bluetooth speaker to play music. At this time, the first device may require the user to move around before the first smart device can be adjusted. Therefore, when the first smart device and the second smart device are paired and connected, the pairing connection information can be sent to the smart ring, and then the smart ring can be used to switch the content displayed on the interface of the first smart device.

[0035] In some implementations, obtaining the position change information sent by the smart ring may include: obtaining the current initial position of the smart ring and the target position after the smart ring moves; and determining the position change information of the smart ring based on the target position and the initial position.

[0036] In this embodiment, the working principle of IMU (Inertial Measurement Unit) in motion tracking is based on inertial sensors, which are mainly used to measure and record the acceleration, angular velocity and sometimes magnetic field changes of objects. These data can be used to infer the motion state of the object, including position, speed, direction, posture, etc. IMU usually contains multiple sensors, mainly accelerometer: used to measure acceleration along each axis (usually X, Y, and Z directions). Accelerometers can determine the acceleration of objects by sensing changes in gravity and other external forces. Gyroscope: used to measure angular velocity and help sense the rotation rate of objects around different axes. Gyroscopes use angular velocity to infer the angular change and rotation of objects. Magnetometer (optional): provides directional information of objects relative to the earth's magnetic field by measuring the strength and direction of the earth's magnetic field. It is often used to correct the data of accelerometers and gyroscopes to help determine the orientation of objects. Workflow of IMU motion tracking: Data acquisition: The accelerometer measures the acceleration of objects in all directions, including the acceleration of gravity. The gyroscope measures the angular velocity of an object and captures its rotation. The magnetometer (if present) provides data on the direction of the object relative to the Earth's magnetic field. Data fusion: The data output by a single accelerometer and gyroscope is not sufficient to fully describe the motion state of an object. In order to obtain a more accurate motion trajectory, IMUs usually use data fusion algorithms (such as complementary filtering, Kalman filtering, etc.) to synthesize the data of accelerometers, gyroscopes, and magnetometers into a more accurate motion model. The accelerometer provides absolute information on the acceleration of the object, but due to the influence of gravity, errors are prone to occur in dynamic motion. The gyroscope mainly provides information on the rotation of the object, which can effectively reduce the error of the accelerometer in a dynamic environment, but it will accumulate drift errors over time. The magnetometer can help calibrate the directionality of the system and reduce the deviation caused by gyroscope drift. Attitude and position estimation: Based on the data from the accelerometer, the acceleration of the object can be estimated, and the velocity and displacement of the object can be further calculated. Based on the data from the gyroscope, the angle (attitude) of the object, that is, the rotation of the object in space, can be estimated. Using data fusion algorithms, IMU can estimate the object's three-dimensional position, velocity, acceleration, direction and other motion information in real time. MU tracks the object's motion trajectory in real time by continuously updating acceleration and angular velocity.

[0037] See also Figure 2 The embodiment of this specification provides an interface switching method for a smart device, which is applied to a smart ring and may include the following steps.

[0038] Step S210: using the inertial measurement unit inside the smart ring to collect the movement state of the finger, and obtain the position change information of the smart ring.

[0039] Step S220: Feedback the position change information to a first smart device connected to the smart ring; wherein the position change information is used to indicate a page switching direction of the first smart device.

[0040] In some embodiments, the smart ring is provided with a trigger module, and the method may further include: when the trigger module is activated, acquiring the motion state of the finger using an inertial measurement unit inside the smart ring.

[0041] In some implementations, the method may further include: upon receiving pairing connection information sent by the smart device to connect to a second smart device, collecting the movement state of the finger using an inertial measurement unit inside the smart ring.

[0042] In some embodiments, using an inertial measurement unit inside the smart ring to collect the movement state of the finger and obtain the position change information of the smart ring can include: collecting the current initial position of the smart ring and the target position after the smart ring moves; and determining the position change information of the smart ring based on the target position and the initial position.

[0043] For a detailed explanation of the interface switching method of the smart device on the smart bracelet side, please refer to the explanation of the interface switching method of the smart device on the first smart device side, and the implementation method of this specification will not be repeated here.

[0044] See also Figure 3 In some implementations, an interface switching device for a smart device may be provided. The interface switching device for the smart device is applied to a first smart device, and the first smart device is connected to a smart ring. The interface switching device for the smart device may include: a location information acquisition module, a direction determination module, and a page adjustment module.

[0045] The position information acquisition module is used to acquire the position change information sent by the smart ring; wherein the position change information is the movement state of the finger acquired by the inertial measurement unit placed inside the smart ring.

[0046] The direction determination module is used to determine the target direction in which the interface of the first smart device needs to slide according to the position change information.

[0047] The page adjustment module is used to adjust the content displayed on the first smart device interface based on the target direction.

[0048] See also Figure 4 In some implementations, an interface switching device for a smart device may be provided. The interface switching device for the smart device is applied to a smart ring. The interface switching device for the smart device may include: a location information acquisition module, a direction determination module, and a page adjustment module.

[0049] The position information acquisition module is used to collect the movement state of the finger using the inertial measurement unit inside the smart ring to obtain the position change information of the smart ring.

[0050] The position information feedback module is used to feed back the position change information to a first smart device connected to the smart ring; wherein the position change information is used to indicate a page switching direction of the first smart device.

[0051] The specific functions and effects achieved by the interface switching device of the smart device can be explained with reference to other embodiments of this specification, and will not be repeated here. Each module in the interface switching device of the smart device can be implemented in whole or in part by software, hardware, and a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each of the above modules.

[0052] See also Figure 5 In some implementations, a computer device may be provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the method steps in the implementation are implemented.

[0053] In some embodiments, a computer-readable storage medium may be provided, on which a computer program is stored. When the computer program is executed by a processor, the method steps in the embodiments are implemented.

[0054] In some implementations, a computer program product may be provided, including computer instructions, wherein the computer instructions are used to enable a computer to execute the method described in the above implementations.

[0055] Those of ordinary skill in the art can understand that all or part of the processes in the implementation method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the implementation methods of the methods described. Among them, any reference to memory, storage, database or other media used in the various implementations provided in this specification may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0056] It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0057] The descriptions of the various embodiments of this specification are made in a progressive manner. Different embodiments focus on describing the parts that are different from other embodiments. After reading this specification, a person skilled in the art can know that the various embodiments in this specification, as well as the various technical features disclosed in the embodiments, can be combined in more ways. To make the description concise, not all possible combinations of the various technical features in the embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0058] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0059] The multiple embodiments in this specification emphasize the parts that are different from other embodiments, and the various embodiments can be explained in comparison with each other. Any combination of the multiple embodiments in this specification by technicians in the relevant field based on general technical knowledge is included in the disclosure scope of this specification.

[0060] The above description is only an implementation method of this case and is not intended to limit the scope of protection of the claims of this case. For those skilled in the art, this case may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this case should be included in the scope of the claims of this case.

Claims

1. A method for switching interfaces of a smart device, characterized in that: The method is applied to a first smart device, the first smart device is connected to a smart ring, and the method includes: Acquire the position change information sent by the smart ring; wherein the position change information is the movement state of the finger acquired by an inertial measurement unit placed inside the smart ring; Determining, according to the position change information, a target direction in which the interface of the first smart device needs to slide; Based on the target direction, adjust the content displayed on the first smart device interface.

2. The method according to claim 1, characterized in that The smart ring is provided with a trigger module, and the method further comprises: When the trigger module is activated, the position change information sent by the smart ring is obtained.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: When the first smart device is in pairing connection with the second smart device, pairing connection information is sent to the smart ring.

4. The method according to claim 1, characterized in that: Obtaining the location change information sent by the smart ring includes: Obtaining the current initial position of the smart ring and the target position of the smart ring after moving; The position change information of the smart ring is determined based on the target position and the initial position.

5. A method for switching interfaces of a smart device, characterized in that: The method is applied to a smart ring, and the method comprises: Using the inertial measurement unit inside the smart ring to collect the movement state of the finger, and obtain the position change information of the smart ring; The position change information is fed back to a first smart device connected to the smart ring; wherein the position change information is used to indicate a page switching direction of the first smart device.

6. The method according to claim 5, characterized in that The smart ring is provided with a trigger module, and the method further comprises: When the trigger module is activated, the motion state of the finger is acquired by using the inertial measurement unit inside the smart ring.

7. The method according to claim 5 or 6, characterized in that: The method further comprises: When receiving the pairing connection information sent by the smart device and connected to the second smart device, the inertial measurement unit inside the smart ring is used to collect the movement state of the finger.

8. The method according to claim 5, characterized in that The inertial measurement unit in the smart ring is used to collect the motion state of the finger to obtain the position change information of the smart ring, including: Collecting the current initial position of the smart ring and the target position of the smart ring after moving; The position change information of the smart ring is determined based on the target position and the initial position.

9. An interface switching device for a smart device, characterized in that: The interface switching device of the smart device is applied to a first smart device, the first smart device is connected to a smart ring, and the interface switching device of the smart device includes: A position information acquisition module, used to acquire the position change information sent by the smart ring; wherein the position change information is the movement state of the finger acquired by an inertial measurement unit placed inside the smart ring; a direction determination module, used to determine a target direction in which the interface of the first smart device needs to slide according to the position change information; The page adjustment module is used to adjust the content displayed on the first smart device interface based on the target direction.

10. An interface switching device for a smart device, characterized in that: The interface switching device of the smart device is applied to a smart ring, and the interface switching device of the smart device comprises: A position information acquisition module, used to acquire the motion state of the finger by using the inertial measurement unit inside the smart ring to obtain the position change information of the smart ring; The position information feedback module is used to feed back the position change information to a first smart device connected to the smart ring; wherein the position change information is used to indicate a page switching direction of the first smart device.

11. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the method according to any one of claims 1 to 4 or claims 5 to 8 is implemented.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 4 or claims 5 to 8 is implemented.

13. A computer program product, characterized in that The method comprises computer instructions for causing a computer to execute the method of any one of claims 1 to 4 or claims 5 to 8.

Images