Interaction control method and device of intelligent wearable equipment, equipment and storage medium

By obtaining the target spatial position of the hand interaction control device in the smart wearable device and displaying the interactive interface, in response to user interaction actions, the problem of low interactive control accuracy of smart wearable devices is solved, and a more efficient and intuitive interactive experience is achieved.

CN119024961AInactive Publication Date: 2024-11-26ZHUHAI MOJIE TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411046737.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-31
Publication Date
2024-11-26
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The interactive control accuracy of existing smart wearable devices is low, making it difficult to provide an intuitive and efficient user interaction experience.

Method used

By obtaining the target spatial position of the hand interaction control device, the interactive interface of the smart wearable device is displayed next to the hand interaction control device according to the position, and the display content is switched in response to the user's interactive actions, including through touch operations and rotation operations Adjust the interface content and perspective.

Benefits of technology

It improves the accuracy and authenticity of interactive control, enhances the user experience, and makes interactive operations more intuitive and convenient.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119024961A_ABST
    Figure CN119024961A_ABST
Patent Text Reader

Abstract

The invention provides an interaction control method and device of intelligent wearable equipment, the intelligent wearable equipment and a computer readable storage medium. The interaction control method of the intelligent wearable device comprises the following steps: acquiring a target spatial position of a hand interaction control device; according to the target spatial position, displaying an interaction interface of an intelligent wearable device on the side of the hand interaction control device; and in response to an interaction action aiming at the hand interaction control equipment, switching the display content of the interaction interface. According to the invention, the interaction control accuracy and authenticity of the intelligent wearable device can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of smart wearable devices, and in particular to an interactive control method and device for a smart wearable device, a smart wearable device, and a computer-readable storage medium. Background Art

[0002] With the development of smart wearable technology, augmented reality devices and virtual reality devices have entered the lives of users. At present, there are many main interaction methods for smart wearable devices such as augmented reality devices and virtual reality devices, such as eye tracking interaction, gesture recognition interaction, voice command interaction, interactive control device (such as ring, etc.) interaction, etc. Among them, the inventor of the embodiment of this application found in the actual research and development process that the interactive control accuracy of smart wearable devices using interactive control device interaction is low. Summary of the invention

[0003] The present application provides an interactive control method and device for a smart wearable device, a smart wearable device, and a computer-readable storage medium, which can improve the interactive control accuracy and authenticity of the smart wearable device.

[0004] In a first aspect, the present application provides an interactive control method for a smart wearable device, the method comprising:

[0005] Obtain the target spatial position of the hand interaction control device;

[0006] According to the target spatial position, displaying an interactive interface of the smart wearable device next to the hand interaction control device;

[0007] In response to an interactive action on the hand interaction control device, display content of the interactive interface is switched.

[0008] In some embodiments, the switching of the display content of the interactive interface in response to the interactive action on the hand interactive control device includes:

[0009] Detecting, by means of the hand interaction control device, a touch operation on an interactive control of the hand interaction control device;

[0010] In response to the touch operation, the display content of the interactive interface is switched from the current page content to the target page content matching the touch operation.

[0011] In some embodiments, the switching of the display content of the interactive interface in response to the interactive action on the hand interactive control device includes:

[0012] detecting a rotation operation on the hand interaction control device through a motion sensor of the hand interaction control device;

[0013] In response to the rotation operation, the viewing angle of the displayed content of the interactive interface is rotated according to the rotation angle and rotation direction of the hand interaction control device.

[0014] In some embodiments, the interactive interface includes a first display area, a second display area disposed at one end of the first display area, and a third display area disposed at the other end of the first display area away from the second display area, wherein the first display area is used to display the current page content, the second display area is used to display a thumbnail of the next page content, and the third display area is used to display a thumbnail of the previous page content.

[0015] In some embodiments, the preset previous page operation direction is opposite to the previous page display direction, and the previous page display direction is the relative direction between the third display area and the first display area; wherein the preset next page operation direction is opposite to the next page display direction, and the next page display direction is the relative direction between the second display area and the first display area;

[0016] The switching of the display content of the interactive interface in response to the interactive action on the hand interactive control device includes:

[0017] In response to a next page touch operation on an interactive control of the hand interactive control device, switching the displayed content of the interactive interface from the current page content to content corresponding to the next page content thumbnail;

[0018] Alternatively, in response to a previous page touch operation on the interactive control of the hand interaction control device, the displayed content of the interactive interface is switched from the current page content to the content corresponding to the thumbnail of the previous page content.

[0019] In some embodiments, obtaining the target spatial position of the hand interaction control device includes:

[0020] Acquiring an environment image including the hand interaction control device through a camera of the smart wearable device;

[0021] Position recognition is performed based on the environment image to determine the target spatial position of the hand interaction control device.

[0022] In some embodiments, obtaining the target spatial position of the hand interaction control device includes:

[0023] Sending an ultra-wideband signal to a built-in ultra-wideband chip of the hand interaction control device through a built-in ultra-wideband chip of the smart wearable device;

[0024] Obtaining the propagation duration of the ultra-wideband signal;

[0025] A target spatial position of the hand interaction control device is determined based on the propagation duration.

[0026] In a second aspect, the present application provides an interactive control device for a smart wearable device, the interactive control device for the smart wearable device comprising:

[0027] An acquisition unit, used for acquiring a target spatial position of a hand interaction control device;

[0028] A display unit, configured to display an interactive interface of a smart wearable device beside the hand interaction control device according to the target spatial position;

[0029] A control unit is used to switch the display content of the interactive interface in response to an interactive action on the hand interactive control device.

[0030] In some embodiments, the control unit is specifically configured to:

[0031] Detecting, by means of the hand interaction control device, a touch operation on an interactive control of the hand interaction control device;

[0032] In response to the touch operation, the display content of the interactive interface is switched from the current page content to the target page content matching the touch operation.

[0033] In some embodiments, the control unit is specifically configured to:

[0034] detecting a rotation operation on the hand interaction control device through a motion sensor of the hand interaction control device;

[0035] In response to the rotation operation, the viewing angle of the displayed content of the interactive interface is rotated according to the rotation angle and rotation direction of the hand interaction control device.

[0036] In some embodiments, the display unit is specifically used for:

[0037] Displaying an interactive interface of a smart wearable device including current page content, a next page content thumbnail, and a previous page content thumbnail, wherein the interactive interface includes a first display area, a second display area arranged at one end of the first display area, and a third display area arranged at the other end of the first display area away from the second display area, the first display area is used to display the current page content, the second display area is used to display the next page content thumbnail, and the third display area is used to display the previous page content thumbnail.

[0038] In some embodiments, the preset previous page operation direction is opposite to the previous page display direction, and the previous page display direction is the relative direction between the third display area and the first display area; the preset next page operation direction is opposite to the next page display direction, and the next page display direction is the relative direction between the second display area and the first display area; the control unit is specifically used to:

[0039] In response to a next page touch operation on an interactive control of the hand interactive control device, switching the displayed content of the interactive interface from the current page content to content corresponding to the next page content thumbnail;

[0040] Alternatively, in response to a previous page touch operation on the interactive control of the hand interaction control device, the displayed content of the interactive interface is switched from the current page content to the content corresponding to the thumbnail of the previous page content.

[0041] In some embodiments, the acquisition unit is specifically used to:

[0042] Acquiring an environment image including the hand interaction control device through a camera of the smart wearable device;

[0043] Position recognition is performed based on the environment image to determine the target spatial position of the hand interaction control device.

[0044] In some embodiments, the acquisition unit is specifically used to:

[0045] Sending an ultra-wideband signal to a built-in ultra-wideband chip of the hand interaction control device through a built-in ultra-wideband chip of the smart wearable device;

[0046] Obtaining the propagation duration of the ultra-wideband signal;

[0047] A target spatial position of the hand interaction control device is determined based on the propagation duration.

[0048] In a third aspect, the present application also provides a smart wearable device, which includes a processor and a memory, wherein a computer program is stored in the memory, and when the processor calls the computer program in the memory, it executes any interactive control method of the smart wearable device provided in the present application.

[0049] In a fourth aspect, the present application also provides a computer-readable storage medium on which a computer program is stored, and the computer program is loaded by a processor to execute the interactive control method of the smart wearable device.

[0050] In the present application, on the one hand, by obtaining the target spatial position of the hand interactive control device; according to the target spatial position, the interactive interface of the smart wearable device is displayed next to the hand interactive control device, so that when the user uses the hand interactive control device to interact, the position of the interactive interface and the operation position remain relatively consistent visually, so that the user can directly perform interactive operations on the interactive interface in terms of visual perception, which can make the user's operation more intuitive and convenient, thereby improving the convenience and accuracy of interaction to a certain extent. On the second hand, by displaying the interactive interface of the smart wearable device next to the hand interactive control device, the interactive interface can be made closer to three-dimensional, the authenticity of the interactive interface can be improved, the authenticity of the interaction can be improved, and the interaction accuracy can be improved to a certain extent. Therefore, the present application can improve the accuracy and authenticity of the interactive control of smart wearable devices and improve the user experience of the interaction of smart wearable devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0052] Figure 1 It is a schematic block diagram of the structure of a smart wearable device provided in an embodiment of the present application;

[0053] Figure 2 This is a flow chart of an interactive control method for a smart wearable device provided in an embodiment of the present application;

[0054] Figure 3 is a schematic diagram illustrating the positional relationship between the interactive interface and the hand interactive control device in an embodiment of the present application;

[0055] Figure 4 is a schematic diagram for explaining a second display area showing a thumbnail of the next page of content on an interactive interface in an embodiment of the present application;

[0056] Figure 5 It is a schematic diagram for explaining the third display area displaying the thumbnail of the previous page content on the interactive interface in the embodiment of the present application;

[0057] Figure 6 It is a schematic diagram for explaining that a thumbnail of the previous page content and a thumbnail of the next page content are displayed simultaneously on an interactive interface in an embodiment of the present application;

[0058] Figure 7 It is a schematic diagram of the structure of an embodiment of an interactive control device for a smart wearable device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0059] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0060] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0061] In the description of the embodiments of the present application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0062] In order to enable any person skilled in the art to implement and use the present application, the following description is provided. In the following description, details are listed for the purpose of explanation. It should be understood that those of ordinary skill in the art can recognize that the present application can also be implemented without using these specific details. In other examples, the known process will not be elaborated in detail to avoid unnecessary details that make the description of the present application embodiment obscure. Therefore, the present application is not intended to be limited to the embodiments shown, but is consistent with the widest range of principles and features disclosed in accordance with the embodiments of the present application.

[0063] The embodiments of the present application provide an interactive control method and device for a smart wearable device, a smart wearable device, and a computer-readable storage medium. The smart wearable device interactive control device can be integrated in a smart wearable device. The smart wearable device can be smart glasses, smart helmets, etc. The smart glasses can be AR (augmented reality) glasses, VR (Virtual Reality) glasses, MR (Mixed Reality) glasses, XR (eXtended Reality) glasses, etc. The smart helmet can be an AR helmet, etc.

[0064] The executor of the interactive control method of the smart wearable device in the embodiment of the present application can be the interactive control device of the smart wearable device provided in the embodiment of the present application, or the smart wearable device integrated with the interactive control device of the smart wearable device, wherein the interactive control device of the smart wearable device can be implemented in hardware or software.

[0065] Some embodiments of the present application are described in detail below in conjunction with the accompanying drawings. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0066] Figure 1 It is a schematic block diagram of the structure of a smart wearable device provided in an embodiment of the present application.

[0067] like Figure 1 As shown, the smart wearable device 100 includes a processor 101 and a memory 102, and the processor 101 and the memory 102 are connected via a bus 103, such as an I2C (Inter-integrated Circuit) bus.

[0068] Specifically, the processor 101 is used to provide computing and control capabilities to support the operation of the entire smart wearable device 100. The processor 101 can be a central processing unit (CPU), and the processor 101 can also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0069] Specifically, the memory 102 may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a mobile hard disk.

[0070] Those skilled in the art will understand that Figure 1 The structure shown in the figure is only a block diagram of a partial structure related to the embodiment scheme of the present application, and does not constitute a limitation on the smart wearable device to which the embodiment scheme of the present application is applied. The specific smart wearable device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0071] The processor 101 is used to run the computer program stored in the memory 102, and implements any one of the interactive control methods of the smart wearable device provided in the embodiments of the present application when executing the computer program. For example, the processor 101 is used to run the computer program stored in the memory 102, and can implement the following steps when executing the computer program:

[0072] Acquire a target spatial position of a hand interaction control device; display an interaction interface of a smart wearable device beside the hand interaction control device according to the target spatial position; and switch display content of the interaction interface in response to an interaction action to the hand interaction control device.

[0073] It should be noted that technicians in the relevant field can clearly understand that for the convenience and brevity of description, the specific working process of the smart wearable device described above can refer to the corresponding process in the embodiment of the interactive control method of the smart wearable device below, and will not be repeated here.

[0074] In the following, Figure 1 The smart wearable device shown in is used as an example to execute the interactive control method of the smart wearable device. The interactive control method of the smart wearable device provided by the embodiment of the present application is described in detail. For the sake of simplicity and convenience of description, the execution subject will be omitted in the subsequent method embodiments. Figure 1 The scenarios are only used to explain the interactive control method of the smart wearable device provided in the embodiments of the present application, but do not constitute a limitation on the application scenarios of the interactive control method of the smart wearable device provided in the embodiments of the present application.

[0075] See also Figure 2 , Figure 2 201 to 203, wherein:

[0076] 201. Obtain a target spatial position of a hand interaction control device.

[0077] Among them, smart wearable devices can be smart glasses, smart helmets, etc. Smart glasses can be AR (augmented reality) glasses, VR (Virtual Reality) glasses, MR (Mixed Reality) glasses, XR (eXtended Reality) glasses, etc., and smart helmets can be AR helmets, etc.

[0078] Among them, the hand interaction control device is a control device for the user to interact with the smart wearable device, for example, it can be a finger ring, a bracelet, a glove, etc.

[0079] The target space position refers to the position of the hand interaction control device in space.

[0080] There are many ways to obtain the target spatial position in step 201, illustratively including:

[0081] (1) Detection by camera of smart wearable device. In this case, step 201 may specifically include the following steps 2011A to 2012A:

[0082] 2011A. Acquire an environment image including the hand interaction control device through the camera of the smart wearable device.

[0083] For example, a camera can be installed on the smart wearable device, and the camera can be turned on by triggering the smart wearable device through certain instructions or actions, and the camera of the smart wearable device can be used to collect the environment image containing the hand interaction control device. For example, taking the smart wearable device as AR glasses and the hand interaction control device as a finger ring, after the user wears the AR glasses and the finger ring, the interaction process is started, and when the user nods twice in succession, the camera of the AR glasses is turned on to shoot to obtain the environment image containing the finger ring.

[0084] 2012A. Perform position recognition based on the environment image to determine the target spatial position of the hand interaction control device.

[0085] Exemplarily, computer vision technology may be used to identify feature points of a hand interaction control device in an environment image; and the target spatial position of the hand interaction control device may be determined by the positions of the feature points of the hand interaction control device.

[0086] (2) UWB (Ultra-Wideband) chips are built into the smart wearable device and the hand interactive control device respectively, and the target spatial position is detected by the UWB chips built into the smart wearable device and the hand interactive control device respectively. At this time, step 201 may specifically include the following steps 2011B to 2013B:

[0087] 2011B. Sending an ultra-wideband signal to the built-in ultra-wideband chip of the hand interaction control device through the built-in ultra-wideband chip of the smart wearable device.

[0088] 2012B. Obtaining the propagation duration of the ultra-wideband signal.

[0089] 2013B. Determine the target spatial position of the hand interaction control device based on the propagation duration.

[0090] For example, first, the built-in ultra-wideband chip of the smart wearable device can send an ultra-wideband signal to the built-in ultra-wideband chip of the hand interactive control device. The built-in ultra-wideband chip of the hand interactive control device records the timestamp of receiving the ultra-wideband signal and returns the receiving timestamp of the ultra-wideband signal to the smart wearable device; then, the smart wearable device can calculate the propagation time of the ultra-wideband signal according to the receiving timestamp of the ultra-wideband signal and the sending timestamp of the ultra-wideband signal; finally, according to the propagation time of the ultra-wideband signal and the propagation speed of the ultra-wideband signal, calculate the distance between the smart wearable device and the hand interactive control device, and then calculate the target spatial position of the hand interactive control device.

[0091] 202. Display an interactive interface of a smart wearable device next to the hand interaction control device according to the target spatial position.

[0092] For example, Figure 3 As shown in (a), if the user uses the hand interaction control device on the right hand to interact, the interaction interface of the smart wearable device can be displayed on the left side of the hand interaction control device according to the target space position. Figure 3 As shown in (b), if the user uses the hand interaction control device on the left hand to interact, the interaction interface of the smart wearable device can be displayed on the right side of the hand interaction control device according to the target spatial position. Therefore, displaying the interaction interface next to the ring can improve the intuitiveness of the interaction, realize natural and intuitive interaction with the user, and improve the interaction accuracy to a certain extent.

[0093] There are many ways to display the interactive interface of the smart wearable device in step 202, which include, for example:

[0094] (1) The interactive interface sets a display area for displaying the current page content. At this time, in step 202, the interactive interface containing the current page content can be displayed next to the hand interactive control device through the smart wearable device according to the target spatial position.

[0095] (2) The interactive interface is provided with a plurality of display areas for displaying the current page content and at least one of a thumbnail of the next page content and a thumbnail of the previous page content.

[0096] (2.1) Taking the example of setting two display areas in the interactive interface, which are respectively used to display the current page content and the next page content thumbnail, at this time, in step 202, the interactive interface containing the current page content and the next page content thumbnail can be displayed next to the hand interactive control device through the smart wearable device according to the target spatial position, wherein the interactive interface is set with a first display area for displaying the current page content and a second display area for displaying the next page content thumbnail.

[0097] (2.2) Taking the example of setting two display areas in the interactive interface, which are respectively used to display the current page content and the thumbnail of the previous page content, at this time, in step 202, the interactive interface containing the current page content and the thumbnail of the previous page content can be displayed next to the hand interactive control device through the smart wearable device according to the target spatial position, wherein the interactive interface is set with a first display area for displaying the current page content and a third display area for displaying the thumbnail of the previous page content.

[0098] Among them, the current page content, the previous page content, and the next page content can be a song page, a card page, etc., and the specific content form is not limited in this embodiment.

[0099] (2.3) Taking the example of setting three display areas on the interactive interface, which are respectively used to display the current page content, the next page content thumbnail, and the previous page content thumbnail, at this time, in step 202, the interactive interface containing the current page content, the next page content thumbnail, and the previous page content thumbnail can be displayed next to the hand interactive control device through the smart wearable device according to the target spatial position, wherein the interactive interface is set with a first display area for displaying the current page content, a second display area for displaying the next page content thumbnail, and a third display area for displaying the previous page content thumbnail.

[0100] Furthermore, if Figure 3 As shown, in order to improve the intuitiveness of the interaction, when the interaction interface is set with three display areas, the interaction interface includes a first display area, a second display area arranged at one end of the first display area, and a third display area arranged at the other end of the first display area away from the second display area, the first display area is used to display the current page content, the second display area is used to display the thumbnail of the next page content, and the third display area is used to display the thumbnail of the previous page content.

[0101] The first display area refers to an area used to display the content of the current page.

[0102] The second display area refers to an area used to display a thumbnail of the next page of content.

[0103] The third display area refers to an area for displaying a thumbnail of the previous page content.

[0104] The next page display direction refers to the relative direction between the second display area and the first display area.

[0105] The previous page display direction refers to the relative direction between the third display area and the first display area.

[0106] The next page operation direction refers to the interactive operation direction of switching to the next page relative to the first display area.

[0107] The previous page operation direction refers to the interactive operation direction of switching to the previous page relative to the first display area.

[0108] Furthermore, in order to improve the intuitiveness of interaction, the second display area for displaying the thumbnail of the next page content and the third display area for displaying the thumbnail of the previous page content can be set according to the interactive operation direction of switching to the previous page or the next page. The following takes cases ① to ③ as examples to introduce how to set each display area according to the interactive operation direction:

[0109] ① In some embodiments, the interactive interface is provided with two display areas: a first display area and a second display area. In order to improve the intuitiveness of the interactive operation, the next page operation direction is opposite to the next page display direction. When determining the next page operation direction, the next page display direction can be determined according to the next page operation direction, thereby determining the relative direction of the second display area to the first display area. For example, Figure 4 As shown in (a) of FIG. 1 , when the relative interactive interface is operated upward (such as sliding upward on the relative interface) to switch to the next page, the second display area for displaying the thumbnail of the next page content can be set at the lower side of the first display area. Figure 4 As shown in (b), when the relative interactive interface is operated to the right (such as sliding the relative interface to the right) to switch to the next page, the second display area for displaying the thumbnail of the next page content can be set to the left side of the first display area.

[0110] ② In some embodiments, the interactive interface is provided with two display areas: a first display area and a third display area. In order to improve the intuitiveness of the interactive operation, the previous page operation direction is opposite to the previous page display direction. When determining the previous page operation direction, the previous page display direction can be determined according to the previous page operation direction, thereby determining the relative direction of the third display area to the first display area. For example, Figure 5 As shown in (a) of FIG. 1 , when the user switches to the previous page by operating downward relative to the interactive interface (such as sliding downward relative to the interface), the third display area for displaying the thumbnail of the previous page content can be set on the upper side of the first display area. Figure 5 As shown in (b), when the relative interactive interface is operated to the left (such as sliding the relative interface to the left) to switch to the previous page, the third display area for displaying the thumbnail of the previous page content can be set to the right side of the first display area.

[0111] ③ In some embodiments, the interactive interface is provided with two display areas: a first display area, a second display area, and a third display area. In order to improve the intuitiveness of the interactive operation, the operation direction of the previous page is opposite to the display direction of the previous page, and the operation direction of the next page is opposite to the display direction of the next page. On the one hand, when determining the operation direction of the previous page, the display direction of the previous page can be determined according to the operation direction of the previous page, thereby determining the relative direction of the third display area with respect to the first display area. On the other hand, when determining the operation direction of the next page, the display direction of the next page can be determined according to the operation direction of the next page, thereby determining the relative direction of the second display area with respect to the first display area. For example, Figure 6 As shown in (a) of FIG. 1 , when the upper and lower sides of the relative interactive interface are operated (such as sliding the upper and lower sides of the relative interface) to switch to the previous page or the next page, the second display area for displaying the thumbnail of the next page content and the third display area for displaying the thumbnail of the previous page content can be set at the upper and lower sides of the first display area respectively. Figure 6 As shown in (b), when the relative interactive interface is operated to the left or right sides (such as sliding to the left or right sides of the relative interface) to switch to the previous page or the next page, the second display area for displaying the thumbnail of the next page content and the third display area for displaying the thumbnail of the previous page content can be set on the left and right sides of the first display area, respectively.

[0112] Therefore, on the one hand, by keeping the next page display direction opposite to the next page operation direction, the user's visual experience when switching to the next page content is that the flow direction of the next page content is consistent with the operation direction, which can make the user's operation more intuitive and convenient, thereby improving the convenience and accuracy of interaction to a certain extent. On the other hand, by keeping the previous page display direction opposite to the previous page operation direction, the user's visual experience when switching to the previous page content is that the flow direction of the previous page content is consistent with the operation direction, which can make the user's operation more intuitive and convenient, thereby improving the convenience and accuracy of interaction to a certain extent.

[0113] 203. In response to an interactive action on the hand interaction control device, switch display content of the interactive interface.

[0114] There are many ways to switch the display content of the interactive interface in step 203, illustratively including:

[0115] (1) Switching pages through the interactive controls of the hand interactive control device to switch the display content of the interactive interface. At this time, step 203 may specifically include the following steps 2031A to 2032A:

[0116] 2031A. Detect, through the hand interaction control device, a touch operation on an interactive control of the hand interaction control device.

[0117] Among them, the interactive controls can be physical buttons, touch bars, etc.

[0118] 2032A. In response to the touch operation, switch the display content of the interactive interface from the current page content to the target page content matching the touch operation.

[0119] Exemplarily, through the hand interaction control device, a next page touch operation on the interactive control of the hand interaction control device is detected; in response to the next page touch operation on the interactive control of the hand interaction control device, the displayed content of the interactive interface is switched from the current page content to the content corresponding to the thumbnail of the next page content. Alternatively, through the hand interaction control device, a previous page touch operation on the interactive control of the hand interaction control device is detected; in response to the previous page touch operation on the interactive control of the hand interaction control device, the displayed content of the interactive interface is switched from the current page content to the content corresponding to the thumbnail of the previous page content.

[0120] For example, see Figure 6 In (a), taking the interactive control as a touch bar, sliding the touch bar upward to switch to the next page, and sliding downward to switch to the previous page as an example, if the user performs a touch operation on the touch bar of the hand interactive control device for the next page (such as sliding the touch bar upward), the hand interactive control device will send a touch operation instruction for the next page of the touch bar to the smart wearable device. After receiving the touch operation instruction for the next page of the interactive control, the smart wearable device switches the display content of the interactive interface from the current page content to the content corresponding to the thumbnail of the next page content. If the user performs a touch operation on the touch bar of the hand interactive control device for the previous page (such as sliding the touch bar downward), the hand interactive control device will send a touch operation instruction for the previous page of the touch bar to the smart wearable device. After receiving the touch operation instruction for the previous page of the interactive control, the smart wearable device switches the display content of the interactive interface from the current page content to the content corresponding to the thumbnail of the previous page content.

[0121] For example, see Figure 6In (a), taking the interactive control as a touch bar, sliding the touch bar to the left to switch to the next page, and sliding to the right to switch to the previous page as an example, if the user performs a touch operation on the touch bar of the hand interactive control device for the next page (such as sliding the touch bar to the left), the hand interactive control device will send a touch operation instruction for the next page of the touch bar to the smart wearable device. After receiving the touch operation instruction for the next page of the interactive control, the smart wearable device switches the display content of the interactive interface from the current page content to the content corresponding to the thumbnail of the next page content. If the user performs a touch operation on the touch bar of the hand interactive control device for the previous page (such as sliding the touch bar to the right), the hand interactive control device will send a touch operation instruction for the previous page of the touch bar to the smart wearable device. After receiving the touch operation instruction for the previous page of the interactive control, the smart wearable device switches the display content of the interactive interface from the current page content to the content corresponding to the thumbnail of the previous page content.

[0122] (2) The display content of the interactive interface is a three-dimensional object, and the different viewing angles of the three-dimensional object in the interactive interface are switched by rotating the hand interactive control device to switch the display content of the interactive interface. In this case, step 203 may specifically include the following steps 2031B to 2032B:

[0123] 2031B. Detect a rotation operation on the hand interaction control device through a motion sensor of the hand interaction control device.

[0124] Among them, the motion sensor can be an IMU (Inertial Measurement Unit), a gyroscope, an accelerometer, etc.

[0125] 2032B. In response to the rotation operation, rotate the viewing angle of the displayed content of the interactive interface according to the rotation angle and rotation direction of the hand interaction control device.

[0126] Exemplarily, the motion sensor of the hand interactive control device will collect the motion data of the hand interactive control device (including but not limited to acceleration, angular velocity, etc.) to determine whether there is a rotation operation of the hand interactive control device. When the user rotates the hand interactive control device, the motion sensor of the hand interactive control device will detect the rotation operation of the hand interactive control device, and send the rotation angle and rotation direction of the hand interactive control device to the smart wearable device; the smart wearable device determines the matching post-rotation perspective content according to the rotation angle and rotation direction of the hand interactive control device, and rotates the display content of the interactive interface from the current perspective content to the matching post-rotation perspective content to rotate the perspective of the display content of the interactive interface. In this way, the interactive interface can rotate with the rotation detected by the motion sensor of the hand interactive control device (such as a ring), so that the user can view various angles of the three-dimensional object in the interactive interface, providing a rich interactive experience.

[0127] For example, taking the hand interaction control device as a ring and the smart wearable device as AR glasses, when the user turns the ring to the left, the three-dimensional object displayed on the AR interaction interface will follow and rotate to the left; when the user turns the ring to the right, the three-dimensional object displayed on the AR interaction interface will follow and rotate to the right; when the user turns the ring upward, the three-dimensional object displayed on the AR interaction interface will follow and rotate upward; when the user turns the ring downward, the three-dimensional object displayed on the AR interaction interface will follow and rotate downward.

[0128] Furthermore, in order to improve the interactive control accuracy of the hand interactive control device, the viewing angle of the displayed content of the interactive interface can be rotated according to the rotation angle, rotation direction, and target spatial position of the hand interactive control device. Detecting the absolute position of the hand interactive control device (i.e., the target spatial position) can provide more precise and accurate control than relative movement alone. The absolute position can be used to ensure the precise positioning of the user's operation in space. Therefore, by utilizing the target spatial position of the hand interactive control device to switch the displayed content, the displayed content can be displayed or switched according to the absolute position (i.e., the target spatial position) and relative movement (i.e., the rotation angle, the rotation direction) of the hand interactive control device, thereby improving the interactive accuracy.

[0129] In order to better understand the embodiments of the present application, the interactive control process of the smart wearable device is described below by taking "the smart wearable device is AR glasses and the hand interactive control device is a finger ring" as an example, wherein the smart wearable device is provided with a spatial position recognition module, an interface design module, a touch bar interactive module and an IMU following module, and the interactive control process is as follows:

[0130] 1. The user wears AR glasses and ring to start the interactive system.

[0131] 2. A spatial position recognition module, which recognizes the position of the ring in space through the camera of the AR glasses, or through the UWB chips built into the AR glasses and the ring.

[0132] For the specific implementation, please refer to the relevant description of step 201, which will not be repeated here for simplicity.

[0133] 3. Interface design module: according to the position of the ring in space, a curved interactive interface is displayed beside the ring, wherein the curved interactive interface includes the current page content and the short side content protruding up and down. The short side content protruding up and down is the thumbnail of the previous page content and the thumbnail of the next page content respectively.

[0134] For the specific implementation, please refer to the relevant description of step 202, which will not be repeated here for simplicity.

[0135] 4. The touch bar interaction module receives the up and down sliding operation of the touch bar set by the user on the ring, and switches the display content of the curved surface interaction interface according to the up and down sliding operation of the touch bar.

[0136] For the specific implementation, please refer to the relevant instructions of steps 2031A to 2032A, which will not be repeated here for the sake of simplicity.

[0137] 5. The IMU following module detects the rotation of the ring in real time, adjusts the angle of the curved interface, and displays different perspectives of the 3D object.

[0138] For the specific implementation, please refer to the relevant description of steps 2031B to 2032B, which will not be repeated here for the sake of simplicity.

[0139] From the above content, it can be seen that, in the first aspect, by obtaining the target spatial position of the hand interaction control device; according to the target spatial position, the interactive interface of the smart wearable device is displayed next to the hand interaction control device, so that when the user uses the hand interaction control device to interact, the position of the interactive interface and the operation position are visually relatively consistent, so that the user can directly perform interactive operations on the interactive interface in terms of visual perception, which can make the user's operation more intuitive and convenient, thereby improving the convenience and accuracy of interaction to a certain extent. In the second aspect, by displaying the interactive interface of the smart wearable device next to the hand interaction control device, the interactive interface can be made closer to three-dimensional, the authenticity of the interactive interface can be improved, the authenticity of the interaction can be improved, and the interaction accuracy can be improved to a certain extent. In the third aspect, by rotating the viewing angle of the display content of the interactive interface according to the rotation angle, rotation direction, and target spatial position of the hand interaction control device, since the absolute position can be used to ensure the precise positioning of the user operation in space, therefore, compared with relying on the relative movement of the interactive control device to complete the interaction of the smart wearable device, according to the absolute position (i.e., target spatial position) and relative movement (i.e., rotation angle, rotation direction) of the hand interaction control device, display or switch the display content, the interaction accuracy of the smart wearable device can be improved. Therefore, the embodiments of the present application can improve the accuracy and authenticity of interactive control of smart wearable devices and improve the user experience of interacting with smart wearable devices.

[0140] In addition, in order to better implement the interactive control method of the smart wearable device in the embodiment of the present application, based on the interactive control method of the smart wearable device, the embodiment of the present application also provides an interactive control device for the smart wearable device, such as Figure 7 FIG. 1 is a schematic diagram of a structure of an embodiment of an interactive control device for a smart wearable device provided in an embodiment of the present application. The interactive control device 700 for a smart wearable device includes:

[0141] An acquisition unit 701 is used to acquire a target spatial position of a hand interaction control device;

[0142] A display unit 702, configured to display an interactive interface of a smart wearable device beside the hand interaction control device according to the target spatial position;

[0143] The control unit 703 is used to switch the display content of the interactive interface in response to the interactive action on the hand interactive control device.

[0144] In some embodiments, the control unit 703 is specifically used to:

[0145] Detecting, by means of the hand interaction control device, a touch operation on an interactive control of the hand interaction control device;

[0146] In response to the touch operation, the display content of the interactive interface is switched from the current page content to the target page content matching the touch operation.

[0147] In some embodiments, the control unit 703 is specifically used to:

[0148] detecting a rotation operation on the hand interaction control device through a motion sensor of the hand interaction control device;

[0149] In response to the rotation operation, the viewing angle of the displayed content of the interactive interface is rotated according to the rotation angle and rotation direction of the hand interaction control device.

[0150] In some embodiments, the display unit 702 is specifically used for:

[0151] Displaying an interactive interface of a smart wearable device including current page content, a next page content thumbnail, and a previous page content thumbnail, wherein the interactive interface includes a first display area, a second display area arranged at one end of the first display area, and a third display area arranged at the other end of the first display area away from the second display area, the first display area is used to display the current page content, the second display area is used to display the next page content thumbnail, and the third display area is used to display the previous page content thumbnail.

[0152] In some embodiments, the preset previous page operation direction is opposite to the previous page display direction, and the previous page display direction is the relative direction between the third display area and the first display area; the preset next page operation direction is opposite to the next page display direction, and the next page display direction is the relative direction between the second display area and the first display area; the control unit 703 is specifically used to:

[0153] In response to a next page touch operation on an interactive control of the hand interactive control device, switching the displayed content of the interactive interface from the current page content to content corresponding to the next page content thumbnail;

[0154] Alternatively, in response to a previous page touch operation on the interactive control of the hand interaction control device, the displayed content of the interactive interface is switched from the current page content to the content corresponding to the thumbnail of the previous page content.

[0155] In some embodiments, the acquisition unit 701 is specifically used to:

[0156] Acquiring an environment image including the hand interaction control device through a camera of the smart wearable device;

[0157] Position recognition is performed based on the environment image to determine the target spatial position of the hand interaction control device.

[0158] In some embodiments, the acquisition unit 701 is specifically used to:

[0159] Sending an ultra-wideband signal to a built-in ultra-wideband chip of the hand interaction control device through a built-in ultra-wideband chip of the smart wearable device;

[0160] Obtaining the propagation duration of the ultra-wideband signal;

[0161] A target spatial position of the hand interaction control device is determined based on the propagation duration.

[0162] In specific implementation, the above units can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above units can refer to the above interactive control method embodiment of the smart wearable device, which will not be repeated here.

[0163] A person skilled in the art can understand that all or part of the steps in the above-mentioned interactive control method of the smart wearable device can be completed by instructions, or by controlling related hardware through instructions. The instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0164] To this end, an embodiment of the present application provides a computer-readable storage medium, in which multiple computer programs are stored. The computer programs can be loaded by a processor to execute any interactive control method of a smart wearable device provided in an embodiment of the present application.

[0165] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0166] In the above-mentioned interactive control device, computer-readable storage medium, and smart wearable device embodiments of the smart wearable device, the description of each embodiment has its own emphasis. For parts not described in detail in a certain embodiment, refer to the relevant description of other embodiments. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process and beneficial effects of the interactive control device, computer-readable storage medium, smart wearable device and its corresponding units described above can refer to the description of the interactive control method of the smart wearable device in the above embodiment, and will not be repeated here.

[0167] The above is a detailed introduction to the interactive control method, device, smart wearable device and computer-readable storage medium of an intelligent wearable device provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the ideas of the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An interactive control method for a smart wearable device, characterized in that: The method comprises: Obtain the target spatial position of the hand interaction control device; Displaying an interactive interface of the smart wearable device next to the hand interaction control device according to the target spatial position; In response to an interaction action on the hand interaction control device, display content of the interaction interface is switched.

2. The interactive control method of the smart wearable device according to claim 1, characterized in that: The switching of display content of the interactive interface in response to the interactive action on the hand interactive control device includes: Detecting, by the hand interaction control device, a touch operation on an interactive control of the hand interaction control device; In response to the touch operation, the display content of the interactive interface is switched from the current page content to the target page content matching the touch operation.

3. The interactive control method of the smart wearable device according to claim 1, characterized in that: The switching of display content of the interactive interface in response to the interactive action on the hand interactive control device includes: detecting a rotation operation on the hand interaction control device through a motion sensor of the hand interaction control device; In response to the rotation operation, the viewing angle of the display content of the interactive interface is rotated according to the rotation angle and rotation direction of the hand interaction control device.

4. The interactive control method of the smart wearable device according to claim 1, characterized in that: The interactive interface includes a first display area, a second display area set at one end of the first display area, and a third display area set at the other end of the first display area away from the second display area. The first display area is used to display the current page content, the second display area is used to display a thumbnail of the next page content, and the third display area is used to display a thumbnail of the previous page content.

5. The interactive control method of the smart wearable device according to claim 4, Its characteristics are: The preset previous page operation direction is opposite to the previous page display direction, and the previous page display direction is the relative direction between the third display area and the first display area; The preset next page operation direction is opposite to the next page display direction, and the next page display direction is the relative direction between the second display area and the first display area; The switching of display content of the interactive interface in response to the interactive action on the hand interactive control device includes: In response to a next-page touch operation on an interactive control of the hand interaction control device, switching the displayed content of the interactive interface from the current page content to content corresponding to the next page content thumbnail; Alternatively, in response to a previous page touch operation on the interactive control of the hand interaction control device, the displayed content of the interactive interface is switched from the current page content to the content corresponding to the previous page content thumbnail.

6. The interactive control method of the smart wearable device according to claim 1, characterized in that: The obtaining of the target spatial position of the hand interaction control device includes: Acquiring an environment image including the hand interaction control device through a camera of the smart wearable device; Position recognition is performed based on the environmental image to determine the target spatial position of the hand interaction control device.

7. The interactive control method of the smart wearable device according to claim 1, characterized in that: The obtaining of the target spatial position of the hand interaction control device includes: Sending an ultra-wideband signal to the built-in ultra-wideband chip of the hand interaction control device through the built-in ultra-wideband chip of the smart wearable device; Obtaining a propagation duration of the ultra-wideband signal; A target spatial position of the hand interaction control device is determined based on the propagation duration.

8. An interactive control device for a smart wearable device, characterized in that: The interactive control device of the smart wearable device includes: an acquisition unit, configured to acquire a target spatial position of a hand interaction control device; A display unit, configured to display an interactive interface of the smart wearable device next to the hand interaction control device according to the target spatial position; A control unit is used to switch the display content of the interactive interface in response to an interactive action on the hand interactive control device.

9. A smart wearable device, characterized in that: The method comprises a processor and a memory, wherein a computer program is stored in the memory, and when the processor calls the computer program in the memory, the method for interactive control of the smart wearable device according to any one of claims 1 to 7 is executed.

10. A computer-readable storage medium, characterized in that A computer program is stored thereon, and the computer program is loaded by a processor to execute the interactive control method of the smart wearable device according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Methods And Apparatus For Human Centric "Hyper Ui For Devices"Architecture That Could Serve As An Integration Point With Multiple Target / Endpoints (Devices) And Related Methods / System With Dynamic Context Aware Gesture Input Towards A "Modular" Universal Controller Platform And Input Device Virtualization

    CN107896508A

  • Virtual content interaction method and device, terminal equipment and storage medium

    CN111766937A

  • AR glasses interaction method and device, computer readable storage medium and AR glasses

    CN114327031A

  • User interface operation method and system, storage medium and electronic device

    CN116560529A

  • Adaptive graphic user interfacing system

    US20190121522A1