Input interaction control methods, smart wearable devices, and readable storage media

Abstract

This application discloses an input interaction control method, a smart wearable device, and a readable storage medium. The input interaction control method includes: if a change from a connected state to a detached state is detected between a laser projection accessory and a display body, the laser projection accessory projects a laser beam corresponding to the array layout of the current virtual interactive interface onto the projection plane; the laser projection accessory detects the reflected beam of the laser beam in the projection direction, locates the blocking coordinate position of the laser beam based on the beam information of the reflected beam, and sends the located blocking coordinate position to the display body; the display body determines the interaction command mapped to the blocking coordinate position in the current virtual interactive interface, and inputs the interaction command for interaction control. This application can improve the portability of smart wearable devices while improving the smoothness of input interaction control.

Description

Technical Field

[0001] This application relates to the field of wearable device technology, and more particularly to an input interaction control method, a smart wearable device, and a readable storage medium. Background Technology

[0002] VR (Virtual Reality) glasses or AR (Augmented Reality) glasses are smart wearable devices that are currently developing and becoming increasingly widespread. However, the input interaction control methods of mainstream smart wearable devices mainly rely on eye movement recognition. This input interaction control method heavily depends on eye movement. In usage scenarios with many interface elements, frequent eye movement is required, leading to eye muscle soreness and easily causing eye fatigue. Eye fatigue often occurs during input interaction, with users blinking more frequently and needing frequent short breaks before inputting commands, resulting in poor fluency and efficiency of input interaction control. If smart wearable devices use external physical keyboards for input interaction control, the large and bulky nature of these keyboards makes them difficult to carry, further compromising portability and making it inconvenient to use the UI (User Interface) for input interaction control anytime, anywhere, thus negatively impacting the user experience. Summary of the Invention

[0003] The main objective of this application is to provide an input interaction control method, a smart wearable device, and a readable storage medium, which aims to improve the portability of the smart wearable device while enhancing the fluency of input interaction control.

[0004] To achieve the above objectives, this application provides an input interaction control method applied to a smart wearable device. The smart wearable device includes a display main body and a laser projection accessory, the laser projection accessory being detachably connected to the display main body. The steps of the input interaction control method include:

[0005] If it is detected that the laser projection accessory and the display body have changed from a connected state to a detached state, then the laser beam corresponding to the array layout of the current virtual interactive interface is projected onto the projection plane through the laser projection accessory;

[0006] The laser projection accessory detects the reflected beam of the laser beam reflected back in the projection direction. Based on the beam information of the reflected beam, the blocking coordinate position of the laser beam is located, and the located blocking coordinate position is sent to the display body.

[0007] The display subject determines the interaction command that maps the blocking coordinate position to the current virtual interactive interface, and performs input interaction control according to the interaction command.

[0008] Optionally, the step of determining the interaction command mapped to the blocking coordinate position in the current virtual interactive interface includes:

[0009] Based on multiple consecutive blocking coordinate positions within a preset time period, the user's gesture operation on the virtual interactive interface is simulated.

[0010] Based on the pre-stored gesture mapping instruction table, the control instruction of the gesture operation mapping is determined, and the control instruction of the gesture operation mapping is used as the interaction instruction of the blocking coordinate position mapped in the current virtual interactive interface.

[0011] Optionally, the display body includes an eyeglasses frame and a magnetic module. The eyeglasses frame includes a nose bridge, and the laser projection accessory includes a Bluetooth module. The magnetic module is fixed to the nose bridge, and the laser projection accessory is detachably connected to the magnetic module via magnetic attraction.

[0012] The step of projecting a laser beam corresponding to the array layout of the current virtual interactive interface onto the projection plane via the laser projection accessory if the connection between the laser projection accessory and the display body changes from a connected state to a detached state includes:

[0013] If it is detected that the laser projection accessory and the magnetic module have changed from a connected state to a detached state, then the Bluetooth module of the laser projection accessory is activated to establish a Bluetooth connection with the glasses.

[0014] After a successful Bluetooth connection, the laser projection accessory projects the laser beams corresponding to the array layout of the current virtual interactive interface onto the projection plane.

[0015] Optionally, the display body further includes a charging module and a power module. The input end of the charging module is electrically connected to the power module. The charging module is disposed on the nose bridge and spaced apart from the magnetic module. When the laser projection accessory is connected to the display body, the output end of the charging module is matched and aligned with the charging interface of the laser projection accessory so that the display body can charge the laser projection accessory.

[0016] Optionally, the laser projection accessory includes a fixedly connected accessory body and a Hall sensor. The Hall sensor is used to detect the current magnetic field signal around the accessory body. Before the step of activating the Bluetooth module of the laser projection accessory if the connection between the laser projection accessory and the magnetic module changes from a connected state to a detached state, the following steps are included:

[0017] If the current magnetic field signal is detected to be a preset first magnetic field signal, it is determined that the laser projection accessory and the magnetic suction module are in a connected state.

[0018] If the current magnetic field signal is detected to be a preset second magnetic field signal, it is determined that the laser projection accessory and the magnetic module are in a disassembled state, wherein the signal strength of the first magnetic field signal is different from the signal strength of the second magnetic field signal.

[0019] Optionally, the step of locating the blocking coordinate position of the laser beam based on the beam information of the reflected beam includes:

[0020] Obtain the pre-stored standard echo information of the laser beam, compare the beam information of the reflected beam with the standard echo information, and determine the echo variation information of the laser beam;

[0021] If the echo variation information conforms to the preset echo variation rule, then the coordinate position of the reflected beam that conforms to the echo variation rule is determined.

[0022] The coordinate position of the reflected beam that conforms to the echo variation rule is used as the blocking coordinate position for blocking the laser beam.

[0023] Optionally, the echo variation information includes variations in the echo intensity and / or echo period of the laser beam, and the step of comparing the beam information of the reflected beam with the standard echo information to determine the echo variation information of the laser beam includes:

[0024] If the change in echo intensity is greater than a preset intensity threshold, and / or if the change in echo period is greater than a preset duration threshold, then the echo change information is determined to conform to a preset echo change rule.

[0025] Optionally, before the step of locating the blocking coordinate position of the laser beam based on the beam information of the reflected beam, the following steps are included:

[0026] The laser beam is projected onto a preset coordinate position on the virtual interactive interface by the laser projection accessory to form a calibration mark on the virtual interactive interface, wherein the wavelength of the laser beam forming the calibration mark is different from the wavelength of the laser beam forming the virtual interactive interface.

[0027] The calibration reflection beam reflected back by the laser beam that forms the calibration mark is detected in the projection direction;

[0028] Based on the beam information of the calibrated reflected beam, the beam positioning and recognition algorithm pre-stored in the laser projection accessory is calibrated;

[0029] The step of locating the blocking coordinate position of the laser beam based on the beam information of the reflected beam includes:

[0030] Based on the beam information of the reflected beam, the blocking coordinates of the laser beam are located using the calibrated beam positioning and recognition algorithm.

[0031] This application also provides a smart wearable device, which is a physical device. The smart wearable device includes: a memory, a processor, and a program of the input interaction control method stored in the memory and executable on the processor. When the program of the input interaction control method is executed by the processor, it can implement the steps of the input interaction control method as described above.

[0032] This application also provides a readable storage medium, which is a computer-readable storage medium, on which a program implementing an input interaction control method is stored. The program implementing the input interaction control method is executed by a processor to implement the steps of the input interaction control method as described above.

[0033] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the input interaction control method described above.

[0034] This application detachably connects a laser projection accessory to the display body. If the connection between the laser projection accessory and the display body changes from a connected state to a detached state, the laser projection accessory projects a laser beam corresponding to the array layout of the current virtual interactive interface onto the projection plane. The laser projection accessory also detects the reflected beam from the laser beam in the projection direction. Based on the beam information of the reflected beam, the blocking coordinates of the laser beam are located, and these blocking coordinates are sent to the display body. The display body then determines the interaction command mapped to the blocking coordinates in the current virtual interactive interface and inputs this command, thereby completing the current UI (User Interface) interaction of the smart wearable device. This application provides a novel input interaction control method for smart wearable devices. A laser projection accessory is detachably connected to the glasses holder of the smart wearable device. When the UI interface of the smart wearable device system needs to be operated, the user can remove the laser projection accessory and place it on a horizontal surface. The laser projection accessory projects a virtual interactive interface with a resolution adapted to the viewing window of the smart wearable device's glasses. The user can then operate the current UI interface through this virtual interactive interface, realizing input interaction control between humans and smart wearable devices such as AR / VR glasses. Compared to current input interaction control methods for smart wearable devices that rely on eye movement recognition, this application eliminates the need for frequent eye movements, thus avoiding eye fatigue and increased blinking frequency, as well as the need for frequent eye breaks before inputting interactive commands. Therefore, this application improves the smoothness of input interaction control for smart wearable devices. Meanwhile, compared to smart wearable devices that use an external physical keyboard for input and interaction control, this application eliminates the need to carry a large and bulky external physical keyboard. When not in use, the laser projection accessory can be mounted on the display body and removed when needed (ready to use anytime, anywhere). This allows for input and interaction control of the UI interface of the smart wearable device anytime, anywhere, thereby improving the portability of the smart wearable device and enhancing the user experience.

[0035] Additionally, it should be noted that because laser projection accessories are lightweight and compact (larger laser projection accessories, when installed on the display unit, can easily make the smart wearable device heavy or bulky, affecting the user's wearing experience), their batteries are often small, resulting in relatively short battery life. Therefore, this application places the analysis process of "determining the interactive command mapped to the current virtual interface based on the blocking coordinates" on the display unit's side. The laser projection accessory only needs to send the identified blocking coordinates to the display unit, thereby reducing the operational load and hardware configuration requirements of the laser projection accessory, and ultimately improving its battery life. Attached Figure Description

[0036] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0037] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0038] Figure 1 This is a flowchart illustrating the first embodiment of the input interaction control method of this application;

[0039] Figure 2 This is a flowchart illustrating the second embodiment of the input interaction control method in this application;

[0040] Figure 3 This is a flowchart illustrating the third embodiment of the input interaction control method in this application;

[0041] Figure 4 This is a schematic diagram of the structure of the display subject in one embodiment of this application;

[0042] Figure 5 This is a schematic diagram of the structure of a laser projection accessory in one embodiment of this application;

[0043] Figure 6 This is a schematic diagram of the structure of a smart wearable device in one embodiment of this application;

[0044] Figure 7 This is a schematic diagram of a scenario in which a laser projection accessory is charging in a charging case, according to one embodiment of this application.

[0045] Figure 8This is a schematic diagram of a projection scene when the laser projection accessory is removed from the display body according to one embodiment of this application;

[0046] Figure 9 This is a schematic diagram of the hardware operating environment involved in the smart wearable device in the embodiments of this application.

[0047] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0048] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0049] In this embodiment, the smart wearable device in this disclosure may include, but is not limited to, Mixed Reality (MR) devices (e.g., MR glasses and MR helmets), Augmented Reality (AR) devices (e.g., AR glasses and AR helmets), Virtual Reality (VR) devices (e.g., VR glasses and VR helmets), Extended Reality (XR) devices (e.g., XR glasses and XR helmets), or some combination thereof.

[0050] Currently, the main input interaction control methods of mainstream smart wearable devices rely on eye movement recognition. This method heavily depends on eye movement, which, in scenarios with many interface elements, requires frequent eye movement, leading to eye muscle soreness and eye fatigue. This fatigue often occurs during input interaction, with increased blinking frequency and frequent brief breaks between eye movements, resulting in poor smoothness and efficiency of input interaction. If smart wearable devices use external physical keyboards for input interaction, the large and bulky keyboards are difficult to carry, further compromising the portability of AR glasses and hindering convenient input interaction on the UI (User Interface) interface, leading to a poor user experience.

[0051] Example 1

[0052] Based on this, please refer to Figure 1 This embodiment provides an input interaction control method applied to a smart wearable device. The smart wearable device includes a display main body and a laser projection accessory, the laser projection accessory being detachably connected to the display main body. The steps of the input interaction control method include:

[0053] Step S10: If it is detected that the laser projection accessory and the display body have changed from a connected state to a detached state, then the laser beam corresponding to the array layout of the current virtual interactive interface is projected onto the projection plane through the laser projection accessory.

[0054] In this embodiment, the smart wearable device can be XR glasses or an XR helmet. Furthermore, the laser projection accessory and the display body can be detachably connected via threaded connections, snap-fit ​​connections, or magnetic connections.

[0055] It should be noted that when the laser projection accessory is detected to have switched from a connected state to a detached state with the display main body, it indicates that the user has removed the laser projection accessory from the smart wearable device and placed it on a horizontal surface. The laser projection accessory then projects the current operating interface of the smart wearable device (i.e., the current virtual interactive interface in this embodiment) onto the projection plane. In other words, when the laser projection accessory is detected to have switched from a connected state to a detached state with the display main body, the laser module of the laser projection accessory is activated, thereby projecting the laser beam corresponding to the array layout of the current virtual interactive interface onto the projection plane to form the virtual interactive interface. This projection plane can be a preset fixed projection plane or any plane that meets the projection conditions and is selected by the user based on their own scene environment. It is easy to understand that the plane selected by the user must form a certain angle with the laser beam projected by the laser projection accessory in order for the laser beam to be successfully projected onto the projection plane.

[0056] In one embodiment, a microswitch can be installed at the connection point between the laser projection accessory and the display body to detect whether the laser projection accessory and the display body are in a connected or detached state. For example, the microswitch is located at the connection point of the laser projection accessory. When the laser projection accessory and the display body are in a connected state, the display body presses the button of the microswitch on the laser projection accessory. At this time, the microswitch is in a pressed state, and then the microswitch sends the pressed state information to the laser projection accessory, thus confirming that the laser projection accessory and the display body are in a connected state. When the laser projection accessory and the display body are in a detached state, the button of the microswitch is in its original state, and then the microswitch sends the original state information to the laser projection accessory, thus confirming that the laser projection accessory and the display body are in a detached state.

[0057] In another embodiment, an on / off switch can be installed at the connection point between the laser projection accessory and the display body to detect whether the laser projection accessory and the display body are in a connected or disassembled state. For example, the on / off switch is located at the connection point of the laser projection accessory. When the laser projection accessory and the display body are in a connected state, the display body will trigger the on / off switch of the laser projection accessory, and the preset monitoring circuit containing the on / off switch in the laser projection accessory will be de-energized. Then, the laser projection accessory determines that the laser projection accessory and the display body are in a connected state based on the de-energized state information of the preset monitoring circuit. When the laser projection accessory and the display body are in a disassembled state, the preset monitoring circuit containing the on / off switch in the laser projection accessory will be energized. Then, the laser projection accessory determines that the laser projection accessory and the display body are in a disassembled state based on the energized state information of the preset monitoring circuit.

[0058] In another embodiment, a Hall sensor can be installed at the connection point between the laser projection accessory and the display body to detect whether the laser projection accessory and the display body are in a connected or disassembled state. For example, before leaving the factory, experiments can be conducted to determine that when the laser projection accessory and the display body are in a connected state, the current magnetic field signal measured by the Hall sensor is magnetic field signal a, and when the laser projection accessory and the display body are in a disassembled state, the current magnetic field signal measured by the Hall sensor is magnetic field signal b. Magnetic field signals a and b can be pre-stored in the laser projection accessory or the display body. This Hall sensor can also be installed on the laser projection accessory or the display body, close to the connection point. When the Hall sensor detects that the deviation between the current magnetic field signal and magnetic field signal a is less than a preset deviation threshold, it determines that the laser projection accessory and the display body are in a connected state. When the Hall sensor detects that the deviation between the current magnetic field signal and magnetic field signal b is less than the preset deviation threshold, it determines that the laser projection accessory and the display body are in a disassembled state.

[0059] For example, refer to Figure 8 The display body 10 and the laser projection accessory 20 in the smart wearable device 100 are detachably connected. When the laser projection accessory 20 and the display body 10 are detected to change from a connected state to a detached state, it means that the user has removed the laser projection accessory 20 from the display body 10. At this time, the laser projection accessory 20 needs to be placed on a horizontal surface, and a virtual interactive interface with a resolution adapted to the viewing window of the smart wearable device 100 is projected on the projection area (i.e. the plane to be projected). The user can complete the operation of the user interface through the virtual interactive interface to realize the input control of human-computer interaction.

[0060] Step S20: The laser projection accessory detects the reflected beam of the laser beam reflected back in the projection direction. Based on the beam information of the reflected beam, the blocking coordinate position of the laser beam is located, and the located blocking coordinate position is sent to the display body.

[0061] In this embodiment, for ease of understanding, an example is given: when a user operates the virtual interactive interface projected by the laser projection accessory, for example, by touching a coordinate position (A, B) on the virtual interactive interface with a finger or interactive stylus, the laser beam at that coordinate position (A, B) will be blocked by the finger or interactive stylus. At this time, the coordinate position (A, B) is the blocking coordinate position in the path of the laser beam projected onto the plane to be projected, where the light is blocked. Since the time it takes for the laser beam to reflect back after being blocked is shortened, the blocking coordinate position can be determined based on the echo period of the laser beam at each coordinate position (for example, the echo period of a certain coordinate position refers to the time from the start of projecting the laser beam to receiving the reflected beam of the laser beam reflected back in the projection direction at that coordinate position). This allows for the location of the blocking coordinate position, and by sending the located blocking coordinate position to the display subject, the processor of the display subject can analyze the interactive command triggered by the user on the virtual interactive interface based on the blocking coordinate position.

[0062] Step S30: Determine the interaction command mapped to the blocking coordinate position in the current virtual interactive interface through the display subject, and perform input interaction control according to the interaction command.

[0063] In this embodiment, the interaction command mapping between the blocking coordinate position and the current virtual interactive interface can be obtained by querying the pre-stored coordinate mapping command table, and the interaction command can be input to complete the operation of the current UI (User Interface) interactive interface of the smart wearable device, thereby realizing the input control of human-computer interaction.

[0064] As an example, the current virtual interactive interface is a virtual keyboard. Users perform key touch operations on this virtual keyboard using their fingers or an interactive stylus. The touch operation type can include single click, double click, or long press (e.g., a 3-second long press). The display subject can determine which specific key on the virtual keyboard was touched by the user through the blocking coordinates of the light block located by the laser projection accessory, and the blocking characteristics of the light block (e.g., blocking duration, number of blocking times per unit time). For example, the blocking coordinates can be used to locate the specific key on the virtual keyboard that was touched, and the blocking characteristics can be used to determine the touch type. Then, the user's key touch operation on the virtual keyboard is used to determine the user's desired input interaction command, which is then used to operate the current UI (User Interface) of the smart wearable device, realizing human-computer interaction input control.

[0065] As another example, the current virtual interactive interface is directly the current UI interactive interface of the smart wearable device.

[0066] The step of determining the interactive command mapped to the blocking coordinate position in the current virtual interactive interface includes:

[0067] Step A10: Simulate the user's gesture operation on the virtual interactive interface based on multiple consecutive blocking coordinate positions within a preset time period;

[0068] Step A20: Determine the control command of the gesture operation mapping according to the pre-stored gesture mapping command table, and use the control command of the gesture operation mapping as the interaction command of the blocking coordinate position in the current virtual interactive interface.

[0069] In this embodiment, the gesture operation may include single-click, double-click, long-press (e.g., long-press for 3 seconds), swipe up, swipe down, swipe left, and swipe right. Those skilled in the art will understand that a user's gesture operation on a virtual interactive interface can be simulated based on the blocking coordinate positions of multiple consecutive light blocks within a preset time period, and the blocking characteristics of the light blocks (e.g., the blocking duration of a single light block and the number of blocks per unit time). It is easily understood that different gesture operations performed on a virtual interactive interface often map to different control commands. This embodiment identifies the user's gesture operation on the virtual interactive interface by identifying multiple consecutive blocking coordinate positions within a preset time period, thereby inputting the user's desired operation type command into the current UI of the smart wearable device, more accurately realizing input control for human-computer interaction.

[0070] In this embodiment, the current UI interface refers to the application interface currently displayed on the smart wearable device. Users can manipulate the current UI interface projected by the laser projection accessory to enter a new UI interface; that is, the current UI interface continuously changes based on user input. To aid understanding, two examples are provided. In one example, the current UI interface is the video playback interface of a Douyin (TikTok) video application. Users can manipulate this interface, such as by swiping up or down, to switch between currently playing Douyin videos. The updated current UI interface then becomes the playback interface of the selected Douyin video. In another example, the current UI interface is the VR video interface of a VR video application. Users can manipulate this interface, such as by swiping left, right, and clicking. Swiping left and right adjusts the playback progress of the currently playing VR video, while clicking allows switching between pause and play.

[0071] As another example, the current virtual interactive interface is also the current UI interactive interface of the smart wearable device. The step of determining the interactive command mapped to the blocking coordinate position in the current virtual interactive interface includes:

[0072] Step B10: Determine the UI control of the current virtual interactive interface corresponding to the blocking coordinate position;

[0073] Step B20: Determine the control instructions mapped to the UI control according to the pre-stored control mapping instruction table, and use the control instructions mapped to the UI control as the interaction instructions mapped to the blocking coordinate position in the current virtual interactive interface.

[0074] In this embodiment, the UI (User Interface) controls used for interaction often differ across different UI interfaces. For example, when the UI interface is the login screen of the KuGou Music application, it may include UI controls such as login and registration controls. When the UI interface is the main page after logging into the KuGou Music application, it may include UI controls such as "playlist," "radio," and "music library." When the UI interface is the homepage of Gaode Maps, it may include UI controls such as "location search," "walking," "driving," and "public transport." When the UI interface is the playback page of a VR video application playing VR videos, it may include UI controls such as "volume," "speed," and "bullet comments." It is understood that the UI controls in the current UI interface are distributed at different coordinate positions within the current UI interface, and triggering different UI controls often maps to different control commands. For example, triggering the "Volume" control maps to a command to adjust the volume; triggering the "Speed" control maps to a command to adjust the playback speed; and triggering the "Comments" control maps to a command to toggle the comments function on and off. It should be noted that the examples of UI interaction interfaces and UI control types above are for illustrative purposes only and do not constitute a limitation on the types of UI interaction interfaces and UI controls.

[0075] This embodiment determines the UI control corresponding to the blocking coordinate position of the current virtual interactive interface, and determines the control instruction mapped to the UI control according to the pre-stored control mapping instruction table. The control instruction mapped to the UI control is then used as the interaction instruction mapped to the blocking coordinate position in the current virtual interactive interface. This allows the current UI interactive interface to be projected onto the projection plane via a laser projection accessory. Users can input the operation type instructions they need to the current UI interactive interface of the smart wearable device by touching the UI controls displayed at different coordinate positions on the current UI interactive interface, thereby further accurately realizing the input control of human-computer interaction.

[0076] In this embodiment, the laser projection accessory is detachably connected to the display body. If the connection between the laser projection accessory and the display body changes from a connected state to a detached state, the laser projection accessory projects the laser beam corresponding to the array layout of the current virtual interactive interface onto the projection plane. The laser projection accessory also detects the reflected beam of the laser beam in the projection direction. Based on the beam information of the reflected beam, the blocking coordinates of the laser beam are located, and the obtained blocking coordinates are sent to the display body. The display body then determines the interaction command mapped to the blocking coordinates in the current virtual interactive interface and inputs this interaction command, thereby completing the current UI (User Interface) interaction of the smart wearable device. This embodiment provides a novel input interaction control method for smart wearable devices. A laser projection accessory is detachably connected to the glasses holder of the smart wearable device. When the UI interface of the smart wearable device system needs to be operated, the user can remove the laser projection accessory and place it on a horizontal surface. The laser projection accessory projects a virtual interactive interface with a resolution adapted to the viewing window of the smart wearable device's glasses. The user can then operate the current UI interface through this virtual interactive interface, realizing input interaction control between humans and smart wearable devices such as AR / VR glasses. Compared with the current input interaction control method of smart wearable devices that relies on eye movement recognition, this embodiment does not require frequent eye movements, thus avoiding the increased frequency of blinking caused by eye fatigue and the need for frequent short breaks before inputting interactive commands. Therefore, this embodiment improves the smoothness of input interaction control of smart wearable devices. Meanwhile, compared to smart wearable devices that use an external physical keyboard for input and interaction control, this embodiment eliminates the need to carry a large and bulky external physical keyboard. When not in use, the laser projection accessory can be mounted on the display body and removed when needed (ready to use anytime). Input and interaction control of the UI interface of the smart wearable device can be performed anytime and anywhere, thereby improving the portability of the smart wearable device and thus enhancing the user experience.

[0077] Additionally, it should be noted that because laser projection accessories are lightweight and compact (larger or heavier laser projection accessories, when mounted on the display unit, can make the smart wearable device heavier or bulkier, affecting the user's wearing experience), their batteries are often small, resulting in relatively short battery life. Therefore, this embodiment places the analysis process of "determining the interactive command mapped to the current virtual interface based on the blocking coordinates" on the display unit's side. The laser projection accessory only needs to send the identified blocking coordinates to the display unit, thereby reducing the operational load and hardware configuration requirements of the laser projection accessory, and ultimately improving its battery life.

[0078] Furthermore, it should be noted that a virtual keyboard can also be displayed within a VR or AR image on the smart wearable device. Users can then press keys on this virtual keyboard with their fingers, and the smart wearable device's camera can map the key positions of the virtual keyboard to the coordinates of their fingers to complete the input of interactive commands. However, current image recognition algorithms for cameras struggle to accurately capture and recognize finger coordinates, resulting in low accuracy and consequently, low accuracy in input interaction control. Therefore, compared to this input interaction control method, the input interaction control method proposed in this application improves the accuracy of input interaction control for smart wearable devices.

[0079] In one possible implementation, the step of detecting the reflected beam of the laser beam reflected back in the projection direction by the laser projection accessory includes:

[0080] Step C10: Detect the light beam from multiple directions using the laser projection accessory and identify the wavelength of the detected light beam.

[0081] Step C20: The light beam with a wavelength within the preset target wavelength range is used as the reflected beam of the laser beam reflected back in the projection direction.

[0082] In this embodiment, the target wavelength range can be set by those skilled in the art according to actual conditions, and this embodiment does not impose specific limitations. It is understood that if a laser beam of the first wavelength is projected onto the plane to be projected by the laser projection accessory, then the wavelength of the reflected beam returned by the laser beam in the projection direction should also be the first wavelength. In this case, the first wavelength can be used as the median, and a preset wavelength value fluctuating around this median can be used as the target wavelength range. This filters out beams of other wavelengths and shields beams generated by other unrelated external devices. Therefore, this embodiment uses the laser projection accessory to detect beams in multiple directions, identifies the wavelength of the detected beams, and uses beams with wavelengths within the preset target wavelength range as the reflected beam returned by the laser beam in the projection direction. By identifying and receiving beams of specific wavelengths, interference from light emitted by other unrelated external devices on the input interaction control process of the smart wearable device is avoided, further improving the accuracy of input interaction control.

[0083] In one possible implementation, refer to Figure 2 The display body includes an eyeglass frame and a magnetic module. The eyeglass frame includes a nose bridge, and the laser projection accessory includes a Bluetooth module. The magnetic module is fixed to the nose bridge, and the laser projection accessory is detachably connected to the magnetic module via magnetic attraction.

[0084] Step S10, if it is detected that the laser projection accessory and the display body have changed from a connected state to a detached state, then the step of projecting the laser beam corresponding to the array layout of the current virtual interactive interface onto the projection plane through the laser projection accessory includes:

[0085] Step S11: If it is detected that the laser projection accessory and the magnetic module have changed from a connected state to a detached state, then the Bluetooth module of the laser projection accessory is turned on to establish a Bluetooth connection with the glasses.

[0086] Step S12: After the Bluetooth connection is successful, the laser beam corresponding to the array layout of the current virtual interactive interface is projected onto the plane to be projected using the laser projection accessory.

[0087] Because the space at the bridge of the glasses is larger than in other areas, there is more space for the laser projection accessory to be installed there, facilitating its installation and removal. Furthermore, magnetic attachment is more convenient for installing and removing the laser projection accessory compared to threaded or bayonet connections. Therefore, this embodiment improves the ease of installation and removal of the laser projection accessory on the display unit by incorporating a Bluetooth module in the laser projection accessory. This magnetic module is fixed to the bridge of the glasses, and the laser projection accessory is detachably connected to the magnetic module via magnetic attachment.

[0088] Furthermore, due to the lightweight and compact design of laser projection accessories (larger or heavier components on the display unit can make smart wearable devices heavy or bulky, affecting user comfort), their batteries are smaller, resulting in shorter battery life. Therefore, this embodiment activates the Bluetooth module of the laser projection accessory only when it detects a transition from a connected to a detached state between the accessory and the magnetic module, establishing a Bluetooth connection with the glasses (this Bluetooth communication link allows the laser projection accessory to send the located blocking coordinates to the display unit). In other words, Bluetooth is only activated when the user needs to input and interact with the current UI interface, requiring the accessory to be removed and placed on a horizontal surface to project the virtual interface. When the accessory is still attached to the display unit, indicating the user doesn't need it, Bluetooth is off, conserving power and extending battery life.

[0089] In one feasible embodiment, the display body further includes a charging module and a power module. The input end of the charging module is electrically connected to the power module. The charging module is disposed on the nose bridge and spaced apart from the magnetic module. When the laser projection accessory is connected to the display body, the output end of the charging module is matched and aligned with the charging interface of the laser projection accessory so that the display body can charge the laser projection accessory.

[0090] For example, refer to Figure 4 and Figure 5 ,in, Figure 4 The display body 10 shown has two magnetic modules 2a on its nose bridge. A charging module 1a is located between the two magnetic modules 2a. Figure 5The laser projection accessory 20 shown has two magnetic metal parts 2b corresponding to the positions of the magnetic module 2a, and a charging interface 1b is located between the two magnetic metal parts 2b. When the laser projection accessory 20 is connected to the display body 10, the output end of the charging module 1a is aligned with the charging interface 1b of the laser projection accessory 20, so that the display body 10 can charge the laser projection accessory 20. Additionally, Figure 5 The laser projection accessory 20 shown also includes a laser module 3 and a projection optical engine 2 connected to each other. The laser module 3 is used as the output source of the laser beam, for example, generating a laser beam corresponding to the array layout of the current virtual interactive interface, while the projection optical engine 2 is used to project the laser beam generated by the laser module 3 onto the plane to be projected. As mentioned above, see reference 2. Figure 6 100 smart wearable devices Figure 6 The diagram illustrates the connection between the laser projection accessory 20 and the display body 10. The magnetic metal part 2b of the laser projection accessory 20 is magnetically connected to the magnetic module 2a of the display body 10, facilitating the installation and removal of the laser projection accessory 20 and the display body 10. The laser projection accessory 20 can be detached from the display body 10 for immediate use, enabling input and interactive control of the UI interface of the smart wearable device 100 anytime, anywhere.

[0091] This embodiment incorporates a charging module on the display body. The input end of the charging module is electrically connected to the power module. The charging module is mounted on the nose bridge and spaced apart from the magnetic module. When the laser projection accessory is detected to be in the connected state, the output end of the charging module aligns with the charging interface of the laser projection accessory. This allows the laser projection accessory to be charged by the display body when it is installed on the display body, thus replenishing its power during periods of non-use and further extending its battery life.

[0092] In one possible implementation, the smart wearable device further includes a charging case, which includes a first cavity for fixing the display body, a second cavity for fixing the laser projection accessory, a first charging interface disposed in the first cavity, and a second charging interface disposed in the second cavity.

[0093] For example, refer to Figure 7 , Figure 7 This is a schematic diagram of a scenario in which the laser projection accessory 20 is charging in the charging box 4 according to one embodiment of this application.

[0094] This embodiment uses a charging box set up on the smart wearable device to charge the laser projection accessory and the display main body. When the power stored in the power module of the display main body is insufficient, the charging box can replenish the power of the laser projection accessory and the display main body in a timely manner.

[0095] In one possible implementation, the laser projection accessory includes a fixedly connected accessory body and a Hall sensor, the Hall sensor being used to detect the current magnetic field signal around the accessory body. Prior to the step of activating the Bluetooth module of the laser projection accessory if the connection between the laser projection accessory and the magnetic module changes from a connected state to a detached state, the following steps are included:

[0096] If the current magnetic field signal is detected to be a preset first magnetic field signal, it is determined that the laser projection accessory and the magnetic suction module are in a connected state.

[0097] If the current magnetic field signal is detected to be a preset second magnetic field signal, it is determined that the laser projection accessory and the magnetic module are in a disassembled state, wherein the signal strength of the first magnetic field signal is different from the signal strength of the second magnetic field signal.

[0098] It is easy to deduce that if the current magnetic field signal is detected to change from the first magnetic field signal to the second magnetic field signal, then it is determined that the laser projection accessory and the magnetic module have changed from a connected state to a detached state.

[0099] In this embodiment, the first and second magnetic field signals can be determined experimentally before leaving the factory, for example, through multiple experiments: when the laser projection accessory and the display body are connected, the signal strength of the magnetic field signal sensed by the Hall sensor is the first magnetic field signal. When the laser projection accessory and the display body are detached, the signal strength of the magnetic field signal sensed by the Hall sensor is the second magnetic field signal. It is easy to understand that there is a difference between the signal strength of the first and second magnetic field signals. By storing the first and second magnetic field signals in the laser projection accessory or the display body, and with the Hall sensor located in the laser projection accessory, when the Hall sensor detects that the deviation between the current magnetic field signal and the first magnetic field signal is less than a preset deviation threshold (setting a certain deviation value is to prevent fluctuations caused by unstable magnetic field signals), it is determined that the laser projection accessory and the display body are connected. When the Hall sensor detects that the deviation between the current magnetic field signal and the second magnetic field signal is less than the preset deviation threshold, it is determined that the laser projection accessory and the display body are detached.

[0100] This embodiment provides a novel input interaction control method for smart wearable devices. A laser projection accessory is magnetically attached to the nose bridge of the smart wearable device. When the system interface of the smart wearable device needs to be operated, the laser projection accessory can be removed. After the Hall sensor built into the laser projection accessory detects the preset magnetic field change rule, it activates Bluetooth to establish a communication link with the smart wearable device. When the laser projection accessory is placed on a horizontal surface, it projects a virtual interactive interface with a resolution size adapted to the viewing window of the smart wearable device. Users can perform touch operations on the virtual interactive interface to input the user's desired operation type command on the current UI of the smart wearable device, thereby achieving more accurate human-computer interaction input control.

[0101] In one feasible embodiment, the step of locating the blocking coordinate position of the laser beam based on the beam information of the reflected beam includes:

[0102] Step C10: The laser beam is projected onto a preset coordinate position on the virtual interactive interface through the laser projection accessory to form a calibration mark on the virtual interactive interface. The wavelength of the laser beam that forms the calibration mark is different from the wavelength of the laser beam that forms the virtual interactive interface.

[0103] Step C20: Detect the calibration reflection beam reflected back by the laser beam that forms the calibration mark in the projection direction;

[0104] Step C30: Based on the beam information of the calibration reflected beam, calibrate the beam positioning and recognition algorithm pre-stored in the laser projection accessory;

[0105] In step S30, the step of locating the blocking coordinate position of the laser beam based on the beam information of the reflected beam includes:

[0106] Step C40: Based on the beam information of the reflected beam, the blocking coordinates of the laser beam are located using the calibrated beam positioning and recognition algorithm.

[0107] In this embodiment, the calibration mark is a visual calibration mark, such as a cursor. The user can use a finger or stylus to touch the coordinates of the calibration mark on the virtual interface (i.e., the touch coordinates of the finger or stylus coincide with the coordinates of the calibration mark). At this time, the coordinates of the calibration mark are the blocking coordinates of the laser beam. Since the coordinates of the calibration mark are known (the coordinates are preset, i.e., the aforementioned preset coordinates), the calibration process of the positioning and recognition algorithm for locating the blocking coordinates of the laser beam can be completed by actually detecting the blocking coordinates and the known preset coordinates. The preset coordinates can be set by those skilled in the art according to actual conditions to better calibrate the positioning and recognition algorithm; this embodiment does not impose specific limitations. In one embodiment, the preset coordinates can be the coordinates of the center of the virtual interface.

[0108] In this embodiment, it is necessary to receive the reflected beam of the laser beam reflected back in the projection direction through the laser projection accessory, and locate the blocking coordinate position of the laser beam based on the reflected beam, thereby recognizing the user's touch operation on the virtual interactive interface. Therefore, this positioning process requires a positioning and recognition algorithm to locate the blocking coordinate position of the laser beam. Since this positioning and recognition algorithm is closely related to the spatial relative position of the laser projection accessory and the projection plane, in order to improve the accuracy of locating and recognizing the blocking coordinate position of the laser beam, it is necessary to calibrate the positioning and recognition algorithm before locating the blocking coordinate position of the laser beam. In this embodiment, the laser projection accessory projects the laser beam to a preset coordinate position on the virtual interactive interface to form a calibration mark on the virtual interactive interface. The wavelength of the laser beam forming the calibration mark is different from the wavelength of the laser beam forming the virtual interactive interface. The calibration reflection beam reflected back by the laser beam forming the calibration mark in the projection direction is detected. Then, based on the beam information of the calibration reflection beam, the beam positioning and recognition algorithm pre-stored in the laser projection accessory is calibrated, thereby improving the accuracy of locating the blocking coordinate position of the laser beam, and thus more accurately recognizing the interactive commands input by the user, further improving the accuracy of input interactive control.

[0109] Example 2

[0110] Based on the above embodiments of this application, please refer to Figure 3 In another embodiment of this application, content that is the same as or similar to that in Embodiment 1 described above can be referred to the above description and will not be repeated hereafter. Based on this, the step of locating the blocking coordinate position of the laser beam based on the beam information of the reflected beam includes:

[0111] Step S21: Obtain the pre-stored standard echo information of the laser beam, compare the beam information of the reflected beam with the standard echo information, and determine the echo variation information of the laser beam;

[0112] Step S22: If the echo variation information conforms to the preset echo variation rule, then determine the coordinate position of the reflected beam that conforms to the echo variation rule.

[0113] Step S23: The coordinate position of the reflected beam that conforms to the echo variation rule is used as the blocking coordinate position of the laser beam.

[0114] In this embodiment, the standard echo information refers to the beam information of the reflected beam of a laser beam projected onto the plane to be projected (i.e., the echo information of the laser beam when there are no obstacles such as fingers or pens obstructing it). In one embodiment, the standard echo information can be obtained through experimental calibration before leaving the factory, and the calibrated standard echo information of the laser beam can be pre-stored in the system of the laser projection accessory. In another embodiment, stable echo information within a preset fluctuation range can be taken as the standard echo information within a preset time after the laser projection accessory has started its projection function (based on the principle that the echo information of the laser beam will change abruptly when there are obstacles such as fingers or pens obstructing it).

[0115] Furthermore, in one possible implementation, the echo variation information includes variations in the echo intensity and / or echo period of the laser beam. Step S23, after comparing the beam information of the reflected beam with the standard echo information to determine the echo variation information of the laser beam, includes:

[0116] Step D10: If the change value of the echo light intensity is greater than the preset light intensity threshold, and / or if the change value of the echo period is greater than the preset duration threshold, then it is determined that the echo change information conforms to the preset echo change rule.

[0117] In this embodiment, the echo intensity of the laser beam refers to the illumination intensity of the reflected beam that the laser beam reflects back in the projection direction. The echo period of the laser beam refers to the time from the start of projecting the laser beam to receiving the reflected beam that the laser beam reflects back in the projection direction.

[0118] Considering that the laser beam will scatter to some extent when blocked by a finger or stylus, this scattering will reduce the intensity of the reflected beam at the blocked coordinate position, i.e., the echo intensity will decrease. Furthermore, the time it takes for the laser beam to reflect back after being blocked by a finger or stylus will shorten, i.e., the echo period will shorten. Therefore, this embodiment can determine that the laser beam has been blocked by a finger or stylus when the detected change in echo intensity exceeds a preset intensity threshold, and / or when the detected change in echo period exceeds a preset duration threshold (indicating a sudden change in the laser beam). This means the echo change information conforms to a preset echo change rule. The coordinate position of the reflected beam that conforms to this echo change rule is used as the blocking coordinate position of the laser beam, thereby improving the accuracy of recognizing the user's touch operation on the virtual interface and thus enhancing the accuracy of input interaction control of the smart wearable device.

[0119] Example 3

[0120] This invention also provides an input interaction control device, which is applied to a smart wearable device. The smart wearable device includes a display main body and a laser projection accessory. The input interaction control device includes:

[0121] The projection module is used to project the laser beam corresponding to the array layout of the current virtual interactive interface onto the projection plane through the laser projection accessory if it is detected that the laser projection accessory and the display body have changed from a connected state to a detached state.

[0122] The positioning module is used to detect the reflected beam of the laser beam reflected back in the projection direction through the laser projection accessory, locate the blocking coordinate position of the laser beam based on the beam information of the reflected beam, and send the located blocking coordinate position to the display body.

[0123] The interaction module is used to determine the interaction command that the blocking coordinate position is mapped in the current virtual interaction interface through the display subject, and to perform input interaction control according to the interaction command.

[0124] Optionally, the interaction module is further configured to:

[0125] Based on multiple consecutive blocking coordinate positions within a preset time period, the user's gesture operation on the virtual interactive interface is simulated.

[0126] Based on the pre-stored gesture mapping instruction table, the control instruction of the gesture operation mapping is determined, and the control instruction of the gesture operation mapping is used as the interaction instruction of the blocking coordinate position mapped in the current virtual interactive interface.

[0127] Optionally, the display body includes an eyeglasses main body and a magnetic module. The eyeglasses main body includes a nose bridge. The laser projection accessory includes a Bluetooth module. The magnetic module is fixed to the nose bridge. The laser projection accessory is detachably connected to the magnetic module via magnetic attraction. The projection module is further used for:

[0128] If it is detected that the laser projection accessory and the magnetic module have changed from a connected state to a detached state, then the Bluetooth module of the laser projection accessory is activated to establish a Bluetooth connection with the glasses.

[0129] After a successful Bluetooth connection, the laser projection accessory projects the laser beams corresponding to the array layout of the current virtual interactive interface onto the projection plane.

[0130] Optionally, the display body further includes a charging module and a power module. The input end of the charging module is electrically connected to the power module. The charging module is disposed on the nose bridge and spaced apart from the magnetic module. When the laser projection accessory is connected to the display body, the output end of the charging module is matched and aligned with the charging interface of the laser projection accessory so that the display body can charge the laser projection accessory.

[0131] Optionally, the laser projection accessory includes a fixedly connected accessory body and a Hall sensor, the Hall sensor being used to detect the current magnetic field signal around the accessory body, and the projection module being further used for:

[0132] If the current magnetic field signal is detected to be a preset first magnetic field signal, it is determined that the laser projection accessory and the magnetic suction module are in a connected state.

[0133] If the current magnetic field signal is detected to be a preset second magnetic field signal, it is determined that the laser projection accessory and the magnetic module are in a disassembled state, wherein the signal strength of the first magnetic field signal is different from the signal strength of the second magnetic field signal.

[0134] Optionally, the positioning module is further configured to:

[0135] Obtain the pre-stored standard echo information of the laser beam, compare the beam information of the reflected beam with the standard echo information, and determine the echo variation information of the laser beam;

[0136] If the echo variation information conforms to the preset echo variation rule, then the coordinate position of the reflected beam that conforms to the echo variation rule is determined.

[0137] The coordinate position of the reflected beam that conforms to the echo variation rule is used as the blocking coordinate position for blocking the laser beam.

[0138] Optionally, the echo variation information includes variations in the echo intensity and / or echo period of the laser beam, and the positioning module is further configured to:

[0139] If the change in echo intensity is greater than a preset intensity threshold, and / or if the change in echo period is greater than a preset duration threshold, then the echo change information is determined to conform to a preset echo change rule.

[0140] Optionally, the input interaction control further includes a calibration module, which is further used for:

[0141] The laser beam is projected onto a preset coordinate position on the virtual interactive interface by the laser projection accessory to form a calibration mark on the virtual interactive interface, wherein the wavelength of the laser beam forming the calibration mark is different from the wavelength of the laser beam forming the virtual interactive interface.

[0142] The calibration reflection beam reflected back by the laser beam that forms the calibration mark is detected in the projection direction;

[0143] Based on the beam information of the calibrated reflected beam, the beam positioning and recognition algorithm pre-stored in the laser projection accessory is calibrated;

[0144] The step of locating the blocking coordinate position of the laser beam based on the beam information of the reflected beam includes:

[0145] Based on the beam information of the reflected beam, the blocking coordinates of the laser beam are located using the calibrated beam positioning and recognition algorithm.

[0146] The input interaction control device provided in this embodiment of the invention employs the input interaction control method in Embodiment 1 or Embodiment 2, which can improve the portability of smart wearable devices while enhancing the fluency of input interaction control. Compared with the prior art, the beneficial effects of the input interaction control device provided in this embodiment of the invention are the same as those of the input interaction control method provided in the above embodiments, and other technical features in the input interaction control device are the same as those disclosed in the previous embodiment method, and will not be repeated here.

[0147] Example 4

[0148] This invention provides a smart wearable device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, which are executed by the at least one processor to enable the at least one processor to perform the input interaction control method described in Embodiment 1 above.

[0149] The following is for reference. Figure 9 The diagram illustrates a structural schematic suitable for implementing the embodiments of the present disclosure of a smart wearable device. The smart wearable device in the embodiments of the present disclosure may include, but is not limited to, Mixed Reality (MR) devices, Augmented Reality (AR) devices, Virtual Reality (VR) devices, Extended Reality (XR) devices, or some combination thereof. Figure 9 The smart wearable device shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments disclosed herein.

[0150] like Figure 9 As shown, the smart wearable device may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM 1002) or a program loaded from a storage device into a random access memory (RAM 1004). The RAM 1004 also stores various programs and data required for the operation of the AR glasses. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. Input / output (I / O) interfaces are also connected to the bus 1005.

[0151] Typically, the following systems can be connected to I / O interface 1006: input devices 1007 including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 1008 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1009. Communication device 1009 allows the smart wearable device to communicate wirelessly or wiredly with other devices to exchange data. Although smart wearable devices with various systems are shown in the figures, it should be understood that it is not required to implement or possess all the systems shown. More or fewer systems may be implemented alternatively.

[0152] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of embodiments of this disclosure.

[0153] The smart wearable device provided by this invention, employing the input interaction control method in Embodiment 1 or Embodiment 2 described above, can improve both the portability and fluency of input interaction control. Compared with the prior art, the beneficial effects of the smart wearable device provided by this invention are the same as those of the input interaction control method provided in Embodiment 1 described above, and other technical features of this smart wearable device are the same as those disclosed in the previous embodiment method, and will not be repeated here.

[0154] It should be understood that various parts of this disclosure can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics may be combined in any suitable manner in one or more embodiments or examples.

[0155] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

[0156] Example 5

[0157] This invention provides a computer-readable storage medium having computer-readable program instructions stored thereon, which are used to execute the input interaction control method in Embodiment 1 above.

[0158] The computer-readable storage medium provided in this embodiment of the invention may be, for example, a USB flash drive, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0159] The aforementioned computer-readable storage medium may be included in the smart wearable device; or it may exist independently and not assembled into the smart wearable device.

[0160] The aforementioned computer-readable storage medium carries one or more programs. When these programs are executed by a smart wearable device, the smart wearable device: if it detects that the laser projection accessory and the display body have changed from a connected state to a detached state, it projects a laser beam corresponding to the array layout of the current virtual interactive interface onto the projection plane via the laser projection accessory; it detects the reflected beam of the laser beam reflected back in the projection direction via the laser projection accessory, locates the blocking coordinate position of the laser beam based on the beam information of the reflected beam, and sends the located blocking coordinate position to the display body; the display body determines the interaction command mapped by the blocking coordinate position in the current virtual interactive interface, and performs input interaction control based on the interaction command.

[0161] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0162] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0163] The modules described in the embodiments of this disclosure can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0164] The computer-readable storage medium provided by this invention stores computer-readable program instructions for executing the above-described input interaction control method, which can improve the portability of smart wearable devices while enhancing the fluency of input interaction control. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this embodiment are the same as those of the input interaction control method provided in Embodiment 1 or Embodiment 2, and will not be repeated here.

[0165] Example 6

[0166] This invention also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the input interaction control method described above.

[0167] The computer program product provided in this application can improve the portability of smart wearable devices while enhancing the smoothness of input interaction control. Compared with the prior art, the beneficial effects of the computer program product provided in this embodiment are the same as those of the input interaction control methods provided in Embodiment 1 or Embodiment 2 above, and will not be repeated here.

[0168] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent scope of this application.

Claims

1. An input interaction control method, characterized by, The input interaction control method is applied to a smart wearable device, the smart wearable device comprising a display main body and a laser projection accessory, the laser projection accessory being detachably connected with the display main body, and the steps of the input interaction control method comprising: if it is detected that the laser projection accessory and the display main body are switched from a connected state to a detached state, projecting, by the laser projection accessory, a laser beam corresponding to an array layout of a current virtual interaction interface to a to-be-projected plane; detecting, by the laser projection accessory, a reflected beam reflected back in a projection direction of the laser beam, positioning a blocking coordinate position of a light ray blockage of the laser beam according to beam information of the reflected beam, and sending the positioned blocking coordinate position to the display main body; determining, by the display main body, an interaction instruction mapped by the blocking coordinate position in the current virtual interaction interface, and performing input interaction control according to the interaction instruction; wherein the step of positioning the blocking coordinate position of the light ray blockage of the laser beam according to the beam information of the reflected beam comprises: obtaining pre-stored standard echo information of the laser beam, comparing the beam information of the reflected beam with the standard echo information, and determining echo change information of the laser beam; if the echo change information meets a preset echo change rule, determining a coordinate position of the reflected beam meeting the echo change rule; taking the coordinate position of the reflected beam meeting the echo change rule as the blocking coordinate position of the light ray blockage of the laser beam.

2. The input interaction control method according to claim 1, wherein The step of determining the interaction instruction mapped by the blocking coordinate position in the current virtual interaction interface comprises: simulating a gesture operation of a user in the virtual interaction interface according to a plurality of continuous blocking coordinate positions within a preset time length; determining a control instruction mapped by the gesture operation according to a pre-stored gesture mapping instruction table, and taking the control instruction mapped by the gesture operation as the interaction instruction mapped by the blocking coordinate position in the current virtual interaction interface.

3. The input interaction control method of claim 1, wherein, The display main body comprises a glasses main body and a magnetic suction module, the glasses main body comprising a nose bridge, the laser projection accessory comprising a Bluetooth module, the magnetic suction module being fixed to the nose bridge, and the laser projection accessory being detachably connected with the magnetic suction module in a magnetic suction manner, The step of projecting, by the laser projection accessory, a laser beam corresponding to an array layout of a current virtual interaction interface to a to-be-projected plane if it is detected that the laser projection accessory and the display main body are switched from a connected state to a detached state comprises: if it is detected that the laser projection accessory and the magnetic suction module are switched from a connected state to a detached state, starting a Bluetooth module of the laser projection accessory and establishing a Bluetooth connection with the glasses main body; after the Bluetooth connection is successful, projecting, by the laser projection accessory, a laser beam corresponding to an array layout of a current virtual interaction interface to a to-be-projected plane.

4. The input interaction control method according to Claim 3, wherein The display body further comprises a charging module and a power supply module, an input end of the charging module is electrically connected with the power supply module, the charging module is arranged on the nose bridge, and is arranged at a distance from the magnetic attraction module; when the laser projection accessory and the display body are in the connected state, an output end of the charging module is matched and aligned with a charging interface of the laser projection accessory, so that the display body charges the laser projection accessory.

5. The input interaction control method according to Claim 3, wherein The laser projection accessory comprises a fixedly connected accessory main body and a Hall sensor, the Hall sensor is used to detect a current magnetic field signal around the accessory main body, and the step of starting the Bluetooth module of the laser projection accessory before the laser projection accessory is detected to be switched from the connected state to the disassembled state comprises: If the current magnetic field signal is detected to be a preset first magnetic field signal, it is determined that the laser projection accessory and the magnetic attraction module are in the connected state; If the current magnetic field signal is detected to be a preset second magnetic field signal, it is determined that the laser projection accessory and the magnetic attraction module are in the disassembled state, wherein the signal strength of the first magnetic field signal is different from the signal strength of the second magnetic field signal.

6. The input interaction control method of claim 1, wherein, The echo change information comprises a change in echo light intensity and / or echo period of the laser beam, and the step of comparing the beam information of the reflected beam with the standard echo information to determine the echo change information of the laser beam comprises: If the change value of the echo light intensity is greater than a preset light intensity threshold value, and / or if the change value of the echo period is greater than a preset time length threshold value, it is determined that the echo change information meets a preset echo change rule.

7. The input interaction control method of claim 1, wherein, The step of positioning the blocking coordinate position of the light ray blockage of the laser beam according to the beam information of the reflected beam comprises: projecting a laser beam to a preset coordinate position on the virtual interactive interface through the laser projection accessory to form a calibration mark on the virtual interactive interface, wherein the wavelength of the laser beam forming the calibration mark is different from the wavelength of the laser beam forming the virtual interactive interface; detecting a calibration reflected light beam reflected back in a projection direction of the laser beam forming the calibration mark; calibrating a pre-stored beam positioning recognition algorithm in the laser projection accessory according to beam information of the calibration reflected light beam; The step of positioning the blocking coordinate position of the light ray blockage of the laser beam according to the beam information of the reflected beam comprises: According to the beam information of the reflected beam, the blocking coordinate position of the light ray blockage of the laser beam is positioned through the calibrated beam positioning recognition algorithm.

8. An intelligent wearable device, characterized by, The smart wearable device comprises: at least one processor; and a memory connected in communication with the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the steps of the input interaction control method of any one of claims 1 to 7.

9. A readable storage medium, characterized by, The readable storage medium is a computer readable storage medium, and the computer readable storage medium stores a program for implementing the input interaction control method. The program for implementing the input interaction control method is executed by a processor to implement the steps of the input interaction control method in any one of claims 1 to 7.

Images