Interface control method, intelligent glasses and storage medium

Abstract

The embodiment of the invention provides an interface control method, intelligent glasses and a storage medium, and the method comprises the steps: determining the force direction of the pressure corresponding to a display instruction after the display instruction for displaying a UI interface is detected; wherein the force direction comprises at least one of the following directions from left to right, from right to left, from top to bottom and from bottom to top; and determining a target display position of the UI interface according to the force direction, and displaying the UI interface in a field angle of the intelligent glasses based on the target display position. Therefore, the intelligent glasses can intelligently control the display position of the UI interface in the field angle of the intelligent glasses according to the direction of the force, and the display flexibility of the UI interface in the field angle is improved; and after the user triggers the display instruction for displaying the UI interface, the user does not need to trigger and move the UI interface to change the display position of the UI interface in the field angle, and the display position of the UI interface in the field angle can be determined through the display instruction, so that the determination process of the display position of the UI interface is simplified.

Description

Technical Field

[0001] The present invention relates to the field of display technology, and in particular to an interface control method, smart glasses, and a storage medium. Background Art

[0002] With the development of smart wearable technology, smart glasses with display capabilities, such as augmented reality glasses and virtual reality glasses, have entered users' lives. Currently, the UI (User Interface) of smart glasses is normally displayed in the center of the field of view (FOV). However, for glasses, especially smart glasses with augmented reality capabilities, sometimes displaying the UI in the center of the FOV can affect the user's ability to view real-world objects while wearing the smart glasses. Therefore, how to intelligently control the display of the UI within the FOV of smart glasses is an urgent problem to be solved. Summary of the Invention

[0003] Embodiments of the present invention provide an interface control method, smart glasses, and a storage medium, aiming to improve the flexibility of displaying a UI interface within the field of view of the smart glasses.

[0004] In a first aspect, an embodiment of the present invention provides an interface control method, which is applied to smart glasses and includes:

[0005] After detecting a display instruction of the UI interface, determining the force direction of the pressure corresponding to the display instruction; wherein the force direction includes at least one of the following: from left to right, from right to left, from top to bottom, and from bottom to top;

[0006] The target display position of the UI interface is determined according to the force direction, and the UI interface is displayed in the field of view of the smart glasses based on the target display position.

[0007] Optionally, a pressure detection component is used to detect a display instruction of a display UI interface;

[0008] The pressure detection component is arranged in at least one of the following ways:

[0009] The pressure detection component is provided on at least one temple of the smart glasses;

[0010] The pressure detection component is arranged on the frame of the smart glasses;

[0011] The pressure detection component is arranged on a control device connected to the smart glasses.

[0012] Optionally, after the step of displaying the UI interface within the field of view of the smart glasses based on the target display position, the method further includes:

[0013] When the pressure detection component detects a control instruction for controlling the UI interface in the field of view, the UI interface is controlled according to the control instruction, wherein the control instruction includes at least one of the following: an interface return instruction, a function confirmation instruction, and an interface switching instruction; different control instructions correspond to different pressure values.

[0014] Optionally, the method further includes:

[0015] When the pressure value detected by the pressure detection component is greater than a preset value, a display instruction of the UI interface is triggered.

[0016] Optionally, the step of determining the target display position of the UI interface according to the force direction further includes:

[0017] When it is determined that the force direction is from left to right, determining the target display position of the UI interface to be to the right of the field of view angle;

[0018] When it is determined that the force direction is from right to left, determining the target display position of the UI interface to be the left of the field of view angle;

[0019] When it is determined that the force direction is from top to bottom, determining the target display position of the UI interface to be below the field of view angle;

[0020] When it is determined that the force direction is from bottom to top, the target display position of the UI interface is determined to be above the field of view angle.

[0021] Optionally, the method further includes:

[0022] When a display instruction of the display UI interface is detected, determining the current scene of the smart glasses;

[0023] If the current scene of the smart glasses is the target scene, determining the force direction of the pressure corresponding to the display instruction;

[0024] If the scene currently located by the smart glasses is a non-target scene, the UI interface is displayed in the middle position of the field of view of the smart glasses.

[0025] Optionally, after the step of displaying the UI interface within the field of view of the smart glasses based on the target display position, the method further includes:

[0026] When the smart glasses switch from the target scene to the non-target scene, the UI interface is controlled to be displayed at the middle position of the field of view.

[0027] Optionally, the method further includes:

[0028] When the force direction is the same, but the scenes in which the smart glasses are located are different, or the UI interfaces displayed are different, the display area position of the UI interface in the field of view angle is different, wherein the display area position is within the target display position range corresponding to the force direction.

[0029] In a second aspect, an embodiment of the invention further provides a pair of smart glasses, comprising a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for realizing connection and communication between the processor and the memory, wherein when the computer program is executed by the processor, the interface control method as described in the first aspect is realized.

[0030] In a third aspect, an embodiment of the present invention further provides a storage medium for computer-readable storage, wherein the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the interface control method as described in the first aspect.

[0031] An embodiment of the present invention provides an interface control method, smart glasses and a storage medium. In the embodiment of the present application, after the smart glasses detect a display instruction to display a UI interface, the force direction of the force corresponding to the display instruction is determined, the target display position of the UI interface is determined according to the force direction, and the UI interface is displayed in the field of view angle of the smart glasses based on the target display position, thereby enabling the smart glasses to intelligently control the display position of the UI interface in the field of view angle of the smart glasses according to the direction of the force, thereby improving the flexibility of displaying the UI interface within the field of view angle; and after the user triggers the display instruction to display the UI interface, the user does not need to trigger the mobile UI interface to change the display position of the UI interface within the field of view angle. The display position of the UI interface within the field of view angle can be determined by the display instruction, thereby simplifying the process of determining the display position of the UI interface. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0033] Figure 1 This is a schematic block diagram of the structure of smart glasses provided by an embodiment of the present invention;

[0034] Figure 2 This is a flow chart of an interface control method provided by an embodiment of the present invention;

[0035] Figure 3aThis is a reference schematic diagram showing that the target display position of the UI interface in the embodiment of the present invention is on the left side of the field of view;

[0036] Figure 3b This is a reference schematic diagram showing that the target display position of the UI interface in the embodiment of the present invention is on the right side of the field of view;

[0037] Figure 3c This is a reference schematic diagram showing that the target display position of the UI interface in an embodiment of the present invention is above the field of view angle;

[0038] Figure 3d This is a reference schematic diagram showing that the target display position of the UI interface in an embodiment of the present invention is below the field of view angle;

[0039] Figure 3e This is another reference schematic diagram in which the target display position of the UI interface in an embodiment of the present invention is on the left side of the field of view. DETAILED DESCRIPTION

[0040] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0041] The flowcharts shown in the accompanying drawings are for illustrative purposes only and do not necessarily include all contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may be decomposed, combined, or partially merged, so the actual execution order may vary depending on the actual situation.

[0042] It should be understood that the terms used in this specification are only for the purpose of describing particular embodiments and are not intended to limit the present invention. As used in the specification and appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms unless the context clearly indicates otherwise.

[0043] The embodiment of the present invention provides an interface control method, smart glasses and a storage medium. The embodiment of the present invention provides a technical solution.

[0044] In an embodiment of the present invention, the smart glasses may be AR (Augmented Reality) glasses, an AR helmet, VR (Virtual Reality) glasses, or the like.

[0045] The following embodiments of the present invention are described in detail with reference to the accompanying drawings. In the absence of conflict, the following embodiments and features therein may be combined with each other.

[0046] Figure 1 This is a schematic block diagram of the structure of smart glasses provided by an embodiment of the present invention.

[0047] like Figure 1 As shown, the smart glasses 100 include a processor 101 and a memory 102 , and the processor 101 and the memory 102 are connected via a bus 103 , which is, for example, an I 2 C (Inter-integrated Circuit) bus.

[0048] Specifically, the processor 101 is used to provide computing and control capabilities to support the operation of the entire smart glasses 100. The processor 101 can be a central processing unit (CPU), and the processor 101 can also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0049] Specifically, the memory 102 may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a mobile hard disk.

[0050] Those skilled in the art will understand that Figure 1 The structure shown in the figure is merely a block diagram of a portion of the structure related to the embodiment of the present invention and does not constitute a limitation on the smart glasses to which the embodiment of the present invention is applied. Specific smart glasses may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0051] The processor 101 is configured to run a computer program stored in the memory 102 . The computer program may be provided in smart glasses. When the smart glasses execute the computer program, they implement any one of the interface control methods provided in the embodiments of the present invention.

[0052] In one embodiment, the processor is configured to run a computer program stored in the memory, and implement the following steps when executing the computer program:

[0053] After detecting a display instruction of the UI interface, determining the force direction of the pressure corresponding to the display instruction; wherein the force direction includes at least one of the following: from left to right, from right to left, from top to bottom, and from bottom to top;

[0054] The target display position of the UI interface is determined according to the force direction, and the UI interface is displayed in the field of view of the smart glasses based on the target display position.

[0055] In one embodiment, a display instruction of a display UI interface is detected by a pressure detection component;

[0056] The pressure detection component is arranged in at least one of the following ways:

[0057] The pressure detection component is provided on at least one temple of the smart glasses;

[0058] The pressure detection component is arranged on the frame of the smart glasses;

[0059] The pressure detection component is arranged on a control device connected to the smart glasses.

[0060] In one embodiment, after the step of displaying the UI interface within the field of view of the smart glasses based on the target display position, the processor is further configured to implement the following steps when executing the computer program:

[0061] When the pressure detection component detects a control instruction for controlling the UI interface in the field of view, the UI interface is controlled according to the control instruction, wherein the control instruction includes at least one of the following: an interface return instruction, a function confirmation instruction, and an interface switching instruction; different control instructions correspond to different pressure values.

[0062] In one embodiment, when executing the computer program, the processor is further configured to implement the following steps:

[0063] When the pressure value detected by the pressure detection component is greater than a preset value, a display instruction of the UI interface is triggered.

[0064] In one embodiment, the step of determining the target display position of the UI interface according to the force direction further includes:

[0065] When it is determined that the force direction is from left to right, determining the target display position of the UI interface to be to the right of the field of view angle;

[0066] When it is determined that the force direction is from right to left, determining the target display position of the UI interface to be the left of the field of view angle;

[0067] When it is determined that the force direction is from top to bottom, determining the target display position of the UI interface to be below the field of view angle;

[0068] When it is determined that the force direction is from bottom to top, the target display position of the UI interface is determined to be above the field of view angle.

[0069] In one embodiment, when executing the computer program, the processor is further configured to implement the following steps:

[0070] When a display instruction of the display UI interface is detected, determining the current scene of the smart glasses;

[0071] If the current scene of the smart glasses is the target scene, determining the force direction of the pressure corresponding to the display instruction;

[0072] If the scene currently located by the smart glasses is a non-target scene, the UI interface is displayed in the middle position of the field of view of the smart glasses.

[0073] In one embodiment, after the step of displaying the UI interface within the field of view of the smart glasses based on the target display position, the processor is further configured to implement the following steps when executing the computer program:

[0074] When the smart glasses switch from the target scene to the non-target scene, the UI interface is controlled to be displayed at the middle position of the field of view.

[0075] In one embodiment, when the force direction is the same, but the scenes in which the smart glasses are located are different, or the UI interfaces displayed are different, the display area position of the UI interface in the field of view angle is different, wherein the display area position is within the target display position range corresponding to the force direction.

[0076] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the smart glasses described above can refer to the corresponding process in the following interface control method embodiment, and will not be repeated here.

[0077] The following will be combined Figure 1 The smart glasses in the embodiment of the present invention provide a detailed introduction to the interface control method. Figure 1 The smart glasses are only used to explain the interface control method provided in the embodiment of the present invention, but do not constitute a limitation on the application scenarios of the interface control method provided in the embodiment of the present invention.

[0078] See also Figure 2 , Figure 2 It is a flow chart of an interface control method provided by an embodiment of the present invention.

[0079] like Figure 2 As shown, the interface control method is applied to smart glasses, and the interface control method includes step S101 and step S102.

[0080] Step S101: After detecting a display instruction of a UI interface, determine the force direction of the pressure corresponding to the display instruction; wherein the force direction includes at least one of the following: from left to right, from right to left, from top to bottom, and from bottom to top.

[0081] When the smart glasses detect a display instruction to display a UI interface, they determine the direction of the pressure corresponding to the display instruction. The force direction is the direction of the pressure applied by the user to the smart glasses or other device when triggering the display instruction. In this embodiment, the force direction includes at least one of the following: from left to right, from right to left, from top to bottom, and from bottom to top. In this embodiment, the UI interface corresponding to the display instruction can be the main interface or another interface pre-set by the user, such as the interface of an application.

[0082] In one embodiment, a display instruction of the UI interface is detected by a pressure detection component.

[0083] In one embodiment, a display instruction for displaying a UI interface can be detected by a pressure detection component. The pressure detection component is a component that can detect the magnitude of pressure triggered by the user, such as an electromagnetic pressure sensor, a resistive pressure sensor, a capacitive pressure sensor, etc. The pressure detection component can be set on the smart glasses or on a control device connected to the smart glasses. The control device can be a ring or other type of control device. When the pressure detection component is set on the control device, when the control device detects a user's touch operation based on the pressure detection component, the control device will generate a display instruction based on the touch operation and send the display instruction to the smart glasses. The display instruction will carry direction information of the pressure corresponding to the touch operation. Based on this direction information, it can be determined whether the force direction of the pressure corresponding to the display instruction is from left to right, from right to left, from top to bottom, or from bottom to top. When the pressure detection component is set on the smart glasses, the pressure detection component can be set on one of the temples of the smart glasses, or on both temples of the smart glasses, or on the frame of the smart glasses. In this embodiment, the specific setting position of the pressure detection component in the smart glasses and the control device is not limited, and the setting position only needs to be convenient for user touch.

[0084] As can be seen, in the disclosed embodiments, the pressure detection assembly can be configured in at least one of the following ways: the pressure detection assembly can be configured on at least one temple of the smart glasses; the pressure detection assembly can be configured on the frame of the smart glasses; or the pressure detection assembly can be configured on a control device connected to the smart glasses. Providing multiple configuration options for the pressure detection assembly allows smart glasses manufacturers to configure the pressure detection assembly as needed, thereby increasing flexibility in the configuration of the pressure detection assembly.

[0085] It is understandable that the different pressure detection components have different methods for detecting the direction of force. For example, when the pressure detection component is a capacitive pressure sensor, the corresponding direction of the horizontal electrode (row) can be set to the x-axis, and the x-axis corresponds to the left and right direction. The corresponding direction of the longitudinal electrode (column) is set to the y-axis (up and down), and the y-axis corresponds to the up and down direction. When the user operates on the pressure detection component, that is, when the force is triggered, the pressure detection component will detect the pressure effect. At this time, the order of capacitance change of the row / column electrodes is detected. If the left electrode triggers the capacitance change first and the right side triggers later, it indicates that the force direction is from left to right; if the upper electrode triggers first and the lower side triggers later, it indicates that the force direction is from top to bottom; if the left electrode triggers the capacitance change later and the right side triggers first, it indicates that the force direction is from right to left; if the upper electrode triggers later and the lower side triggers first, it indicates that the force direction is from bottom to top. If the pressure detection component is a piezoresistive pressure sensor, the distributed piezoresistive element array corresponding to the piezoresistive pressure sensor can be used to detect the movement trajectory of pressure in the xy plane: if the pressure triggers elements A(x1, y1) → B(x2, y2) in sequence and x2>x1, the force direction is from left to right; if y2>y1, the force direction is from top to bottom, where A and B are the two pressure application points in the xy plane. This embodiment does not specifically limit the method for detecting force direction. During application, reference can be made to the methods for determining force direction in related technical fields.

[0086] In one embodiment, the method further comprises:

[0087] When the pressure value detected by the pressure detection component is greater than a preset value, a display instruction of the UI interface is triggered.

[0088] In one embodiment, when the pressure value detected by the pressure detection component of the smart glasses is greater than a preset value, the smart glasses trigger a display instruction for displaying a UI interface. The preset value can be set as needed, and this embodiment does not limit the specific size of the preset value. When the pressure value detected by the pressure detection component of the smart glasses is less than or equal to the preset value, the smart glasses do not trigger a display instruction for displaying the UI interface. It is understandable that at this time, the smart glasses do not respond to the touch operation triggered by the user on the pressure detection component, or execute other functional instructions corresponding to the touch operation.

[0089] In this embodiment, the smart glasses trigger the display instruction of the UI interface only when the pressure value detected by the pressure detection component is greater than the preset value, thereby reducing the false touch rate of the display instruction triggering.

[0090] Step S102: determining a target display position of the UI interface according to the force direction, and displaying the UI interface in the field of view of the smart glasses based on the target display position.

[0091] After the smart glasses determine the direction of the pressure detected by the pressure detection component, they determine the target display position of the UI interface based on the force direction and display the UI interface within the field of view of the smart glasses based on the target display position. In this embodiment, each different force direction can be set to a different display position; alternatively, each two force directions can be set to correspond to a display position, such as left-to-right and right-to-left corresponding to a display position, and top-to-bottom and bottom-to-top corresponding to a display position.

[0092] In one embodiment, the step of determining the target display position of the UI interface according to the force direction further includes:

[0093] When it is determined that the force direction is from left to right, determining the target display position of the UI interface to be to the right of the field of view angle;

[0094] When it is determined that the force direction is from right to left, determining the target display position of the UI interface to be the left of the field of view angle;

[0095] When it is determined that the force direction is from top to bottom, determining the target display position of the UI interface to be below the field of view angle;

[0096] When it is determined that the force direction is from bottom to top, the target display position of the UI interface is determined to be above the field of view angle.

[0097] In one embodiment, if each different force direction corresponds to a different display position, the process of determining the target display position of the UI interface based on the force direction may be as follows: when the smart glasses determine that the force direction is from left to right, the smart glasses determine that the target display position of the UI interface is to the right of the field of view angle. The right of the field of view angle may also be any position to the right of the field of view angle, such as the middle position to the right of the field of view angle or the upper right corner. When the smart glasses determine that the force direction is from right to left, the smart glasses determine that the target display position of the UI interface is to the left of the field of view angle; when the smart glasses determine that the force direction is from top to bottom, the target display position of the UI interface is determined to be below the field of view angle; when the smart glasses determine that the force direction is from bottom to top, the smart glasses determine that the target display position of the UI interface is above the field of view angle. The target display position is the display position of the UI interface in the field of view angle.

[0098] In this embodiment, when the center point of the UI interface is to the right of the center point of the field of view, it can be determined that the UI interface is displayed on the right side of the field of view; when the center point of the UI interface is to the left of the center point of the field of view, it can be determined that the UI interface is displayed on the left side of the field of view; when the center point of the UI interface is above the field of view, it can be determined that the UI interface is displayed above the field of view; when the center point of the UI interface is below the field of view, it can be determined that the UI interface is displayed below the field of view. It is understandable that in a certain scenario, the UI interface can be displayed both above and to the right of the field of view, and the specific display rules can be set as needed.

[0099] In one embodiment, referring to FIG. Figure 3b A reference diagram showing that the target display position of the UI interface is on the right side of the field of view; Figure 3a A reference diagram showing that the target display position of the UI interface is on the left side of the field of view; Figure 3c A reference diagram showing the target display position of the UI interface above the field of view angle; Figure 3d A reference diagram showing the target display position of the UI interface below the field of view. Figure 3a-3d It can be seen that one of the sides of the target display position may or may not coincide with one of the sides of the field of view angle.

[0100] In this embodiment, after the smart glasses detect a display instruction to display the UI interface, they determine the force direction of the pressure corresponding to the display instruction, determine the target display position of the UI interface according to the force direction, and display the UI interface in the field of view of the smart glasses based on the target display position, thereby enabling the smart glasses to intelligently control the display position of the UI interface in the field of view of the smart glasses according to the direction of pressure, thereby improving the flexibility of displaying the UI interface within the field of view; and after the user triggers the display instruction to display the UI interface, the user does not need to trigger the mobile UI interface to change the display position of the UI interface within the field of view, and the display position of the UI interface within the field of view can be determined by the display instruction, thereby simplifying the process of determining the display position of the UI interface.

[0101] In one embodiment, after step S102, the method further includes:

[0102] When the pressure detection component detects a control instruction for controlling the UI interface in the field of view, the UI interface is controlled according to the control instruction, wherein the control instruction includes at least one of the following: an interface return instruction, a function confirmation instruction, and an interface switching instruction; different control instructions correspond to different pressure values.

[0103] In one embodiment, after the UI interface is displayed in the field of view of the smart glasses, the smart glasses again detect whether the pressure detection component has received a control instruction for controlling the UI interface. After the smart glasses detect the control instruction for controlling the UI interface based on the pressure detection component, the smart glasses control the UI interface according to the control instruction, wherein the control instruction detected by the pressure detection component includes at least one of the following: an interface return instruction, a function confirmation instruction, and an interface switching instruction; different control instructions correspond to different pressure values. The interface return instruction is to return to the previous UI interface, the function confirmation instruction is to confirm the start of a certain function, such as the function confirmation instruction can be an instruction to confirm playing music, or an instruction to confirm making a phone call, etc. The interface switching instruction is to switch to the next level page, for example, if you are currently reading a novel page, you can switch to the next page of the current page through the interface switching instruction.

[0104] In one embodiment, after the smart glasses display a UI interface, if the pressure detection component does not detect the user's touch pressure on the pressure detection component after a preset time period, the smart glasses generate an interface return instruction, wherein the preset time period can be set according to specific needs, such as 3 seconds, 5 seconds, or 6 seconds. It is understandable that the pressure value detected by the pressure detection component at this time is 0.

[0105] When the smart glasses display the UI interface, if the pressure detection component detects that the pressure of the user touching the pressure detection component is within the first pressure value range, the smart glasses generate a function confirmation instruction; if the pressure detection component detects that the pressure of the user touching the pressure detection component is within the second pressure value range, the smart glasses generate an interface switching instruction. The maximum value corresponding to the first pressure value range is less than the minimum value of the second pressure value range, that is, the pressure corresponding to the first pressure value range is the user lightly pressing the pressure detection component, and the pressure corresponding to the second pressure value range is the user heavily pressing the pressure detection component. The light pressure and heavy pressure here are relative. The pressure value corresponding to the display instruction of the UI interface can be within the first pressure value range or within the second pressure value range.

[0106] In this embodiment, after the smart glasses display the UI interface, the pressure detection component is used to control the display of the UI interface, thereby performing interface switching, function response, etc. The displayed UI interface is controlled by the same pressure detection component that displays the UI interface in the field of view, that is, multi-faceted control of the UI interface is achieved through one component.

[0107] In one embodiment, the method further includes: upon detecting a display instruction for displaying a UI interface, determining a current scene of the smart glasses;

[0108] If the current scene of the smart glasses is the target scene, determining the force direction of the pressure corresponding to the display instruction;

[0109] If the scene currently located by the smart glasses is a non-target scene, the UI interface is displayed in the middle position of the field of view of the smart glasses.

[0110] In one embodiment, when the smart glasses detect a display instruction to display a UI interface, the smart glasses determine the current scene they are in and determine whether the current scene is a target scene. In this embodiment, the target scene is a scene in which the user needs to view other things while wearing the smart glasses, and the display of the UI interface cannot obstruct the user's viewing of other things. For example, when the smart glasses are AR glasses, when the user wears the AR glasses, in scenes such as sports scenes and walking scenes, the user may need to view real-world objects through the AR glasses. Therefore, it is not convenient to display the UI interface in the middle of the field of view to prevent the display of the UI interface from interfering with the user's viewing of real-world objects.

[0111] If the scene the smart glasses are currently in is the target scene, the smart glasses determine the force direction of the pressure corresponding to the display command, and determine the target display position of the UI interface based on the force direction. Based on this target display position, the UI interface is displayed in the field of view of the smart glasses. If the scene the smart glasses are currently in is not the target scene, the smart glasses display the UI interface in the middle of the field of view.

[0112] In this embodiment, if the scene currently located in the smart glasses is a target scene, the smart glasses determine the display position of the UI interface in the field of view angle according to the force direction, thereby controlling the display position of the UI interface in the field of view angle according to the force direction; if the scene currently located in the smart glasses is a non-target scene, the smart glasses directly display the UI interface in the middle position of the field of view angle, thereby achieving, in a specific scenario, in order to facilitate the user to view real-world objects through the smart glasses, the display of the UI interface in the field of view angle is controlled according to the force direction, and when the smart glasses do not need to view real-world objects or the display of the UI interface will not affect the user's viewing of real-world objects through the smart glasses, the smart glasses directly display the UI interface in the middle position of the field of view angle, thereby providing a variety of UI interface display methods, and further improving the flexibility of UI interface display.

[0113] In one embodiment, after the step of displaying the UI interface within the field of view of the smart glasses based on the target display position, the method further includes:

[0114] When the smart glasses switch from the target scene to the non-target scene, the UI interface is controlled to be displayed at the middle position of the field of view.

[0115] In one embodiment, when the smart glasses switch from a target scene to a non-target scene, the smart glasses control the UI interface to be displayed in the middle position of the field of view angle, that is, the display position of the UI interface is controlled to change from the target display position to the middle position of the field of view angle, thereby achieving the flexibility of switching the display position of the UI interface.

[0116] In one embodiment, when the force direction is the same, but the scenes in which the smart glasses are located are different, or the UI interfaces displayed are different, the display area position of the UI interface in the field of view angle is different, wherein the display area position is within the target display position range corresponding to the force direction.

[0117] In one embodiment, when the smart glasses are in different scenes or display different UI interfaces, even if the force direction is the same, the display area position of the UI interface in the field of view is different. For example, when the force direction of the two touch operations on the pressure detection component is from right to left, but the smart glasses detect the touch operation for the first time, the scene in which the smart glasses are located is scene A. At this time, the target display position of the UI interface is as follows: Figure 3a As shown; when the smart glasses detect the touch operation for the second time, the scene in which the smart glasses are located is scene B, and the target display position of the UI interface is as follows; Figure 3e As shown in the figure, the display area positions corresponding to scene A and scene B are different. For example, when the direction of the touch operation force on the pressure detection component is from right to left, but the smart glasses detect the touch operation first, the UI interface to be displayed is interface a. At this time, the target display position of the UI interface is as follows: Figure 3a When the glasses detect the touch operation for the second time, the UI interface to be displayed is interface b. At this time, the target display position of the UI interface is as follows: Figure 3e As shown in the figure, it can be seen that the display area positions corresponding to interface a and interface b are different. It can be understood that the pressure values ​​corresponding to the two touch operations are different, or the first is a single-click touch operation and the second is a double-click touch operation. Through the above description, it can be seen that the display area position is within the target display position range corresponding to the force direction. That is, although the smart glasses are in different scenes or the displayed UI interfaces are different, when the force direction is from left to right, the target display position of the UI interface is all to the right of the field of view angle, only the specific display area position is different; when the force direction is from top to bottom, the target display position of the UI interface is all below the field of view angle, only the specific display area position is different. In this embodiment, the different UI interfaces can be different UI interfaces or different types of UI interfaces. The type of UI interface can be pre-set, and this embodiment does not limit this.

[0118] This embodiment improves the flexibility of displaying the UI interface within the field of view angle by different display area positions of the UI interface in the field of view angle when the force direction is the same but the smart glasses are in different scenes or the displayed UI interfaces are different. This avoids the situation where the display position of the UI interface within the field of view angle is fixed in any scene or when any UI interface is displayed when the force direction is fixed.

[0119] An embodiment of the present invention further provides a storage medium for computer-readable storage, wherein the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement any interface control method provided in the description of the embodiment of the present invention.

[0120] The storage medium may be the internal storage unit of the smart glasses described in the aforementioned embodiment, such as a hard disk or memory of the smart glasses. The storage medium may also be an external storage device of the smart glasses, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc., equipped on the smart glasses.

[0121] It will be appreciated by those skilled in the art that all or some of the steps, systems, and functional modules / units in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In a hardware embodiment, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As is well known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable, and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those skilled in the art that communication media generally embodies computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0122] It should be understood that the term "and / or" used in the present specification and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, including these combinations. It should be noted that, in this article, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system that includes a series of elements includes not only those elements, but also includes other elements that are not explicitly listed, or also includes elements that are inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "including a..." does not exclude the presence of other identical elements in the process, method, article or system that includes the element.

[0123] The serial numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments. The above description is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be included in the scope of protection of the present invention. Therefore, the scope of protection of the present invention shall be based on the scope of protection of the claims.

Claims

1. An interface control method, characterized in that: The method is applied to smart glasses, and the method includes: After detecting a display instruction of the UI interface, determining the force direction of the pressure corresponding to the display instruction; wherein the force direction includes at least one of the following: from left to right, from right to left, from top to bottom, and from bottom to top; The target display position of the UI interface is determined according to the force direction, and the UI interface is displayed in the field of view of the smart glasses based on the target display position.

2. The interface control method according to claim 1, characterized in that: Detect the display instructions of the UI interface through the pressure detection component; The pressure detection component is arranged in at least one of the following ways: The pressure detection component is provided on at least one temple of the smart glasses; The pressure detection component is arranged on the frame of the smart glasses; The pressure detection component is arranged on a control device connected to the smart glasses.

3. The interface control method according to claim 2, characterized in that: After the step of displaying the UI interface within the field of view of the smart glasses based on the target display position, the method further includes: When the pressure detection component detects a control instruction for controlling the UI interface in the field of view, the UI interface is controlled according to the control instruction, wherein the control instruction includes at least one of the following: an interface return instruction, a function confirmation instruction, and an interface switching instruction; different control instructions correspond to different pressure values.

4. The interface control method according to claim 2, characterized in that: The method further comprises: When the pressure value detected by the pressure detection component is greater than a preset value, a display instruction of the UI interface is triggered.

5. The interface control method according to claim 1, characterized in that: The step of determining the target display position of the UI interface according to the force direction further includes: When it is determined that the force direction is from left to right, determining the target display position of the UI interface to be to the right of the field of view angle; When it is determined that the force direction is from right to left, determining the target display position of the UI interface to be the left of the field of view angle; When it is determined that the force direction is from top to bottom, determining the target display position of the UI interface to be below the field of view angle; When it is determined that the force direction is from bottom to top, the target display position of the UI interface is determined to be above the field of view angle.

6. The interface control method according to claim 1, characterized in that: The method further comprises: When a display instruction of the display UI interface is detected, determining the current scene of the smart glasses; If the scene currently located by the smart glasses is the target scene, determining the force direction of the pressure corresponding to the display instruction; If the scene currently located by the smart glasses is a non-target scene, the UI interface is displayed in the middle position of the field of view of the smart glasses.

7. The interface control method according to claim 6, characterized in that: After the step of displaying the UI interface within the field of view of the smart glasses based on the target display position, the method further includes: When the smart glasses switch from the target scene to the non-target scene, the UI interface is controlled to be displayed at the middle position of the field of view.

8. The interface control method according to any one of claims 1 to 7, characterized in that: The method further comprises: When the force direction is the same, but the scenes in which the smart glasses are located are different, or the UI interfaces displayed are different, the display area position of the UI interface in the field of view angle is different, wherein the display area position is within the target display position range corresponding to the force direction.

9. A pair of smart glasses, characterized in that: The smart glasses include a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for realizing connection and communication between the processor and the memory, wherein when the computer program is executed by the processor, the interface control method according to any one of claims 1 to 8 is implemented.

10. A storage medium for computer-readable storage, characterized in that: The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the interface control method according to any one of claims 1 to 8.

Images