Intelligent glasses mode switching method and device, computer equipment and storage medium

Through the environment and field of view detection of smart glasses, the modes are automatically identified and switched, which solves the problem of poor flexibility in switching modes of smart glasses and improves the user experience.

CN119024953APending Publication Date: 2024-11-26ZHUHAI MOJIE TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310590830.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-23
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The flexibility of switching smart glasses mode is poor, resulting in poor user experience, requiring manual selection and switching, and unable to adapt to the functional needs of scene changes.

Method used

By detecting the wearing status of smart glasses, obtaining the current usage scenario and mode, automatically identifying the target mode, and switching when it does not match, including environmental detection, field of view detection and head motion information analysis, to achieve automatic mode switching.

Benefits of technology

It improves the accuracy of smart glasses pattern recognition and the flexibility of switching, reduces the error of users' subjective judgment, and enhances the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119024953A_ABST
    Figure CN119024953A_ABST
Patent Text Reader

Abstract

The invention provides an intelligent glasses mode switching method and device, equipment and a storage medium, and the method comprises the steps: firstly obtaining a current use scene and a current glasses mode of the intelligent glasses when a user wears the intelligent glasses, and automatically recognizing a target glasses mode corresponding to the current scene according to the current use scene; and judging whether the current glasses mode of the intelligent glasses is matched with the current use scene or not. And when the current glasses mode is not matched with the current use scene, the glasses modes of the intelligent glasses are automatically switched, so that the accuracy of mode recognition and the flexibility of mode switching of the intelligent glasses are improved, meanwhile, errors caused by insufficient experience during subjective judgment of the user are reduced, and the use experience of the user is enhanced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of smart wearable technology, and in particular to a method, device, equipment and storage medium for switching modes of smart glasses. Background Art

[0002] Smart glasses are wearable smart electronic devices with independent operating systems. They can be controlled by voice or motion to take pictures, watch videos, play games, and make calls, for example, AR glasses and VR glasses.

[0003] Augmented Reality (AR) technology is a technology that cleverly integrates virtual information with the real world. It widely uses a variety of technical means such as multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, and sensing to simulate computer-generated text, images, three-dimensional models, music, videos and other virtual information, and apply them to the real world. The two types of information complement each other, thereby achieving "enhancement" of the real world. Among them, AR glasses are a wearable smart electronic product designed and produced based on augmented reality technology. By wearing AR glasses, users can not only see actual objects in reality, but also see virtual objects or images that appear in real scenes.

[0004] VR glasses use head-mounted display devices to block people's vision and hearing to the outside world, guiding users to create a feeling of being in a virtual environment. The display principle is that the left and right eye screens display the images of the left and right eyes respectively. After the human eye obtains this different information, a sense of three-dimensionality is created in the mind.

[0005] However, although current smart glasses have the function of selecting and switching the glasses mode, users need to select and switch manually. And when users use smart glasses, the usage scenarios may change, which may cause the user's functional requirements for smart glasses to change accordingly. Therefore, the current smart glasses mode switching flexibility is poor, which reduces the user experience. Summary of the invention

[0006] The present application provides a smart glasses mode switching method, device, equipment and storage medium, aiming to improve the switching flexibility of smart glasses modes and enhance the user experience.

[0007] In a first aspect, the present application provides a smart glasses mode switching method, comprising:

[0008] When detecting that the smart glasses are in a wearing state, obtaining a current usage scenario and a current glasses mode of the smart glasses;

[0009] Determining a target eyewear mode corresponding to the current usage scenario;

[0010] When the target glasses mode is different from the current glasses mode, the glasses mode of the smart glasses is switched from the current glasses mode to the target glasses mode.

[0011] In a second aspect, the present application also provides a smart glasses mode switching device, comprising:

[0012] A current usage scenario acquisition module, used to acquire the current usage scenario and current glasses mode of the smart glasses when detecting that the smart glasses are in a wearing state;

[0013] A target glasses mode determination module, used to determine a target glasses mode corresponding to the current usage scenario;

[0014] The glasses mode switching module is used to switch the glasses mode of the smart glasses from the current glasses mode to the target glasses mode when the target glasses mode is different from the current glasses mode.

[0015] In a third aspect, the present application also provides a computer device, comprising a processor, a memory, and a computer program stored in the memory and executable by the processor, wherein when the computer program is executed by the processor, the steps of the smart glasses mode switching method as described above are implemented.

[0016] In a fourth aspect, the present application also provides a computer-readable storage medium, on which a computer program is stored, wherein when the computer program is executed by a processor, the steps of the smart glasses mode switching method as described above are implemented.

[0017] The present invention provides a method, device, equipment and storage medium for switching modes of smart glasses. The method includes: when detecting that the smart glasses are in a wearing state, obtaining the current use scenario and the current glasses mode of the smart glasses; determining the target glasses mode corresponding to the current use scenario; when the target glasses mode is different from the current glasses mode, switching the glasses mode of the smart glasses from the current glasses mode to the target glasses mode. In the above manner, when the user wears the smart glasses, the current use scenario and the current glasses mode of the smart glasses are first obtained, and the target glasses mode corresponding to the current scene can be automatically identified according to the current use scenario, so as to determine whether the current glasses mode of the smart glasses matches the current use scenario. And when the current glasses mode does not match the current use scenario, the glasses mode of the smart glasses is automatically switched, so as to improve the accuracy of the smart glasses mode recognition and the flexibility of the mode switching, and at the same time reduce the error caused by the lack of experience in the subjective judgment of the user, and enhance the user's use experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0019] Figure 1 A schematic diagram of a flow chart of a first embodiment of a method for switching modes of smart glasses provided in an embodiment of the present application;

[0020] Figure 2 A schematic diagram of a flow chart of a method for switching modes of smart glasses based on field of view detection provided in an embodiment of the present application;

[0021] Figure 3 A schematic diagram of a flow chart of a second embodiment of a method for switching modes of smart glasses provided in an embodiment of the present application;

[0022] Figure 4 A schematic diagram of a flow chart of a third embodiment of a method for switching modes of smart glasses provided in an embodiment of the present application;

[0023] Figure 5 A schematic diagram of a flow chart of a fourth embodiment of a method for switching modes of smart glasses provided in an embodiment of the present application;

[0024] Figure 6 A schematic diagram of a flow chart of a method for switching modes of smart glasses based on head motion information detection provided in an embodiment of the present application;

[0025] Figure 7 A schematic diagram of a flow chart of a fifth embodiment of a method for switching modes of smart glasses provided in an embodiment of the present application;

[0026] Figure 8 A flowchart of a sixth embodiment of a method for switching modes of smart glasses provided in an embodiment of the present application;

[0027] Fig. 9 It is a structural schematic diagram of a first embodiment of a smart glasses mode switching device provided by the present application;

[0028] Fig.10 It is a schematic block diagram of the structure of a computer device provided in an embodiment of the present application.

[0029] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0030] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0031] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0032] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0033] Please refer to Figure 1 , Figure 1 A flowchart of a first embodiment of a method for switching modes of smart glasses provided in an embodiment of the present application.

[0034] like Figure 1 As shown, the recharging method includes steps S101 to S103.

[0035] Step S101: when it is detected that the smart glasses are in a wearing state, the current usage scenario and the current glasses mode of the smart glasses are obtained.

[0036] In one embodiment, smart glasses may include smart electronic products such as AR glasses and VR glasses. Among them, AR glasses are a wearable smart electronic product designed and produced based on augmented reality technology. By wearing AR glasses, users can not only see actual objects in reality, but also see virtual objects or images that appear in real scenes. VR glasses use head-mounted display devices to block people's vision and hearing to the outside world, guiding users to have a feeling of being in a virtual environment. The display principle is that the left and right eye screens display the images of the left and right eyes respectively, and the human eye obtains this different information and produces a three-dimensional sense in the mind.

[0037] In one embodiment, when a user wears smart glasses, the environment detection module detects the user's current environment and determines the user's current usage scenario of the smart glasses, so as to determine the user's current functional requirements for using the smart glasses.

[0038] In one embodiment, the environment detection module can determine the current usage scenario of the user's smart glasses based on the detected specific objects, sounds, and lights. For example, when the environment detection module detects a desk, a bookshelf, and the surrounding environment is relatively quiet, it is determined that the user's current environment is a quiet scene, such as reading in a library or reading room, etc. At this time, it can be determined that the user currently needs the smart glasses to switch to a quieter usage mode or function, such as a reading mode, an eye protection function, etc.; when the environment detection module detects that fitness equipment or someone around the user is exercising, and the user's field of vision scene moves regularly, it can be determined that the user is also currently exercising, etc. At this time, it can be determined that the user currently needs the smart glasses to switch to a usage mode or function suitable for exercise, such as exercise mode or playing some songs suitable for exercise.

[0039] In one embodiment, the current glasses mode of the smart glasses is obtained to determine whether the current glasses mode matches the current usage scenario, so as to determine whether the mode of the smart glasses needs to be switched.

[0040] In one embodiment, the usage data of the smart glasses in different glasses modes are different, so the current usage mode of the smart glasses can be determined by reading and analyzing the real-time usage data of the smart glasses. Or when the smart glasses are enabled, the glasses mode function module of the smart glasses is directly accessed to read the current glasses mode information.

[0041] In one embodiment, when the user wears the smart glasses, he or she can actively start the smart glasses by pressing buttons, touching, clicking, etc., thereby generating a start-up operation instruction for the smart glasses.

[0042] In one embodiment, when the user wears the smart glasses, the user's intention to use the smart glasses can also be determined through a sensor or a detection module, thereby activating the smart glasses.

[0043] For example, the temperature of the head can be detected by a temperature sensor, and the smart glasses can be started when the head temperature reaches a preset temperature threshold; or the pressure when the smart glasses are worn can be detected by a pressure sensor, and the smart glasses can be started when the force reaches a preset pressure; or the iris information can be detected by an iris recognition module, and the smart glasses can be started when the iris information of the user's eyes is detected; or the user's fingerprint information can be detected by a fingerprint recognition sensor, and the smart glasses can be started when the user's fingerprint information is recognized; or the leg angle of the smart glasses can be detected, and the smart glasses can be started when the angle reaches a preset angle, etc.

[0044] Step S102: determining a target glasses mode corresponding to the current usage scenario.

[0045] In one embodiment, before using the smart glasses, usage scenarios applicable to different glasses modes can be set and stored in the smart glasses in the form of a database or table.

[0046] In one embodiment, when the current usage scenario is obtained, the preset usage scenario matching the current usage scenario is determined by comparing the current usage scenario with the preset usage scenario, and then the target glasses mode corresponding to the current usage scenario is determined.

[0047] In one embodiment, the preset usage scenario may be a specific scenario or environment, such as a library, a gym, or a dimly lit room.

[0048] In one embodiment, the preset usage scenario may also be a user action scenario. User actions corresponding to each eyewear mode may be set, such as gestures and head movements. When a specific gesture / head movement is detected, the eyewear mode corresponding to the action is determined as the target eyewear mode.

[0049] Step S103: When the target glasses mode is different from the current glasses mode, switching the glasses mode of the smart glasses from the current glasses mode to the target glasses mode.

[0050] In one embodiment, when it is detected that the target glasses mode corresponding to the current usage environment is the same as the current glasses mode of the smart glasses, the current glasses mode is maintained.

[0051] In one embodiment, when it is detected that the target glasses mode is different from the current glasses mode, a glasses mode switching instruction is triggered and generated, and the glasses mode of the smart glasses is automatically switched to the target glasses mode to adapt to the functional requirements of the smart glasses in the current usage scenario and enhance the user's usage experience.

[0052] The embodiment of the present application provides a method for switching the modes of smart glasses. When the user wears the smart glasses, the method first obtains the current usage scenario and the current glasses mode of the smart glasses, and can automatically identify the target glasses mode corresponding to the current scenario according to the current usage scenario, thereby determining whether the current glasses mode of the smart glasses matches the current usage scenario. When the current glasses mode does not match the current usage scenario, the glasses mode of the smart glasses is automatically switched, thereby improving the accuracy of smart glasses mode recognition and the flexibility of mode switching, while reducing the errors caused by lack of experience in the user's subjective judgment, and enhancing the user's usage experience.

[0053] In one embodiment, the glasses mode of the smart glasses may include a fixed field of view mode and a screen following mode. In the fixed field of view mode, the screen field of view does not change, and the displayed image is always the captured image in the same direction; in the screen following mode, the screen field of view moves synchronously with the user's field of view shift or head deflection, and the field of view image is updated in real time to the image in the direction of the user's field of view.

[0054] like Figure 2 As shown, when the user wears smart glasses, the current usage scenario and current glasses mode of the smart glasses can be detected by the visual field detection module. Then, the visual field movement behavior is detected by the visual field detection module to determine the target glasses mode corresponding to the visual field movement behavior, and then combined with the current glasses mode, it is determined whether the glasses mode needs to be switched.

[0055] Please refer to Figure 3 , Figure 3 A flowchart of a second embodiment of a method for switching modes of smart glasses provided in an embodiment of the present application.

[0056] like Figure 3 As shown, based on the above Figure 1 In the illustrated embodiment, step S102 specifically includes:

[0057] Step S201: when the current glasses mode is a fixed field of view mode, detecting a field of view movement range of the current user, and when the field of view movement range exceeds a first threshold, determining that the target glasses mode is a screen following mode;

[0058] In one embodiment, each time the smart glasses are used, the glasses mode used when they were last turned off can be used. That is, when the smart glasses are turned on again, they can directly enter the glasses mode used when they were last turned off.

[0059] In one embodiment, the smart glasses may also be set to a default glasses mode, that is, each time the smart glasses are turned on and used, they are directly switched to the default glasses mode. The default glasses mode may be any glasses mode in the smart glasses, for example, the default glasses mode of the smart glasses may be set to a fixed field of view mode, and each time the smart glasses are turned on, the smart glasses are switched to the fixed field of view mode by default.

[0060] In one embodiment, the current glasses mode may be the glasses mode used when the smart glasses were last turned off, or the default glasses mode used when the smart glasses are turned on, or the glasses mode selected by the user when using the smart glasses.

[0061] In one embodiment, in the fixed field of view mode, the user interface does not change orientation as the user's head rotates.

[0062] In one embodiment, when the current glasses mode is a fixed field of view mode, the field of view movement range of the current user is detected, and when it is detected that the field of view movement range of the current user exceeds a first threshold, the target glasses mode is determined to be a screen following mode, and the glasses mode of the smart glasses is switched to the screen following mode.

[0063] The visual field movement range exceeding the first threshold value means that the visual field movement range of the current user is equal to or greater than the first threshold value. In the embodiment of the present disclosure, the visual field movement range can be an angle value, such as 30 degrees, 60 degrees, etc.

[0064] In one embodiment, the current user's visual field movement range can be detected by detecting the user's head deflection angle, and a head deflection mark can be set, such as a frame that is reduced in proportion to the current visual field of the screen, or a cross mark, etc. When the user looks straight ahead, the center of the head deflection mark coincides with the center of the screen of the smart glasses, and the visual field detection range deflects synchronously with the user's head deflection.

[0065] In one embodiment, the first threshold may be the current field of view of the screen.

[0066] In one embodiment, when the head deflection mark is a frame that is reduced in proportion to the current visual field of the screen, the current visual field of the screen can be used as the first threshold. When it is detected that the frame exceeds the edge of the current visual field of the screen, that is, when the visual field movement range exceeds the edge position of the current visual field, the target glasses mode is determined to be the screen following mode.

[0067] For example, the head deflection mark can be set to the frame range of the display screen of the smart glasses that is proportionally reduced. When the user looks straight ahead, the center point of the frame range coincides with the center point of the display screen of the smart glasses. In the fixed field of view mode, the display screen of the smart glasses will not deflect as the user's head deflects, but the head deflection mark (i.e., the frame range) deflects synchronously with the user's head. Therefore, when the user's head is detected to be deflected, the frame range will also move in the display screen. The current field of view of the display screen can be set as the first threshold. When the edge of the frame range moves outside the current field of view of the display screen, that is, when the display screen cannot be fully displayed or the frame range cannot be detected, it is considered that the field of view movement range exceeds the current field of view, thereby determining that the target glasses mode is the screen following mode.

[0068] In one embodiment, the first threshold may also be a deflection angle.

[0069] In one embodiment, when the head deflection mark is a cross mark, a deflection angle can be preset as the first threshold. When it is detected that the deflection angle between the center of the cross and the center of the current field of view of the screen exceeds the preset deflection angle, the target glasses mode is determined to be the screen following mode.

[0070] In one embodiment, in the fixed field of view mode, the current field of view of the screen may be used as the first threshold, or the edge or center position of the current field of view may be used as a basis. For example, when the edge of the current user's field of view movement range exceeds the edge or center position of the current field of view range by a certain angle or distance, the target glasses mode is determined to be the screen following mode.

[0071] In one embodiment, the timing can be started when the visual field movement range is detected to exceed the first threshold for the first time, and the number of times the visual field movement range exceeds the first threshold within a preset time period is detected. When the number of times exceeds the preset number, the target glasses mode is determined to be the screen following mode, for example, the visual field movement range exceeds the first threshold three times within 30 seconds, etc. In this way, misjudgment can be avoided and the recognition accuracy of the user's intention can be improved.

[0072] Step S202: When the current glasses mode is the screen following mode, detecting the field of view movement action of the current user, and when the field of view movement action is a preset action, determining that the target glasses mode is the fixed field of view mode.

[0073] In one embodiment, in screen following mode, when the field of view of the smart glasses exceeds the edge position, the screen content follows the field of view of the user, that is, after the user stops rotating his head, the field of view of the smart glasses screen content is reset to be in the center of the field of view.

[0074] In one embodiment, when the current glasses mode is the screen following mode, the screen of the smart glasses moves synchronously with the user's field of view, and at this time, the field of view movement action of the current user can be detected. When the field of view movement action is a preset action, it is determined that the user currently needs to switch the glasses mode to the fixed field of view mode.

[0075] In one embodiment, the visual field movement action may be a visual field movement operation, such as when the user shakes his head left and right or nods up and down, in the screen follow mode, the screen visual field moves synchronously with the user's head movement. At this time, the preset action may be set to the visual field range continuously moving left and right multiple times, moving up and down multiple times, rotating clockwise or counterclockwise, and the like. When it is detected that the user operates the screen visual field to perform the preset action, the target glasses mode is determined to be the fixed visual field mode, and then the glasses mode is switched.

[0076] In one embodiment, the preset action may be one or more, for example, continuous left and right movement of the field of view may be used as the preset action corresponding to the fixed field of view mode, and continuous up and down movement or clockwise rotation may also be used as the preset action corresponding to the fixed field of view mode. In this case, the field of view movement action is the same as any of the preset actions and can trigger the switching of the glasses mode.

[0077] In one embodiment, the preset action may also be an action formed by combining multiple actions, such as turning clockwise first, and then moving left and right.

[0078] In one embodiment, the preset action may also be a gesture of the user, such as waving, spreading five fingers, clenching a fist, etc. The field of view movement action may be a gesture made by the user within the field of view.

[0079] In this embodiment, different mode switching detection objects and actions are set in different glasses modes, so as to meet the mode switching requirements in different glasses modes and improve the flexibility of smart glasses mode switching.

[0080] Please refer to Figure 4 , Figure 4 A flowchart of a third embodiment of a method for switching modes of smart glasses provided in an embodiment of the present application.

[0081] like Figure 4 As shown, based on the above Figure 1 In the illustrated embodiment, step S102 specifically further includes:

[0082] Step S301, detecting the visual field movement range of the current user;

[0083] Step S302: when the visual field movement range exceeds a second threshold, obtaining the number of times the visual field movement range exceeds the second threshold within a first preset time period, wherein the number of times the visual field movement range exceeds the second threshold;

[0084] Step S303: When the number of exceeding times is equal to or greater than a third threshold, determine that the target glasses mode is a screen following mode.

[0085] In one embodiment, when a user uses the smart glasses for the first time, the smart glasses may not switch to any glasses mode, but may display the currently selectable glasses modes on the field of view screen and prompt the triggering actions corresponding to each glasses mode.

[0086] In one embodiment, the smart glasses can be configured to reset the glasses mode each time they are turned on, and wait for the user to select a glasses mode to be switched into.

[0087] In one embodiment, when the smart glasses are not in any glasses mode, the visual field movement range of the current user is detected. When the visual field movement range exceeds a preset second threshold, timing is started, and the number of times the visual field movement range exceeds the second threshold within a first preset time period is detected. If the number of times exceeds reaches a third threshold, the glasses mode is determined to be the screen following mode.

[0088] In one embodiment, the second threshold may be a screen range or a field of view movement deflection angle threshold.

[0089] In one embodiment, the edge of the screen range can be used as a detection basis, and the visual field movement range can be a range that is proportionally reduced from the screen range. When it is detected that the visual field movement range of the current user exceeds the edge of the screen range, the number of times the visual field movement range exceeds the edge of the screen range within a first preset time period is detected, and when the number of times exceeds reaches a third threshold, the glasses mode is determined to be the screen following mode.

[0090] For example, when it is detected that the current user's field of view movement range exceeds the edge of the screen range, the number of times the user's field of view movement range exceeds the edge of the screen range in the next 1 minute (the first preset time period) is detected. When the number of excess times reaches 3 times (the third threshold), the glasses mode is determined to be the screen following mode.

[0091] In one embodiment, the deflection angle of the visual field movement range relative to the center of the screen can be detected. When the user looks straight ahead, the center of the visual field movement range coincides with the center of the screen range, and the visual field movement range deflects synchronously with the user's visual field deflection.

[0092] In one embodiment, the second threshold value can be preset as the field of view deflection angle value, such as a field of view deflection of 45°. That is, when it is detected that the field of view deflection angle of the current user reaches or exceeds 45°, the number of times the user's field of view deflection angle reaches or exceeds 45° in the next 1 minute (the first preset time period) is detected. When the number reaches 3 times (the third threshold value), the glasses mode is determined to be the screen following mode.

[0093] It can be understood that the first preset time period and the third threshold value can be set according to actual needs.

[0094] For example, the third threshold value may be set to once, and the first preset time period is not set. At this time, when it is detected that the visual field movement range of the current user exceeds the second threshold value, the target glasses mode is determined to be the screen following mode.

[0095] Alternatively, the third threshold may be set to 2 times or more, and the first preset time period may be set to 30 seconds. In this case, when it is detected that the visual field movement range of the current user exceeds the second threshold, it is necessary to detect whether the visual field movement range exceeds the second threshold in the next 30 seconds. When the number of times exceeds the third threshold, the target glasses mode may be determined to be the screen following mode; otherwise, the current glasses mode is maintained.

[0096] In this embodiment, when the user activates the smart glasses, the user's current mode requirement for using the smart glasses is determined by detecting the user's visual field movement range when using the smart glasses. When the user's visual field movement range exceeds the second threshold, the glasses mode that the user needs to switch to is determined, and by setting the third threshold, an accurate judgment is further made, thereby avoiding the user's misoperation and triggering the mode switch, and improving the accuracy of the smart glasses mode switch.

[0097] Please refer to Figure 5 , Figure 5 A flowchart of a fourth embodiment of a method for switching modes of smart glasses provided in an embodiment of the present application.

[0098] like Figure 5 As shown, based on the above Figure 1 In the illustrated embodiment, step S102 specifically further includes:

[0099] Step S401, detecting the visual field movement action of the current user;

[0100] Step S402: when the field of view moving action is a preset action, obtaining the number of action triggering times of the current user within a second preset time period, wherein the number of action triggering times is the number of times the current user operates the preset action;

[0101] Step S403: When the number of action triggering times is equal to or greater than a fourth threshold, determining that the target glasses mode is a fixed field of view mode.

[0102] In one embodiment, when a user uses the smart glasses for the first time, the smart glasses may not switch to any glasses mode, but may display the currently selectable glasses modes on the field of view screen and prompt the triggering actions corresponding to each glasses mode.

[0103] In one embodiment, the smart glasses can be configured to reset the glasses mode each time they are turned on, and wait for the user to select a glasses mode to be switched into.

[0104] In one embodiment, when the smart glasses are not in any glasses mode, the visual field movement action of the current user can be detected, such as continuous left-right movement, continuous up-and-down movement, clockwise rotation, etc. Then, the currently detected visual field movement action is compared with the preset action, and when the visual field movement action is the preset action, the target glasses mode is determined to be the glasses mode corresponding to the preset action.

[0105] In one embodiment, the preset action may be one or more, for example, continuous left and right movement of the field of view may be used as the preset action corresponding to the fixed field of view mode, and continuous up and down movement or clockwise rotation may also be used as the preset action corresponding to the fixed field of view mode. In this case, the field of view movement action is the same as any of the preset actions and can trigger the switching of the glasses mode.

[0106] In one embodiment, the preset action may also be an action formed by combining multiple actions, such as turning clockwise first, and then moving left and right.

[0107] In one embodiment, the preset action may also be a gesture of the user, such as waving, spreading five fingers, clenching a fist, etc. The field of view movement action may be a gesture made by the user within the field of view.

[0108] It can be understood that the second preset time period and the fourth threshold value can be set according to actual needs.

[0109] In this embodiment, when the user activates the smart glasses, the user's current mode requirement for using the smart glasses is determined by detecting the user's visual field movement action when using the smart glasses. When the user's visual field movement action triggers a preset action, the glasses mode that the user needs to switch to is determined. By detecting the number of action triggers and setting a fourth threshold, an accurate judgment is further made, thereby avoiding the user's misoperation and triggering the mode switch, and improving the accuracy of the smart glasses mode switch.

[0110] In one embodiment, the smart glasses further include a focus mode, a sports mode, and a user-defined mode. Figure 6 As shown, when the user wears AR glasses, the glasses mode currently used by the smart glasses can be obtained. Then the head information of the user is detected by the head movement detection module to determine the current environment in which the user uses the smart glasses, and then determine the target glasses mode that matches the use environment. Combined with the current glasses mode and the target glasses mode of the smart glasses, determine whether the glasses mode needs to be switched. When the current glasses mode and the target glasses mode are the same, the current glasses mode is maintained; otherwise, the glasses mode of the smart glasses is switched to the target glasses mode to meet the user's use needs for the smart glasses in the current environment.

[0111] Please refer to Figure 7 , Figure 7A flowchart of a fifth embodiment of a method for switching modes of smart glasses provided in an embodiment of the present application.

[0112] like Figure 7 As shown, based on the above Figure 1 In the illustrated embodiment, step S102 specifically further includes:

[0113] Step S501, detecting the head position information of the current user;

[0114] Step S502: when it is detected that the head position information is located in a preset area, obtaining a duration for which the head position information is located in the preset area;

[0115] Step S503: when the duration reaches a preset duration, determining that the target glasses mode is a focus mode.

[0116] In one embodiment, the focus mode refers to allowing only functions applicable to the current usage scenario to be used, while blocking other functions that may interfere with the current usage scenario. For example, when a user is reading, the focus mode can allow silent notifications of certain information, such as phone calls and text messages, while blocking notifications of other information, such as message notifications from communication software.

[0117] In one embodiment, the head position information of the current user can be detected by a head motion sensor. The head position information can be fed back to the screen range of the smart glasses in the form of a field of view.

[0118] In one embodiment, when the user is reading, watching TV / movies, or working, the user's head position information may remain in the same position for a long time. At this time, the user's field of view will also remain in a fixed area and move slightly, so the head motion sensor can be used to detect the current user's field of view and head deflection angle, and the field of view moves within the screen according to the detected user's head deflection angle.

[0119] In one embodiment, a preset fixed area can be set within the screen range. When it is detected that the user's field of view is within the preset area, the timing starts and the duration of the field of view being within the preset area is recorded. When the duration reaches the preset duration, the target glasses mode is determined to be the focus mode.

[0120] For example, when it is detected that the user's head position information is located in a preset area, the timing starts. When the timing reaches five minutes, it is determined that the target glasses mode is the focus mode, and the glasses mode of the smart glasses is switched to the focus mode.

[0121] In one embodiment, when the visual field exceeds the preset area, the timing ends and is reset to zero, and the timing starts again when the visual field is completely within the preset area.

[0122] In one embodiment, the user's head coordinate information can also be directly detected, and combined with the user's environment information, the user's current usage scenario for the smart glasses can be determined. For example, if the user's head coordinate information remains unchanged for a long time or the change range is less than the preset value, and it is detected that the user's current environment is relatively quiet (such as a library, reading room, theater, viewing room, etc.), or there are specific items (such as books, computers, etc.), it can be considered that the user is currently reading or watching a movie. At this time, the glasses mode of the smart glasses can be switched to the focus mode, so that the user has a better reading or viewing experience.

[0123] In this embodiment, the user's current state is judged by detecting the relative relationship between the user's head position information and the preset area. When the user's head position information is within the preset area and lasts for a preset time, it can be judged that the user is concentrating on something, thereby switching the glasses mode of the smart glasses to the focus mode, so that the user can avoid being disturbed by unnecessary external information, allowing the user to concentrate more on current affairs, thereby improving the user's experience of using the smart glasses.

[0124] Please refer to Figure 8 , Figure 8 A flowchart of a sixth embodiment of a smart glasses mode switching method provided in an embodiment of the present application.

[0125] like Figure 8 As shown, based on the above Figure 7 In the illustrated embodiment, step S102 specifically further includes:

[0126] Step S601: when it is detected that the coordinate change of the head position information of the current user occurs, obtaining the coordinate change frequency of the head position information within a third preset time period;

[0127] Step S602: when the coordinate change frequency reaches a preset frequency, obtaining an average amplitude of the coordinate change of the head position information within the third preset time period;

[0128] Step S603: When the average amplitude of the coordinate change reaches a preset amplitude, determining that the target glasses mode is a sports mode.

[0129] In one embodiment, the sports mode refers to a glasses mode suitable for users to use during exercise. For example, during exercise, there may be large-scale and shielded image movement, such as when running. In the sports mode, image stabilization can be achieved, making the display image of the smart glasses more stable and avoiding dizziness of the user. The sports mode can also record and display the user's exercise data. For example, when running outdoors, it can also display route recommendations, kilometers, and running speed.

[0130] In one embodiment, the head coordinate information of the current user can be detected by the head motion detection module. When the head coordinate changes significantly, the coordinate change frequency of the user's head coordinate in the third preset time period is obtained. When the coordinate change frequency reaches the preset frequency, the average amplitude of the coordinate change of the user's head coordinate in the third preset time period is calculated, and when the average amplitude reaches the preset amplitude, the target glasses mode is determined to be the sports mode.

[0131] In one embodiment, the head position information of the user in different motion states can be collected to calculate the frequency of the user's head coordinate changes in different motion states as the preset frequency. And according to the head position information in each motion state, the amplitude of the user's head coordinate changes in different motion states can be calculated as the preset amplitude.

[0132] For example, when the current user is running, the head position information of the current user during the running process can be collected, and then according to the current user's running habits, the frequency and amplitude of the head coordinate changes of the current user during the running process can be determined, and then the average values ​​are calculated as the preset frequency and preset amplitude. When the user wears smart glasses, when the position coordinate changes of the user's head are detected, and the frequency and amplitude of the changes are the same as the preset frequency and preset amplitude corresponding to the user's running, it can be determined that the user is currently running. In order to improve the accuracy of the judgment, the detection time can be set. For example, when the position coordinate changes of the user's head are detected and the frequency and amplitude of the changes are maintained for more than five minutes, it can be determined that the user is currently running.

[0133] In one embodiment, when the duration of the head position information being located in the preset area does not reach the preset duration, and the frequency of the coordinate change of the head position information within the third preset time period does not reach the preset frequency, or when the duration of the head position information being located in the preset area does not reach the preset duration, and the average amplitude of the coordinate change of the head position information within the third preset time period does not reach the preset amplitude, the target glasses mode is determined to be the user-defined mode.

[0134] In this embodiment, by detecting the frequency and amplitude of changes in the user's head coordinates, the user's current sports project can be accurately judged, and the glasses mode of the smart glasses can be switched to a sports mode suitable for the user's current sports scene, so that the screen display of the smart glasses is more suitable for sports scenes, and sports auxiliary data can be displayed, so that the user can grasp his or her own exercise situation more accurately, thereby improving the user's experience of using the smart glasses.

[0135] In one embodiment, when it is detected that the head information does not meet the trigger conditions corresponding to the focus mode and the sports mode, it can be determined that the target glasses mode is the user-defined mode.

[0136] In one embodiment, the user-defined mode may be a mode in which the user sets parameters according to the functional parameters of the smart glasses, such as the screen brightness, screen size, clarity, and sound channel parameters of the smart glasses.

[0137] In one embodiment, the user-defined mode can be to provide the user with the glasses modes currently available for the smart glasses, and then the user actively selects one of the glasses modes to switch, such as no mode, focus mode, and sports mode.

[0138] In this embodiment, by providing a user-defined mode, users can have more independent settings and selections of glasses modes, so that users can achieve a customized glasses mode configuration experience, thereby making the glasses mode of the smart glasses more suitable for the user's personal needs and improving the user's usage experience.

[0139] See also Fig. 9 , Fig. 9 It is a structural schematic diagram of a first embodiment of a smart glasses mode switching device provided in the present application, and the smart glasses mode switching device is used to execute the aforementioned smart glasses mode switching method.

[0140] like Fig. 9 As shown, the smart glasses mode switching device 700 includes: a current use scene acquisition module 701, a target glasses mode determination module 702 and a glasses mode switching module 703.

[0141] The current usage scenario acquisition module 701 is used to acquire the current usage scenario and current glasses mode of the smart glasses when detecting that the smart glasses are in a wearing state;

[0142] A target glasses mode determination module 702 is used to determine a target glasses mode corresponding to the current usage scenario;

[0143] The glasses mode switching module 703 is used to switch the glasses mode of the smart glasses from the current glasses mode to the target glasses mode when the target glasses mode is different from the current glasses mode.

[0144] In one embodiment, the target glasses mode determination module 702 is further used to detect the field of view movement range of the current user when the current glasses mode is the fixed field of view mode, and determine that the target glasses mode is the screen following mode when the field of view movement range exceeds a first threshold; when the current glasses mode is the screen following mode, detect the field of view movement action of the current user, and when the field of view movement action is a preset action, determine that the target glasses mode is the fixed field of view mode.

[0145] In one embodiment, the target glasses mode determination module 702 is also used to detect the field of view movement range of the current user; when the field of view movement range exceeds a second threshold, the number of times the field of view movement range exceeds the first preset time period is obtained, wherein the number of times the field of view movement range exceeds the second threshold; when the number of times the field of view movement range exceeds the second threshold, the target glasses mode is determined to be the screen following mode.

[0146] In one embodiment, the target glasses mode determination module 702 is also used to detect the field of view movement action of the current user; when the field of view movement action is a preset action, the number of action triggers of the current user within a second preset time period is obtained, wherein the number of action triggers is the number of times the current user operates the preset action; when the number of action triggers is equal to or greater than a fourth threshold, it is determined that the target glasses mode is a fixed field of view mode.

[0147] In one embodiment, the target glasses mode determination module 702 is also used to detect the head position information of the current user; when it is detected that the head position information is within a preset area, the duration of time the head position information is within the preset area is obtained; when the duration reaches a preset duration, the target glasses mode is determined to be a focus mode.

[0148] In one embodiment, the target glasses mode determination module 702 is further used to obtain the coordinate change frequency of the head position information within a third preset time period when it is detected that the coordinate change of the head position information of the current user occurs; when the coordinate change frequency reaches the preset frequency, obtain the average coordinate change amplitude of the head position information within the third preset time period; when the average coordinate change amplitude reaches the preset amplitude, determine that the target glasses mode is a motion mode.

[0149] In one embodiment, the target glasses mode determination module 702 is further used to determine that the target glasses mode is a user-defined mode when the duration of the head position information being located in the preset area does not reach the preset duration, and the frequency of the coordinate change of the head position information within the third preset time period does not reach the preset frequency, or when the duration of the head position information being located in the preset area does not reach the preset duration, and the average amplitude of the coordinate change of the head position information within the third preset time period does not reach the preset amplitude.

[0150] It should be noted that technicians in the relevant field can clearly understand that for the convenience and conciseness of description, the specific working process of the above-described device and each module can refer to the corresponding process in the aforementioned shooting method embodiment based on the split camera module, and will not be repeated here.

[0151] The apparatus provided in the above embodiment may be implemented in the form of a computer program. The computer program may be Fig.10 Runs on the computer device shown.

[0152] See also Fig.10 , Fig.10 1 is a schematic block diagram of a computer device provided in an embodiment of the present application. The computer device may be a server.

[0153] See also Fig.10 The computer device includes a processor, a memory and a network interface connected through a system bus, wherein the memory may include a non-volatile storage medium and an internal memory.

[0154] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions, and when the program instructions are executed, the processor can execute any shooting method based on the split camera module.

[0155] The processor is used to provide computing and control capabilities and support the operation of the entire computer equipment.

[0156] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor can execute any shooting method based on the split camera module.

[0157] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art will appreciate that Fig.10The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0158] It should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0159] In one embodiment, the processor is used to run a computer program stored in the memory to implement the following steps:

[0160] When detecting that the smart glasses are in a wearing state, obtaining a current usage scenario and a current glasses mode of the smart glasses;

[0161] Determining a target eyewear mode corresponding to the current usage scenario;

[0162] When the target glasses mode is different from the current glasses mode, the glasses mode of the smart glasses is switched from the current glasses mode to the target glasses mode.

[0163] In one embodiment, when the processor implements the determining of the target glasses mode corresponding to the current usage scenario, the processor is used to implement:

[0164] When the current glasses mode is a fixed field of view mode, detecting a field of view movement range of the current user, and when the field of view movement range exceeds a first threshold, determining that the target glasses mode is a screen following mode;

[0165] When the current glasses mode is the screen following mode, the field of view movement action of the current user is detected, and when the field of view movement action is a preset action, the target glasses mode is determined to be the fixed field of view mode.

[0166] In one embodiment, when implementing the determining of the target glasses mode corresponding to the current usage scenario, the processor is further configured to implement:

[0167] Detect the current user's field of view movement range;

[0168] When the visual field movement range exceeds the second threshold, obtaining the number of times the visual field movement range exceeds the second threshold within the first preset time period, wherein the number of times the visual field movement range exceeds the second threshold;

[0169] When the number of exceeding times is equal to or greater than a third threshold, the target glasses mode is determined to be a screen following mode.

[0170] In one embodiment, when implementing the determining of the target glasses mode corresponding to the current usage scenario, the processor is further configured to implement:

[0171] Detect the current user's field of view movement;

[0172] When the field of view moving action is a preset action, obtaining the number of action triggering times of the current user within a second preset time period, wherein the number of action triggering times is the number of times the current user operates the preset action;

[0173] When the number of action triggering times is equal to or greater than a fourth threshold, it is determined that the target glasses mode is a fixed field of view mode.

[0174] In one embodiment, when implementing the determining of the target glasses mode corresponding to the current usage scenario, the processor is further configured to implement:

[0175] Detect the current user's head position information;

[0176] When it is detected that the head position information is located in a preset area, obtaining a duration for which the head position information is located in the preset area;

[0177] When the duration reaches a preset duration, the target glasses mode is determined to be a focus mode.

[0178] In one embodiment, when implementing the determining of the target glasses mode corresponding to the current usage scenario, the processor is further configured to implement:

[0179] When detecting that the coordinates of the head position information of the current user change, obtaining the coordinate change frequency of the head position information within a third preset time period;

[0180] When the coordinate change frequency reaches a preset frequency, obtaining an average amplitude of the coordinate change of the head position information within the third preset time period;

[0181] When the average amplitude of the coordinate change reaches a preset amplitude, it is determined that the target glasses mode is a sports mode.

[0182] In one embodiment, when implementing the determining of the target glasses mode corresponding to the current usage scenario, the processor is further configured to implement:

[0183] When the duration of the head position information being located in the preset area does not reach the preset duration, and the frequency of the coordinate change of the head position information within the third preset time period does not reach the preset frequency, or when the duration of the head position information being located in the preset area does not reach the preset duration, and the average amplitude of the coordinate change of the head position information within the third preset time period does not reach the preset amplitude, it is determined that the target glasses mode is the user-defined mode.

[0184] A computer-readable storage medium is also provided in an embodiment of the present application, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and the processor executes the program instructions to implement any one of the shooting methods based on the split camera module provided in the embodiments of the present application.

[0185] The computer-readable storage medium may be an internal storage unit of the computer device described in the above embodiment, such as a hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a smart memory card (SmartMediaCard, SMC), a secure digital (SecureDigital, SD) card, a flash card (FlashCard), etc. equipped on the computer device.

[0186] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A method for switching modes of smart glasses, characterized in that: The method comprises: When detecting that the smart glasses are in a wearing state, obtaining a current usage scenario and a current glasses mode of the smart glasses; Determining a target eyewear mode corresponding to the current usage scenario; When the target glasses mode is different from the current glasses mode, the glasses mode of the smart glasses is switched from the current glasses mode to the target glasses mode.

2. The smart glasses mode switching method according to claim 1, characterized in that: The determining the target glasses mode corresponding to the current usage scenario includes: When the current glasses mode is a fixed field of view mode, detecting a field of view movement range of the current user, and when the field of view movement range exceeds a first threshold, determining that the target glasses mode is a screen following mode; Alternatively, when the current glasses mode is the screen following mode, the field of view movement action of the current user is detected, and when the field of view movement action is a preset action, the target glasses mode is determined to be the fixed field of view mode.

3. The smart glasses mode switching method according to claim 1, characterized in that: The determining of the target glasses mode corresponding to the current usage scenario further includes: Detect the current user's field of view movement range; When the visual field movement range exceeds the second threshold, obtaining the number of times the visual field movement range exceeds the second threshold within the first preset time period, wherein the number of times the visual field movement range exceeds the second threshold; When the number of exceeding times is equal to or greater than a third threshold, the target glasses mode is determined to be a screen following mode.

4. The smart glasses mode switching method according to claim 1, characterized in that: The determining of the target glasses mode corresponding to the current usage scenario further includes: Detect the current user's field of view movement; When the field of view moving action is a preset action, obtaining the number of action triggering times of the current user within a second preset time period, wherein the number of action triggering times is the number of times the preset action is triggered; When the number of action triggering times is equal to or greater than a fourth threshold, it is determined that the target glasses mode is a fixed field of view mode.

5. The smart glasses mode switching method according to claim 1, characterized in that: The determining of the target glasses mode corresponding to the current usage scenario further includes: Detect the current user's head position information; When it is detected that the head position information is located in a preset area, obtaining a duration for which the head position information is located in the preset area; When the duration reaches a preset duration, the target glasses mode is determined to be a focus mode.

6. The smart glasses mode switching method according to claim 5, characterized in that: The method further comprises: When detecting that the coordinates of the head position information of the current user change, obtaining the coordinate change frequency of the head position information within a third preset time period; When the coordinate change frequency reaches a preset frequency, obtaining an average amplitude of the coordinate change of the head position information within the third preset time period; When the average amplitude of the coordinate change reaches a preset amplitude, it is determined that the target glasses mode is a sports mode.

7. The smart glasses mode switching method according to claim 6, characterized in that: The method further comprises: When the duration of the head position information being located in the preset area does not reach the preset duration, and the frequency of the coordinate change of the head position information within the third preset time period does not reach the preset frequency, or when the duration of the head position information being located in the preset area does not reach the preset duration, and the average amplitude of the coordinate change of the head position information within the third preset time period does not reach the preset amplitude, it is determined that the target glasses mode is the user-defined mode.

8. A smart glasses mode switching device, characterized in that: The smart glasses mode switching device comprises: A current usage scenario acquisition module, used to acquire the current usage scenario and current glasses mode of the smart glasses when detecting that the smart glasses are in a wearing state; A target glasses mode determination module, used to determine a target glasses mode corresponding to the current usage scenario; The glasses mode switching module is used to switch the glasses mode of the smart glasses from the current glasses mode to the target glasses mode when the target glasses mode is different from the current glasses mode.

9. A computer device, characterized in that: The computer device includes a processor, a memory, and a computer program stored in the memory and executable by the processor, wherein when the computer program is executed by the processor, the steps of the smart glasses mode switching method as described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, the steps of the smart glasses mode switching method according to any one of claims 1 to 7 are implemented.