Smart glasses and control method thereof

Abstract

This application provides a smart glasses and its control method, belonging to the technical field of smart glasses. The smart glasses include a glasses body, a camera, a position detection device, and a control device. The camera is rotatably mounted on the glasses body and has a horizontal and a vertical shooting position during its rotation stroke. The position detection device is used to detect the position information of the camera. The control device is used to select a corresponding processing algorithm based on the position information detected by the position detection device. By rotatably mounting the camera on the glasses body, this application improves the convenience of switching between horizontal and vertical shooting modes simply by rotating the camera, eliminating the need for the user to remove the glasses or rotate their entire eyes.

Description

Technical Field

[0001] This application relates to the technical field of smart glasses, specifically to a smart pair of glasses and its control method. Background Technology

[0002] Smart glasses are wearable electronic devices that can be worn on the human eye, including but not limited to AI glasses, camera glasses, XR glasses, audio glasses, and Bluetooth glasses that are currently common on the market. Smart glasses have the form of ordinary glasses, consisting of frames, lenses, and temples, and are equipped with electronic components such as power supplies, processors, and sensors, which can be built into the glasses case or connected externally.

[0003] Currently, smart glasses, such as AR glasses, Bluetooth glasses, and VR glasses, generally have cameras with a fixed shooting direction. When worn by the user, they can only shoot in landscape mode or in portrait mode.

[0004] Therefore, when users need to switch from landscape to portrait mode for shooting, or vice versa, they must rotate the entire pair of glasses. This requires users to remove their glasses, resulting in a poor user experience. Summary of the Invention

[0005] This application provides a smart glasses and its control method, which aims to enable existing smart glasses to conveniently switch between landscape and portrait shooting modes.

[0006] On one hand, embodiments of this application provide smart glasses, including:

[0007] The main body of the glasses;

[0008] A camera is rotatably mounted on the main body of the glasses, and the camera has a horizontal shooting position and a vertical shooting position during its rotation stroke;

[0009] A position detection device is used to detect the position information of the camera; and,

[0010] The control device is used to select the corresponding processing algorithm based on the position information detected by the position detection device.

[0011] In some embodiments, the camera includes:

[0012] A substrate, which is rotatably mounted on the eyeglasses body;

[0013] An image acquisition module, used for image acquisition, is fixedly mounted on the substrate; and,

[0014] A connector that connects the substrate and the control device.

[0015] In some embodiments, the position detection device includes:

[0016] A magnetic component is fixedly mounted on the main body of the glasses; and,

[0017] A Hall element is fixedly mounted on the substrate so that it moves closer to or further away from the magnetic element when the substrate rotates.

[0018] In some embodiments, the substrate has an abutting side, and the Hall element is mounted on the abutting side;

[0019] The main body of the glasses is provided with a limiting rib. The limiting rib is located near the abutting side and abuts against the abutting side when the camera is in the horizontal or vertical shooting position, so as to limit the rotation of the camera.

[0020] In some embodiments, the connector is a multi-strand coaxial cable.

[0021] On the other hand, embodiments of this application provide a control method for smart glasses. The control method is applied to any of the smart glasses described above. The smart glasses further include a driving device, which drives and is connected to the camera and electrically connected to the control device, to drive the camera to rotate according to instructions from the control device. The control method includes:

[0022] Upon receiving a switching command, the driving device is controlled to drive the camera to switch between the horizontal shooting position and the vertical shooting position;

[0023] Based on the position information detected by the position detection device, the corresponding processing algorithm is selected.

[0024] In some embodiments, prior to the step of receiving a switching instruction, the control method further includes:

[0025] Detect user action information;

[0026] The switching command is triggered based on the user's action information.

[0027] In some embodiments, the smart glasses further include a blink detection module for detecting the number of blinks of the user;

[0028] The step of detecting user action information includes:

[0029] The blink detection module is controlled to detect the number of times the user blinks.

[0030] In some embodiments, the step of triggering the switching instruction based on the user's action information includes:

[0031] The switching command is triggered when the number of blinks exceeds a preset value within a preset time period.

[0032] In some embodiments, the step of triggering the switching instruction based on the user's action information includes:

[0033] When the camera detects preset gesture information, the switching command is triggered.

[0034] In some embodiments, the smart glasses further include a gravity sensor for detecting the user's head posture. After the step of selecting the corresponding processing algorithm, the control method further includes:

[0035] Obtain the attitude information detected by the gravity sensor;

[0036] The compensation angle information is determined based on the attitude information;

[0037] Based on the compensation angle information, the driving device is controlled to drive the camera to rotate by the corresponding angle.

[0038] In some embodiments, the smart glasses further include a display module, and the control method further includes:

[0039] Acquire multiple viewfinder images as the camera rotates;

[0040] Cut out the first frame portion that maintains a consistent framing range from multiple viewfinder frames;

[0041] Control the display module to display the first viewfinder portion.

[0042] This embodiment of the application mounts the camera to the main body of the glasses in a rotating manner. Therefore, when switching from horizontal to vertical shooting, or vice versa, simply rotating the camera changes the shooting direction without requiring the user to remove the glasses or rotate their entire eyes. This improves the convenience of switching between the smart glasses. Furthermore, a position detection device and a control device are included. The control device selects the appropriate processing algorithm based on the position information detected by the position detection device, enabling the smart glasses to quickly switch between horizontal and vertical shooting modes. Attached Figure Description

[0043] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0044] Figure 1 This is a front view of the smart glasses provided in some embodiments of this application;

[0045] Figure 2 This is a schematic diagram of the connection structure between the camera and the control device in some embodiments of this application;

[0046] Figure 3 This is a schematic diagram of camera rotation provided in some embodiments of this application;

[0047] Figure 4 This is a flowchart of the first embodiment of the control method for smart glasses provided in this application;

[0048] Figure 5 This is a schematic diagram illustrating how the viewfinder of the smart glasses in this application changes when the camera is rotated;

[0049] Figure 6 This is a schematic diagram of the display module showing the camera of the smart glasses in this application when it is rotated.

[0050] Description of main component symbols:

[0051] Detailed Implementation

[0052] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0053] In the description of this application, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," and "outer," etc., indicating orientation or positional relationships based on the orientation or positional relationships shown in the accompanying drawings, are used only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this application. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more of the stated features. In the description of this application, "a plurality of" means two or more, unless otherwise explicitly specified.

[0054] "A and / or B" includes the following three combinations: A only, B only, and a combination of A and B.

[0055] The use of "applies to" or "configured to" in this application implies open and inclusive language, which does not exclude the applicability to or configuration to devices performing additional tasks or steps. Additionally, the use of "based on" implies openness and inclusivity, because processes, steps, calculations, or other actions "based on" one or more of the stated conditions or values ​​may in practice be based on additional conditions or values ​​beyond those stated.

[0056] In this application, the term "exemplary" is used to mean "used as an example, illustration, or description." Any embodiment described as "exemplary" in this application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use this application. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that this application can be made without using these specific details. In other instances, well-known structures and processes are not described in detail to avoid obscuring the description of this application with unnecessary detail. Therefore, this application is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in this application.

[0057] Smart glasses have the form of natural glasses and can perform functions such as extended reality display, wear status detection, biometric recognition, human-computer interaction, and data processing. Smart glasses can include a frame, temples, processor, sensors, optical display components, microphone, and speakers. The temples and frame contain cavities that house circuitry and electronic components.

[0058] Sensors can include cameras, eye trackers, iris scanners, IMUs, gyroscopes, etc. Optical display components include micro-projection optical engines and optical couplers. The micro-projection optical engine can be based on Micro-OLED, Micro-LED, LCOS, or LBS. The optical coupler can be an optical lens or a waveguide. The processor can be a specialized XR processor or a general-purpose processor. The frame and temples form the supporting structure of the entire pair of glasses. The temples are flexible, and their length and clamping force can be adjusted to fit users with different head shapes. The camera can capture images of the user's hands, face, and eyes, the microphone can listen to the user's voice, and the processor can calculate and process various data.

[0059] Smart glasses are wearable electronic devices that can be worn on the human eye, including but not limited to AI glasses, camera glasses, XR glasses, audio glasses, and Bluetooth glasses that are currently common on the market. Smart glasses have the form of ordinary glasses, consisting of frames, lenses, and temples, and are equipped with electronic components such as power supplies, processors, and sensors, which can be built into the glasses case or connected externally.

[0060] Currently, smart glasses, such as AR glasses, Bluetooth glasses, and VR glasses, generally have cameras with a fixed shooting direction. When worn by the user, they can only shoot in landscape mode or in portrait mode.

[0061] Therefore, when users need to switch from landscape to portrait mode for shooting, or vice versa, they must rotate the entire pair of glasses. This requires users to remove their glasses, resulting in a poor user experience.

[0062] For this, please refer to Figures 1 to 3 Some embodiments of this application provide a smart glasses 100, including a glasses body 10, a camera 20, a position detection device 30, and a control device 40; the camera 20 is rotatably mounted on the glasses body 10, and the camera 20 has a horizontal shooting position and a vertical shooting position during its rotation stroke; the position detection device 30 is used to detect the position information of the camera 20; the control device 40 is used to select a corresponding processing algorithm according to the position information detected by the position detection device 30.

[0063] It should be noted that the specific implementation of the smart glasses 100 is not limited; it can be AR glasses, Bluetooth glasses, VR glasses, etc., and is not limited here. Similarly, the specific implementation of the position detection device 30 is not limited; it can be a Hall element 32, a light distance sensor, etc., and is not limited here. The specific implementation of the control device 40 is not limited; it can be a microcontroller, a control chip, a control circuit, etc., and is not limited here. The specific rotation method of the camera 20 is not limited; it can be manually rotated by the user, or a drive device, such as a drive motor or a drive cylinder, can be used to drive the camera 20 to rotate, and is not limited here. The installation position of the camera 20 is not limited; it can be mounted on the frame or on the temple, and is not limited here.

[0064] Specifically, the specific content of the processing algorithms corresponding to the horizontal and vertical shooting positions is not limited, as long as the images can be processed according to the horizontal and vertical shooting positions. In some embodiments, the resolution of the image in vertical shooting is X multiplied by Y, and the resolution in horizontal shooting becomes Y multiplied by X. The processing algorithm can specifically modify the resolution of the image accordingly. For example, when the camera 20 is in the vertical shooting position, the control device 40 selects the corresponding processing algorithm to adjust the resolution of the image captured by the camera 20 to X multiplied by Y, and when the camera 20 is in the horizontal shooting position, the control device 40 selects the corresponding processing algorithm to adjust the resolution of the image captured by the camera 20 to Y multiplied by X.

[0065] It is understood that the position detection device 30 is used to detect the position information of the camera 20. Thus, the position detection device 30 can accurately detect whether the camera 20 is in a horizontal or vertical shooting position. This allows the control device 40 to select the corresponding processing algorithm based on the position information detected by the position detection device 30. That is, when the camera 20 is in a horizontal shooting position, the corresponding horizontal processing algorithm is selected, and when it is in a vertical shooting position, the vertical processing algorithm is selected. Thus, different processing algorithms are selected and called based on the position information detected by the position detection device 30 to perform algorithm calibration on the shooting effect.

[0066] In this embodiment, the camera 20 is rotated and mounted on the main body of the glasses 10. Therefore, when switching from horizontal to vertical shooting, or vice versa, the camera 20 can be rotated to change its shooting direction without requiring the user to remove the glasses or rotate their entire eyes. This improves the convenience of switching between modes in the smart glasses 100. Furthermore, a position detection device 30 and a control device 40 are provided. The control device 40 selects the appropriate processing algorithm based on the position information detected by the position detection device 30, ensuring good shooting results for the smart glasses 100 in both horizontal and vertical shooting modes.

[0067] As for the camera 20, it may be that only the acquisition module 22 or the photosensitive module is rotated, or the entire camera 20 may be rotated; there is no limitation here.

[0068] In some embodiments, the camera 20 includes a base plate 21, a data acquisition module 22, and a connector 23. The base plate 21 is rotatably mounted on the glasses body 10. The data acquisition module 22 is used to acquire images and is fixedly mounted on the base plate 21. The connector 23 connects the base plate 21 and the control device 40.

[0069] It should be noted that the substrate 21 is a circuit board, which may be a PCB board, and it cooperates with the connector 23 to transmit the image information acquired by the acquisition module 22 to the control device 40.

[0070] The specific implementation of the connector 23 is not limited. It can be in the form of an FPC, a coaxial cable, a data cable, etc., and is not limited here.

[0071] In the scheme of this embodiment, the substrate 21 is rotatably mounted on the glasses body 10. When the substrate 21 rotates, it can drive the acquisition module 22 to rotate together, thereby changing the shooting direction of the camera 20 and allowing the camera 20 to switch between the horizontal shooting position and the vertical shooting position.

[0072] Meanwhile, in some embodiments, the position detection device 30 includes a magnetic element 31 and a Hall element 32. The magnetic element 31 is fixedly disposed on the eyeglass body 10; the Hall element 32 is fixedly mounted on the substrate 21 so as to move closer to or further away from the magnetic element 31 when the substrate 21 rotates.

[0073] It should be noted that the specific implementation of the magnetic component 31 is not limited. It can be in the form of a permanent magnet, an electromagnetic coil generating a magnetic field, or a magnetized element, etc. There are no limitations here. When the distance between the Hall element 32 and the magnetic component 31 changes, the level of the electrical signal generated by it will also change accordingly. When the distance is close, it outputs a low level, and when the distance is far, it outputs a high level. Thus, the level of the Hall element 32 output can be used to determine whether the camera 20 is in the horizontal or vertical shooting position.

[0074] In the scheme of this embodiment, the Hall element 32 is fixedly mounted on the substrate 21, so that when the substrate 21 rotates, the Hall element 32 will also rotate. The magnetic element 31 is mounted on the eyeglass body 10, so when the substrate 21 rotates, the magnetic element 31 will not rotate. This allows the Hall element 32 to move closer to or further away from the magnetic element 31 when it rotates with the substrate 21.

[0075] Specifically, when the Hall element 32 generates a high level, the camera 20 is in the horizontal shooting position, and when it generates a low level, the camera 20 is in the vertical shooting position. Alternatively, when the Hall element 32 generates a high level, the camera 20 is in the vertical shooting position, and when it generates a low level, the camera 20 is in the horizontal shooting position. No limitation is made here.

[0076] Of course, in some embodiments, the Hall element 32 may be mounted on the eyeglass body 10, and the magnetic element 31 may be mounted on the substrate 21. When the substrate 21 rotates, the magnetic element 31 moves closer to or further away from the Hall element 32.

[0077] In some embodiments, in order to limit the rotational stroke of the substrate 21 so that it rotates exactly 90° in one rotation, a limiting structure can be provided on the glasses body 10. Through the limiting effect of the limiting structure, the substrate 21 can rotate exactly 90° in one rotation, thereby better switching between the horizontal and vertical shooting positions.

[0078] In a further embodiment, the substrate 21 has an abutment side 211, and the Hall element 32 is mounted on the abutment side 211; the glasses body 10 is provided with a limiting rib 50, which is arranged adjacent to the abutment side 211 and abuts against the abutment side 211 when the camera 20 is in the horizontal or vertical shooting position, so as to limit the rotation of the camera 20.

[0079] Please see Figure 3 In this embodiment, when the camera 20 is in the horizontal or vertical shooting position, the limiting rib 50 abuts against the abutting side 211, so that the camera 20 can only rotate from the horizontal to the vertical shooting position when in the horizontal shooting position, and can only rotate from the vertical to the horizontal shooting position when in the vertical shooting position. This limits the rotation stroke of the camera 20, ensuring that each rotation of the camera 20 is exactly 90°. In particular, when the camera 20 is manually rotated, it can be switched between the horizontal and vertical shooting positions more accurately.

[0080] In some embodiments, the magnetic element 31 protrudes from the surface of the eyeglass body 10 to form the limiting rib 50.

[0081] In the solution of this embodiment, by having the magnetic component 31 abut against the contact side 211, the rotation of the camera 20 is limited, thereby eliminating the need for an additional limiting structure and effectively reducing costs.

[0082] It should be noted that since the movement of the camera 20 is a rotation, when using conventional connectors 23, such as flexible circuit boards, the copper layer thickness of the flexible circuit board is only 12~20um, and the flexible circuit board is only a one-dimensional plane, which cannot cope with the rotation scenario, resulting in tearing, signal attenuation, and characteristic impedance imbalance.

[0083] In one embodiment, the connector 23 is a multi-strand coaxial cable, which has good dynamic and static bending capabilities and can be applied to the design of eyeglass temples and pivot positions.

[0084] Furthermore, the wiring of the camera 20 includes high-speed MIPI wiring and power lines, typically around 16 signal lines. Using 32~42AWG cables can meet the transmission requirements of high-speed signals. The minimum diameter of a single conductor can be 0.2mm, and the total linear diameter can be less than 1.4mm, thus better meeting the rotation requirements of the camera 20.

[0085] On the other hand, please refer to the following: Figure 4 This application provides a control method for a smart glasses 100. The control method is applied to any of the smart glasses 100 described above. The smart glasses 100 further includes a driving device, which drives and connects to the camera 20 and is electrically connected to the control device 40, to drive the camera 20 to rotate according to instructions from the control device 40. The control method includes:

[0086] Step S100: Upon receiving a switching command, control the driving device to drive the camera 20 to switch between the horizontal shooting position and the vertical shooting position;

[0087] Step S200: Select the corresponding processing algorithm based on the position information detected by the position detection device 30.

[0088] It should be noted that the specific implementation of the driving device is not limited; it can be a drive motor, a drive cylinder, etc., driving the camera 20 to rotate, etc., and is not limited here. Upon receiving a switching command, the driving device is controlled to switch the camera 20 between the horizontal and vertical shooting positions. This can be either controlling the driving device to switch the camera 20 from the horizontal to the vertical shooting position, or controlling the driving device to switch the camera 20 from the vertical to the horizontal shooting position; it is not limited here.

[0089] The specific form in which the switching command is generated is not limited; it can be triggered by an APP, a TP, a button, an iris recognition, a head shake, etc., and is not limited here.

[0090] Specifically, the specific content of the processing algorithms corresponding to the horizontal and vertical shooting positions is not limited, as long as the images can be processed according to the horizontal and vertical shooting positions. In some embodiments, the resolution of the image in vertical shooting is X multiplied by Y, and the resolution in horizontal shooting becomes Y multiplied by X. The processing algorithm can specifically modify the resolution of the image accordingly. For example, when the camera 20 is in the vertical shooting position, the control device 40 selects the corresponding processing algorithm to adjust the resolution of the image captured by the camera 20 to X multiplied by Y, and when the camera 20 is in the horizontal shooting position, the control device 40 selects the corresponding processing algorithm to adjust the resolution of the image captured by the camera 20 to Y multiplied by X.

[0091] In the scheme of this embodiment, when a switching command is received, the driving device is controlled to drive the camera 20 to switch between the horizontal shooting position and the vertical shooting position. According to the position information detected by the position detection device 30, the corresponding processing algorithm is selected, thereby selecting and calling different processing algorithms according to the position information detected by the position detection device 30 to perform algorithm calibration on the shooting effect in order to obtain a better shooting effect.

[0092] Furthermore, prior to the step of receiving the switching instruction, the control method further includes:

[0093] Step S80: Detect the user's action information;

[0094] Step S90: Trigger the switching command based on the user's action information.

[0095] It should be noted that there are no restrictions on the specific implementation of detecting user action information. It can be detecting user gesture information, user blinking information, user iris information, etc., and no limitation is made here.

[0096] Understandably, since the smart glasses 100 are worn on the user's eyes, direct operation of the smart glasses 100 often presents many inconveniences.

[0097] In the technical solution of this embodiment, by detecting the user's action information and triggering the switching command based on the user's action information, the user only needs to perform a specific action to switch the rotation of the camera 20, without the user actually needing to operate the smart glasses 100 directly, thus improving the convenience of the user switching the camera 20.

[0098] Furthermore, in some embodiments, the smart glasses 100 also includes a blink detection module, which is used to detect the number of blinks of the user;

[0099] The step of detecting user action information includes:

[0100] Step S81: Control the blink detection module to detect the number of blinks of the user.

[0101] Specifically, the implementation of the blink detection module is not limited. It can be in the form of a motion sensor to detect the user's blinking action, or it can be that an additional camera 20 is set on the main body 10 of the smart glasses 100 to take pictures of the user's eyes and then identify the number of blinks, etc. There are no limitations here.

[0102] In this embodiment, considering that the smart glasses 100 are worn on the user's glasses, the switching command is triggered by detecting the number of blinks of the user, eliminating the need for the user to directly operate the smart glasses 100. Furthermore, the blink detection module on the smart glasses 100 is used to detect the user's eye movements. The blink detection module is close to the user's eyes, resulting in higher detection accuracy.

[0103] After detecting the number of blinks of the user, the specific triggering method is not limited. It can be that the user does not blink for a certain period of time, and the corresponding switching instruction is generated. Alternatively, the switching instruction can be generated after detecting that the user blinks several times in a row, etc. There are no limitations here.

[0104] In some embodiments, the step of triggering the switching instruction based on the user's action information includes:

[0105] Step S91: When the number of blinks exceeds a preset value within a preset time, the switching command is triggered.

[0106] It should be noted that the specific value of the preset duration is not limited, and it can be 10 seconds, 20 seconds, 11 seconds, etc., without limitation. The specific value of the preset value is also not limited, and it can be two, three, four, etc. In some embodiments, the preset duration is 5 seconds and the number of blinks is 5. In this way, the user's daily blinking action can be effectively prevented from accidentally triggering the switching command.

[0107] In the technical solution of this embodiment, when the number of blinks within a preset time exceeds a preset value, the switching command is triggered. The switching command will only be triggered if the number of blinks accumulates to a certain number in a short period of time, which can effectively prevent users' daily blinking actions from accidentally triggering the switching command.

[0108] In some embodiments, the step of triggering the switching instruction based on the user's action information includes:

[0109] Step S92: When the camera 20 detects preset gesture information, the switching command is triggered.

[0110] It should be noted that when a user uses the smart glasses 100, they can be guided to customize gesture information, thereby storing preset gesture information. When the camera 20 is working, that is, when the user uses the smart glasses 100 to enter the photo-taking mode, the camera 20 detects the user's movements in real time. When the camera 20 detects the preset gesture information, it triggers the switching command, thereby switching from the original horizontal photo-taking position to the vertical photo-taking position, or vice versa. Of course, the smart glasses 100 may also have preset gesture information built in at the factory, etc., which is not limited here.

[0111] The specific form of the preset gesture information is not limited; it can be the user waving their palm to the left twice, or the user waving their palm to the right twice, etc. There are no restrictions here.

[0112] In the technical solution of this embodiment, by using the camera 20 to detect the user's gesture information, there is no need to set up an additional detection module for detection, which saves manufacturing costs. Furthermore, during the process of triggering the switching command, there is no need to directly operate the smart glasses 100, which improves the convenience of triggering.

[0113] In some embodiments, the smart glasses 100 further includes a gravity sensor 70 for detecting the user's head posture. After the step of selecting the corresponding processing algorithm, the control method further includes:

[0114] Step S300: Obtain the attitude information detected by the gravity sensor 70;

[0115] It is understandable that when the user's head tilts to a certain extent, the smart glasses 100 worn by the user's head will also tilt accordingly. At this time, the gravity sensor 70 can effectively detect the tilt angle of the user's head.

[0116] Step S400: Determine the compensation angle information based on the attitude information;

[0117] Specifically, for example, when the gravity sensor 70 detects that the tilt angle of the user's head is -5°, the corresponding control compensation angle is 5°.

[0118] Step S500: Control the driving device to drive the camera 20 to rotate by the corresponding angle according to the compensation angle information.

[0119] Understandably, since our smart glasses 100 are worn on the user's head, the user's head is prone to tilting during shooting, causing the viewfinder 60 to be tilted. For example, when the camera 20 is set on the frame, if the user's head tilts left or right, the viewfinder 60 of the camera 20 will also tilt left or right accordingly. When the camera 20 is set on the temple, if the user's head tilts forward or backward, the viewfinder 60 of the camera 20 will also tilt forward or backward accordingly, resulting in poor quality photos or videos.

[0120] In the solution of this embodiment, by setting the gravity sensor 70, after the camera 20 is switched to the vertical or horizontal shooting position, the gravity sensor 70 can detect the user's head posture, determine the compensation angle information based on the posture information, and control the driving device to drive the camera 20 to rotate by the corresponding angle based on the compensation angle information. By rotating the camera 20, the camera 20 is kept in a horizontal state, thereby improving the shooting effect.

[0121] In other words, in the solution of this application, if the user's head tilts or moves slightly when taking a picture, the gravity sensor 70 and the driving device can work together to keep the camera 20 in a horizontal position, resulting in better photos.

[0122] It should be noted that the installation position of the gravity sensor 70 is not limited; it can be installed on the glasses body 10 or on the camera 20. No limitation is made here. Please refer to [link / reference]. Figure 3 The gravity sensor 70 is mounted on the substrate 21 of the camera 20, so that when the user takes a picture, it can effectively obtain the tilt angle of the camera 20, thereby quickly adjusting the camera 20 to a horizontal state.

[0123] In some embodiments, the smart glasses 100 further includes a display module 80, and the control method further includes:

[0124] Step S600: Acquire multiple viewfinder images 60 as the camera 20 rotates;

[0125] Step S700: Cut out a first framing portion 61 from multiple framing frames 60 with a consistent framing range;

[0126] Step S800: Control the display module 80 to display the first viewfinder portion 61.

[0127] Please see Figure 5 , Figure 5 The image 60 refers to the viewfinder 60 of the camera 20 in three positions: the vertical shooting position, the horizontal shooting position, and during rotation. The viewfinder 60 can also be understood as the framing range. During the rotation of the camera 20, if the user's head does not move, a portion of the viewfinder 60, or the framing range, will not change. Figure 5 The area within the circle can be captured by the camera 20 regardless of its rotation angle. However, the view and range of the area outside the circle will change as the camera 20 rotates. If the entire view 60 is displayed to the user while the camera 20 is rotating, showing the rotating image up close to the user's eyes could potentially cause dizziness.

[0128] Therefore, in this embodiment, multiple viewfinder images 60 are acquired when the camera 20 rotates, and a first viewfinder portion 61 with a consistent framing range is cut out from the multiple viewfinder images 60, that is... Figure 5 The display module 80 controls the display of the first viewfinder portion 61 in the middle circle. Since the display device only displays the circle, even if the camera 20 rotates, the displayed image is not actually rotating, and can even be understood as a static image, thus effectively avoiding dizziness for the user.

[0129] Please also refer to Figure 6Taking the display module 80 as a landscape orientation as an example, when the camera 20 is in a portrait orientation, the display module 80 displays a rectangular display screen 81 in the center, that is... Figure 6 The first display module 80 displays screen 81. When the switching command is received, the camera 20 rotates, and the display screen 81 of the first display module 80 switches to the display screen 81 of the second display module 80. At this time, the display screen 81 is circular and used for displaying... Figure 5 The first framing portion 61 is circular. Then, when the camera 20 rotates to the horizontal shooting position, the display screen 81 of the display module 80 switches to the display screen 81 of the third display module 80 for full-screen display. With this setting, when the camera 20 rotates and switches, the displayed image is not actually rotating, and can even be understood as a static image, thereby effectively avoiding dizziness for the user.

[0130] It is important to emphasize that the display module 80 can be a physical screen (i.e., an optical lens) or a virtual screen. The virtual screen is the virtual display screen that appears to the user after the propagation and conversion of numerous optical components through the micro-display of the AR glasses (for example, a 1280*960 giant screen projected at a position 4 meters in front of the user when wearing AR glasses).

[0131] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the control method for smart glasses in the above embodiments.

[0132] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0133] The aforementioned computer-readable storage medium may be included in the smart glasses; or it may exist independently and not assembled into the smart glasses.

[0134] The aforementioned computer-readable storage medium carries one or more programs that, when executed by the smart glasses, cause the smart glasses to: upon receiving a switching instruction, control the driving device to drive the camera to switch between the horizontal and vertical shooting positions;

[0135] Based on the position information detected by the position detection device, the corresponding processing algorithm is selected.

[0136] Computer program code for performing the operations of the present application may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0137] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, program segment or a part of code, and the module, program segment or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be implemented by a combination of dedicated hardware and computer instructions.

[0138] The modules described in the embodiments of the present application may be implemented in software or hardware, wherein the name of a module does not necessarily limit the unit itself.

[0139] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the control method of the above-described smart glasses, which can solve the technical problem of inconvenient operation when switching between landscape and portrait modes for shooting in existing smart glasses. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as the beneficial effects of the control method of the smart glasses provided in the above embodiments, and will not be repeated here.

[0140] The above provides a detailed description of the smart glasses and control method provided in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A control method for smart glasses, characterized in that, The smart glasses include: The main body of the glasses; A camera is rotatably mounted on the main body of the glasses, and the camera has a horizontal shooting position and a vertical shooting position during its rotation stroke; A position detection device is used to detect the position information of the camera; and, The control device is used to select the corresponding processing algorithm based on the position information detected by the position detection device. A driving device is provided, which drives and is connected to the camera and electrically connected to the control device, so as to drive the camera to rotate according to the instructions of the control device. The smart glasses also include a display module. The control method includes: Upon receiving a switching command, the driving device is controlled to drive the camera to switch between the horizontal shooting position and the vertical shooting position; Based on the position information detected by the position detection device, the corresponding processing algorithm is selected. Acquire multiple viewfinder images as the camera rotates; Cut out the first frame portion that maintains a consistent framing range from multiple viewfinder frames; Control the display module to display the first viewfinder portion.

2. The control method for smart glasses according to claim 1, characterized in that, Prior to the step of receiving a switching instruction, the control method further includes: Detect user action information; The switching command is triggered based on the user's action information.

3. The control method for smart glasses according to claim 2, characterized in that, The smart glasses also include a blink detection module, which is used to detect the number of times the user blinks; The step of detecting user action information includes: The blink detection module is controlled to detect the number of times the user blinks.

4. The control method for smart glasses according to claim 3, characterized in that, The step of triggering the switching command based on the user's action information includes: The switching command is triggered when the number of blinks exceeds a preset value within a preset time period.

5. The control method for smart glasses according to claim 2, characterized in that, The step of triggering the switching command based on the user's action information includes: When the camera detects preset gesture information, the switching command is triggered.

6. The control method for smart glasses according to claim 1, characterized in that, The smart glasses also include a gravity sensor for detecting the user's head posture. After the step of selecting the corresponding processing algorithm, the control method further includes: Obtain the attitude information detected by the gravity sensor; The compensation angle information is determined based on the attitude information; Based on the compensation angle information, the driving device is controlled to drive the camera to rotate by the corresponding angle.

7. The control method for smart glasses according to claim 1, characterized in that, The camera includes: A substrate, which is rotatably mounted on the eyeglasses body; An image acquisition module, used for image acquisition, is fixedly mounted on the substrate; and, A connector that connects the substrate and the control device.

8. The control method for smart glasses according to claim 7, characterized in that, The position detection device includes: A magnetic component is fixedly mounted on the main body of the glasses; and, A Hall element is fixedly mounted on the substrate so that it moves closer to or further away from the magnetic element when the substrate rotates.

9. The control method for smart glasses according to claim 8, characterized in that, The substrate has an abutting side, and the Hall element is mounted on the abutting side; The main body of the glasses is provided with a limiting rib. The limiting rib is located near the abutting side and abuts against the abutting side when the camera is in the horizontal or vertical shooting position, so as to limit the rotation of the camera.

10. The control method for smart glasses according to claim 7, characterized in that, The connector is a multi-strand coaxial cable.

Images