Intelligent glasses and control method thereof
By designing a rotatable camera and position detection device in smart glasses, the camera is automatically switched between horizontal and vertical screen shooting, solving the problem of users in the prior art that manually rotate or take off their glasses, and improving the user experience.
Patent Information
- Application Number
- CN202510891460.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-06-30
- Publication Date
- 2025-08-01
- Estimated Expiration
- 2045-06-30
AI Technical Summary
Existing smart glasses require the user to manually rotate or take off the glasses when switching between horizontal and vertical screen shooting, resulting in poor user experience.
A smart glasses are designed, the camera can be rotatably installed on the glasses' main body, equipped with a position detection device and a control device, and automatically switch the shooting direction by detecting the camera position information, and selecting the corresponding processing algorithm based on the position information.
It realizes convenient switching between horizontal and vertical shooting of the camera, without the need for user to manually rotate or take off their glasses, improving the user experience.
Smart Images

Figure CN120405968A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the technical field of smart glasses, and particularly relates to a smart glass and its control method. Background Art
[0002] Smart glasses are electronic devices that can be worn on the human eye, including but not limited to common AI glasses, camera glasses, XR glasses, audio glasses, Bluetooth glasses, etc. on the market. Smart glasses have the form of ordinary glasses, consisting of a frame, a mirror frame, and temple arms, and are equipped with electronic devices such as a power supply, a computing processor, and sensors, which can be built into the glasses case or externally electrically connected.
[0003] Currently, for smart glasses such as AR glasses, Bluetooth glasses, VR glasses, etc., the shooting direction of the cameras set on the glasses is generally fixed. When the user wears them, they can only perform horizontal screen shooting or vertical screen shooting in a single way.
[0004] Therefore, when the user needs to switch from horizontal screen shooting to vertical screen shooting, or from vertical screen shooting to horizontal screen shooting, the entire glasses must be directly rotated, and during this process, the user needs to take off the glasses, resulting in a poor user experience. Summary of the Invention
[0005] The embodiments of this application provide a smart glass and its control method, aiming to enable existing smart glasses to conveniently switch between horizontal screen and vertical screen shooting.
[0006] On the one hand, the embodiments of this application provide a smart glass, including: A glasses body; A camera rotatably mounted on the glasses body, the camera having a horizontal shooting position and a vertical shooting position on its rotation stroke; A position detection device for detecting the position information of the camera; and, A control device for correspondingly selecting a corresponding processing algorithm according to the position information detected by the position detection device.
[0007] In some embodiments, the camera includes: A substrate rotatably mounted on the glasses body; An acquisition module for image acquisition, fixedly mounted on the substrate; and, A connecting member connecting the substrate and the control device.
[0008] In some embodiments, the position detection device includes: A magnetic member fixedly arranged on the glasses body; and, The Hall element is fixedly mounted on the substrate to approach or move away from the magnetic member when the substrate rotates.
[0009] In some embodiments, the substrate has an abutting side, and the Hall element is mounted on the abutting side; The glasses body is convexly provided with a limiting rib. The limiting rib is arranged adjacent to the abutting side and abuts against the abutting side when the camera is in the horizontal photographing position or the vertical photographing position, so as to limit the rotation of the camera.
[0010] In some embodiments, the connecting member is a multi-strand coaxial cable.
[0011] On the other hand, an embodiment of the present application provides a control method for a smart glasses. The control method is applied to the smart glasses as described in any one of the above. The smart glasses further include a driving device. The driving device is drivingly connected to the camera and electrically connected to the control device to drive the camera to rotate according to the instruction of the control device. The control method includes: When receiving a switching instruction, controlling the driving device to drive the camera to switch between the horizontal photographing position and the vertical photographing position; According to the position information detected by the position detection device, correspondingly select a corresponding processing algorithm.
[0012] In some embodiments, before the step of receiving the switching instruction, the control method further includes: Detecting the action information of the user; Triggering the switching instruction based on the action information of the user.
[0013] In some embodiments, the smart glasses further include a blink detection module, and the blink detection module is used to detect the number of blinks of the user; The step of detecting the action information of the user includes: Controlling the blink detection module to detect the number of blinks of the user.
[0014] In some embodiments, the step of triggering the switching instruction based on the action information of the user includes: When the number of blinks within a preset time duration exceeds a preset value, triggering the switching instruction.
[0015] In some embodiments, the step of triggering the switching instruction based on the action information of the user includes: [[ID=:39]]When the camera detects preset gesture information, triggering the switching instruction.
[0016] In some embodiments, the smart glasses further include a gravity sensor for detecting the head posture of the user. After the step of correspondingly selecting a processing algorithm, the control method further includes: Obtaining the posture information detected by the gravity sensor; Determining compensation angle information according to the posture information; Controlling the driving device to drive the camera to rotate by a corresponding angle according to the compensation angle information.
[0017] In some embodiments, the smart glasses further include a display module, and the control method further includes: Obtaining a plurality of viewfinder images when the camera rotates; Cutting out a first viewfinder part with a consistent viewfinder range from the plurality of viewfinder images; Controlling the display module to display the first viewfinder part.
[0018] In the embodiments of the present application, by rotatably mounting the camera on the glasses body, when it is necessary to switch from horizontal shooting to vertical shooting, or from vertical shooting to horizontal shooting, only the camera needs to be rotated to change the shooting direction of the camera, without the user having to take off the glasses or rotate the entire eyes, which improves the convenience of switching of the smart glasses. Moreover, a position detection device and a control device are provided, and the control device is used to correspondingly select a processing algorithm according to the position information detected by the position detection device, so that the smart glasses can quickly switch between landscape and portrait shooting. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present application. For those skilled in the art, without creative efforts, other drawings can be obtained according to these drawings.
[0020] Figure 1 is the front view of the smart glasses provided by some embodiments of the present application; Figure 2 is the schematic connection structure between the camera and the control device in some embodiments of the present application; Figure 3 is the schematic diagram of the rotation of the camera provided by some embodiments of the present application; Figure 4 is the flowchart of the first embodiment of the control method of the smart glasses provided by the present application; Figure 5It is a schematic diagram of the viewfinder screen change when the camera of the smart glasses in this application rotates; Figure 6 It is a schematic diagram of the display on the display module when the camera of the smart glasses in this application rotates.
[0021] Main component symbol description: Specific implementation manners
[0022] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative efforts belong to the scope of protection of the present application.
[0023] In the description of the present application, it should be understood that the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus cannot be understood as a limitation to the present application. In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include one or more of the described features. In the description of the present application, "a plurality" means two or more, unless otherwise specifically defined.
[0024] "A and / or B" includes the following three combinations: only A, only B, and the combination of A and B.
[0025] The use of "suitable for" or "configured to" in the present application means open and inclusive language, which does not exclude devices suitable for or configured to perform additional tasks or steps. In addition, the use of "based on" means open and inclusive, because a process, step, calculation, or other action "based on" one or more of the described conditions or values can in practice be based on additional conditions or values beyond the described ones.
[0026] In this application, the term "exemplary" is used to mean "serving as an example, illustration, or instance". Any embodiment described as "exemplary" in this application is not necessarily to be construed as more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use this application. In the following description, details are set forth for the purpose of explanation. It should be understood that those of ordinary skill in the art can recognize that this application can be implemented without these specific details. In other instances, well-known structures and processes are not elaborated in detail to avoid obscuring the description of this application with unnecessary details. Therefore, this application is not intended to be limited to the embodiments shown, but rather to be in line with the broadest scope consistent with the principles and features disclosed in this application.
[0027] The smart glasses have the form of natural glasses and can have functions such as extended reality display, wearing state detection, biometric recognition, human-computer interaction, and data processing. The smart glasses can include a frame, temple arms, a processor, sensors, an optical display component, a microphone, a speaker, etc. There are cavities inside the temple arms and the frame, and circuits and electronic components are placed in the cavities.
[0028] The sensors can include a camera, an eye tracker, an iris scanner, an IMU, a gyroscope, etc. The optical display component includes a micro-projection optical machine and an optical coupler. The micro-projection optical machine can be based on Micro-Oled, can be based on Micro-Led, can be based on LCOS, can be based on LBS. The optical coupler can be an optical lens or a waveguide plate. The processor can be an XR professional processor or an ordinary general-purpose processor. The frame and temple arms are the support structure of the whole glasses. The temple arms have a certain elasticity, and the length and clamping force can be adjusted to suit the wearing of users with different head shapes. The camera can capture the user's hand, face, eyes, etc. The microphone can listen to the user's voice, and the processor can calculate and process various data.
[0029] Smart glasses are electronic devices that can be worn on the human eyes, including but not limited to common AI glasses, camera glasses, XR glasses, audio glasses, Bluetooth glasses, etc. on the market now. The smart glasses have the form of ordinary glasses, consisting of a frame, a frame, and temple arms, and are configured with electronic devices such as a power supply, a computing processor, sensors, etc., which can be built into the glasses case or externally electrically connected.
[0030] For current smart glasses, such as AR glasses, Bluetooth glasses, VR glasses, etc., the shooting direction of the cameras set on the glasses is generally fixed. When the user wears them, they can only shoot in a single landscape or portrait orientation.
[0031] Therefore, when the user needs to switch from landscape to portrait for shooting, or from portrait to landscape shooting, the entire pair of glasses must be directly rotated, and in this process, the user needs to take off the glasses, resulting in a poor user experience.
[0032] For this, please refer to Figures 1 to 3 , some embodiments of the present application provide a smart glasses 100, including a glasses body 10, a camera 20, a position detection device 30 and a control device 40; the camera 20 is rotatably installed on the glasses body 10, and the camera 20 has a horizontal photographing position and a vertical photographing position on its rotation stroke; the position detection device 30 is used to detect the position information of the camera 20; the control device 40 is used to select a corresponding processing algorithm according to the position information detected by the position detection device 30.
[0033] It should be noted that the specific implementation form of the smart glasses 100 is not limited, and it can be an AR glasses, a Bluetooth glasses, a VR glasses, etc., which are not limited here, and the specific implementation form of the position detection device 30 is not limited, and it can be in the form of a Hall element 32, or in the form of an optical distance sensor, etc., which are not limited here, and the specific implementation form of the control device 40 is not limited, and it can be in the form of a single-chip microcomputer, or in the form of a control chip, or in the form of a control circuit, etc., which are not limited here. And the specific rotation mode of the camera 20 is not limited, and it can be directly rotated manually by the user, or a driving device can be set, such as a driving motor, a driving cylinder, etc., to drive the camera 20 to rotate, etc., which are not limited here. And the installation position of the camera 20 is not limited, and it can be set on the frame or on the temple, which are not limited here.
[0034] Specifically, the specific content of the processing algorithms corresponding to the horizontal photographing position and the vertical photographing position is not limited, as long as the images can be processed corresponding to landscape shooting and portrait shooting. In some embodiments, the resolution corresponding to portrait shooting is X multiplied by Y, and the resolution corresponding to landscape shooting becomes Y multiplied by X. The processing algorithm can specifically be to modify the resolution of the image. For example, when the camera 20 is in the vertical photographing position, the control device 40 selects a corresponding processing algorithm to adjust the resolution of the image captured by the camera 20 to X multiplied by Y, and when the camera 20 is in the horizontal photographing position, the control device 40 selects a corresponding processing algorithm to adjust the resolution of the image captured by the camera 20 to Y multiplied by X.
[0035] It can be understood that the position detection device 30 is used to detect the position information of the camera 20. Thus, through the position detection device 30, it can accurately detect whether the camera 20 is in the horizontal shooting position or the vertical shooting position. Then, the control device 40 can select the corresponding processing algorithm according to the position information detected by the position detection device 30. That is, when the camera 20 is in the horizontal shooting position, the corresponding processing algorithm for the horizontal position is selected; when the camera 20 is in the vertical shooting position, the processing algorithm for the vertical position is selected. Thus, different processing algorithms are selected and called according to the position information detected by the position detection device 30 to perform algorithm calibration on the shooting effect.
[0036] In the embodiment of the present application, the camera 20 is rotatably mounted on the glasses body 10. Therefore, when it is necessary to switch from horizontal shooting to vertical shooting, or from vertical shooting to horizontal shooting, only the camera 20 needs to be rotated to change the shooting direction of the camera 20, without the user having to take off the glasses, nor does the user need to rotate the entire glasses, which improves the convenience of switching of the smart glasses 100. Moreover, a position detection device 30 and a control device 40 are also provided. The control device 40 is used to select the corresponding processing algorithm according to the position information detected by the position detection device 30, so that the smart glasses 100 have a better shooting effect whether in the horizontal screen or the vertical screen.
[0037] For the camera 20, it is not limited here that only the acquisition module 22 or the photosensitive module is rotatably mounted, or the entire camera 20 is rotatably mounted.
[0038] In some embodiments, the camera 20 includes a substrate 21, an acquisition module 22, and a connection member 23. The substrate 21 is rotatably mounted on the glasses body 10; the acquisition module 22 is used for image acquisition and is fixedly mounted on the substrate 21; the connection member 23 connects the substrate 21 and the control device 40.
[0039] It should be noted that the substrate 21 is a circuit board, which can be a PCB board. It cooperates with the connection member 23 to transmit the image information collected by the acquisition module 22 to the control device 40.
[0040] The specific implementation form of the connection member 23 is not limited. It can be in the form of an FPC, or in the form of a coaxial cable, or in the form of a data cable, etc. It is not limited here.
[0041] Correspondingly, in the solution of this embodiment, the substrate 21 is rotatably mounted on the glasses main body 10. When the substrate 21 rotates, it can drive the acquisition module 22 to rotate together, thereby changing the shooting direction of the camera 20, so that the camera 20 can be switched between the horizontal shooting position and the vertical shooting position.
[0042] Meanwhile, in some embodiments, the position detection device 30 includes a magnetic member 31 and a Hall element 32. The magnetic member 31 is fixedly arranged on the glasses main body 10; the Hall element 32 is fixedly mounted on the substrate 21 to approach or move away from the magnetic member 31 when the substrate 21 rotates.
[0043] It should be noted that the specific implementation form of the magnetic member 31 is not limited. It can be in the form of a permanent magnet, or in the form of an electromagnetic coil generating a magnetic field, or in the form of a magnetized element, etc. It is not limited here. When the distance between the Hall element 32 and the magnetic member 31 changes, the level of the electrical signal generated by it will also change accordingly. When the distance is close, a low level is output, and when the distance is far, a high level is output. Thus, it is judged whether the camera 20 is in the horizontal shooting position or the vertical shooting position according to the level high or low output by the Hall element 32.
[0044] Correspondingly, in the solution of this embodiment, by fixedly mounting the Hall element 32 on the substrate 21, when the substrate 21 rotates, the Hall element 32 will also rotate together. And the magnetic member 31 is mounted on the glasses main body 10. Therefore, when the substrate 21 rotates, the magnetic member 31 will not rotate, so that when the Hall element 32 follows the substrate 21 to rotate, it can move closer to or away from the magnetic member 31.
[0045] Specifically, it can be that when the Hall element 32 generates a high level, the camera 20 is in the horizontal shooting position, and when it generates a low level, the camera 20 is in the vertical shooting position. Or it can be that when the Hall element 32 generates a high level, the camera 20 is in the vertical shooting position, and when it generates a low level, the camera 20 is in the horizontal shooting position. It is not limited here.
[0046] Of course, in some embodiments, it can also be that the Hall element 32 is mounted on the glasses main body 10, and the magnetic member 31 is mounted on the substrate 21. When the substrate 21 rotates, the magnetic member 31 approaches or moves away from the Hall element 32.
[0047] In some embodiments, in order to limit the rotation stroke of the substrate 21 so that its one-time rotation is exactly 90°, a limiting structure can also be provided on the glasses body 10. Through the limiting effect of the limiting structure, the one-time rotation of the substrate 21 is exactly 90°, so as to better switch between the horizontal photographing position and the vertical photographing position.
[0048] In a further embodiment, the substrate 21 has an abutting side 211, and the Hall element 32 is installed on the abutting side 211; a limiting rib 50 protrudes from the glasses body 10, the limiting rib 50 is arranged adjacent to the abutting side 211, and when the camera 20 is in the horizontal photographing position or the vertical photographing position, it abuts against the abutting side 211 to limit the rotation of the camera 20.
[0049] Please refer to Figure 3 , in the solution of this embodiment, when the camera 20 is in the horizontal photographing position or the vertical photographing position, the limiting rib 50 abuts against the abutting side 211, so that the camera 20 can only rotate from the horizontal photographing position to the vertical photographing position when it is in the horizontal photographing position, and the camera 20 can only rotate from the vertical photographing position to the horizontal photographing position when it is in the vertical photographing position, thereby limiting the rotation stroke of the camera 20 and making the one-time rotation of the camera 20 exactly 90°. Especially when manually rotating the camera 20, the camera 20 can be switched between the horizontal photographing position and the vertical photographing position more accurately.
[0050] In some embodiments, the magnetic member 31 protrudes from the surface of the glasses body 10 to form the limiting rib 50.
[0051] Correspondingly, in the solution of this embodiment, by making the magnetic member 31 abut against the abutting side 211 to limit the rotation of the camera 20, there is no need to additionally provide a limiting structure, effectively reducing the cost.
[0052] It should be noted that since the movement of the camera 20 is a rotation, when using a conventional connecting member 23, such as a flexible circuit board, the copper layer thickness of the flexible circuit board is only 12 - 20 um, and the flexible circuit board is only a one-dimensional plane, which cannot cope with the rotation scenario and will cause tearing, signal attenuation, and characteristic impedance imbalance.
[0053] In one embodiment, the connecting member 23 is a multi-strand coaxial cable, and the coaxial cable has good dynamic bending and static bending capabilities and can be applied to the design of the glasses temple and the rotating shaft position.
[0054] Furthermore, the wiring of the camera 20 includes high-speed MIPI wiring and power lines. Generally, about 16 signal lines are sufficient. Using wires with a gauge of 32 - 42 AWG can meet the transmission requirements of high-speed signal lines. The minimum diameter of a single wire can be made to 0.2 mm, and the total linear diameter can be made less than 1.4 mm, thus better meeting the rotation requirements of the camera 20.
[0055] On the other hand, please also refer to Figure 4 , the embodiment of the present application provides a control method for the smart glasses 100. The control method is applied to the smart glasses 100 as described in any of the above. The smart glasses 100 further include a driving device. The driving device is drivingly connected to the camera 20 and electrically connected to the control device 40 to drive the camera 20 to rotate according to the instructions of the control device 40. The control method includes: Step S100: When a switching instruction is received, control the driving device to drive the camera 20 to switch between the horizontal shooting position and the vertical shooting position; Step S200: According to the position information detected by the position detection device 30, correspondingly select the appropriate processing algorithm.
[0056] It should be noted that the specific implementation form of the driving device is not limited. It can be a driving motor, a driving cylinder, etc., to drive the camera 20 to rotate, etc., which is not limited here. When a switching instruction is received, controlling the driving device to drive the camera 20 to switch between the horizontal shooting position and the vertical shooting position can be controlling the driving device to drive the camera 20 to switch from the horizontal shooting position to the vertical shooting position, or controlling the driving device to drive the camera 20 to switch from the vertical shooting position to the horizontal shooting position, which is not limited here.
[0057] The specific generation form of the switching instruction is not limited. It can be triggered by an APP, a TP, a button, iris recognition, head shaking, etc., which is not limited here.
[0058] Specifically, the specific content of the processing algorithms corresponding to the horizontal shooting position and the vertical shooting position is not limited, as long as the images can be processed correspondingly according to horizontal screen shooting and vertical screen shooting. In some embodiments, the resolution corresponding to the vertical screen shooting of the image is X multiplied by Y, and the resolution corresponding to the horizontal screen shooting becomes Y multiplied by X. The processing algorithm can specifically be to modify the resolution of the image correspondingly. For example, when the camera 20 is in the vertical shooting position, the control device 40 selects the corresponding processing algorithm to adjust the resolution of the image captured by the camera 20 to X multiplied by Y, and when the camera 20 is in the horizontal shooting position, the control device 40 selects the corresponding processing algorithm to adjust the resolution of the image captured by the camera 20 to Y multiplied by X.
[0059] Correspondingly, in the solution of this embodiment, when a switching instruction is received, the driving device is controlled to drive the camera 20 to switch between the horizontal shooting position and the vertical shooting position, and according to the position information detected by the position detection device 30, the corresponding processing algorithm is selected accordingly, so as to select and call different processing algorithms according to the position information detected by the position detection device 30 to perform algorithm calibration on the shooting effect to obtain a better shooting effect.
[0060] Further, before the step of receiving the switching instruction, the control method further includes: Step S80: Detect the action information of the user; Step S90: Trigger the switching instruction based on the action information of the user.
[0061] It should be noted that the specific implementation form of detecting the action information of the user is not limited. It can be detecting the gesture information of the user, or detecting the blinking information of the user, or detecting the iris information of the user, etc., which are not limited herein.
[0062] It can be understood that the smart glasses 100 are worn on the user's eyes. Therefore, direct operation of the smart glasses 100 often has many inconveniences.
[0063] Correspondingly, in the technical solution of this embodiment, by detecting the action information of the user and triggering the switching instruction based on the action information of the user, the switching of the rotation of the camera 20 can be realized only by the user performing a specific action, rather than the user actually directly operating the smart glasses 100, which improves the convenience of the user for switching the camera 20.
[0064] Even further, in some embodiments, the smart glasses 100 further include a blinking detection module, and the blinking detection module is used to detect the number of blinks of the user; The step of detecting the action information of the user includes: Step S81: Control the blink detection module to detect the number of blinks of the user.
[0065] Specifically, the specific implementation form of the blink detection module is not limited. It can be in the form of an action sensor to detect the blink action of the user, or another camera 20 can be set on the glasses body 10 of the smart glasses 100 to capture the eyes of the user through this camera 20, and then identify the number of blinks of the user, etc. This is not limited herein.
[0066] Correspondingly, in the solution of this embodiment, considering that the smart glasses 100 are worn at the glasses of the user, the switching instruction is triggered by detecting the number of blinks of the user, and the user no longer needs to directly operate the smart glasses 100. Moreover, the blink detection module on the smart glasses 100 is used to detect the eye movement of the user. The distance between the blink detection module and the eyes of the user is close, and the detection accuracy is higher.
[0067] After detecting the number of blinks of the user, the specific triggering form is not limited. It can be that the user does not blink within a certain time, and the switching instruction is generated correspondingly, or after detecting that the user blinks continuously several times, the switching instruction is generated correspondingly, etc. This is not limited herein.
[0068] In some embodiments, the step of triggering the switching instruction based on the action information of the user includes: Step S91: When the number of blinks within a preset time duration exceeds a preset value, trigger the switching instruction.
[0069] It should be noted that the specific value of the preset time duration is not limited. It can be 10 seconds, 20 seconds, 11 seconds, etc. This is not limited herein. The specific value of the preset value is not limited. It can be two times, three times, four times, etc. In some embodiments, the preset time duration is 5 seconds and the number of blinks is 5 times. In this way, it can more effectively avoid the switching instruction being accidentally triggered by the user's daily blink action.
[0070] Correspondingly, in the technical solution of this embodiment, when the number of blinks within a preset time duration exceeds a preset value, the switching instruction is triggered. Only when the number of blinks accumulates to a certain number within a short time will the switching instruction be triggered, which can more effectively avoid the switching instruction being accidentally triggered by the user's daily blink action.
[0071] In some embodiments, the step of triggering the switching instruction based on the action information of the user includes: Step S92: When the camera 20 detects preset gesture information, trigger the switching instruction.
[0072] It should be noted that when the user uses the smart glasses 100, the user can be guided to customize gesture information, so as to store preset gesture information. When the camera 20 works, that is, when the user uses the smart glasses 100 to enter the photo-taking mode, the camera 20 detects the information of the user's actions in real time. When the camera 20 detects the preset gesture information, the switching instruction is triggered, so as to switch from the original horizontal photo-taking position to the vertical photo-taking position, or from the original vertical photo-taking position to the horizontal photo-taking position. Of course, it can also be that when the smart glasses 100 leave the factory, preset gesture information is built in, etc., which is not limited here.
[0073] The form of the specific preset gesture information is not limited. It can be that the user waves the palm to the left twice, or the user waves the palm to the right twice, etc., which is not limited here.
[0074] Corresponding to the technical solution of this embodiment, by using the camera 20 to detect the gesture information of the user, it is no longer necessary to additionally set a detection module for detection, saving the production and manufacturing costs, and during the process of triggering the switching instruction, it is no longer necessary to directly operate the smart glasses 100, improving the convenience of triggering.
[0075] In some embodiments, the smart glasses 100 further include a gravity sensor 70. The gravity sensor 70 is used to detect the head posture of the user. After the step of correspondingly selecting the corresponding processing algorithm, the control method further includes: Step S300: Obtain the posture information detected by the gravity sensor 70; It can be understood that after the head posture of the user is tilted to a certain extent, the smart glasses 100 worn on the user's head will also tilt accordingly. At this time, the gravity sensor 70 can effectively detect the tilt angle of the user's head.
[0076] Step S400: Determine the compensation angle information according to the posture information; Specifically, for example, when the gravity sensor 70 detects that the tilt angle of the user's head is -5°, the corresponding control compensation angle is 5°.
[0077] Step S500: Correspondingly control the driving device to drive the camera 20 to rotate by a corresponding angle according to the compensation angle information.
[0078] It can be understood that since our smart glasses 100 are worn on the user's head, when taking pictures, the user's head is prone to tilting, resulting in the tilting of the viewfinder screen 60. For example, when the camera 20 is disposed on the spectacle frame, if the user's head tilts left or right, the viewfinder screen 60 corresponding to the camera 20 will also tilt left or right accordingly. When the camera 20 is disposed on the temple, if the user's head tilts forward or backward, at this time, the viewfinder screen 60 corresponding to the camera 20 will also tilt forward or backward accordingly, and the effect of the taken photos or videos is poor.
[0079] Correspondingly, in the solution of this embodiment, by disposing the gravity sensor 70, after the camera 20 switches to the vertical shooting position or the horizontal shooting position, the gravity sensor 70 can be used to detect the user's head posture, determine the compensation angle information according to the posture information, and correspondingly control the driving device to drive the camera 20 to rotate by a corresponding angle according to the compensation angle information. Thus, by rotating the camera 20, the camera 20 can be kept in a horizontal state, so that the photographing effect is better.
[0080] That is to say, in the solution of this application, when the user takes pictures, even if the user's head tilts or moves slightly, the cooperation of the gravity sensor 70 and the driving device can keep the camera 20 in a horizontal state, making the effect of the taken photos better.
[0081] It should be noted that the installation position of the gravity sensor 70 is not restricted. It can be installed on the glasses main body 10 or on the camera 20. There is no limitation here. Please refer to Figure 3 In this case, the gravity sensor 70 is installed on the substrate 21 of the camera 20, so that when the user takes pictures, the tilting angle of the camera 20 can be effectively obtained, and the camera 20 can be quickly adjusted to a horizontal state.
[0082] In some embodiments, the smart glasses 100 further include a display module 80, and the control method further includes: Step S600: Obtain a plurality of viewfinder screens 60 when the camera 20 rotates; Step S700: Cut out a first viewfinder portion 61 with a consistent viewfinder range from the plurality of viewfinder screens 60; Step S800: Control the display module 80 to display the first viewfinder portion 61.
[0083] Please refer to Figure 5 , Figure 5The figure shows the viewfinder images 60 of the camera 20 at the vertical shooting position, the horizontal shooting position, and during the rotation process. Here, the viewfinder image 60 can also be understood as the viewfinder range. During the rotation of the camera 20, if the user's head does not move, a part of its viewfinder image 60 or the viewfinder range will not change, that is Figure 5 the part within the circle in the figure. Regardless of the angle to which the camera 20 rotates, the camera 20 can view this part of the range. For some parts outside the circle, when the camera 20 rotates, the viewed image and range will change. If the entire viewfinder image 60 is directly displayed to the user during the rotation of the camera 20, showing a rotating image close to the user's eyes, it is likely to cause the user to feel dizzy.
[0084] Therefore, in the solution of this embodiment, multiple viewfinder images 60 during the rotation of the camera 20 are obtained, and the first viewfinder part 61 with a consistent viewfinder range among the multiple viewfinder images 60 is cut out, that is Figure 5 the part within the circle in the figure. The display module 80 is controlled to display the first viewfinder part 61. Since only the part within the circle is displayed on the display device, even if the camera 20 rotates, the actually displayed image is not rotating, and can even be understood as a static image, thus effectively avoiding the user from feeling dizzy.
[0085] Please refer to Figure 6 simultaneously. Taking the display module 80 in landscape mode as an example, when the camera 20 is in the vertical shooting position, a rectangular display image 81 is displayed in the middle of the display module 80, that is Figure 6 the display image 81 of the first display module 80 in the figure. When the switching instruction is received, the camera 20 rotates. At this time, the display image 81 of the display module 80 switches to the display image 81 of the second display module 80. Correspondingly, the display image 81 is circular and is used to display Figure 5 the circular first viewfinder part 61 in the figure. Then, when the camera 20 rotates to the horizontal shooting position, the display image 81 of the display module 80 switches to the display image 81 of the third display module 80 for full-screen display. With this setting, when the camera 20 rotates and switches, the actually displayed image is not rotating, and can even be understood as a static image, thus effectively avoiding the user from feeling dizzy.
[0086] It should be emphasized that the display module 80 can be a physical screen (i.e., an optical lens) or a virtual screen. Among them, the virtual screen is the micro display screen of the AR glasses that forms a virtual display screen in front of the user after being propagated and converted by many optical components (for example, after wearing the AR glasses, a 1280*960 giant screen is projected at a position 4m in front of the eyes).
[0087] The present application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, and the computer-readable program instructions are used to execute the control method of the smart glasses in the above embodiments.
[0088] The computer-readable storage medium provided by the present application can be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems, or devices, or any combination of the above. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium can be any tangible medium that contains or stores a program, and this program can be used by or combined with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium can be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.
[0089] The above computer-readable storage medium can be included in the smart glasses; or it can exist separately and not be assembled into the smart glasses.
[0090] The above computer-readable storage medium carries one or more programs. When the above one or more programs are executed by the smart glasses, the smart glasses are caused to: when receiving a switching instruction, control the driving device to drive the camera to switch between the horizontal photographing position and the vertical photographing position; According to the position information detected by the position detection device, correspondingly select a corresponding processing algorithm.
[0091] Computer program code for performing the operations of this application can be written in one or more programming languages or combinations thereof. The above-mentioned programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, executed as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, by connecting through an Internet service provider via the Internet).
[0092] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than that marked in the accompanying drawings. For example, two consecutively represented blocks may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system for performing the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.
[0093] The modules described in the embodiments of this application can be implemented in software or in hardware. Among them, the name of the module does not constitute a limitation to the unit itself in some cases.
[0094] The readable storage medium provided by this application is a computer-readable storage medium. The computer-readable storage medium stores computer-readable program instructions (i.e., computer programs) for performing the control method of the above-mentioned smart glasses, and can solve the technical problem of inconvenient operation of switching between landscape and portrait shooting of existing smart glasses. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by this application are the same as those of the control method of the smart glasses provided in the above embodiments, and will not be elaborated here.
[0095] The above has introduced in detail the smart glasses and its control method provided by the embodiments of the present application. Specific examples are used in this article to elaborate on the principle and implementation manner of the present application. The description of the above embodiments is only used to help understand the method and its core idea of the present application; at the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present application.
Claims
1. An intelligent glasses, characterized in that, Comprising: The main body of the glasses; A camera rotatably mounted on the main body of the glasses, the camera having a horizontal photographing position and a vertical photographing position on its rotation stroke; A position detection device for detecting the position information of the camera; And, A control device for correspondingly selecting a corresponding processing algorithm according to the position information detected by the position detection device.
2. The smart glasses according to claim 1, characterized in that The camera includes: A substrate rotatably mounted on the main body of the glasses; An acquisition module for performing image acquisition, fixedly mounted on the substrate; and, A connecting member connecting the substrate and the control device.
3. The smart glasses according to claim 2, characterized in that The position detection device includes: A magnetic member fixedly provided on the main body of the glasses; and, A Hall element fixedly mounted on the substrate to approach or move away from the magnetic member when the substrate rotates.
4. The smart glasses according to claim 3, characterized in that, The substrate has an abutting side, and the Hall element is mounted on the abutting side; A limiting rib protrudes from the main body of the glasses, the limiting rib is arranged adjacent to the abutting side, and when the camera is in the horizontal photographing position or the vertical photographing position, it abuts against the abutting side to limit the rotation of the camera.
5. The smart glasses according to claim 2, characterized in that The connecting member is a multi-strand coaxial cable.
6. A control method for a smart glasses, characterized in that, Applied to the smart glasses according to any one of claims 1 to 5, the smart glasses further include a driving device, the driving device is drivingly connected to the camera and electrically connected to the control device to drive the camera to rotate according to the instruction of the control device, and the control method includes: When receiving a switching instruction, controlling the driving device to drive the camera to switch between the horizontal photographing position and the vertical photographing position; Correspondingly selecting a corresponding processing algorithm according to the position information detected by the position detection device.
7. The control method according to claim 6, wherein Before the step of when receiving the switching instruction, the control method further includes: Detecting the action information of the user; Triggering the switching instruction based on the action information of the user.
8. The control method according to claim 7, wherein The smart glasses further include a blink detection module for detecting the number of blinks of the user; The step of detecting the action information of the user includes: Controlling the blink detection module to detect the number of blinks of the user.
9. The control method according to claim 8, characterized in that The step of triggering the switching instruction based on the action information of the user includes: When the number of blinks within a preset time duration exceeds a preset value, triggering the switching instruction.
10. The control method according to claim 7, characterized in that The step of triggering the switching instruction based on the action information of the user includes: When the camera detects preset gesture information, triggering the switching instruction.
11. The control method according to claim 6, characterized in that, The smart glasses further include a gravity sensor for detecting the head posture of the user. After the step of correspondingly selecting a corresponding processing algorithm, the control method further includes: Obtaining the posture information detected by the gravity sensor; Determining compensation angle information according to the posture information; Controlling the driving device to drive the camera to rotate a corresponding angle according to the compensation angle information.
12. The control method according to claim 6, wherein The smart glasses further include a display module, and the control method further includes: Obtaining a plurality of viewfinder images when the camera rotates; Cutting out a first viewfinder part with a consistent viewfinder range among the plurality of viewfinder images; Control the display module to display the first viewfinder portion.
Citation Information
Patent Citations
Camera control method and device, mobile terminal and computer readable medium
CN108668077A
Head-mounted equipment, display control method and display control device
CN113325586A
Intelligent lifting control method, storage medium and electronic equipment
CN113709446A
Intelligent glasses
CN113777806A
Camera pose compensation method and device, electronic equipment and readable storage medium
CN114777773A