Intelligent wearable device and control method of intelligent wearable device

Abstract

The invention discloses intelligent wearable equipment and a control method of the intelligent wearable equipment, the intelligent wearable equipment comprises an equipment main body, a display module, a first driving device, a first camera module and a first detection module, the display module is arranged on the equipment main body, the first driving device is arranged on the equipment main body, the first camera module is arranged on the first driving device, and the first detection module is arranged on the first driving device. The first camera module is electrically connected to the display module, the first detection module is arranged on the equipment main body, the first detection module is electrically connected to the first driving device, and the first detection module is used for detecting eyeball rotation information or head rotation information of a user; the first driving device is used for driving the first camera module to rotate to shoot a first image according to the eyeball rotation information or the head rotation information. By adopting the scheme of the invention, the first camera module can rotate along with the eyeballs of the user, so that the visual angle of the first image shot by the first camera module is approximately consistent with the visual angle of the user.

Description

Technical Field

[0001] The present invention relates to the technical field of wearable devices, and in particular to an intelligent wearable device and a control method for the intelligent wearable device. Background Art

[0002] Smart wearable devices such as AR glasses and MR glasses usually include a device body and a camera module. The camera module is fixed to the device body to capture the user's surrounding environment. When the user's head turns, the device body will follow the user's head, so the camera module will also follow the user's head, so that the camera module's shooting angle is consistent with the user's angle. However, in actual use, the user's eyeballs will also turn, causing the user's angle of view to change, which in turn causes the camera module's shooting angle of view to deviate from the user's angle of view, affecting the user's experience. Summary of the invention

[0003] The embodiment of the present invention discloses a smart wearable device and a control method for the smart wearable device, which can enable a first camera module to follow the rotation of a user's eyeball, so that the viewing angle of a first image captured by the first camera module is roughly consistent with the viewing angle of the user.

[0004] In order to achieve the above objectives, in a first aspect, the present invention discloses a smart wearable device, comprising:

[0005] Equipment body;

[0006] A display module, wherein the display module is arranged on the device body;

[0007] a first driving device, the first driving device being arranged on the device body;

[0008] a first camera module, the first camera module is disposed in the first driving device, the first camera module is used to capture a first image, the first image is used to describe the user's field of view, the first camera module is electrically connected to the display module, and the display module is used to display a second image to the user according to the first image; and

[0009] A first detection module, the first detection module is disposed in the device body, the first detection module is electrically connected to the first driving device, and the first detection module is used to detect eye movement information or head movement information of the user;

[0010] Among them, the first driving device is used to drive the first camera module to rotate according to the eye rotation information or the head rotation information to capture the first image.

[0011] As an optional implementation manner, in an embodiment of the first aspect of the present invention,

[0012] The display module includes an optical component and a projection device, wherein the optical component is disposed on the device body, the optical component includes a first side facing the user and a second side opposite to the first side, the optical component is used to transmit light propagating from the second side to the first side, the projection device is disposed on the device body, the projection device is electrically connected to the first camera module, the projection device is used to project the second image onto the optical component according to the first image, and the optical component is used to reflect the second image toward the user, or,

[0013] The display module has a display side, and the display side faces the user to display the second image toward the user.

[0014] As an optional implementation, in an embodiment of the first aspect of the present invention, the number of the first driving device and the first camera module are both one, and the first driving device is disposed in the middle of the device body, or,

[0015] There are multiple first driving devices and multiple first camera modules, and multiple first driving devices are arranged at intervals on the device body, and each first camera module is correspondingly arranged on each first driving device.

[0016] As an optional implementation, in an embodiment of the first aspect of the present invention, the first image includes a first sub-image and a second sub-image, the first sub-image is used to describe the field of view of the left eyeball of the user, the second sub-image is used to describe the field of view of the right eyeball of the user, and the number of the first driving device and the number of the first camera module are both two.

[0017] The first driving device is disposed on the left side of the middle part of the device body, and the first camera module located on the left side of the middle part of the device body is used to capture a first sub-image.

[0018] Another first driving device is arranged on the right side of the middle part of the device body, and the first camera module located on the right side of the middle part of the device body is used to capture the second sub-image.

[0019] As an optional implementation, in an embodiment of the first aspect of the present invention, the smart wearable device also includes a second camera module, which is arranged on the device body at an interval relative to the first driving device, and the second camera module is used to capture a third image, and the third image is used to describe the user's frontal field of view, and the display module is used to display a second image to the user based on the first image and the third image.

[0020] As an optional implementation, in an embodiment of the first aspect of the present invention, the device body is provided with a mounting groove, and the smart wearable device also includes a second driving device, the second driving device is arranged in the mounting groove, the first driving device is arranged in the second driving device, and the second driving device is used to drive the first driving device and the first camera module to move until they protrude from or are hidden in the mounting groove.

[0021] As an optional implementation, in an embodiment of the first aspect of the present invention, the first detection module is also used to detect the rotation information of the device body, and the first driving device is also used to drive the first camera module to rotate according to the rotation information of the device body to maintain the position of the first image taken by the first camera module.

[0022] As an optional implementation, in an embodiment of the first aspect of the present invention, the first driving device is used to drive the first camera module to rotate along a first direction and a second direction perpendicular to the first direction according to the eye rotation information or the head rotation information to capture the first image.

[0023] As an optional implementation, in an embodiment of the first aspect of the present invention, the first driving device includes a mounting seat, a first frame, a second frame and a driving module, and the first camera module is disposed on the mounting seat.

[0024] The mounting seat is rotatably connected to the first frame along the first direction, and the first frame is rotatably connected to the second frame along the second direction, or the mounting seat is rotatably connected to the first frame along the second direction, and the first frame is rotatably connected to the second frame along the first direction.

[0025] The second frame is arranged on the device body, the driving module is arranged on the first frame, the driving module is electrically connected to the first detection module, the driving module is used to drive the mounting seat to rotate relative to the first frame according to the eye rotation information or the head rotation information, and the driving module is also used to drive the first frame to rotate relative to the second frame according to the eye rotation information or the head rotation information.

[0026] In a second aspect, the present invention discloses a control method for a smart wearable device, characterized in that the smart wearable device includes a first driving device and a first camera module, the first camera module is provided on the first driving device, and the method includes:

[0027] Acquire current rotation information of the user's eyeball or head, where the current rotation information includes a current rotation direction;

[0028] Determining a target rotation direction and a target rotation angle according to the current rotation information;

[0029] The first driving device is controlled to drive the first camera module to rotate according to the target rotation direction and the target rotation angle.

[0030] As an optional implementation manner, in an embodiment of the second aspect of the present invention, the target rotation direction is consistent with the current rotation direction, and the target rotation angle is a preset rotation angle.

[0031] As an optional implementation, in an embodiment of the second aspect of the present invention, the current rotation information also includes a current rotation angle, the target rotation direction is consistent with the current rotation direction, and the target rotation angle is the same as the current rotation angle.

[0032] As an optional implementation, in an embodiment of the second aspect of the present invention, the current rotation information also includes a current rotation angle, the target rotation direction is consistent with the current rotation direction, and the target rotation angle is in a preset ratio with the current rotation angle.

[0033] Compared with the prior art, the present invention has the following beneficial effects:

[0034] An embodiment of the present invention provides a smart wearable device and a control method for the smart wearable device. The smart wearable device includes a device body, a display module, a first driving device, a first camera module and a first detection module. The first driving device can drive the first camera module to rotate relative to the device body, thereby changing the viewing angle of a first image taken by the first camera module relative to the device body. The first detection module is used to detect the user's eye movement information or head movement information. The first driving device can drive the first camera module to rotate according to the user's eye movement information (such as the direction and angle of eye movement, etc.), so that the first camera module follows the user's eye movement, so that the viewing angle of the first image taken by the first camera module is roughly consistent with the user's viewing angle, and then the display module displays the first image. When viewing two images, it is possible to make adjustments based on the first image so that the second image viewed by the user is more consistent with the user's actual viewing angle, thereby reducing the impact on the user's usage experience. Alternatively, since the user's eye movement usually occurs simultaneously with the head movement and the rotation direction is consistent, the first driving device can drive the first camera module to rotate a certain angle based on the user's head rotation information (such as the direction and angle of head rotation, etc.), so that the first camera module follows the user's eye movement, thereby making the viewing angle of the first image taken by the first camera module more consistent with the user's viewing angle. Furthermore, when the display module displays the second image, it can make adjustments based on the first image so that the second image viewed by the user is more consistent with the user's actual viewing angle, thereby reducing the impact on the user's usage experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0036] Figure 1 is a schematic diagram of the three-dimensional structure of the smart wearable device disclosed in the first aspect of the embodiment of the present application;

[0037] Figure 2 yes Figure 1 A cross-sectional view of the smart wearable device in the AA direction;

[0038] Figure 3 is a cross-sectional view of the smart wearable device disclosed in the first aspect of the embodiment of the present application in another state;

[0039] Figure 4 is a schematic structural diagram of a first driving device disclosed in the first aspect of an embodiment of the present application;

[0040] Figure 5 is a schematic diagram of the three-dimensional structure of another smart wearable device disclosed in the first aspect of the embodiment of the present application;

[0041] Figure 6 is a schematic diagram of the three-dimensional structure of another smart wearable device disclosed in the first aspect of the embodiment of the present application;

[0042] Figure 7 It is a flowchart of a control method of a smart wearable device disclosed in the second aspect of an embodiment of the present application;

[0043] Figure 8 It is a structural diagram of another example of the smart wearable device disclosed in the embodiment of the present application.

[0044] Icons: 1. smart wearable device; 10. device body; 100. mounting slot; 11. display module; 110. display side; 12. first drive device; 120. mounting seat; 121. first frame; 122. second frame; 123. drive module; 13. first camera module; 14. first detection module; 15. second camera module; 16. second drive device; X, first direction; Y, second direction. DETAILED DESCRIPTION

[0045] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0046] The technical solution of the present invention will be further described below in conjunction with embodiments and drawings.

[0047] See also Figure 1 A first aspect of an embodiment of the present invention provides a smart wearable device 1, including a device body 10, a display module 11, a first driving device 12, a first camera module 13 and a first detection module 14, wherein the display module 11 is disposed on the device body 10, the first driving device 12 is disposed on the device body 10, the first camera module 13 is disposed on the first driving device 12, the first camera module 13 is used to capture a first image, the first image is used to describe the user's field of view, the first camera module 13 is electrically connected to the display module 11, the display module 11 is used to display a second image to the user according to the first image, the first detection module 14 is disposed on the device body 10, the first detection module 14 is electrically connected to the first driving device 12, the first detection module 14 is used to detect the user's eye movement information or head movement information, and the first driving device 12 is used to drive the first camera module 13 to rotate according to the eye movement information or the head rotation information to capture the first image.

[0048] In the smart wearable device 1 provided in the first aspect of the embodiment of the present invention, the first driving device 12 can drive the first camera module 13 to rotate relative to the device body 10, thereby changing the viewing angle of the first image captured by the first camera module 13 relative to the device body 10, and at the same time using the first detection module 14 to detect the user's eye movement information or head rotation information, and the first driving device 12 drives the first camera module 13 to rotate according to the user's eye movement information (such as the direction and angle of eye movement, etc.), so that the first camera module 13 follows the user's eye movement, so that the viewing angle of the first image captured by the first camera module 13 is roughly consistent with the user's viewing angle, and then when the display module 11 displays the second image, it can be adjusted according to the first image. , so that the second image viewed by the user is more consistent with the user's actual perspective, reducing the impact on the user's usage experience, or, because the user's eyeball movement usually occurs simultaneously with the head movement and the rotation direction is consistent, the first driving device 12 can drive the first camera module 13 to rotate a certain angle according to the user's head rotation information (such as the direction and angle of head rotation, etc.), so that the first camera module 13 follows the user's eyeball movement, so that the perspective of the first image captured by the first camera module 13 is more consistent with the user's perspective, and then when the display module 11 displays the second image, it can be adjusted according to the first image, so that the second image viewed by the user is more consistent with the user's actual perspective, reducing the impact on the user's usage experience.

[0049] Optionally, the smart wearable device 1 may be AR (Augmented Reality) glasses, MR (Mixed Reality) glasses, etc., which may be selected according to actual conditions and are not specifically limited in this embodiment.

[0050] As an optional implementation, the display module 11 includes optical components and a projection device, such as Figure 1 As shown, in this embodiment, the projection device is not shown in the figure, and the display module 1 in the figure only shows the optical component, the optical component is arranged in the device body 10, the optical component includes a first side facing the user and a second side opposite to the first side, the optical component is used to transmit the light propagating from the second side to the first side, the projection device is arranged in the device body 10, the projection device is electrically connected to the first camera module 13, the projection device is used to project the second image to the optical component according to the first image, and the optical component is used to reflect the second image toward the user.

[0051] In this way, when the display module 11 is configured to include an optical component and a projection device, since the optical component can transmit light propagating from the second side to the first side, the user can directly observe the real peripheral environment through the optical component, and by recognizing the first image captured by the first camera module 13, the projection device projects the second image (virtual image) at the required position of the optical component, and reflects the second image toward the user through the optical component, then the second image can be added to the real peripheral environment observed by the user, achieving an augmented reality effect. At this time, the smart wearable device 1 can be an AR glasses.

[0052] As another optional implementation, Figure 1 As shown, the display module 11 has a display side 110 , and the display side 110 faces the user to display the second image to the user.

[0053] In this way, when the display module 11 is configured to have a display side 110, and the display side 110 faces the user to display the second image to the user, the display module 11 can form a second image based on the first image captured by the first camera module 13 combined with the virtual image, and directly display the second image to the user to achieve a mixed reality effect. In this case, the smart wearable device 1 can be MR glasses.

[0054] In some embodiments, the smart wearable device 1 also includes a control module (not shown), which is electrically connected to the display module 11, the first drive module 123, the first camera module 13 and the first detection module 14. The control module is used to control the first drive device 12 to drive the first camera module 13 to rotate according to the user's eye movement information or head rotation information to maintain the position of the first image taken by the first camera module 13. The control module is also used to receive the first image taken by the first camera module 13, and control the display module 11 to display the second image according to the first image.

[0055] In this way, the control module can receive the eye movement information or the head rotation information detected by the first detection module 14, and process the eye movement information or the head rotation information to confirm the direction and angle in which the first driving module 123 needs to drive the first camera module 13 to rotate, so that the viewing angle of the first image taken by the first camera module 13 is kept consistent with the user's viewing angle as much as possible. The control module can also receive the first image taken by the first camera module 13 and identify and process the first image (for example, identify objects on the first image, synthesize other virtual images on the first image, etc.) to form a second image, and control the display module 11 to display the second image.

[0056] Optionally, the first detection module 14 can be an eye tracker or a visual sensor to obtain the rotation information of the user's eyeball. The first detection module 14 can also be an angular velocity sensor, an angular acceleration sensor, etc. to obtain the rotation information of the user's head. The specific selection can be made according to the actual situation and is not specifically limited in this embodiment. Among them, the rotation angle of the rotation information of the user's head can be obtained by calculation. For example, when the first detection module 14 is an angular acceleration sensor, it can detect the current rotation angular acceleration of the user's head, and calculate the current rotation angle through the relationship between the current rotation angular acceleration and time.

[0057] In some embodiments, the first detection module 14 is also used to detect the rotation information of the device body 10, and the first driving device 12 is also used to drive the first camera module 13 to rotate according to the rotation information of the device body 10 to maintain the position of the first image captured by the first camera module 13.

[0058] In this way, the first detection module 14 can detect the rotation information of the device body 10 (including the rotation direction and rotation angle of the device body 10), that is, it can detect slight shaking of the device body 10, so that the first camera module 13 can be driven to rotate according to the rotation information of the device body 10, so that the first camera module 13 rotates in a direction opposite to the rotation direction of the device body 10 and the rotation angle is the same as the rotation angle of the device body 10, so that the position of the first image taken by the first camera module 13 can be maintained when the device body 10 shakes, that is, the first image will not shake, and then the second image observed by the user will not shake, thereby improving the user experience.

[0059] Optionally, two different sensors can be set in the first detection module 14, one of which detects the user's eye rotation information or head rotation information, and the other sensor detects the rotation information of the device body 10. The first detection module 14 can also be set with a sensor, which simultaneously detects the user's head rotation information and the rotation information of the device body 10 (because the device body 10 is worn on the user's head, it can be considered that the rotation information of the device body 10 is the rotation information of the user's head). For example, an angular acceleration sensor is set. After calculation, when the detected rotation angle of the device body 10 is greater than or equal to a preset value, it is considered to be the user's head. The rotation of the device body 10 generated by the active rotation makes the first camera module 13 follow the rotation of the user's eyeballs, and the rotation direction is the same as the rotation direction of the head, so that the viewing angle of the first image taken by the first camera module 13 is roughly consistent with the viewing angle of the user. When the detected rotation angle of the device body 10 is less than the preset value, it is considered to be a slight shake of the device body 10, so that the first camera module 13 rotates in the direction opposite to the rotation direction of the device body 10 and the rotation angle is the same as the rotation angle of the device body 10, so that the position of the first image taken by the first camera module 13 can be maintained when the device body 10 shakes.

[0060] Please also read Figure 2 and Figure 3 In some embodiments, the device body 10 is provided with a mounting groove 100, and the smart wearable device 1 further includes a second driving device 16, the second driving device 16 is disposed in the mounting groove 100, the first driving device 12 is disposed in the second driving device 16, and the second driving device 16 is used to drive the first driving device 12 and the first camera module 13 to move to protrude from the mounting groove 100 (such as Figure 2 shown) or hidden in (as Figure 3 As shown) mounting groove 100.

[0061] In this way, by providing an installation groove 100 on the device body 10 and providing a second driving device 16 in the installation groove 100, the second driving device 16 can drive the first driving device 12 and the first camera module 13 to move. When the first camera module 13 needs to be used, the first driving device 12 and the first camera module 13 can be driven by the second driving device 16 to move until they are exposed from the device body 10, so that the first camera module 13 can normally capture the first image. When the first camera module 13 is not needed, the first driving device 12 and the first camera module 13 can be driven by the second driving device 16 to move until they are hidden in the installation groove 100, so that the appearance of the smart wearable device 1 is relatively simple.

[0062] Optionally, the second drive device 16 may be a lifting mechanism, for example, lifting and lowering is achieved through the cooperation of a slide rail and a slider or through an electric push rod, so that the second drive device 16 can drive the first drive device 12 and the first camera module 13 to slide relative to the device body 10. The second drive device 16 may also be a flipping mechanism, for example, flipping is achieved by setting a rotating shaft, so that the second drive device 16 can drive the first drive device 12 and the first camera module 13 to rotate relative to the device body 10. The specific selection can be made according to actual conditions and is not specifically limited in this embodiment.

[0063] See also Figure 4 In some embodiments, the first driving device 12 is used to drive the first camera module 13 to rotate along a first direction X and a second direction Y perpendicular to the first direction X according to eye movement information or head rotation information to capture a first image.

[0064] In this way, the first camera module 13 can be rotated in two axes through the first driving device 12, so that the first camera module 13 can be rotated to any direction and any angle, thereby ensuring that the first camera module 13 can be rotated to the required direction and to the required angle according to the user's eye rotation information or head rotation information detected by the first detection module 14.

[0065] In some embodiments, the first driving device 12 includes a mounting seat 120, a first frame 121, a second frame 122 and a driving module 123. The first camera module 13 is disposed on the mounting seat 120. The mounting seat 120 is rotatably connected to the first frame 121 along a first direction X, and the first frame 121 is rotatably connected to the second frame 122 along a second direction Y. Alternatively, the mounting seat 120 is rotatably connected to the first frame 121 along the second direction Y, and the first frame 121 is rotatably connected to the second frame 122 along the first direction X. The second frame 122 is disposed on the device body 10. The driving module 123 is disposed on the first frame 121. The driving module 123 is electrically connected to the first detection module 14. The driving module 123 is used to drive the mounting seat 120 to rotate relative to the first frame 121 according to eye rotation information or head rotation information. The driving module 123 is also used to drive the first frame 121 to rotate relative to the second frame 122 according to eye rotation information or head rotation information.

[0066] In this way, the mounting seat 120 is used to carry the first camera module 13, and the mounting seat 120 can rotate relative to the first frame 121 along the first direction X, and the first frame 121 can rotate relative to the second frame 122 along the second direction Y, so that the first camera module 13 can be rotated in two axes, so that the first camera module 13 can be rotated to any direction and any angle, thereby ensuring that the first camera module 13 can be rotated to the required rotation direction and to the required rotation angle according to the user's eyeball rotation information or head rotation information detected by the first detection module 14, and the driving module 123 can provide power for the rotation of the mounting seat 120 and the first frame 121. In addition, the structure of the first driving device 12 is relatively simple, which can reduce the space occupied by the first driving module 123 on the device body 10, which is conducive to the miniaturization design of the smart wearable device 1.

[0067] Optionally, the driving module 123 may be a piezoelectric motor or a voice coil motor, etc., to reduce the volume occupied by the driving module 123. The specific selection can be made according to actual conditions and is not specifically limited in this embodiment.

[0068] In some embodiments, such as Figure 1 As shown, the number of the first driving device 12 and the first camera module 13 are both one, and the first driving device 12 is arranged in the middle of the device body 10, or, as shown in FIG. Figure 5 As shown, there are multiple first driving devices 12 and multiple first camera modules 13, and multiple first driving devices 12 are arranged at intervals on the device body 10, and each of the first camera modules 13 is correspondingly arranged on each of the first driving devices 12.

[0069] In this way, when the number of the first driving device 12 and the first camera module 13 are set to be one, the first driving device 12 is arranged in the middle of the device body 10, so that the viewing angle of the first camera module 13 is relatively coincident with the central field of view of the user's two eyeballs, thereby further making the viewing angle of the first image taken by the first camera module 13 more consistent with the user's viewing angle, and then when the display module 11 displays the second image, it can be adjusted according to the first image, further reducing the impact on the user's experience. At the same time, the number of the first driving device 12 and the first camera module 13 are both one, which can reduce the space occupied by the first driving device 12 and the first camera module 13 on the device body 10, which is conducive to the miniaturized design of the smart wearable device 1 and can reduce the production cost of the smart wearable device 1. When there are multiple first driving devices 12 and multiple first camera modules 13, multiple first driving devices 12 are arranged at intervals on the equipment body 10, and each first driving device 12 is provided with a first camera module 13. Multiple first images with different fields of view can be acquired through the multiple first camera modules 13, so that the second image can be obtained based on the multiple first images, so that the second image can have a better display effect (for example, the second image can be synthesized by multiple first images, so that the second image has a larger field of view angle).

[0070] See also Figure 5 In some embodiments, the first image includes a first sub-image and a second sub-image, the first sub-image is used to describe the field of view of the user's left eyeball, and the second sub-image is used to describe the field of view of the user's right eyeball. The number of first driving devices 12 and first camera modules 13 are both two, wherein one first driving device 12 is disposed on the left side of the middle of the device body 10, and the first camera module 13 located on the right side of the middle of the device body 10 is used to capture the first sub-image, and the other first driving device 12 is disposed on the right side of the middle of the device body 10, and the first camera module 13 located on the right side of the middle of the device body 10 is used to capture the second sub-image.

[0071] In this way, by setting two first driving devices 12 and two first camera modules 13, and one of the first driving devices 12 is arranged on the left side of the middle part of the device body 10, one of the first camera modules 13 is arranged on the first driving device 12, and the other first driving device 12 is arranged on the right side of the middle part of the device body 10, and the other first camera module 13 is arranged on the first driving device 12, the two first driving devices 12 can respectively drive the two first camera modules 13 to rotate according to the user's eye movement information or head rotation information, and the two first camera modules 13 are respectively close to the positions of the user's left eyeball and right eyeball, so that the viewing angles of the first sub-image and the second sub-image captured by the two first camera modules 13 are relatively consistent with the viewing angles of the user's left eyeball and right eyeball, thereby making the first image more in line with the user's real viewing angle, and then when the display module 11 displays the second image, it can be adjusted according to the first image, further improving the user's experience.

[0072] Optionally, when the first detection module 14 detects the user's eyeball rotation information, the first detection module 14 may only detect the user's left eyeball rotation information, or may only detect the user's right eyeball rotation information, or may respectively detect the user's left eyeball and right eyeball rotation information, which may be selected according to actual conditions and is not specifically limited in this embodiment. Preferably, the first detection module 14 respectively detects the user's left eyeball and right eyeball rotation information, and the first drive device 12 located on the left side of the middle of the device body 10 drives the first camera module 13 on the first drive device 12 to rotate according to the rotation information of the left eyeball, so that the viewing angle of the first sub-image captured by the first camera module 13 is consistent with the viewing angle of the user's left eyeball, and the first drive device 12 located on the right side of the middle of the device body 10 drives the first camera module 13 on the first drive device 12 to rotate according to the rotation information of the right eyeball, so that the viewing angle of the second sub-image captured by the first camera module 13 is consistent with the viewing angle of the user's right eyeball.

[0073] See also Figure 6 In some embodiments, the smart wearable device 1 also includes a second camera module 15, which is arranged on the device body 10 at an interval relative to the first driving device 12. The second camera module 15 is used to capture a third image, and the third image is used to describe the user's frontal field of view. The display module 11 is used to display the second image to the user based on the first image and the third image.

[0074] In this way, by setting the second camera module 15 on the device body 10, the angle between the second camera module 15 and the device body 10 will not change, and the second camera module 15 will rotate with the device body 10 when the user's head rotates. Then, the third image captured by the second camera module 15 is always consistent with the user's frontal field of view, and the first camera module 13 will rotate relative to the device body 10. Combining the first image with the third image can enable the second image to obtain a larger field of view angle, thereby avoiding the situation where the field of view angle of the second image obtained is smaller than the user's actual field of view angle when the field of view angle of the first camera module 13 is smaller.

[0075] See also Figure 7 A second aspect of an embodiment of the present invention provides a control method for a smart wearable device, wherein the smart wearable device includes a first driving device and a first camera module, wherein the first camera module is disposed on the first driving device, and the method includes:

[0076] S100, obtaining current rotation information of the user's eyeball or head, where the current rotation information includes a current rotation direction;

[0077] In this embodiment, the smart wearable device further includes a first detection module, which detects the current rotation information of the user's eyeball or head through the first detection module. Optionally, the first detection module can be an eye tracker or a visual sensor to obtain the current rotation direction of the user's eyeball, and the first detection module can also be an angular velocity sensor, an angular acceleration sensor, etc. to obtain the current rotation direction of the user's head. The specific selection can be based on actual conditions and is not specifically limited in this embodiment.

[0078] Optionally, the number of the first drive device and the first camera module can be one or more, which can be selected according to actual conditions. When the number of the first drive device and the first camera module is multiple, the multiple first drive devices can control the rotation of the multiple first camera modules according to a current rotation information detected by the first detection module, for example, the multiple first drive devices control the rotation of the multiple first camera modules according to the current rotation information of the left eyeball detected by the first detection module, or the multiple first drive devices control the rotation of the multiple first camera modules according to the current rotation information of the head detected by the first detection module; the multiple first drive devices can also control the rotation of the multiple first camera modules respectively according to the multiple current rotation information detected by the first detection module, for example, some of the first drive devices control the rotation of some of the first camera modules according to the current rotation information of the left eyeball detected by the first detection module, and the remaining first drive devices control the rotation of the remaining first camera modules according to the current rotation information of the right eyeball detected by the first detection module.

[0079] As an optional implementation, the current rotation information of the user's eye or head is obtained, and the current rotation information includes the current rotation direction. The specific implementation method is: obtain the current rotation information of the user's eye or head, and the current rotation information includes the current rotation direction and the current rotation angle.

[0080] In this embodiment, the smart wearable device also includes a first detection module, which detects the current rotation information of the user's eyeball or head through the first detection module. Optionally, the first detection module can be an eye tracker or a visual sensor to obtain the current rotation direction and current rotation angle of the user's eyeball. The first detection module can also be an angular velocity sensor, an angular acceleration sensor, etc. to obtain the current rotation direction and current rotation angle of the user's head (the current rotation angle can be obtained by calculation, for example, when the first detection module is an angular acceleration sensor, it can detect the current rotation angular acceleration of the user's head, and calculate the current rotation angle by the relationship between the current rotation angular acceleration and time). The specific selection can be made according to the actual situation, and is not specifically limited in this embodiment.

[0081] S102, determining a target rotation direction and a target rotation angle according to current rotation information;

[0082] Since the current rotation information may include the current rotation direction, or the current rotation direction and the current rotation angle, the two situations are described below respectively:

[0083] When the current rotation information includes the current rotation direction:

[0084] Optionally, the target rotation angle may be a preset rotation angle, that is, no matter what the detected target rotation direction is, the target rotation angle is the preset rotation angle. For example, when the preset rotation angle is set to 15°, when the current rotation direction is upward, the target rotation angle is 15°, and when the current rotation direction is downward, the target rotation angle is still 15°; the target rotation angle may also be a random rotation angle. For example, when the current rotation direction is upward, the target rotation angle may be 10°, 15°, 17°, 20°, etc., and when the current rotation direction is downward, the target rotation angle may also be 10°, 15°, 17°, 20°, etc.

[0085] As an optional implementation, the specific implementation method of determining the target rotation direction and the target rotation angle according to the current rotation information is to determine the target rotation direction and the target rotation angle according to the current rotation information, the target rotation direction is consistent with the current rotation direction, and the target rotation angle is a preset rotation angle.

[0086] Specifically, the target rotation direction is consistent with the current rotation direction of the rotation information. For example, when the current rotation direction is upward, the target rotation direction is also upward; when the current rotation direction is downward, the target rotation direction is also downward.

[0087] Optionally, the preset rotation angle may be 1°, 3°, 5°, 10°, etc., which may be selected according to actual conditions and is not specifically limited in this embodiment.

[0088] By implementing the above method, the target rotation angle and target rotation are confirmed only by detecting the current rotation direction. The detection difficulty is low, the implementation of the method is relatively simple, and the target rotation angle is a preset rotation angle, that is, a preset fixed angle. No additional calculation is required, which improves the response speed of the first drive device and can reduce the power consumption of the smart glasses.

[0089] When the current rotation information includes the current rotation direction and the current rotation angle:

[0090] As an optional implementation, the specific implementation method of determining the target rotation direction and the target rotation angle according to the current rotation information is: determine the target rotation direction and the target rotation angle according to the current rotation information, the target rotation direction is consistent with the current rotation direction, and the target rotation angle is the same as the current rotation angle.

[0091] Specifically, the target rotation direction is consistent with the current rotation direction of the rotation information. For example, when the current rotation direction is upward, the target rotation direction is also upward; when the current rotation direction is downward, the target rotation direction is also downward.

[0092] In this embodiment, the target rotation angle is the same as the current rotation angle. For example, when the current rotation angle is 5°, the target rotation angle is 5°; when the current rotation angle is 15°, the target rotation angle is 15°.

[0093] By implementing the above method, the target rotation angle can be adjusted more accurately by detecting the current rotation direction and the current rotation angle.

[0094] As another optional implementation, the specific implementation method of determining the target rotation direction and the target rotation angle according to the current rotation information is: determine the target rotation direction and the target rotation angle according to the current rotation information, the target rotation direction is consistent with the current rotation direction, and the target rotation angle is in a preset ratio with the current rotation angle.

[0095] Specifically, the target rotation direction is consistent with the current rotation direction of the rotation information. For example, when the current rotation direction is upward, the target rotation direction is also upward; when the current rotation direction is downward, the target rotation direction is also downward.

[0096] In this embodiment, the target rotation angle is in a preset ratio with the current rotation angle. For example, when the preset ratio is 0.2 and the current rotation angle is 5°, the target rotation angle is 1°; when the preset ratio is 0.2 and the current rotation angle is 10°, the target rotation angle is 2°; when the preset ratio is 0.5 and the current rotation angle is 10°, the target rotation angle is 5°; when the preset ratio is 0.5 and the current rotation angle is 20°, the target rotation angle is 10°.

[0097] By implementing the above method, the target rotation angle can be adjusted more accurately by detecting the current rotation direction and the current rotation angle.

[0098] S104, controlling the first driving device to drive the first camera module to rotate according to the target rotation direction and the target rotation angle.

[0099] In this embodiment, the smart wearable device also includes a control module, which is electrically connected to the first detection module and the first drive device. The control module can receive the current rotation information detected by the first detection module, and process the current rotation information to determine the target rotation direction and the target rotation angle, and then send a control signal containing the target rotation direction and the target rotation angle to the first drive device, thereby controlling the first drive device to drive the first camera module to rotate according to the target rotation direction and the target rotation angle. Optionally, the control module can be a central processing unit or a single-chip microcontroller, etc., which can be selected according to actual conditions and is not specifically limited in this embodiment.

[0100] Optionally, the first driving device may include a mounting seat, a first frame, a second frame and a driving module, the mounting seat is rotatably connected to the first frame along a first direction, and the first frame is rotatably connected to the second frame along a second direction, or, the mounting seat is rotatably connected to the first frame along the second direction, the first frame is rotatably connected to the second frame along the first direction, the second frame is arranged in the device body, the driving module is arranged in the first frame, the driving module is electrically connected to the first detection module, the driving module is used to drive the mounting seat to rotate relative to the first frame according to the target rotation direction and the target rotation angle, the driving module is also used to drive the first frame to rotate relative to the second frame according to the target rotation direction and the target rotation angle, so that the first camera module can be rotated in two axes through the first driving device, so that the first camera module can be rotated to any direction and any angle, thereby ensuring that the first camera module can rotate in the target rotation direction to the target rotation angle.

[0101] The implementation of the above method can make the first driving device drive the first camera module to rotate according to the target rotation direction and the target rotation angle, and the target rotation direction is consistent with the current rotation direction of the rotation information, so that the viewing angle of the first image captured by the first camera module is relatively consistent with the viewing angle of the user (because the user's eyeball rotation usually occurs simultaneously with the head rotation and the rotation direction is consistent, when the current rotation direction obtained is the current rotation direction of the head, it can also be considered that it is consistent with the current rotation direction of the eyeball). In addition, when the current rotation information includes the current rotation direction, and the target rotation direction is consistent with the current rotation direction, and the target rotation angle is a preset rotation angle, since the target rotation angle is a preset rotation angle, that is, a preset fixed angle, no additional calculation is required, the calculation logic is relatively simple, the response speed of the first driving device is improved, and the power consumption of the smart glasses can be reduced. When the current rotation information includes the current rotation direction and the current rotation angle, and the target rotation direction is consistent with the current rotation direction, and the target rotation angle is the same as the current rotation angle, so that the viewing angle of the first image captured by the first camera module is roughly consistent with the viewing angle of the user, especially when the detected current rotation angle is the current rotation angle of the eyeball, the viewing angle of the first image captured by the first camera module can be completely consistent with the viewing angle of the user, avoiding the impact on the user's experience. When the current rotation information includes the current rotation direction and the current rotation angle, and the target rotation direction is consistent with the current rotation direction, the target rotation angle is a preset ratio with the current rotation angle, so that the viewing angle of the first image captured by the first camera module is roughly consistent with the viewing angle of the user, especially when the detected current rotation angle is the current rotation angle of the head, because the user's eyeball rotation usually occurs simultaneously with the head rotation and the rotation direction is consistent but the eyeball rotation angle is usually not exactly the same as the head rotation angle, the current rotation angle of the head is corrected by setting a preset ratio, so that the target rotation angle is closer to the current rotation angle of the eyeball, so that the viewing angle of the first image captured by the first camera module is more consistent with the user's viewing angle, further reducing the impact on the user's experience.

[0102] The control method of the smart wearable device provided by the embodiment of the second aspect of the present invention, the first driving device can drive the first camera module to rotate relative to the device body, so as to change the viewing angle of the first image taken by the first camera module relative to the device body, by obtaining the current rotation information of the user's eyeball or head, and determining the target rotation direction and the target rotation angle through the current rotation information, so that the first driving device can drive the first camera module to rotate according to the target rotation direction and the target rotation angle, so that the viewing angle of the first image taken by the first camera module is more consistent with the user's viewing angle, and then when the display module of the smart wearable device displays the second image, it can be adjusted according to the first image to reduce the impact on the user's experience.

[0103] It should be understood that the various steps in the above flowchart are displayed in sequence according to the indication of the arrows, but these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless there is a clear description in this article, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a part of the steps in the above flowchart may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these sub-steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

[0104] Based on the foregoing embodiments, the present application provides a smart wearable device, which may be AR glasses, MR glasses, etc., and its internal structure diagram may be as follows: Figure 8 As shown. The smart wearable device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor of the smart wearable device is used to provide computing and control capabilities. The memory of the smart wearable device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the smart wearable device is used to store data. The network interface of the smart wearable device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, the control method of the aforementioned smart wearable device is implemented.

[0105] An embodiment of the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps in the method provided in the above embodiment are implemented.

[0106] An embodiment of the present application provides a computer program product including instructions, which, when executed on a computer, enables the computer to execute the steps of the method provided in the above method embodiment.

[0107] Those skilled in the art will understand that Figure 8 The structure shown in the figure is only a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the smart wearable device to which the scheme of the present application is applied. The specific smart wearable device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0108] In one embodiment, the smart wearable device provided in the present application can be implemented in the form of a computer program. The memory of the smart wearable device can store various program modules constituting the sampling device. The computer program composed of various program modules enables the processor to execute the steps in the control method of the smart wearable device of each embodiment of the present application described in this specification.

[0109] In one embodiment, a smart wearable device is provided, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of the control method of the smart wearable device disclosed in any embodiment of the present application are implemented.

[0110] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the control method of the smart wearable device disclosed in any embodiment of the present application are implemented.

[0111] It should be noted here that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium, storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0112] It should be understood that "one embodiment" or "an embodiment" or "some embodiments" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in one embodiment" or "in some embodiments" appearing throughout the specification may not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The above-mentioned sequence numbers of the embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments. The above description of each embodiment tends to emphasize the differences between the various embodiments, and the same or similar aspects can be referenced to each other. For the sake of brevity, this article will not repeat them.

[0113] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0114] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as: multiple modules or components can be combined, or can be integrated into another system, or some features can be ignored, or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or modules can be electrical, mechanical or other forms.

[0115] The modules described above as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules; they may be located in one place or distributed on multiple network units; some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.

[0116] In addition, all functional modules in the embodiments of the present application may be integrated into one processing unit, or each module may be a separate unit, or two or more modules may be integrated into one unit; the above-mentioned integrated modules may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0117] A person of ordinary skill in the art can understand that all or part of the steps of implementing the above method embodiments can be completed by hardware related to program instructions, and the aforementioned program can be stored in a storage medium readable by a mobile terminal. When the program is executed, it executes the steps of the above method embodiments; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, and other media that can store program codes.

[0118] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling an electronic device to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0119] The methods disclosed in several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0120] The features disclosed in several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0121] The features disclosed in several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0122] The above is a detailed introduction to the smart wearable device and the control method of the smart wearable device disclosed in the embodiments of the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the smart wearable device and the control method of the smart wearable device of the present invention and their core ideas; at the same time, for general technicians in this field, according to the ideas of the present invention, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A smart wearable device, characterized in that: include Equipment body; A display module, wherein the display module is arranged on the device body; a first driving device, the first driving device being arranged on the device body; a first camera module, the first camera module being disposed on the first driving device, the first camera module being used to capture a first image, the first image being used to describe a user's field of view, the first camera module being electrically connected to the display module, the display module being used to display a second image to the user according to the first image; as well as A first detection module, the first detection module is disposed in the device body, the first detection module is electrically connected to the first driving device, and the first detection module is used to detect eye movement information or head movement information of the user; Among them, the first driving device is used to drive the first camera module to rotate according to the eye rotation information or the head rotation information to capture the first image.

2. The smart wearable device according to claim 1, characterized in that: The display module includes an optical component and a projection device, wherein the optical component is disposed on the device body, the optical component includes a first side facing the user and a second side opposite to the first side, the optical component is used to transmit light propagating from the second side to the first side, the projection device is disposed on the device body, the projection device is electrically connected to the first camera module, the projection device is used to project the second image onto the optical component according to the first image, and the optical component is used to reflect the second image toward the user, or, The display module has a display side, and the display side faces the user to display the second image toward the user.

3. The smart wearable device according to claim 1, characterized in that: The number of the first driving device and the first camera module are both one, and the first driving device is arranged in the middle of the device body, or, There are multiple first driving devices and multiple first camera modules, and multiple first driving devices are arranged at intervals on the device body, and each first camera module is correspondingly arranged on each first driving device.

4. The smart wearable device according to claim 3, characterized in that: The first image includes a first sub-image and a second sub-image, the first sub-image is used to describe the field of view of the left eyeball of the user, and the second sub-image is used to describe the field of view of the right eyeball of the user, and the number of the first driving device and the number of the first camera module are both two. The first driving device is disposed on the left side of the middle part of the device body, and the first camera module located on the left side of the middle part of the device body is used to capture a first sub-image. Another first driving device is arranged on the right side of the middle part of the device body, and the first camera module located on the right side of the middle part of the device body is used to capture the second sub-image.

5. The smart wearable device according to claim 1, characterized in that: The smart wearable device also includes a second camera module, which is arranged on the device body at a distance from the first driving device. The second camera module is used to capture a third image, and the third image is used to describe the user's frontal field of view. The display module is used to display a second image to the user based on the first image and the third image.

6. The smart wearable device according to claim 1, characterized in that: The device body is provided with an installation slot, and the smart wearable device also includes a second driving device, the second driving device is arranged in the installation slot, the first driving device is arranged in the second driving device, and the second driving device is used to drive the first driving device and the first camera module to move until they protrude from or are hidden in the installation slot.

7. The smart wearable device according to claim 1, characterized in that: The first detection module is also used to detect the rotation information of the device body, and the first driving device is also used to drive the first camera module to rotate according to the rotation information of the device body to maintain the position of the first image taken by the first camera module.

8. The smart wearable device according to any one of claims 1 to 7, characterized in that: The first driving device is used to drive the first camera module to rotate along a first direction and a second direction perpendicular to the first direction according to the eye rotation information or the head rotation information to capture the first image.

9. The smart wearable device according to claim 8, characterized in that: The first driving device includes a mounting seat, a first frame, a second frame and a driving module. The first camera module is arranged on the mounting seat. The mounting seat is rotatably connected to the first frame along the first direction, and the first frame is rotatably connected to the second frame along the second direction, or the mounting seat is rotatably connected to the first frame along the second direction, and the first frame is rotatably connected to the second frame along the first direction. The second frame is arranged on the device body, the driving module is arranged on the first frame, the driving module is electrically connected to the first detection module, the driving module is used to drive the mounting seat to rotate relative to the first frame according to the eye rotation information or the head rotation information, and the driving module is also used to drive the first frame to rotate relative to the second frame according to the eye rotation information or the head rotation information.

10. A control method for a smart wearable device, characterized in that: The smart wearable device includes a first driving device and a first camera module, the first camera module is arranged on the first driving device, and the method includes: Acquire current rotation information of the user's eyeball or head, where the current rotation information includes a current rotation direction; Determining a target rotation direction and a target rotation angle according to the current rotation information; The first driving device is controlled to drive the first camera module to rotate according to the target rotation direction and the target rotation angle.

11. The control method according to claim 10, characterized in that: The target rotation direction is consistent with the current rotation direction, and the target rotation angle is a preset rotation angle.

12. The control method according to claim 10, characterized in that: The current rotation information also includes a current rotation angle, the target rotation direction is consistent with the current rotation direction, and the target rotation angle is the same as the current rotation angle.

13. The control method according to claim 10, characterized in that: The current rotation information also includes a current rotation angle, the target rotation direction is consistent with the current rotation direction, and the target rotation angle is in a preset ratio with the current rotation angle.

Images