AR glasses and AR glasses control method

Abstract

The invention relates to the technology of augmented reality display equipment, and discloses AR glasses and an AR glasses control method, the AR glasses comprise a glasses frame module, the glasses frame module comprises a glasses frame assembly and a glasses leg assembly, the glasses frame assembly is provided with a containing cavity with an opening, and the opening is formed in the bottom of the containing cavity; the display module comprises an optical machine and an optical waveguide assembly, the optical waveguide assembly is connected with the mirror frame assembly, the optical waveguide assembly is provided with a coupling-in grating area and a coupling-out grating area, and the optical machine is contained in the containing cavity and arranged corresponding to the coupling-in grating area; the image acquisition device is accommodated in the accommodating cavity, is electrically connected with the optical machine and is configured to perform image acquisition operation through the opening; and a control device. The opening is formed in the bottom of the containing cavity, the image collecting device is arranged to conduct image collecting through the opening, the pertinence of image collecting is improved, gestures made by the target object can be accurately collected to improve the use experience, and the unnecessary privacy problem possibly caused in image collecting is avoided by improving the image collecting angle.

Description

Technical Field

[0001] This application relates to the technology of augmented reality display devices, and in particular to an AR glasses and an AR glasses control method. Background Art

[0002] Existing AR (Augmented Reality) glasses products can provide many convenient functions for users. For example, AR glasses perform image acquisition to detect the actions of target objects and control the output image accordingly. Among them, detecting the actions of target objects is more common: detecting the gesture commands of users.

[0003] However, during the process of image acquisition of the external world by existing AR glasses, the pertinence of image acquisition is poor, which is not conducive to capturing image information for the gesture commands of users. It is very likely that the actual gestures made by users cannot be accurately obtained, resulting in a poor user experience of AR glasses.

[0004] Furthermore, due to the poor pertinence of image acquisition of existing AR glasses, it is inevitable to capture other objects in the external world during the process of image acquisition of the external world, which may inadvertently touch on privacy issues. Summary of the Invention

[0005] The embodiments of this application provide an AR glasses and an AR glasses control method, aiming to improve the pertinence of image acquisition, accurately collect the gestures actually made by the target object to improve the use experience, and improve the image acquisition angle to avoid unnecessary privacy issues that may occur during image acquisition of the external world.

[0006] In a first aspect, the embodiments of this application provide an AR glasses, including:

[0007] A frame module, including a frame component and temple components connected to the frame component. The frame component is provided with an accommodating chamber having an opening, wherein the opening is formed at the bottom of the accommodating chamber;

[0008] A display module, including an optical engine and a waveguide component. The waveguide component is connected to the frame component, and the waveguide component is provided with an input grating area and an output grating area. The optical engine is accommodated in the accommodating chamber and is correspondingly arranged with respect to the input grating area;

[0009] An image acquisition device, which is accommodated in the accommodating chamber and electrically connected to the optical engine, and the image acquisition device is configured to perform image acquisition operations through the opening; and

[0010] A control device, which is electrically connected to the image acquisition device and the optical engine.

[0011] In some embodiments, the frame component includes:

[0012] A lens mounting member, a temple assembly is connected to the lens mounting member, and an optical waveguide assembly is connected to a side of the lens mounting member away from the temple assembly;

[0013] A housing member, the housing member is detachably connected to the lens mounting member and cooperates with the housing member to form a receiving chamber, and an opening is provided in at least one of the housing member and the lens mounting member.

[0014] In some embodiments, the frame module further includes a light transmissive member, the light transmissive member is disposed corresponding to the opening and is used to seal the opening.

[0015] In some embodiments, the image acquisition device is provided with a first sealing structure, and the image acquisition device forms a sealing fit with the frame assembly through the first sealing structure to seal the opening;

[0016] And / or, the frame assembly is provided with a second sealing structure, and the frame assembly forms a sealing fit with the image acquisition device through the second sealing structure to seal the opening.

[0017] In some embodiments, the lens mounting member is further provided with a first mounting structure and a second mounting structure connected to the first mounting structure;

[0018] Wherein, the optical engine and the image acquisition device are mounted on the lens mounting member through the first mounting structure, and the optical waveguide assembly is mounted on the lens mounting member through the second mounting structure.

[0019] In some embodiments, the first mounting structure includes a mounting portion connected to the second mounting structure and an extension portion connected to the mounting portion and extending away from the optical waveguide assembly;

[0020] Wherein, the mounting portion forms a first chamber, the extension portion and the housing member are adapted to form a second chamber, and the first chamber and the second chamber form a receiving cavity;

[0021] At least part of the optical engine is received in the first chamber, the image acquisition device and the control device are received in the second chamber, and the opening is formed in the second chamber.

[0022] In some embodiments, the accommodation space of the first chamber is larger than the accommodation space of the second chamber.

[0023] In some embodiments, the AR glasses further include a voice acquisition device, the voice acquisition device is received in the receiving chamber, and the voice acquisition device performs voice acquisition at least through the opening;

[0024] Alternatively, the AR glasses further include a voice acquisition device, the receiving chamber is provided with a collection hole, the voice acquisition device is disposed corresponding to the collection hole, and the voice acquisition device performs voice acquisition at least through the collection hole.

[0025] In some embodiments, the collection hole is disposed on the same side as the opening.

[0026] In some embodiments, the AR glasses further include a control device and a circuit board module accommodated in an accommodation chamber. The optical engine and the control device are integrated on the circuit board module, and the control device is electrically connected to the optical engine and the image acquisition device through the circuit board module.

[0027] In some embodiments, the AR glasses further include a circuit board module accommodated in an accommodation chamber. The control device is connected to the circuit board module and is electrically connected to the optical engine through the circuit board module.

[0028] Wherein, the control device is configured to receive the image information collected by the image acquisition device and control the optical engine to output a corresponding image light signal according to the image information.

[0029] In some embodiments, the frame assembly includes a first positioning structure disposed on the inner wall of the accommodation chamber, and the circuit board module is provided with a second positioning structure adapted to the first positioning structure;

[0030] When the first positioning structure and the second positioning structure are connected and adapted, the circuit board module is mounted on the frame assembly.

[0031] In some embodiments, the first positioning structure includes a slot formed in the accommodation chamber near one side temple assembly, and the second positioning structure includes a card member inserted and mated with the slot.

[0032] In some embodiments, the image acquisition device is connected to one side of the circuit board module facing the opening and is disposed opposite to the opening.

[0033] In some embodiments, the circuit board module includes at least two stacked sub-circuit boards, and an electrical connection is formed between two adjacent sub-circuit boards;

[0034] Wherein, the image acquisition device is connected to the sub-circuit board on the side of the circuit board module facing the opening and is disposed facing the opening.

[0035] In a second aspect, an AR glasses control method provided by an embodiment of the present application is further provided, which is applied to any AR glasses provided by an embodiment of the present application. The method includes:

[0036] Controlling the image acquisition device to perform an image acquisition operation through the opening to obtain image information, and determining an action instruction of a target object according to the image information;

[0037] Controlling the optical engine to output a corresponding image light signal to the coupling grating area of the optical waveguide assembly according to the action instruction.

[0038] In summary, the embodiments of the present application provide an AR glasses and an AR glasses control method. The AR glasses include: a frame module, including a frame component and temple components connected to the frame component. The frame component is provided with a receiving chamber having an opening, wherein the opening is formed at the bottom of the receiving chamber; a display module, including an optical engine and an optical waveguide component. The optical waveguide component is connected to the frame component, and the optical waveguide component is provided with a coupling-in grating area and a coupling-out grating area. The optical engine is accommodated in the receiving chamber and is correspondingly arranged opposite to the coupling-in grating area; an image acquisition device, which is accommodated in the receiving chamber and electrically connected to the optical engine, and the image acquisition device is configured to perform an image acquisition operation through the opening; and a control device, which is electrically connected to the image acquisition device and the optical engine. The AR glasses provided by the embodiments of the present application improve the pertinence of image acquisition by forming the opening at the bottom of the receiving chamber and configuring the image acquisition device to perform an image acquisition operation through the opening, can accurately collect the gestures actually made by the target object to improve the user experience, and avoid the privacy problems that may occur in the external image acquisition by improving the image acquisition angle. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present application. For those skilled in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0040] Figure 1 It is a module structure diagram of an implementation manner of the AR glasses provided by an embodiment of the present application;

[0041] Figure 2 It is a partial structure schematic diagram of an implementation manner of the AR glasses provided by an embodiment of the present application;

[0042] Figure 3 It is a structure schematic diagram of the receiving chamber in the AR glasses provided by an embodiment of the present application;

[0043] Figure 4 It is a structure schematic diagram of another implementation manner of the AR glasses provided by an embodiment of the present application;

[0044] Figure 5 It is a bottom-angle upward view schematic diagram of the AR glasses provided by an embodiment of the present application;

[0045] Figure 6 It is a structure schematic diagram of the first sealing structure and the second sealing structure in the AR glasses provided by an embodiment of the present application;

[0046] Figure 7Schematic flowchart of the AR glasses control method provided by an embodiment of the present application.

[0047] Reference numerals:

[0048] 1. AR glasses; 10. Frame module; 11. Frame assembly; 111. Accommodation chamber; 1111. First chamber; 1112. Second chamber; 1113. Sealed connection part; 112. Opening; 113. Lens mounting member; 1131. First mounting structure; 1132. Second mounting structure; 1133. Mounting part; 1134. Extension part; 114. Outer shell member; 115. Translucent member; 116. Temple connecting member; 117. Acquisition hole; 12. Temple assembly; 13. Second fitting part; 20. Display module; 21. Optical engine; 22. Optical waveguide assembly; 221. Coupling-in grating area; 222. Coupling-out grating area; 30. Image acquisition device; 31. Acquisition part; 32. Sealing member; 33. First fitting part; 34. Acquisition channel; 40. Control device; 50. Refractive module; 60. Voice acquisition device; 70. Circuit board module; 71. Sub-circuit board. Detailed implementation manners

[0049] The technical solutions of the embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are some, but not all, of the embodiments of the present application. Based on the embodiments of the present application, other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present application. The flowcharts shown in the accompanying drawings are only illustrative, and do not necessarily include all the contents and operations / steps, nor do they necessarily need to be executed in the described order. For example, some operations / steps can be decomposed, combined, or partially merged, so the actual execution order may be changed according to the actual situation. As mentioned above, only specific embodiments of the present application are described, but the scope of protection of the present application is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present application can easily think of various equivalent modifications or replacements, and these modifications or replacements should all be covered by the scope of protection of the present application. Therefore, the scope of protection of the present application should be subject to the scope of protection of the claims.

[0050] The following will describe in detail some embodiments of the present application with reference to the accompanying drawings. Without conflict, the following embodiments and the features in the embodiments can be combined with each other.

[0051] Please refer to Figures 1 to 3 , Figure 1 Module structure diagram of an implementation manner of AR glasses provided by an embodiment of the present application, Figure 2 Partial structure schematic diagram of an implementation manner of AR glasses provided by an embodiment of the present application, Figure 3Schematic diagram of the accommodation chamber in the AR glasses provided by an embodiment of the present application.

[0052] As Figures 1 to 3 shown, an embodiment of the present application provides an AR glasses, including: a frame module, a display module, and an image acquisition device. The following specifically describes the structures of each part of the AR glasses.

[0053] Specifically, the frame module 10 includes a frame assembly 11 and temple assemblies 12 connected to the frame assembly 11. The frame assembly 11 is provided with an accommodation chamber 111 having an opening 112, wherein the opening 112 is opened at the bottom of the accommodation chamber 111. The temple assemblies 12 are used to provide wearing support for the target object, and the target object is, for example, a user wearing the present AR glasses 1.

[0054] The display module 20 includes an optical engine 21 and a waveguide component 22. The waveguide component 22 is connected to the frame assembly 11, and the waveguide component 22 is provided with an input grating region 221 and an output grating region 222. The optical engine 21 is accommodated in the accommodation chamber 111 and is disposed corresponding to the input grating region 221.

[0055] It should be noted that the opening 112 being opened at the bottom of the accommodation chamber 111 means that when the target object wears the present AR glasses 1 and stands, the position of the opening 112 is on the side of the accommodation chamber 111 close to the ground.

[0056] It should also be noted that the optical engine 21 is used to output an image optical signal. Based on the optical engine 21 being disposed corresponding to the input grating region 221 formed by the waveguide component 22, the image optical signal output by the optical engine 21 is incident on the input grating region 221, and the waveguide component 22 is configured to transmit the image optical signal input by the optical engine 21 to the input grating region 221 to generate an image screen in the output grating region 222. Then, the light rays from the outside of the AR glasses 1 incident on the waveguide lens and the image screen generated by the image optical signal in the output grating region 222 are superimposed and pass through the waveguide lens to enter the field of view of the target object.

[0057] Exemplarily, the waveguide component 22 includes a waveguide lens.

[0058] The image acquisition device 30 is accommodated in the accommodation chamber 111 and is electrically connected to the optical engine 21, and the image acquisition device 30 is configured to perform image acquisition operations through the opening 112. The control device 40 is electrically connected to the image acquisition device 30 and the optical engine 21.

[0059] Further, based on the control device 40 being electrically connected to the image acquisition device 30 and the optical engine 21, the control device 40 is further configured to determine an action instruction of the target object based on the image information acquired by the image acquisition device 30, and control the optical engine 21 to output a corresponding image optical signal according to the action instruction. When the target object wears the AR glasses 1 provided in the embodiment of the present application, the target object can control the image optical signal output by the optical engine 21 by making an action instruction.

[0060] It should be noted that, based on the opening 112 being provided at the bottom of the accommodation chamber 111, the image acquisition device 30 performs image acquisition operations through the opening 112, and the captured image information is mainly the image information on the side of the frame assembly 11 facing its bottom.

[0061] Exemplarily, the image acquisition device 30 includes a camera, a photosensitive device, etc.

[0062] Further illustration, when the target object wears the AR glasses 1 provided in the embodiment of the present application, the position of the opening 112 is on the side of the accommodation chamber 111 close to the ground. The image acquisition device 30 performs image acquisition operations through the opening 112, so that the gesture instructions actually made by the target object can be accurately captured, and it is not easy to capture the gestures made by people other than the target object, avoiding obtaining incorrect gesture instructions, and improving the pertinence of capturing the gesture instructions of the target object and the anti-interference effect during the use of the AR glasses 1.

[0063] It should also be noted that since the existing products have poor pertinence in image acquisition, and may inadvertently touch privacy issues due to capturing other objects in the outside world during the process of image acquisition of the outside world, the improvement of the image acquisition angle provided by the AR glasses 1 in the embodiment of the present application avoids related privacy infringement issues, and when the target object wears the AR glasses 1 in the embodiment of the present application, from the front angle of the target object, the image acquisition device 30 and the corresponding opening 112 for image acquisition are hidden, making the AR glasses 1 more beautiful.

[0064] Therefore, the AR glasses 1 provided in the embodiment of the present application improve the pertinence of image acquisition by providing the opening 112 at the bottom of the accommodation chamber 111 and configuring the image acquisition device 30 to perform image acquisition operations through the opening 112, can accurately capture the gestures actually made by the target object to improve the use experience, and avoid privacy issues that may be caused during image acquisition of the outside world through the improvement of the image acquisition angle.

[0065] Please refer to Figure 4 and Figure 5 , Figure 4 which is a schematic structural diagram of another implementation manner of the AR glasses provided in an embodiment of the present application. Figure 5Schematic top view of the AR glasses provided by an embodiment of the present application from the bottom angle.

[0066] As Figures 2 to 5 shown, in some embodiments, the frame assembly 11 includes:

[0067] A lens mounting member 113, the temple assembly 12 is connected to the lens mounting member 113, and the optical waveguide assembly 22 is connected to the side of the lens mounting member 113 away from the temple assembly 12;

[0068] A housing member 114, the housing member 114 is detachably connected to the lens mounting member 113 and cooperates with the housing member 114 to form an accommodation chamber 111, and an opening 112 is provided in at least one of the housing member 114 and the lens mounting member 113.

[0069] Specifically, the temple assembly 12 is connected to the lens mounting member 113, and the optical waveguide assembly 22 is connected to the side of the lens mounting member 113 away from the temple assembly 12. Then, when the target object wears the AR glasses 1 through the temple assembly 12, both the lens mounting member 113 and the optical waveguide assembly 22 connected to the lens mounting member 113 are located in front of the target object's field of view. Further, when the target object wears the AR glasses 1, the coupling grating region 222 is opposite to the target object's field of view.

[0070] It should be noted that the housing member 114 is detachably connected to the lens mounting member 113 and cooperates with the housing member 114 to form an accommodation chamber 111 ( Figure 4 indicating the angle with the bottom of the frame assembly 11 facing up, and Figure 4 the housing member 114, the optical engine 21, the image acquisition device 30, etc. are not shown in the figure), that is, the housing member 114 can be assembled to the lens mounting member 113 to enclose the accommodation chamber 111, or the housing member 114 can be detached from the lens mounting member 113 to expose the accommodation chamber 111, so as to facilitate operations such as disassembly and repair of components such as the image acquisition device 30 and the optical engine 21.

[0071] For example, the housing member 114 and the lens mounting member 113 can be detachably connected by at least one of the ways such as threaded fit, snap fit, and pin fit.

[0072] In some other embodiments, the frame assembly 11 includes a lens mounting member 113 and a housing member 114, the housing member 114 is connected to the lens mounting member 113 and cooperates with the housing member 114 to form an accommodation chamber 111, and the lens mounting member 113 and the housing member 114 are not detachable from each other.

[0073] Exemplarily, the lens mounting member 113 and the housing member 114 are connected by dispensing glue, and the lens mounting member 113 and the housing member 114 are hermetically fitted to each other to form a receiving chamber 111, thereby improving the waterproof and dustproof effect of the receiving chamber 111.

[0074] It should also be noted that the opening 112 is provided in at least one of the housing member 114 and the lens mounting member 113. For example, the opening 112 is directly formed on the housing member 114 or the lens mounting member 113, or the opening 112 is formed by the cooperation of the housing member 114 and the lens mounting member 113. In the embodiment of the present application, it is only necessary to ensure that the opening 112 is formed at the bottom of the receiving chamber 111. For example Figure 4 As shown, the opening 112 is provided on the housing member 114 and is located at the bottom of the receiving chamber 111.

[0075] Such as Figure 2 And Figure 5 As shown, in some embodiments, the AR glasses 1 further include a refractive module 50 connected to the lens mounting member 113. The refractive module 50 is correspondingly coupled to the grating region 222 and is disposed on one side of the optical waveguide assembly 22 close to the temple assembly 12

[0076] Exemplarily, for some users, they may have certain vision correction needs, so it is necessary to provide the refractive module 50. Specifically, the refractive module 50 includes at least refractive lenses.

[0077] In some embodiments, the refractive module 50 is detachably connected to the lens mounting member 113, which is convenient for repeated installation and disassembly of the refractive module 50 to meet the repeated processing requirements of the refractive module 50.

[0078] Such as Figure 2 、 Figure 3 And Figure 4 As shown, in some embodiments, the frame assembly 11 further includes a temple connecting member 116. The temple connecting member 116 is connected to the side of the lens mounting member 113 away from the optical waveguide assembly 22, and the lens mounting member 113 is connected to the temple assembly 12 through the temple connecting member 116.

[0079] In some embodiments, the lens mounting member 113 is movably connected to the temple assembly 12 through the temple connecting member 116. For example, the temple connecting member 116 is rotationally engaged with the temple assembly 12, so that the AR glasses 1 are more convenient to store and are also convenient for the AR glasses 1 to adapt to the head portrait of the target object.

[0080] Such as Figure 4 As shown, in some embodiments, the frame module 10 further includes a light transmissive member 115. The light transmissive member 115 is correspondingly disposed with respect to the opening 112 and is used to seal the opening 112.

[0081] Specifically, the light-transmitting member 115 is disposed corresponding to the opening 112 and is used to seal the opening 112, and the image acquisition device 30 is also disposed corresponding to the opening 112. The image acquisition device 30 is configured to acquire images through the opening 112 and the light-transmitting member 115. That is, the light information outside the AR glasses 1 passes through the light-transmitting member 115 and enters the accommodation chamber 111, and is acquired by the image acquisition device 30. In particular, the light information incident in the direction of the bottom of the accommodation chamber 111, such as the gesture information made by the target object.

[0082] Exemplarily, the light-transmitting member 115 is an element that can transmit light, such as glass or a transparent plastic part.

[0083] It should be understood that setting the light-transmitting member 115 improves the sealing performance of the AR glasses 1, especially the sealing of the bottom of the frame assembly 11. The waterproof performance of the AR glasses 1 is improved, and it can effectively prevent small objects such as external water vapor and dust from entering the accommodation chamber 111 through the opening 112, resulting in damage to components such as the optical engine 21 of the image acquisition device 30 in the accommodation chamber 111.

[0084] Please refer to Figure 6 , Figure 6 which is a schematic structural diagram of the first sealing structure and the second sealing structure in the AR glasses provided by an embodiment of the present application.

[0085] As Figure 6 shown, in some embodiments, the image acquisition device 30 is provided with a first sealing structure, and the image acquisition device 30 forms a sealing fit with the frame assembly 11 through the first sealing structure to seal the opening 112;

[0086] and / or, the frame assembly 11 is provided with a second sealing structure, and the frame assembly 11 forms a sealing fit with the image acquisition device 30 through the second sealing structure to seal the opening 112.

[0087] Specifically, at least one of the first sealing structure and the second sealing structure is provided in the AR glasses 1 to achieve the sealing of the opening 112.

[0088] As Figure 6 (a) shown, taking the image acquisition device 30 being provided with a first sealing structure and the frame assembly 11 being provided with a second sealing structure as an example, the image acquisition device 30 includes a collection part 31 disposed corresponding to the opening 112, such as a camera lens. The image acquisition device 30 is used to acquire images through the collection part 31. The first sealing structure includes a sealing member 32 disposed on the circumferential direction of the collection part 31. The second sealing structure includes a sealing connection part 1113 disposed at the bottom of the accommodation chamber 111, and the sealing connection part 1113 forms a sealing fit with the sealing member 32 to form a collection channel 34 communicating with the collection part 31. Exemplarily, the sealing member 32 can be made of an elastic member, such as silica gel.

[0089] It should be understood that by setting the seal 32 as the first sealing structure, not only the sealing performance and waterproof performance of the AR glasses 1 are effectively improved, but also when an elastic member is used as the seal 32, due to the elasticity of the seal 32, the compatibility of the assembly of the AR glasses 1 and the stability and anti-drop degree of the internal devices of the AR glasses 1 are also improved.

[0090] As Figure 6 shown in (b), alternatively, the first sealing structure includes a first fitting portion 33 provided circumferentially around the camera lens, the second sealing structure includes a second fitting portion 13 provided at the bottom of the accommodation chamber 111 and located inside the accommodation chamber 111, and the first fitting portion 33 and the second fitting portion 13 can be closely arranged so that the first sealing structure and the second sealing mechanism are in sealing cooperation to realize the sealing of the opening 112.

[0091] It should be understood that by adopting such a setting method, on the premise of ensuring that the image acquisition device 30 acquires images in the direction of the bottom of the frame assembly 11, the acquisition angle is significantly increased, and the sensitivity of the acquired image signal is improved.

[0092] As Figure 4 shown, in some embodiments, the lens mounting member 113 is further provided with a first mounting structure 1131 and a second mounting structure 1132 connected to the first mounting structure 1131;

[0093] Among them, the optical engine 21 and the image acquisition device 30 are mounted on the lens mounting member 113 through the first mounting structure 1131, and the optical waveguide assembly 22 is mounted on the lens mounting member 113 through the second mounting structure 1132.

[0094] It should be noted that the optical engine 21, the image acquisition device 30, and the optical waveguide assembly 22 are all mounted on the lens mounting member 113. The lens mounting member 113 forms a first mounting structure 1131, and the first mounting structure 1131 cooperates with the housing member 114 to form an accommodation chamber 111 for mounting the optical engine 21 and the image acquisition device 30. The lens mounting member 113 further forms a second mounting structure 1132 for mounting the optical waveguide assembly 22, and the optical waveguide assembly 22 is mounted on the side of the second mounting structure 1132 away from the first mounting structure 1131. Among them, the first mounting structure 1131 and the second mounting structure 1132 can be separately provided or integrally formed. For example Figure 4 shown, the first mounting structure 1131 and the second mounting structure 1132 are integrally formed.

[0095] By setting different installation structures to install the optical engine 21, the image acquisition device 30, and the optical waveguide assembly 22, on the one hand, the positional relationship conditions in the scenario where the optical engine 21 outputs an image optical signal to the optical waveguide assembly 22 are satisfied. On the other hand, the optical waveguide assembly 22 is installed on the side of the second installation structure 1132 away from the first installation structure 1131, and the installation of the optical engine 21 and the image acquisition device 30 on the first installation mechanism also makes the weight distribution of the AR glasses 1 uniform, and the center of gravity shifts towards the temple assembly 12.

[0096] For example, the first installation structure 1131 and the second installation structure 1132 are arranged separately in the X-axis direction as shown in Figure 4 and the image acquisition device 30, the optical engine 21, and the optical waveguide assembly 22 are arranged in sequence along the X-axis direction, where the X-axis direction refers to the direction from the temple assembly 12 towards the frame assembly 11.

[0097] In some embodiments, the first installation structure 1131 includes an installation portion 1133 connected to the second installation structure 1132 and an extension portion 1134 connected to the installation portion 1133 and extending towards the side away from the optical waveguide assembly 22;

[0098] wherein, the installation portion 1133 forms a first chamber 1111, the extension portion 1134 and the housing member 114 are adapted to form a second chamber 1112, and the first chamber 1111 and the second chamber 1112 form a receiving cavity; at least part of the optical engine 21 is received in the first chamber 1111, the image acquisition device 30 and the control device 40 are received in the second chamber 1112, and an opening 112 is formed in the second chamber 1112.

[0099] Specifically, the installation portion 1133 is connected to the second installation structure 1132, and the extension portion 1134 is connected to the side of the installation portion 1133 away from the optical waveguide assembly 22 and extends along the direction away from the optical waveguide assembly 22. The installation portion 1133 forms a first chamber 1111, the extension portion 1134 and the housing member 114 are adapted to form a second chamber 1112, and the receiving cavity is composed of the above-mentioned first chamber 1111 and second chamber 1112.

[0100] Specifically, at least part of the optical engine 21 is received in the first chamber 1111 so that the optical engine 21 is close to the second installation structure 1132, thereby shortening the distance from the optical engine 21 to the optical waveguide assembly 22 to save the space of the receiving cavity 111 and the volume of the frame assembly 11. It should be understood that in the embodiments of the present application, part of the optical engine 21 can be received in the second chamber 1112.

[0101] For example, the extension portion 1134 is along as shown in Figure 4extends in the opposite direction of the X-axis shown, so that devices accommodated in the second chamber 1112, such as the image acquisition device 30, the control device 40, etc., are arranged in the X-axis direction, avoiding the lens mounting member 113 blocking the line of sight of the target object when the target object wears the AR glasses 1.

[0102] In some embodiments, the accommodation space of the second chamber 1112 is larger than that of the first chamber 1111.

[0103] It should be understood that when setting the lens mounting member 113, the accommodation space of the first chamber 1111 is made smaller than that of the second chamber 1112, which is convenient for installing and fixing the optical engine 21 in the first chamber 1111. Moreover, the larger accommodation space of the second chamber 1112 is beneficial to arranging devices such as the image acquisition device 30, the control device 40, etc., and the circuit board module 70 that may be provided in the second chamber 1112, especially the stacked circuit board module 70.

[0104] Such as Figure 4 and Figure 5 As shown, in some embodiments, the AR glasses 1 further include a voice acquisition device 60. The voice acquisition device 60 is housed in the accommodation chamber 111, and the voice acquisition device 60 performs voice acquisition at least through the opening 112;

[0105] Alternatively, the AR glasses 1 further include a voice acquisition device 60. The accommodation chamber 111 is provided with an acquisition hole 117. The voice acquisition device 60 is arranged corresponding to the acquisition hole 117, and the voice acquisition device 60 performs voice acquisition at least through the acquisition hole 117.

[0106] In some embodiments, the voice acquisition device 60 is a microphone.

[0107] For example, the voice acquisition device 60 can first perform voice acquisition through the corresponding acquisition hole 117. On the other hand, if there is no sealing design at the opening 112 and the circumferential direction of the voice acquisition device 60, the voice acquisition device 60 can also perform voice acquisition through the opening 112.

[0108] For another example, the opening 112 and the acquisition hole 117 can be the same, that is, the image acquisition device 30 and the voice acquisition device 60 face the same opening 112, then the voice acquisition device 60 can perform voice acquisition through the opening 112 (in the case where the opening 112 is larger).

[0109] For example, when the voice collection device 60 performs voice collection at least through the collection hole 117, based on the fact that the collection hole 117 is opened at the bottom of the accommodation chamber 111, when the voice collection device 60 performs voice collection operation through the collection hole 117, the voice information captured by the voice collection device 60 is mainly the voice information on the side of the frame assembly 11 facing its bottom. For example, when the target object wears the AR glasses 1, the voice information emitted by the target object can be preferentially collected.

[0110] Furthermore, the voice collection device 60 is electrically connected to the control device 40. The control device 40 is further configured to determine the voice command of the target object based on the image information collected by the image collection device 30, and control the optical engine 21 to output a corresponding image light signal according to the voice command. Then, when the target object wears the AR glasses 1 provided in the embodiment of the present application, the target object can control the image light signal output by the optical engine 21 by making a voice command.

[0111] In some embodiments, the collection hole 117 is arranged on the same side as the opening 112.

[0112] It should be understood that the opening 112 is opened at the bottom of the accommodation chamber 111. Since the collection hole 117 is arranged on the same side as the opening 112, that is, the collection hole 117 is also opened at the bottom of the accommodation chamber 111, and the voice collection device 60 performs voice collection at least through the collection hole 117, the voice information captured by the voice collection device 60 is mainly the voice information on the side of the frame assembly 11 facing its bottom. For example, when the target object wears the AR glasses 1, the voice information emitted by the target object can be preferentially collected.

[0113] In some embodiments, the voice collection device 60 is an omnidirectional microphone, that is, the voice collection device 60 can also be used to collect composite voice information in multiple directions and transmit the composite voice information to the control device 40. When the control device executes the stored software algorithm, it identifies the composite voice information to screen out the voice information of the target object, that is, the wearer. Exemplarily, the control device 40 can identify the voice information emitted by the target object from the composite voice information according to the voiceprint characteristics of the wearer, so as to control the image light signal output by the optical engine 21 according to the voice information emitted by the target object.

[0114] Such as Figure 2 、 Figure 4 And Figure 5 As shown, in some embodiments, the AR glasses 1 further include a circuit board module 70 accommodated in the accommodation chamber 111. The control device 40 is connected to the circuit board module 70 and is electrically connected to the optical engine 21 through the circuit board module 70.

[0115] Among them, the control device 40 is configured to receive the image information collected by the image acquisition device 30, and control the optical engine 21 to output a corresponding image optical signal according to the image information.

[0116] Specifically, the circuit board module 70 is accommodated in the accommodation chamber 111, and devices such as the control device 40 and the image acquisition device 30 are all mounted on the circuit board module 70. The optical engine 21 is electrically connected to the circuit board module 70, so that the control device 40 is electrically connected to the optical engine 21 through the circuit board module 70, and is also electrically connected to the image acquisition device 30 through the circuit board module 70.

[0117] Furthermore, in addition to the control device 40 and the image acquisition device 30, the devices mounted on the circuit board module 70 further include a power interface, or sensing devices such as a gyroscope and a temperature sensor that do not need to be exposed to the space outside the AR glasses 1.

[0118] By arranging a circuit board in the accommodation chamber 111 and mounting various devices on the circuit board, it is beneficial to perform modular design on the various functional modules accommodated in the accommodation chamber 111, and it is also convenient to improve the space utilization rate of the accommodation chamber 111, and further compress the volume and weight of the AR glasses 1.

[0119] In some embodiments, the frame assembly 11 includes a first positioning structure provided on the inner wall of the accommodation chamber 111, and the circuit board module 70 is provided with a second positioning structure adapted to the first positioning structure;

[0120] When the first positioning structure and the second positioning structure are connected and adapted, the circuit board module 70 is mounted on the frame assembly 11.

[0121] It should be understood that since devices such as the control device 40 and the image acquisition device 30 are all mounted on the circuit board module 70, by providing the first positioning structure and the second positioning structure that are connected and adapted to each other to mount the circuit board module 70 on the frame assembly 11, in the actual use scenario of the AR glasses 1, the positions of devices such as the control device 40 and the image acquisition device 30 are firm and stable, and the use stability of the AR glasses 1 is also improved.

[0122] For example, the connection and adaptation methods of the first positioning structure and the second positioning structure include but are not limited to at least one of adhesive connection, snap connection, and plug connection. For example, in Figure 5 the connection and adaptation method of the first positioning structure and the second positioning structure is adhesive connection, so that the connection between the circuit board module 70 and the frame assembly 11 is firm.

[0123] In some embodiments, the first positioning structure includes a slot formed on the side of the accommodation chamber 111 close to the temple assembly 12, and the second positioning structure includes a card member that is inserted and matched with the slot.

[0124] Specifically, the frame assembly 11 is provided with a slot, and the circuit board module 70 is provided with a card member. The card member is inserted and engaged with the slot to... Conversely, a card member can also be provided on the frame assembly 11, and a slot for engaging with the card member can be provided on the circuit board module 70. When the card member is engaged with the slot, the circuit board module 70 is connected to the frame assembly 11 and is received on one side of the accommodation chamber 111 close to the temple assembly 12.

[0125] In some embodiments, the image acquisition device 30 is connected to one side of the circuit board module 70 facing the opening 112 and is disposed opposite to the opening 112.

[0126] Specifically, the image acquisition device 30 is integrated into the circuit board module 70. The image acquisition device 30 is connected to one side of the circuit board module 70 facing the opening 112, so that the image acquisition direction of the image acquisition device 30 faces the opening 112 and will not be blocked by the circuit board module 70. Moreover, the space utilization rate of the accommodation chamber 111 is improved, and the volume of the frame assembly 11 is further compressed.

[0127] As Figure 4 shown, in some embodiments, the circuit board module 70 includes at least two stacked sub-circuit boards 71, and an electrical connection is formed between two adjacent sub-circuit boards 71.

[0128] Specifically, devices such as the image acquisition device 30, the control device 40, and the voice acquisition device 60 are arranged on the respective sub-circuit boards 71 of the circuit board module 70, and an electrical connection is formed between two adjacent sub-circuit boards 71. Therefore, an electrical connection is also formed between the devices arranged on the respective sub-circuit boards 71. Compared with a single-piece circuit board, in the embodiment of the present application, by at least two stacked sub-circuit boards 71, the occupied area in the extending direction of the circuit board is reduced, and thus the volume of the accommodation chamber 111 is effectively compressed.

[0129] Among them, the image acquisition device 30 is connected to the sub-circuit board 71 on the side of the circuit board module 70 facing the opening 112 and is arranged facing the opening 112. It should be noted that arranging the image acquisition device 30 on the sub-circuit board 71 on the side of the circuit board module 70 facing the opening 112 and on the side facing the opening 112 facilitates the image acquisition direction of the image acquisition device 30 to face the opening 112, will not be blocked by the circuit board module 70, and improves the space utilization rate of the accommodation chamber 111, further compressing the volume of the frame assembly 11.

[0130] Please refer to Figure 7 , Figure 7 which is a schematic flow chart of the AR glasses 1 control method provided by an embodiment of the present application.

[0131] As Figure 7As shown, an embodiment of the present application further provides an AR glasses control method, which is applied to any AR glasses provided in the embodiments of the present application. The method includes steps S1 to S2:

[0132] Step S1: Control the image acquisition device 30 to perform an image acquisition operation through the opening 112 to obtain image information, and determine the action instruction of the target object according to the image information;

[0133] Step S2: Control the optical engine 21 to output a corresponding image optical signal to the coupling grating area 221 of the optical waveguide assembly 22 according to the action instruction.

[0134] Specifically, the device executing this method first controls the image acquisition device 30 to perform an image acquisition operation through the opening 112 to obtain image information, determines the action instruction of the target object according to the image information, and then controls the optical engine 21 to output a corresponding image optical signal to the coupling grating area 221 of the optical waveguide assembly 22 according to the action instruction.

[0135] Such as Figure 1 And Figure 7 As shown, for example, it can be any AR glasses 1 provided in the embodiments of the present application that execute the AR glasses 1 control method provided in the embodiments of the present application. Further, specifically, it is the control device 40 in the AR glasses 1 that executes the AR glasses 1 control method provided in the embodiments of the present application.

[0136] Specifically, the control device 40 in the AR glasses 1 is electrically connected to both the image acquisition device 30 and the optical engine 21. The control device 40 controls the image acquisition device 30 to perform an image acquisition operation through the opening 112 to obtain image information. The control device 40 receives the image information and determines the action instruction of the target object according to the image information. After that, the control device 40 controls the optical engine 21 to output a corresponding image optical signal to the coupling grating area 221 of the optical waveguide assembly 22 according to the action instruction.

[0137] Since when the target object wears the AR glasses 1, the position of the opening 112 is on the side of the accommodation chamber 111 close to the ground, when performing the AR glasses 1 control method, the image acquisition device 30 performs an image acquisition operation through the opening 112, so that the gesture instruction actually made by the target object can be accurately captured, and it is not easy to collect the gestures made by people other than the target object, avoiding obtaining incorrect gesture instructions, and improving the pertinence of capturing the gesture instructions of the target object and the anti-interference effect during the use of the AR glasses 1.

[0138] In summary, the embodiments of the present application provide an AR glasses 1 and an AR glasses control method. The AR glasses 1 include: a frame module 10, including a frame assembly 11 and temple assemblies 12 connected to the frame assembly 11. The frame assembly 11 is provided with an accommodation chamber 111 having an opening 112, wherein the opening 112 is formed at the bottom of the accommodation chamber 111; a display module 20, including an optical engine 21 and an optical waveguide assembly 22. The optical waveguide assembly 22 is connected to the frame assembly 11, and the optical waveguide assembly 22 is provided with an input grating region 221 and an output grating region 222. The optical engine 21 is accommodated in the accommodation chamber 111 and is correspondingly arranged with respect to the input grating region 221; an image acquisition device 30, which is accommodated in the accommodation chamber 111 and electrically connected to the optical engine 21, and the image acquisition device 30 is configured to perform an image acquisition operation through the opening 112; and a control device 40, which is electrically connected to the image acquisition device 30 and the optical engine 21. By forming the opening 112 at the bottom of the accommodation chamber 111 and configuring the image acquisition device 30 to perform an image acquisition operation through the opening 112, the AR glasses 1 provided by the embodiments of the present application improve the pertinence of image acquisition, can accurately acquire the gestures actually made by the target object to improve the user experience, and avoid unnecessary privacy problems that may be caused during external image acquisition through the improvement of the image acquisition angle.

[0139] Those of ordinary skill in the art can understand that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices, can be implemented as software, firmware, hardware, and their appropriate combinations. In the hardware embodiment, the division of the functional modules / units mentioned above does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be executed by several physical components in cooperation. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or may be implemented as hardware, or may be implemented as a set circuit, such as an application-specific set circuit. Such software can be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or transitory medium).

[0140] It should be understood that the terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application. Unless otherwise clearly defined and limited, the terms "installed", "connected", and "coupled" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the communication inside two elements. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood according to specific situations. As used in the specification of this application and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an", and "the" are intended to include the plural forms.

[0141] It should also be understood that the term "and / or" used in the specification of this application and the appended claims refers to any combination and all possible combinations of one or more of the related listed items, and includes these combinations. It should be noted that in this article, the term "comprising", "including", or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article, or system including a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article, or system.

Claims

1. An AR glasses, characterized in that, The AR glasses include: A frame module, including a frame component and temple components connected to the frame component. The frame component is provided with a receiving chamber having an opening, wherein the opening is formed at the bottom of the receiving chamber; A display module, including an optical engine and an optical waveguide component. The optical waveguide component is connected to the frame component, and the optical waveguide component is provided with an input grating region and an output grating region. The optical engine is received in the receiving chamber and is arranged corresponding to the input grating region; An image acquisition device, which is received in the receiving chamber and electrically connected to the optical engine, and the image acquisition device is configured to perform image acquisition operations through the opening; and A control device, which is electrically connected to the image acquisition device and the optical engine.

2. The AR glasses according to claim 1, characterized in that, The frame component includes: A lens mounting member, to which the temple components are connected, and the optical waveguide component is connected to a side of the lens mounting member away from the temple components; A housing member, which is detachably connected to the lens mounting member and cooperates with the housing member to form the receiving chamber, and the opening is provided in at least one of the housing member and the lens mounting member.

3. The AR glasses according to claim 2, characterized in that, The frame module further includes a light-transmitting member, which is arranged corresponding to the opening and is used to seal the opening.

4. The AR glasses according to claim 2, characterized in that, The image acquisition device is provided with a first sealing structure, and the image acquisition device forms a sealing fit with the frame component through the first sealing structure to seal the opening; And / or, the frame component is provided with a second sealing structure, and the frame component forms a sealing fit with the image acquisition device through the second sealing structure to seal the opening.

5. The AR glasses according to claim 2, characterized in that, The lens mounting member is further provided with a first mounting structure and a second mounting structure connected to the first mounting structure; Wherein, the optical engine and the image acquisition device are mounted on the lens mounting member through the first mounting structure, and the optical waveguide component is mounted on the lens mounting member through the second mounting structure.

6. The AR glasses according to claim 5, characterized in that, The first mounting structure includes a mounting portion connected to the second mounting structure and an extension portion connected to the mounting portion and extending away from the optical waveguide component; Wherein, the mounting portion forms a first chamber, and the extension portion and the housing member are adapted to form a second chamber, and the first chamber and the second chamber form the receiving cavity; At least a part of the optical engine is received in the first chamber, the image acquisition device and the control device are received in the second chamber, and the opening is formed in the second chamber.

7. The AR glasses according to claim 6, characterized in that, The accommodation space of the first chamber is larger than the accommodation space of the second chamber.

8. The AR glasses according to any one of claims 1-7, characterized in that, The AR glasses further include a voice acquisition device, which is received in the receiving chamber, and the voice acquisition device performs voice acquisition at least through the opening; Or, the AR glasses further include a voice acquisition device, the receiving chamber is provided with a collection hole, the voice acquisition device is arranged corresponding to the collection hole, and the voice acquisition device performs voice acquisition at least through the collection hole.

9. The AR glasses according to claim 8, characterized in that, The collection hole is arranged on the same side as the opening.

10. The AR glasses according to any one of claims 1-7, characterized in that, The AR glasses further include a circuit board module accommodated in the accommodation chamber, and the control device is connected to the circuit board module and is connected to the optical machine through the circuit board module. Wherein, the control device is configured to receive the image information collected by the image acquisition device and control the optical machine to output a corresponding image light signal according to the image information.

11. The AR glasses according to claim 10, characterized in that, The frame assembly includes a first positioning structure disposed on the inner wall of the accommodation chamber, and the circuit board module is provided with a second positioning structure adapted to the first positioning structure; When the first positioning structure is connected and adapted to the second positioning structure, the circuit board module is mounted on the frame assembly.

12. The AR glasses according to claim 11, characterized in that, The first positioning structure includes a slot formed in the accommodation chamber near the side temple assembly, and the second positioning structure includes a card member that is inserted and mated with the slot.

13. The AR glasses according to claim 10, characterized in that, The image acquisition device is connected to a side of the circuit board module facing the opening and is disposed opposite to the opening.

14. The AR glasses according to claim 10, characterized in that, The circuit board module includes at least two stacked sub-circuit boards, and electrical connections are formed between two adjacent sub-circuit boards; Wherein, the image acquisition device is connected to the sub-circuit board on the side of the circuit board module facing the opening and is disposed facing the opening.

15. An AR glasses control method, applied to the AR glasses according to any one of claims 1-14, characterized in that, The method includes: Controlling the image acquisition device to perform an image acquisition operation through the opening to obtain image information, and determining an action instruction of the target object according to the image information; Controlling the optical machine to output a corresponding image light signal to the coupling grating region of the optical waveguide assembly according to the action instruction.

Images