AR glasses camera angle adjustment method, device, electronic equipment and medium

Abstract

The disclosed embodiments provide an AR glasses camera angle adjustment method, device, electronic device and computer-readable storage medium, and relate to the AR glasses technical field. The method comprises: establishing a human posture model according to the position of the AR glasses and the position of the limbs in the gesture interaction, and determining the functional relationship between the first AR glasses shooting angle and the first limb state parameter in the first state in the human posture model; obtaining the second limb state parameter of multiple samples in the second state as a comfortable state, and obtaining the angle difference between the first limb state parameter and the second limb state parameter; calculating the second AR glasses shooting angle of the sample in the second state according to the angle difference and the functional relationship; obtaining the adjustment angle of the AR glasses camera according to the second AR glasses shooting angle. The AR glasses camera angle adjustment scheme disclosed in the disclosed embodiments helps to improve the user's comfort when issuing gesture operation instructions to the AR glasses.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the technical field of AR glasses. Specifically, the embodiments of the present disclosure relate to an AR glasses camera angle adjustment method, device, electronic device and computer-readable storage medium. Background Art

[0002] AR (Augmented Reality) glasses can perform gesture recognition, which is achieved through the images of gestures provided by the camera installed on the AR glasses.

[0003] However, in general, users are not in the same position every time they perform gesture control, and different users have different hand positions when performing the same control. Therefore, given the limitations of the visual range of the camera on the AR glasses, users are generally required to raise their hands to the visual range of the camera to ensure that the camera can obtain the user's gesture image, which also affects the user's comfort when using AR glasses, making it difficult to increase the user's willingness to use AR glasses. Summary of the invention

[0004] In order to improve the comfort of AR glasses, the embodiments of the present disclosure provide an AR glasses camera angle adjustment method, device, electronic device and computer-readable storage medium, which help to improve the comfort of AR glasses.

[0005] In a first aspect, an embodiment of the present disclosure provides a method for adjusting the angle of an AR glasses camera, the method comprising the following steps:

[0006] Establishing a human posture model according to the position of the AR glasses and the position of the limbs in the gesture interaction, and determining a functional relationship between a first AR glasses shooting angle and a first limb state parameter in the first state in the human posture model;

[0007] Acquire a second limb state parameter when the plurality of samples are in a second state, and acquire an angle difference between the first limb state parameter and the second limb state parameter;

[0008] Calculate a second AR glasses shooting angle of the sample in a second state according to the angle difference and the functional relationship;

[0009] The adjustment angle of the camera of the AR glasses is obtained according to the second AR glasses shooting angle.

[0010] In an optional embodiment of the first aspect, before the step of obtaining the second limb state parameters of the plurality of samples in the second state, the step further includes:

[0011] Acquire image information of a plurality of samples in a second state according to the human body posture model;

[0012] The second limb state parameter is acquired according to the image information.

[0013] In an optional embodiment of the first aspect, the step of establishing a human posture model according to the position of the AR glasses and the position of the limbs in the gesture interaction includes:

[0014] Constructing a human posture model, and setting the position of the AR glasses on the horizontal line of sight of the human posture model;

[0015] A human posture model in the gesture interaction is set and posture parameters of the human posture model are set; wherein the upper arm of the human posture model is located in a vertical direction, and the forearm is perpendicular to the upper arm; the upper arm rotation angle relative to the vertical direction is 0, and the forearm rotation angle relative to the horizontal direction is 0.

[0016] In an optional embodiment of the first aspect, the functional relationship between the first AR glasses shooting angle and the first limb state parameter in the first state in the human posture model includes:

[0017]

[0018] Wherein, the posture parameters include:

[0019] θ is the angle between the line of sight of the AR glasses and the line from the glasses to the base of the palm;

[0020] L0 is the vertical distance from the AR glasses to the shoulder in the human posture model;

[0021] L1 is the vertical distance from the shoulder to the elbow in the human posture model;

[0022] L2 is the horizontal distance from the elbow to the base of the palm in the human posture model;

[0023] L3 is the palm length in the human posture model;

[0024] d0 is the horizontal distance from the AR glasses to the shoulders in the human posture model.

[0025] In an optional embodiment of the first aspect, the step of obtaining an angle difference between the first limb state parameter and the second limb state parameter includes:

[0026] Collect the upper arm rotation angle in the vertical direction of the upper arm relative to the human body posture model and the lower arm rotation angle in the horizontal direction of the lower arm relative to the human body posture model corresponding to each sample;

[0027] The angle difference between the forearm rotation angle and the upper arm rotation angle of the corresponding sample and the forearm rotation angle and the upper arm rotation angle of the human body posture model is obtained.

[0028] In an optional embodiment of the first aspect, the step of calculating a shooting angle of a second AR glasses when the sample is in a second state according to the angle difference and the functional relationship includes:

[0029] The upper arm rotation angle and the lower arm rotation angle corresponding to each sample are read in sequence to obtain the projection lengths of the upper arm and the lower arm in the vertical direction and the horizontal direction respectively;

[0030] According to the projection length, the second AR glasses shooting angle of each sample in the second state is calculated using the functional relationship, and the average of the second AR glasses shooting angles of each sample in the second state is used as the second AR glasses shooting angle.

[0031] In an optional embodiment of the first aspect, the AR glasses camera angle adjustment method further includes:

[0032] Obtain the second AR glasses shooting angle of each sample in the second state, and obtain the maximum second AR glasses shooting angle and the minimum second AR glasses shooting angle among all samples;

[0033] If the difference between the maximum second AR glasses shooting angle and the minimum second AR glasses shooting angle exceeds the set range, the first median data of the upper arm rotation angle and the second median data of the lower arm rotation angle corresponding to each sample are obtained;

[0034] The first median data and the second median data are respectively used as the upper arm rotation angle difference and the lower arm rotation angle difference between the first limb state parameter and the second limb state parameter.

[0035] In a second aspect, the embodiments of the present disclosure further provide an AR glasses camera angle adjustment device, comprising:

[0036] A model building module, used to build a human posture model according to the position of the AR glasses and the position of the limbs in the gesture interaction, and determine the functional relationship between the first AR glasses shooting angle and the first limb state parameter in the first state in the human posture model;

[0037] An angle difference acquisition module, used to acquire a second limb state parameter of a plurality of samples in a second state, and acquire an angle difference between the first limb state parameter and the second limb state parameter;

[0038] A shooting angle calculation module, used to calculate a second AR glasses shooting angle of the sample in a second state according to the angle difference and the functional relationship;

[0039] The angle adjustment module is used to obtain the adjustment angle of the camera of the AR glasses according to the shooting angle of the second AR glasses.

[0040] In a third aspect, an electronic device is provided, the electronic device comprising:

[0041] one or more processors;

[0042] Memory;

[0043] One or more applications, wherein one or more applications are stored in a memory and configured to be executed by one or more processors, and the one or more programs are configured to: execute the AR glasses camera angle adjustment method described in the first aspect of an embodiment of the present disclosure.

[0044] In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the method for adjusting the angle of the AR glasses camera described in the first aspect of the embodiment of the present disclosure is implemented.

[0045] The technical solution provided by the embodiments of the present disclosure has the following beneficial effects:

[0046] The AR glasses camera angle adjustment scheme provided in the present application establishes a human posture model according to the limb positions in the gesture interaction, compares the second limb state parameter of the collected sample with the first limb state parameter obtained according to the human posture model to obtain the corresponding angle difference, and obtains the second AR glasses shooting angle of the sample in the second state of the comfortable state according to the angle difference, thereby obtaining the adjustment angle of the AR glasses camera. The AR glasses camera angle adjustment scheme provided in the present application can adjust the AR glasses camera angle according to the gesture operations made by the user in a comfortable state and with operational awareness, so that the adjusted camera can obtain the gesture operations made by the user in the second state of the comfortable state, which helps to improve the user's comfort when issuing gesture operation instructions to the AR glasses; on the other hand, it can also filter gesture actions without operational awareness to prevent the AR glasses from receiving erroneous operation instructions and improve the accuracy of instruction operations.

[0047] Additional aspects and advantages of the embodiments of the present disclosure will be partially given in the description below, which will become apparent from the description below, or will be learned through the practice of the embodiments of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] The above and / or additional aspects and advantages of the embodiments of the present disclosure will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0049] Figure 1 A schematic diagram of a flow chart of a method for adjusting the angle of an AR glasses camera provided in one embodiment of the present application;

[0050] Figure 2 A human body posture model of a method for adjusting the angle of an AR glasses camera provided in one embodiment of the present application;

[0051] Figure 3 Another human body posture model of the AR glasses camera angle adjustment method provided by one embodiment of the present application;

[0052] Figure 4 Another human body posture model for the AR glasses camera angle adjustment method provided by one embodiment of the present application;

[0053] Figure 5a A second limb state image of a male sample in a second state according to an embodiment of the present application;

[0054] Figure 5b A second limb state image of a female sample in a second state according to an embodiment of the present application;

[0055] Figure 6 A schematic diagram of obtaining a second AR glasses shooting angle by using a human posture model in a method for adjusting an AR glasses camera angle provided by an embodiment of the present application through a second limb state parameter of a sample;

[0056] Figure 7 A schematic diagram of the structure of an AR glasses camera angle adjustment device provided by one embodiment of the present application;

[0057] Figure 8 A schematic diagram of the structure of an electronic device for adjusting the angle of an AR glasses camera provided by an embodiment of the present application. DETAILED DESCRIPTION

[0058] Embodiments of the present disclosure are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present disclosure, and cannot be interpreted as limiting the present invention.

[0059] It will be understood by those skilled in the art that, unless otherwise stated, the singular forms "a", "an", "said" and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of the present disclosure refers to the presence of the features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof. The term "and / or" used herein includes all or any unit and all combinations of one or more associated listed items.

[0060] In order to make the objectives, technical solutions and advantages of the present disclosure more clear, the embodiments of the present disclosure will be further described in detail below with reference to the accompanying drawings.

[0061] In order to enable AR glasses to obtain the user's gesture image and identify the corresponding operation instructions when the user is in a comfortable posture, the present application provides a technical solution for adjusting the angle of the AR glasses camera.

[0062] Reference Figure 1 , Figure 1 A flowchart of a method for adjusting the angle of an AR glasses camera provided by an embodiment of the present application. The method for adjusting the angle of an AR glasses camera includes the following steps:

[0063] S110, establishing a human posture model according to the position of the AR glasses and the position of the limbs in the gesture interaction, and determining a functional relationship between a first AR glasses shooting angle and a first limb state parameter in a first state in the human posture model.

[0064] When general users use AR glasses, they wear the AR glasses in front of their eyes. AR glasses obtain the user's gesture image through the camera located thereon, and obtain and identify the user's operation instructions based on the gesture image to trigger the corresponding operation. During the use of AR glasses, the camera of AR glasses is generally fixed on the AR glasses and installed facing forward. Therefore, the coverage range of the camera is generally located in the front area of ​​​​the user. Moreover, combined with general operating habits, when the user has an operating awareness, his operating gesture is generally located in front of the human body. If the user puts his hand in the area behind him, it is generally believed that the user does not have the awareness of sending operating instructions to the AR glasses.

[0065] Therefore, according to the above content, a human posture model is established for the area where the user sends operation instructions when he has operation awareness, that is, the human posture model is constructed by combining the limb position in the gesture interaction when the user has operation awareness with the position of the AR glasses, so as to detect the range of the user's sending operation instructions and adjust the angle of the camera of the AR glasses according to the detection range. At the same time, the gesture area that can be detected by the human posture model is located in the front area of ​​the human body. In addition to detecting the limb position in the gesture interaction, it can also filter gestures without operation awareness, so that the coverage area of ​​the adjusted camera can capture the gesture operation made by the user when he has operation awareness.

[0066] In the human posture model, in order to fully obtain the gesture operation instructions of the user with operational awareness, the edge position of the gesture when the user has operational awareness can be used as one edge of the AR glasses shooting angle, and combined with the first limb state parameter in the human posture model, the other edge of the AR glasses shooting angle is determined within the coverage of the AR glasses shooting angle, and the two edges of the AR glasses shooting angle form the first AR glasses shooting angle. According to the spatial angle relationship between the first AR glasses shooting angle and the first limb state parameter, a corresponding functional relationship is formed.

[0067] In order to reduce the complexity of the human body posture model, the functional relationship may be set to a functional relationship in the first state.

[0068] Furthermore, in order to establish the functional relationship in the first state, when constructing the human posture model, a reference position may be established for the coverage of the camera and the positional relationship of the limbs in the human posture model.

[0069] Among them, the reference position of the camera's coverage range can be the horizontal line of sight position of the human body posture model, and the position of the AR glasses is set based on the horizontal line of sight position and in front of the eyes of the human body posture model.

[0070] Reference Figure 2 , Figure 2 A human posture model of an AR glasses camera angle adjustment method provided in one embodiment of the present application.

[0071] The human body posture model is used to set the posture parameters of the human body during gesture interaction. In this embodiment, the first state can be understood as an ideal state. The ideal state is mainly used to construct an ideal state of the posture parameters therein according to the human body posture model.

[0072] For example, in an ideal state, the human posture model simulates an upper arm hanging on the same side of the body, in the vertical direction; the forearm is perpendicular to the upper arm, and the forearm is placed in the horizontal direction. According to the placement of the upper arm and the forearm in an ideal state, the upper arm rotation angle relative to the vertical direction is 0, and the forearm rotation angle relative to the horizontal direction is 0. In the human posture model, the first AR glasses shooting angle is set to the angle formed by the horizontal line of sight and the edge position of the simulated gesture when the user has operational awareness.

[0073] S120, obtaining a second limb state parameter of a plurality of samples in a second state, and obtaining an angle difference between the first limb state parameter and the second limb state parameter.

[0074] In this embodiment, the second state may be a comfortable state for the user. The comfortable state is a natural posture made by the user when the user has an operating consciousness and issues a gesture operation instruction to the AR glasses. In this natural posture, the user will not deliberately make actions such as raising the forearm and / or upper arm.

[0075] The edge position of the simulated gesture when the user has the operational awareness mentioned in step S110 is used as the position of the user's limbs in the second state in this embodiment, so that the adjustment angle of the AR glasses camera obtained by the AR glasses camera angle adjustment method provided by this embodiment can obtain the user's gesture operation instructions in the second state, which helps to improve the comfort of using the AR glasses.

[0076] In this step, a user is taken as a sample, and the second limb state parameters of multiple samples in the second state are obtained. Then, the angle difference between the second limb state parameter of each sample and the first limb state parameter of the human body posture model is obtained respectively.

[0077] In this embodiment, the second limb state parameter can collect the limb state parameter corresponding to each sample according to the first limb state parameter. The angle difference can be obtained by obtaining the side image of each sample when performing gesture operation in the second state, obtaining the corresponding second limb state parameter, and comparing it with the angle of the same parameter of the first limb state parameter, to obtain the angle difference between the first limb state parameter of the corresponding parameter and the second limb state parameter.

[0078] S130, calculating a second AR glasses shooting angle of the sample in a second state according to the angle difference and the functional relationship.

[0079] According to the functional relationship, the second limb state parameter of each sample obtained from step S120 is converted into the numerical value of the first limb state parameter of the corresponding item on the functional relationship, and then the functional relationship is used to calculate the second AR glasses shooting angle corresponding to the sample in the second state.

[0080] In this step, the sample may refer to a specific sample, or all or part of the samples involved in the adjustment test.

[0081] S140: Obtain an adjustment angle of the AR glasses camera according to the second AR glasses shooting angle.

[0082] According to the shooting angle of the second AR glasses when the sample obtained in step S130 is in the second state, combined with the coverage range of the camera, the adjustment angle of the camera of the AR glasses is obtained.

[0083] The AR glasses camera angle adjustment scheme provided in the present application establishes a human posture model according to the limb positions in gesture interaction, compares the second limb state parameters of the collected samples with the first limb state parameters obtained according to the human posture model to obtain the corresponding angle difference, and obtains the second AR glasses shooting angle of the sample in the second state according to the angle difference, thereby obtaining the adjustment angle of the AR glasses camera.

[0084] The AR glasses camera angle adjustment scheme provided in the present application can adjust the AR glasses camera angle according to the gesture operations made by the user in a comfortable state and with operational awareness, so that the adjusted camera can obtain the gesture operations made by the user in the second state as the comfortable state, which helps to improve the user's comfort when issuing gesture operation instructions to the AR glasses; on the other hand, it can also filter gesture actions without operational awareness to prevent the AR glasses from receiving erroneous operation instructions.

[0085] For the AR glasses camera angle adjustment method provided in the embodiment of the present application, a corresponding human body posture model can be constructed according to the gesture operation instructions required.

[0086] If the camera needs to obtain the image of the entire palm movement to accurately identify the corresponding gesture operation instruction, then the corresponding human posture model, such as Figure 2 As shown, in the human posture model, the functional relationship between the first AR glasses shooting angle and the first limb state parameter in the first state is set to:

[0087]

[0088] In formula (1), the posture parameters include:

[0089] θ is the angle between the line of sight of the AR glasses and the line from the glasses to the base of the palm;

[0090] L0 is the vertical distance from the AR glasses to the shoulder in the human posture model;

[0091] L1 is the vertical distance from the shoulder to the elbow in the human posture model;

[0092] L2 is the horizontal distance from the elbow to the base of the palm in the human posture model;

[0093] L3 is the palm length in the human posture model;

[0094] d0 is the horizontal distance from the AR glasses to the shoulders in the human posture model.

[0095] In the human posture model, the posture parameters are divided into vertical posture parameters and horizontal posture parameters. The vertical posture parameters include the vertical distance L0 from the AR glasses to the shoulders in the human posture model and the vertical distance L1 from the shoulders to the elbows in the human posture model; the horizontal posture parameters include the horizontal distance L2 from the elbows to the base of the palms in the human posture model and the horizontal distance d0 from the AR glasses to the shoulders in the human posture model. Among them, since the ears and shoulders are located in the same vertical direction in the human posture model, d0 is equivalent to the distance from the eyes to the ears in the human posture model.

[0096] exist Figure 2 In the human body posture model shown, the camera of the AR glasses is set to be able to obtain gesture operation instructions issued by the entire palm in the human body posture model. The range of the palm is from the fingertips to the base of the palm, that is, the base of the palm in the human body posture model is the edge position of the first AR glasses shooting angle. According to the posture parameters in the vertical direction of the human body posture model, the horizontal line of sight of the human body posture model is used as another edge position of the first AR glasses shooting angle. Therefore, in the first state, the first AR glasses shooting angle can be the angle formed by the horizontal line of sight caused by the starting point and the two connecting lines to the base of the palm in the human body posture model. The first AR glasses shooting angle can satisfy the functional relationship in the above formula (1).

[0097] Reference Figure 3 , Figure 3 Another human body posture model of the AR glasses camera angle adjustment method provided by an embodiment of the present application.

[0098] If the camera of the AR glasses only needs to obtain the operation instructions issued by the fingers, the horizontal posture parameters include the horizontal distance L2 from the elbow to the base of the palm in the human posture model and the palm length L3 in the human posture model, as well as the horizontal distance d0 from the AR glasses to the shoulder in the human posture model. In the human posture model, the first AR glasses shooting angle is the angle formed by the horizontal line of sight and the line connecting the AR glasses to the middle of the palm, and the corresponding functional relationship is:

[0099]

[0100] Reference Figure 4 , Figure 4 Another human body posture model of the AR glasses camera angle adjustment method provided by an embodiment of the present application.

[0101] like Figure 4As shown, at this time, the shooting angle of the first AR glasses can only cover the position of the fingertips, but the camera cannot obtain the gesture operation instructions made in the second state, and the hand needs to be extended forward, beyond the position of the fingertips in the human posture model.

[0102] At this time, the corresponding functional relationship is:

[0103]

[0104] In the human posture model, based on the same first limb state parameter, if the range of the recognition image of the gesture operation information to be obtained is different, the magnitude relationship of the first AR glasses shooting angle obtained in different situations is θ>θ2>θ3. Therefore, when the first AR glasses shooting angle is θ, it can also cover the coverage range corresponding to the first AR glasses shooting angle of θ2 or θ3.

[0105] According to the above analysis, in the execution description of the subsequent embodiments, the description is based on the condition that the shooting angle of the first AR glasses is θ.

[0106] According to the human posture model obtained above, the upper arm rotation angle and the forearm rotation angle of each sample are collected. Specifically, in the present embodiment, the upper arm rotation angle is the rotation angle of the upper arm of the corresponding sample relative to the vertical direction of the human posture model, and the forearm rotation angle is the rotation angle of the forearm of the corresponding sample relative to the horizontal direction of the human posture model. Then, the angle difference between the upper arm rotation angle and the forearm rotation angle of each sample relative to the upper arm rotation angle and the forearm rotation angle in the first limb state parameter is obtained. In the present embodiment, since the upper arm rotation angle and the forearm rotation angle in the first limb state parameter are both 0, the corresponding angle difference can be obtained through the gesture operation image of each sample.

[0107] In order to better illustrate the process of obtaining the second limb state parameter, the following sample data acquisition process is specifically described.

[0108] In this embodiment, 20 males and 12 females are used as samples, and the posture parameters of each sample are measured. Specifically, the specific data of L0, L1, L2, L3, d0, etc. of each sample are actually measured, and the statistical data table is as follows:

[0109]

[0110]

[0111] According to the above obtained posture parameter data table, the first AR glasses shooting angle of each sample is obtained using the above formula (1). Among the above specific parameters, the maximum first AR glasses shooting angle is 80.79°, the minimum first AR glasses shooting angle is 73.22°, and the average value of the first AR glasses shooting angles obtained from all samples is 76.67°.

[0112] The average value of the first AR glasses shooting angle may be the average value of the first AR glasses shooting angle of the male sample and the average value of the first AR glasses shooting angle of the female sample. In the above table, the corresponding samples filled with gray are female samples, and the others are male samples.

[0113] If the average value of the first AR glasses shooting angle of the male samples and the average value of the first AR glasses shooting angle of the female samples are close to the average value of the first AR glasses shooting angle of all samples, there is no need to distinguish between male and female users and make separate adjustments for the adjustment of the AR glasses camera angle.

[0114] In this embodiment, the adjustment angle of the camera of the AR glasses of the corresponding sample can be obtained according to the first AR glasses shooting angle obtained above. The adjustment angle of the camera of the AR glasses of the type corresponding to the above sample can also be obtained according to the average value of the first AR glasses shooting angle.

[0115] Reference Figure 5a and Figure 5b , Figure 5a A second limb state image of a male sample in a second state according to an embodiment of the present application, Figure 5b This is a second limb state image of a female sample in a second state according to an embodiment of the present application.

[0116] Further, the second limb state parameter of each sample in the second state is obtained, such as Figure 5a and Figure 5b . In this embodiment, the side image of each sample in the second state completing the gesture operation instruction to the AR glasses is used as the measurement basis to obtain the second limb state parameters of each sample in the second state. Regardless of whether it is in the second state or not, the specific data of L0, L1, L2, L3, and d0 remain unchanged, but the upper arm rotation angle and forearm rotation angle of each sample will vary due to different operating states and habitual movements, thereby affecting the sample's AR glasses shooting angle. Regarding the upper arm rotation angle and forearm rotation angle of the above samples, the specific data are as follows:

[0117]

[0118]

[0119] In the above data table, the upper arm rotation angle is based on the vertical direction. When the upper arm is tilted in front of the body, the upper arm rotation angle is positive; when the upper arm is tilted behind the body, the upper arm rotation angle is negative. The forearm rotation angle is based on the horizontal direction. When the palm is higher than the elbow, the forearm rotation angle is positive; when the palm is lower than the elbow, the forearm rotation angle is negative.

[0120] When the upper arm rotation angle is negative, that is, the upper arm is tilted toward the back of the body, based on the operating posture that general users have operating awareness and habits, it is considered that the user of the corresponding sample has no operating awareness, and the statistics and calculations of the corresponding sample can be removed.

[0121] In this embodiment, since in the first state, the upper arm rotation angle and the lower arm rotation angle of the human body posture model are both 0, the above-mentioned Figure 5a and Figure 5b The second limb state image in the second state can directly obtain the forearm rotation angle and the upper arm rotation angle of each sample in the second state.

[0122] Reference Figure 6 , Figure 6 In the AR glasses camera angle adjustment method provided as an embodiment of the present application, a human posture model is used to obtain a schematic diagram of the second AR glasses shooting angle through the second limb state parameter of the sample.

[0123] according to Figure 6 As shown, the above step S130 may further include the following steps:

[0124] The upper arm rotation angle and the lower arm rotation angle corresponding to each sample are read in sequence to obtain the projection lengths of the upper arm and the lower arm in the vertical direction and the horizontal direction respectively;

[0125] According to the projection length, the second AR glasses shooting angle of each sample in the second state is calculated using the functional relationship, and the average of the second AR glasses shooting angles of each sample in the second state is used as the second AR glasses shooting angle.

[0126] In this embodiment, using Figure 6 The human body posture model shown in the figure has the upper arm rotation angle α and the lower arm rotation angle β of the corresponding sample. Correspondingly, the projection length of the upper arm in the vertical direction is L1cos(β), and the projection length in the horizontal direction is L1sin(β); ​​the projection length of the lower arm in the vertical direction is L2sin(α), and the projection length in the horizontal direction is L2cos(α).

[0127] Using the functional relationship of the human body posture model, the projection length of the upper arm in the vertical direction, the projection length of the forearm in the vertical direction, and the vertical distance from the AR glasses to the shoulder are used as the elements of the vertical length of the functional relationship, and the projection length of the upper arm in the horizontal direction and the projection length of the forearm in the horizontal direction are used as the elements of the horizontal length of the functional relationship. For the horizontal length of the functional relationship, if the rotation angle of the forearm is positive, that is, the palm position of the sample is higher than the elbow position, then the horizontal length is L0+L1cos(β)-L2sin(α); otherwise, the horizontal length is L0+L1cos(β)+L2sin(α).

[0128] Taking the forearm rotation angle as positive for explanation, according to the functional relationship, the second AR glasses shooting angle of the sample in the second state is obtained. The second AR glasses shooting angle can be specifically expressed as the following functional relationship:

[0129]

[0130] Acquire a first projection length of the upper arm rotation angle in the vertical direction and a second projection length of the lower arm rotation angle in the horizontal direction;

[0131] The second AR glasses shooting angle of each sample in the second state is calculated according to the functional relationship.

[0132] According to the first limb state parameters of each sample, i.e., the specific data of L0, L1, L2, L3, and d0, the maximum second AR glasses shooting angle is 84.07°, and the minimum second AR glasses shooting angle is 51.85°. Since the maximum and minimum second AR glasses shooting angles are far apart, the average value of the second AR glasses shooting angles of all samples can be used as the second AR glasses shooting angle, and the average value of the second AR glasses shooting angle is 71.21°.

[0133] In addition, in this embodiment, for the second AR glasses shooting angle used to adjust the camera of the AR glasses, the method for obtaining the adjustment angle of the camera of the AR glasses can be determined according to the difference between the maximum and minimum second AR glasses shooting angles.

[0134] In the method provided in this embodiment, before obtaining the adjustment angle of the camera of the AR glasses, the following steps may also be included:

[0135] Obtain the second AR glasses shooting angle of each sample in the second state, and obtain the maximum second AR glasses shooting angle and the minimum second AR glasses shooting angle among all samples;

[0136] If the difference between the maximum second AR glasses shooting angle and the minimum second AR glasses shooting angle exceeds the set range, the first median data of the upper arm rotation angle and the second median data of the lower arm rotation angle corresponding to each sample are obtained;

[0137] The first median data and the second median data are used as the upper arm rotation angle difference and the lower arm rotation angle difference between the first limb state parameter and the second limb state parameter.

[0138] The maximum second AR glasses shooting angle and the minimum second AR glasses shooting angle obtained above are continued to be used. The execution method of obtaining the upper arm rotation angle difference and the lower arm rotation angle difference of the overall sample is determined by the difference between the maximum second AR glasses shooting angle and the minimum second AR glasses shooting angle.

[0139] In this embodiment, the difference between the maximum second AR glasses shooting angle and the minimum second AR glasses shooting angle is 32.22°, that is, the maximum second AR glasses shooting angle and the minimum second AR glasses shooting angle are quite far apart. If the average value of the second AR glasses shooting angle of all samples is taken as the overall second AR glasses shooting angle, the shooting range of the AR glasses cannot satisfy most users to perform gesture operations in the second state.

[0140] In this embodiment, if the difference between the maximum second AR glasses shooting angle and the minimum second AR glasses shooting angle is within a set range of 10% of the maximum second AR glasses shooting angle, it is considered that the maximum second AR glasses shooting angle and the minimum second AR glasses shooting angle are not far apart, and the average value of the second AR glasses shooting angle of all samples is used as the overall second AR glasses shooting angle. If the setting range exceeds 10%, it is considered that the maximum second AR glasses shooting angle and the minimum second AR glasses shooting angle are far apart, and the first median data of the upper arm rotation angle of all samples and the second median data of the forearm rotation angle are used as the upper arm rotation angle difference and the forearm rotation angle difference between the first limb state parameter and the second limb state parameter, and the corresponding AR glasses camera angle adjustment angle is obtained using the functional relationship.

[0141] According to the maximum second AR glasses shooting angle and the minimum second AR glasses shooting angle obtained by the above calculation, the difference exceeds the set range. According to the upper arm rotation angle α and the forearm rotation angle β of the above provided sample, the corresponding first median data is 11° and the second median data is 4°. Using the formula (4) of the above human posture model, the corresponding median of the second AR glasses shooting angle is 73.88°, and the median of the second AR glasses shooting angle is used as the second AR glasses shooting angle of the entire sample.

[0142] Furthermore, according to the shooting angle of the second AR glasses and in combination with the camera, an adjustment angle of the camera of the corresponding AR glasses is obtained.

[0143] In this embodiment, the vertical field of view FOV of the camera is 100°. If the central axis of the camera is facing directly in front of the human body, the central axis of the camera is located on the horizontal line of sight of the human body, and the viewing angle below the horizontal line of sight is 100° / 2=50°. In order to meet the needs of users to use gestures to issue operation instructions to the AR glasses in the second state, the angle of the camera adjustment is 73.88°-50°=23.88°, that is, the camera needs to be adjusted downward by 23.88° based on the horizontal line of sight.

[0144] The above description of the execution using several embodiments is to more clearly illustrate the AR glasses camera angle adjustment method of the present application, but the AR glasses camera angle adjustment method provided by the present application is not limited to the execution process of the above embodiments.

[0145] In order to further meet the different users or specific usage needs of the AR glasses, the human body posture model method, sample selection, and sample data processing method can be adaptively adjusted. However, this does not mean that it deviates from the AR glasses camera angle adjustment method provided in this application.

[0146] Based on the same application concept as the above-mentioned method for identifying buried event information, the present application embodiment also provides an AR glasses camera angle adjustment device 700. Figure 7 , Figure 7 A schematic diagram of the structure of an AR glasses camera angle adjustment device provided in one embodiment of the present application.

[0147] A model building module 710 is used to build a human posture model according to the position of the AR glasses and the position of the limbs in the gesture interaction, and determine a functional relationship between a first AR glasses shooting angle and a first limb state parameter in a first state in the human posture model;

[0148] An angle difference acquisition module 720, used to acquire a second limb state parameter of a plurality of samples in a second state, and acquire an angle difference between the first limb state parameter and the second limb state parameter;

[0149] A shooting angle calculation module 730, configured to calculate a second AR glasses shooting angle of the sample in a second state according to the angle difference and the functional relationship;

[0150] The angle adjustment module 740 is used to obtain the adjustment angle of the camera of the AR glasses according to the shooting angle of the second AR glasses.

[0151] The AR glasses camera angle adjustment device 700 provided in the embodiment of the present application establishes a human posture model according to the limb position in the gesture interaction, compares the second limb state parameter of the collected sample with the first limb state parameter obtained according to the human posture model to obtain the corresponding angle difference, and obtains the second AR glasses shooting angle of the sample in the second state according to the angle difference, thereby obtaining the adjustment angle of the camera of the AR glasses. The AR glasses camera angle adjustment scheme provided in the present application can adjust the AR glasses camera angle according to the gesture operation made by the user in a comfortable state and with operational awareness, so that the adjusted camera can obtain the gesture operation made by the user in the second state as a comfortable state, which helps to improve the user's comfort when issuing gesture operation instructions to the AR glasses; on the other hand, it can also filter gesture actions without operational awareness to prevent the AR glasses from receiving wrong operation instructions.

[0152] Based on the same principle as the method shown in the embodiment of the present application, an electronic device is also provided in the embodiment of the present application, which may include but is not limited to: a processor and a memory; the memory is used to store computer operation instructions; the processor is used to execute the method shown in the embodiment by calling the computer operation instructions. Compared with the prior art, the electronic device in the embodiment of the present application can adjust the angle of the AR glasses camera according to the gesture operation made by the user in a comfortable state and with operational awareness, so that the adjusted camera can obtain the gesture operation made by the user in the second state as the comfortable state, which helps to improve the comfort of the user when issuing gesture operation instructions to the AR glasses.

[0153] Reference Figure 8 , Figure 8 A schematic diagram of the structure of an electronic device for adjusting the angle of an AR glasses camera provided by an embodiment of the present application.

[0154] In an alternative embodiment, an electronic device is provided, such as Figure 8 As shown, Figure 8 The electronic device 800 shown includes: a processor 801 and a memory 803. The processor 801 and the memory 803 are connected, such as through a bus 802. Optionally, the electronic device 800 may also include a transceiver 804. It should be noted that in actual applications, the transceiver 804 is not limited to one, and the structure of the electronic device 800 does not constitute a limitation on the embodiments of the present application.

[0155] Among them, electronic devices include but are not limited to: mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 8 The electronic device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0156] The embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is run on a computer, the computer can execute the corresponding content in the aforementioned method embodiment. Compared with the prior art, the computer-readable storage medium in the embodiment of the present application can achieve the purpose of automatic repair and restoration of inter-process communication without the user noticing.

[0157] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0158] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0159] It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

[0160] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other to form a technical solution.

Claims

1. A method for adjusting the angle of an AR glasses camera, characterized in that: The steps include: A human posture model is established according to the position of the AR glasses and the position of the limbs in the gesture interaction, and a functional relationship between a first AR glasses shooting angle in the human posture model and a first limb state parameter in a first state is determined. In the first state, the upper arm of the human posture model is located in a vertical direction, and the forearm is perpendicular to the upper arm; the upper arm rotation angle relative to the vertical direction is 0, and the forearm rotation angle relative to the horizontal direction is 0; Obtain a second limb state parameter of the sample in a second state, and obtain an angle difference between the first limb state parameter and the second limb state parameter corresponding to an upper arm rotation angle and a lower arm rotation angle, wherein the second state is a natural posture made when the user has an operation consciousness and issues a gesture operation instruction to the AR glasses, and in the second state, the upper arm rotation angle and the lower arm rotation angle of the user corresponding to the sample are arbitrary angles; According to the angle difference, convert the second limb parameter into a numerical value of the first limb state parameter of the corresponding item on the functional relationship, and calculate the second AR glasses shooting angle of the sample in the second state according to the functional relationship; The adjustment angle of the camera of the AR glasses is obtained according to the second AR glasses shooting angle.

2. The method for adjusting the angle of the AR glasses camera according to claim 1, characterized in that: Before the step of obtaining the second limb state parameter of the sample in the second state, the method further includes: Acquire image information of the sample in a second state according to the human body posture model; The second limb state parameter is acquired according to the image information.

3. The method for adjusting the angle of the AR glasses camera according to claim 1, characterized in that: The step of establishing a human posture model according to the position of the AR glasses and the position of the limbs in the gesture interaction includes: Constructing a human posture model, and setting the position of the AR glasses on the horizontal line of sight of the human posture model; A human body posture model in the gesture interaction is set and posture parameters of the human body posture model are set.

4. The method for adjusting the angle of the AR glasses camera according to claim 3, characterized in that: The functional relationship between the first AR glasses shooting angle and the first limb state parameter in the first state in the human posture model includes: Wherein, the posture parameters include: θ is the angle between the line of sight of the AR glasses and the line from the glasses to the base of the palm; L0 is the vertical distance from the AR glasses to the shoulder in the human posture model; L1 is the vertical distance from the shoulder to the elbow in the human posture model; L2 is the horizontal distance from the elbow to the base of the palm in the human posture model; L3 is the palm length in the human posture model; d0 is the horizontal distance from the AR glasses to the shoulders in the human posture model.

5. The method for adjusting the angle of the AR glasses camera according to claim 4, characterized in that: The step of obtaining the angle difference between the first limb state parameter and the second limb state parameter corresponding to the upper arm rotation angle and the lower arm rotation angle comprises: Collect the upper arm rotation angle in the vertical direction of the upper arm relative to the human body posture model and the lower arm rotation angle in the horizontal direction of the lower arm relative to the human body posture model corresponding to the sample; The angle difference between the forearm rotation angle and the upper arm rotation angle of the corresponding sample and the forearm rotation angle and the upper arm rotation angle of the human body posture model is obtained.

6. The method for adjusting the angle of the AR glasses camera according to claim 5, characterized in that: The step of converting the second limb parameter into a numerical value of a first limb state parameter of a corresponding item on the functional relationship according to the angle difference, and calculating a second AR glasses shooting angle of the sample in the second state according to the functional relationship includes: The upper arm rotation angle and the lower arm rotation angle corresponding to each sample are read in sequence to obtain the projection lengths of the upper arm and the lower arm in the vertical direction and the horizontal direction respectively; According to the projection length, the second AR glasses shooting angle of each sample in the second state is calculated by using the functional relationship, and the average of the second AR glasses shooting angles of each sample in the second state is used as the second AR glasses shooting angle.

7. The method for adjusting the angle of the AR glasses camera according to claim 6, characterized in that: Also includes: Obtain the second AR glasses shooting angle of each sample in the second state, and obtain the maximum second AR glasses shooting angle and the minimum second AR glasses shooting angle among all samples; If the difference between the maximum second AR glasses shooting angle and the minimum second AR glasses shooting angle exceeds the set range, the first median data of the upper arm rotation angle and the second median data of the lower arm rotation angle corresponding to each sample are obtained; The first median data and the second median data are respectively used as the upper arm rotation angle difference and the lower arm rotation angle difference between the first limb state parameter and the second limb state parameter.

8. An AR glasses camera angle adjustment device, characterized in that: include: A model building module, used to build a human posture model according to the position of the AR glasses and the position of the limbs in the gesture interaction, and determine the functional relationship between the first AR glasses shooting angle in the human posture model and the first limb state parameter in the first state, in which the upper arm of the human posture model is located in a vertical direction, and the forearm is perpendicular to the upper arm; the upper arm rotation angle relative to the vertical direction is 0, and the forearm rotation angle relative to the horizontal direction is 0; An angle difference acquisition module, used to acquire a second limb state parameter of the sample in a second state, and acquire an angle difference corresponding to an upper arm rotation angle and a lower arm rotation angle between the first limb state parameter and the second limb state parameter, wherein the second state is a natural posture made when the user has operation awareness and issues a gesture operation instruction to the AR glasses, and in the second state, the upper arm rotation angle and the lower arm rotation angle of the user corresponding to the sample are arbitrary angles; A shooting angle calculation module, used to convert the second limb parameter into a numerical value of the first limb state parameter of the corresponding item on the functional relationship according to the angle difference, and calculate the second AR glasses shooting angle of the sample in the second state according to the functional relationship; The angle adjustment module is used to obtain the adjustment angle of the camera of the AR glasses according to the shooting angle of the second AR glasses.

9. An electronic device, characterized in that: It includes: one or more processors; Memory; One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to: execute the AR glasses camera angle adjustment method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the AR glasses camera angle adjustment method described in any one of claims 1 to 7 is implemented.

Images