A focusing method and device for photographing components

Abstract

Embodiments of the present application provide a focusing method and device for shooting components, and relate to the technical field of computers. The method comprises: collecting first media information of a target object by a first shooting component. Then, action recognition is performed on the first media information, and when it is determined that the action recognition result matches a preset focusing start action for a second shooting component, the focusing function for the second shooting component is started. The distance change characteristics between the target object and a head-mounted display device are monitored, and the second shooting component is focused based on the distance change characteristics. The target media information collected by the second shooting component after focusing is displayed in a display component. The user does not need to constantly find the buttons of the head-mounted display device worn on the head to realize focusing, thereby improving the efficiency of focusing and the clarity of the collected media information. Moreover, the focusing method of the present application is more in line with the usage habits of users, and is more intuitive and convenient.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a focusing method and apparatus for a camera component. Background Technology

[0002] With the development of science and technology, the market for smart glasses, such as Augmented Reality (AR) glasses and Virtual Reality (VR) glasses, is gradually emerging. Head-mounted display devices (HMDs) such as AR glasses and VR glasses can present images to users through a display screen, giving users an immersive experience.

[0003] Under relevant technologies, when shooting objects at different distances, users can manually adjust the focus of the shooting component by rotating a button on the smart glasses to obtain a clear image or video. However, when wearing smart glasses, users have difficulty seeing the rotating button, so they need to constantly search for it to achieve focus, resulting in low focusing efficiency and inconvenience for users. Summary of the Invention

[0004] This application provides a focusing method and apparatus for a shooting component, which improves the efficiency and convenience of focusing the shooting component.

[0005] On one hand, embodiments of this application provide a focusing method for a shooting component, applied to a head-mounted display device, including:

[0006] The first media information of the target object is acquired through the first imaging component;

[0007] The first media information is subjected to motion recognition, and when it is determined that the motion recognition result matches the preset focus activation action for the second shooting component, the focus function for the second shooting component is activated.

[0008] The distance change characteristics between the target object and the head-mounted display device are monitored, and the second shooting component is focused based on the distance change characteristics. The target media information captured by the second shooting component after focusing is displayed on the display component.

[0009] The distance change characteristics between the monitored target object and the display component include:

[0010] The second media information of the target object is acquired through the first imaging component;

[0011] By performing motion recognition on the second media information, the distance change characteristics between the target object and the head-mounted display device are obtained.

[0012] Optionally, it also includes:

[0013] The third media information of the target object is acquired through the first imaging component;

[0014] The third media information is subjected to motion recognition, and when the motion recognition result matches the preset focus-off action for the second shooting component, the focus function for the second shooting component is turned off.

[0015] Optionally, the distance change feature includes: the change in target distance between the target object and the head-mounted display device;

[0016] The focusing of the second imaging component based on the distance change characteristics includes:

[0017] Based on the focal length adjustment corresponding to the unit distance change, and the target distance change, adjust the focal length of the second imaging component; or,

[0018] Based on the image distance adjustment amount corresponding to the unit distance change and the target distance change, the image distance of the second imaging component is adjusted.

[0019] Optionally, adjusting the focal length of the second imaging component based on the focal length adjustment amount corresponding to the unit distance change and the target distance change includes:

[0020] If the change in target distance is greater than 0, then based on the focal length adjustment corresponding to the unit change in distance and the change in target distance, the focal length of the second shooting component is increased.

[0021] If the change in target distance is less than 0, then based on the focal length adjustment corresponding to the unit distance change and the change in target distance, the focal length of the second shooting component is reduced.

[0022] Optionally, adjusting the image distance of the second imaging component based on the image distance adjustment amount corresponding to the unit distance change and the target distance change includes:

[0023] If the change in target distance is greater than 0, then based on the image distance adjustment amount corresponding to the unit distance change and the change in target distance, the image distance of the second imaging component is reduced.

[0024] If the change in target distance is less than 0, the image distance of the second imaging component is increased based on the image distance adjustment amount corresponding to the unit distance change and the change in target distance.

[0025] Optionally, the first shooting component and the second shooting component are the same shooting component.

[0026] Optionally, the first imaging component is a depth camera.

[0027] On one hand, embodiments of this application provide a focusing device for a shooting component, applied to a head-mounted display device, including:

[0028] The acquisition module is used to acquire first media information of the target object through the first shooting component;

[0029] The matching module is used to perform action recognition on the first media information, and when it is determined that the action recognition result matches the preset focus activation action for the second shooting component, the focus function for the second shooting component is activated.

[0030] The focusing module is used to monitor the distance change characteristics between the target object and the head-mounted display device, and to focus the second shooting component based on the distance change characteristics, and to display the target media information captured by the second shooting component after focusing on the display component.

[0031] Optionally, the focusing module is specifically used for:

[0032] The second media information of the target object is acquired through the first imaging component;

[0033] By performing motion recognition on the second media information, the distance change characteristics between the target object and the head-mounted display device are obtained.

[0034] Optionally, the matching module is further configured to:

[0035] The third media information of the target object is acquired through the first imaging component;

[0036] The third media information is subjected to motion recognition, and when the motion recognition result matches the preset focus-off action for the second shooting component, the focus function for the second shooting component is turned off.

[0037] Optionally, the distance change feature includes: the change in target distance between the target object and the head-mounted display device;

[0038] The focusing module is specifically used for:

[0039] Based on the focal length adjustment corresponding to the unit distance change, and the target distance change, adjust the focal length of the second imaging component; or,

[0040] Based on the image distance adjustment amount corresponding to the unit distance change and the target distance change, the image distance of the second imaging component is adjusted.

[0041] Optionally, the focusing module is specifically used for:

[0042] If the change in target distance is greater than 0, then based on the focal length adjustment corresponding to the unit change in distance and the change in target distance, the focal length of the second shooting component is increased.

[0043] If the change in target distance is less than 0, then based on the focal length adjustment corresponding to the unit distance change and the change in target distance, the focal length of the second shooting component is reduced.

[0044] Optionally, the focusing module is specifically used for:

[0045] If the change in target distance is greater than 0, then based on the image distance adjustment amount corresponding to the unit distance change and the change in target distance, the image distance of the second imaging component is reduced.

[0046] If the change in target distance is less than 0, the image distance of the second imaging component is increased based on the image distance adjustment amount corresponding to the unit distance change and the change in target distance.

[0047] Optionally, the first shooting component and the second shooting component are the same shooting component.

[0048] Optionally, the first imaging component is a depth camera.

[0049] On one hand, embodiments of this application provide a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps of the focusing method of the above-mentioned shooting component.

[0050] On one hand, embodiments of this application provide a computer-readable storage medium storing a computer program executable by a computer device, which, when run on the computer device, causes the computer device to perform the steps of the focusing method of the above-described imaging component.

[0051] In this embodiment, motion recognition is performed on the collected first media information. When the motion recognition result matches a preset focusing activation action for the second shooting component, the second shooting component is focused based on the distance change characteristics between the target object and the head-mounted display device. The target media information collected by the second shooting component after focusing is then displayed on the display device. This eliminates the need for the user to constantly search for buttons on the head-mounted display device to focus, thereby improving focusing efficiency and the clarity of the collected media information. Moreover, the focusing method of this application is more in line with user habits, making it more intuitive and convenient. Attached Figure Description

[0052] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0053] Figure 1 A schematic diagram of a system architecture provided in an embodiment of this application;

[0054] Figure 2 A flowchart illustrating a focusing method for a shooting component provided in this application embodiment. Figure 1 ;

[0055] Figure 3 A flowchart illustrating a focusing method for a display imaging component provided in this application embodiment. Figure 2 ;

[0056] Figure 4 A diagram illustrating a gesture provided in an embodiment of this application. Figure 1 ;

[0057] Figure 5 A schematic diagram of the direction of hand movement provided in this application embodiment. Figure 1 ;

[0058] Figure 6 A schematic diagram of the direction of hand movement provided in this application embodiment. Figure 2 ;

[0059] Figure 7 A diagram illustrating a gesture provided in an embodiment of this application. Figure 2 ;

[0060] Figure 8 A schematic diagram of the structure of a focusing device for a shooting component provided in an embodiment of this application;

[0061] Figure 9 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0062] To make the objectives, technical solutions, and beneficial effects of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0063] For ease of understanding, the terms used in the embodiments of this invention are explained below.

[0064] Focal length: In convex lens imaging, the focal length refers to the distance from the center of the convex lens to the focal point.

[0065] Image distance: In convex lens imaging, image distance refers to the distance from the imaging plane to the convex lens. In this application, image distance also refers to the distance between the image sensor (photosensitive component) of the imaging component and the lens.

[0066] Focusing of the imaging component: The process of adjusting the focal length or image distance to enable the imaging component to capture a clear image or video.

[0067] refer to Figure 1 This is a schematic diagram of the structure of a head-mounted display device applicable to an embodiment of this application. The head-mounted display device 100 includes a first imaging component 101, a second imaging component 102, and a display component 103. The first imaging component 101 and the second imaging component 102 may be the same imaging component or different imaging components. The display component 103 includes a left-eye display screen and a right-eye display screen.

[0068] In AR or VR glasses, the first imaging component 101 and the second imaging component 102 can be used to acquire vision-based tracking and positioning images, motion recognition images, and other required images or videos. The display component 103 can be used to display the target media information acquired by the second imaging component 102 after focusing. Therefore, the user can determine whether to further focus the second imaging component 102 based on the clarity of the target media information displayed on the display component 103 until the second imaging component 102 obtains a clear image.

[0069] based on Figure 1 The system architecture diagram shown in this application illustrates a flowchart of a focusing method for a camera component. Figure 2 As shown, the process of this method is executed by a computer device, which can be... Figure 1 The head-mounted display device shown includes the following steps:

[0070] Step S201: Acquire first media information of the target object through the first shooting component.

[0071] Specifically, the first imaging component can be a depth camera mounted on a head-mounted display device, or it can be a regular camera mounted on the head-mounted display device. The target object can be a hand, foot, head, or other body part, and the first media information includes, but is not limited to, images and videos.

[0072] Step S202: Perform motion recognition on the first media information, and when it is determined that the motion recognition result matches the preset focus activation action for the second shooting component, activate the focus function for the second shooting component.

[0073] Specifically, the second imaging component can be a regular camera mounted on a head-mounted display device. Action recognition is performed on the first media information using either a model-driven or data-driven approach to obtain the action recognition results. The recognition process varies depending on the target object.

[0074] For example, when the target object is a hand, gesture recognition is performed on the image of the hand to be recognized to obtain the gesture recognition result. When using a model-driven approach for gesture recognition, the specific steps include: First, a series of gesture geometric models are generated in advance using hand pose parameters or node positions, and a search space is established, which includes all possible gesture geometric models. During gesture recognition, the search space is queried to find the gesture geometric model that matches the image to be recognized, and the hand pose parameters of the matched gesture geometric model are used as the gesture recognition result.

[0075] When using a data-driven approach for gesture recognition, the specific steps include: first, collecting training samples and their corresponding labels; then, employing machine learning algorithms to learn the mapping from training samples to labels, thereby obtaining a gesture recognition model. These machine learning algorithms include, but are not limited to, random forests, support vector machines, and neural networks. During gesture recognition, the image to be recognized is input into the gesture recognition model, and the model outputs a predicted label corresponding to the image; this predicted label is the gesture recognition result.

[0076] The focus activation action for the second shooting component can be set according to actual needs. For example, the focus activation action could be maintaining a specific hand shape for more than a preset time, or it could be a combination of multiple consecutive hand shapes. By setting a specific hand shape as the focus activation gesture, the focus activation gesture can be effectively distinguished from the gestures of other functions, avoiding accidental activation of the focus function.

[0077] In some embodiments, the first imaging component and the second imaging component are the same imaging component. For example, the first imaging component and the second imaging component are the same ordinary camera.

[0078] Step S203: Monitor the distance change characteristics between the target object and the head-mounted display device, adjust the focus of the second shooting component based on the distance change characteristics, and display the target media information collected by the second shooting component after focusing on the display component.

[0079] Specifically, the target media information includes, but is not limited to, images and videos. Distance change features include: the change in target distance between the target object and the head-mounted display device, where the change in target distance is the difference between the distance between the target object and the head-mounted display device detected in this instance and the distance between the target object and the head-mounted display device detected in the previous instance.

[0080] When the change in target distance is greater than 0, it indicates that the target object is moving away from the head-mounted display device; when the change in target distance is less than 0, it indicates that the target object is moving towards the head-mounted display device; when the change in target distance is equal to 0, it indicates that the distance between the target object and the head-mounted display device has not changed.

[0081] The second shooting component is focused accordingly based on the change in target distance. After each focus adjustment, the target media information is acquired by the focused second shooting component and displayed on the display component, allowing the user to view the target media information on the display component.

[0082] When the target media information becomes clear, the target object continues to move along its original direction of movement, triggering further focusing until the clarity of the target media information reaches the preset requirement. When the target media information becomes blurry, the target object moves along the opposite direction of movement, triggering further focusing until the clarity of the target media information reaches the preset requirement.

[0083] In this embodiment, motion recognition is performed on the collected first media information. When the motion recognition result matches a preset focusing activation action for the second shooting component, the second shooting component is focused based on the distance change characteristics between the target object and the head-mounted display device. The target media information collected by the second shooting component after focusing is then displayed on the display device. This eliminates the need for the user to constantly search for buttons on the head-mounted display device to focus, thereby improving focusing efficiency and the clarity of the collected media information. Moreover, the focusing method of this application is more in line with user habits, making it more intuitive and convenient.

[0084] In some embodiments, third media information of the target object is acquired by a first imaging component. Then, motion recognition is performed on the third media information, and when it is determined that the motion recognition result matches a preset focus-off action for the second imaging component, the focus function for the second imaging component is turned off.

[0085] Specifically, the third media information can be images or videos captured by the first shooting component. The focus-closing action for the second shooting component can be set according to actual needs. For example, the focus-closing action can be maintaining a specific hand shape for more than a preset time, or it can be a combination of multiple consecutive hand shapes. By setting a specific hand shape as the focus-closing gesture, the focus-closing gesture can be effectively distinguished from the gestures of other functions, avoiding accidental closure of the focus function.

[0086] Optionally, in step S203 above, the embodiments of this application employ at least the following implementation methods to monitor the distance change characteristics between the target object and the head-mounted display device:

[0087] Implementation Method 1: Second media information of the target object is acquired through a first imaging component. Then, motion recognition is performed on the second media information to obtain the distance change characteristics between the target object and the head-mounted display device.

[0088] Specifically, the second media information includes, but is not limited to, images and videos. A model-driven or data-driven approach is used to perform motion recognition on the second media information to obtain the distance change characteristics between the target object and the head-mounted display device.

[0089] Taking the hand as the target object, the first imaging component captures an image of the hand to be identified, and then gesture recognition is performed on the image to be identified to obtain the increased or decreased distance between the target object and the head-mounted display device.

[0090] Implementation Method 2: The distance between the target object and the head-mounted display device is monitored using both a wireless device bound to the target object and a wireless device bound to the head-mounted display device. Then, based on the obtained multiple distances, the distance variation characteristics between the target object and the head-mounted display device are determined.

[0091] Specifically, the wireless device bound to the target object periodically transmits wireless signals according to an agreed-upon protocol. Upon receiving these signals, the wireless device bound to the head-mounted display calculates the distance between the target object and the head-mounted display based on the signal reception and transmission times. Based on the distances calculated in the two separate calculations, the change in distance between the target object and the head-mounted display is determined.

[0092] In this embodiment, the action recognition module performs action recognition on the media information of the target object, or the wireless device is bound to the target object and the head-mounted display device to detect the distance change characteristics between the target object and the head-mounted display device, so as to realize the second shooting component to focus based on the distance change characteristics, thereby improving the efficiency and convenience of focusing, and improving the clarity of the captured media information.

[0093] Optionally, in step S203 above, the embodiments of this application employ at least the following methods to focus the second imaging component:

[0094] Implementation Method 1: Focusing is achieved by adjusting the focal length, that is, adjusting the focal length based on the focal length adjustment corresponding to the unit distance change and the target distance change.

[0095] Specifically, the focal length adjustment corresponding to the unit distance change can be set and adjusted according to the actual situation. The lens in the second shooting component can be a zoom lens or a combination of zoom lenses, that is, the focal length can be adjusted within a certain range, so as to obtain clear images or videos when shooting objects at close and far distances. Among them, the zoom lens includes a liquid zoom lens, which controls its focal length through different voltages.

[0096] In practical applications, when shooting images or videos of distant objects, it is necessary to increase the focal length to obtain a clear image or video. When shooting images or videos of close-up objects, it is necessary to decrease the focal length to obtain a clear image or video. Therefore, when adjusting the focal length based on changes in target distance, the following adjustment method is specifically adopted:

[0097] If the change in target distance is greater than 0, it indicates that the target object is moving away from the head-mounted display device, meaning the user needs to photograph a distant object. In this case, based on the focal length adjustment corresponding to the unit distance change and the target distance change, the focal length of the second imaging component is increased. If the change in target distance is less than 0, it indicates that the target object is moving closer to the head-mounted display device, meaning the user needs to photograph a close-up object. In this case, based on the focal length adjustment corresponding to the unit distance change and the target distance change, the focal length of the second imaging component is decreased.

[0098] After adjusting the focus, the second focusing component acquires target media information and displays it on the display component, allowing the user to view the target media information. When the target media information becomes clear, the target object continues to move along its original direction of movement, triggering further focus adjustments until the clarity of the target media information reaches the preset requirement. When the target media information becomes blurry, the target object moves along the opposite direction of movement, triggering further focus adjustments until the clarity of the target media information reaches the preset requirement.

[0099] In this embodiment, when the target object moves away from the head-mounted display device, the focal length of the second shooting component is increased to obtain a clear video or image when shooting distant objects; when the target object moves closer to the head-mounted display device, the focal length of the second shooting component is decreased to obtain a clear video or image when shooting close objects. This focusing method is very intuitive, conforms to the user's usage habits, and brings convenience to the user's focusing.

[0100] Implementation Method 2: Focusing is achieved by adjusting the image distance, that is, adjusting the image distance of the second imaging component based on the image distance adjustment amount corresponding to the unit distance change and the target distance change.

[0101] Specifically, adjusting the image distance refers to adjusting the distance between the image sensor (photosensitive component) and the lens. The image distance adjustment amount corresponding to a unit change in distance can be set and adjusted according to the actual situation. In practical applications, when shooting images or videos of distant objects, it is necessary to reduce the image distance to obtain a clear image or video. When shooting images or videos of close objects, it is necessary to increase the image distance to obtain a clear image or video. Therefore, when adjusting the image distance based on the change in target distance, the following adjustment method is specifically adopted:

[0102] If the change in target distance is greater than 0, it indicates that the target object is moving away from the head-mounted display device, meaning the user needs to capture a distant object. In this case, the image distance of the second imaging component is reduced based on the image distance adjustment corresponding to the unit distance change and the target distance change. If the change in target distance is less than 0, it indicates that the target object is moving closer to the head-mounted display device, meaning the user needs to capture a close-up object. In this case, the image distance of the second imaging component is increased based on the image distance adjustment corresponding to the unit distance change and the target distance change.

[0103] After adjusting the image distance, the second focusing imaging component acquires target media information and displays it on the display component, allowing the user to view the target media information. When the target media information becomes clear, the target object continues to move along its original direction of movement, triggering further adjustments to the image distance until the clarity of the target media information reaches the preset requirement. When the target media information becomes blurry, the target object moves in the opposite direction of movement, triggering further adjustments to the image distance until the clarity of the target media information reaches the preset requirement.

[0104] In this embodiment, when the target object moves away from the head-mounted display device, the image distance of the second shooting component is reduced to obtain a clear video or image when shooting distant objects; when the target object moves closer to the head-mounted display device, the image distance of the second shooting component is increased to obtain a clear video or image when shooting close objects. This method can achieve focusing by adjusting the position of the target object, without needing to rotate the buttons on the head-mounted display device, thus providing convenience for users to focus.

[0105] In some embodiments, the distance between the target object and the head-mounted display device is within a certain range. That is, after the target object moves away from or nears the head-mounted display device by a certain distance, it will be unable or difficult for the target object to move further away from or near the head-mounted display device. In other words, after multiple refocusing operations on the second shooting component based on the change in target distance, if the clarity of the target media information captured by the second shooting component still does not meet the preset requirements, it will be unable or difficult to continue refocusing the second shooting component. In view of this, embodiments of this application propose to perform refocusing by combining a refocusing start action and a refocusing stop action.

[0106] Specifically, a focus adjustment initiation action activates the focus adjustment function for the second imaging component. When photographing a distant object, the target object moves away from the head-mounted display device. The head-mounted display device monitors and obtains a target distance change greater than 0, and then, based on the focal length adjustment corresponding to the unit distance change and the target distance change, increases the focal length of the second imaging component; or, based on the image distance adjustment corresponding to the unit distance change and the target distance change, decreases the image distance of the second imaging component. The focused second imaging component acquires target media information and displays it on the display component, allowing the user to view the target media information on the display component.

[0107] If the clarity of the target media information does not meet the preset requirements, and the target object cannot or easily move further away from the head-mounted display device, the focus-closing action disables the focus function for the second imaging component, and then the distance between the target object and the head-mounted display device is reduced. Then, the focus-starting action restarts the focus function for the second imaging component. At this point, as the target object moves away from the head-mounted display device, focus can continue until the clarity of the target media information captured by the second imaging device meets the preset requirements.

[0108] Accordingly, when photographing close-up objects, the target object moves in the direction closest to the head-mounted display device. The head-mounted display device monitors and obtains a target distance change that is less than 0, and then, based on the focal length adjustment corresponding to the unit distance change and the target distance change, decreases the focal length of the second imaging component; or, based on the image distance adjustment corresponding to the unit distance change and the target distance change, increases the image distance of the second imaging component. The second imaging component, after focusing, acquires target media information and displays it on the display component, allowing the user to view the target media information on the display component.

[0109] If the clarity of the target media information does not meet the preset requirements, and the target object cannot or easily move closer to the head-mounted display device, the focus-closing action disables the focus function for the second imaging component, and then the distance between the target object and the head-mounted display device is increased. Then, the focus-starting action restarts the focus function for the second imaging component. At this point, as the target object moves towards the head-mounted display device, focus can continue until the clarity of the target media information captured by the second imaging device meets the preset requirements.

[0110] In this embodiment, the second shooting device is focused by combining the focus start action and the focus stop action, which can effectively increase the focus range and thus improve the convenience and efficiency of focusing.

[0111] To better explain the embodiments of this application, the following describes a focusing method for a shooting component provided by the embodiments of this application, in conjunction with a specific implementation scenario. The process of this method can be described as follows: Figure 1 The head-mounted display device shown performs the following steps, such as... Figure 3 As shown:

[0112] Step S301: Capture image A of the hand using the first camera.

[0113] Specifically, image A is as follows Figure 4 As shown, this includes a heart-shaped hand gesture. The first camera is either a depth camera or a regular camera.

[0114] Step S302: Perform gesture recognition on image A to obtain the gesture recognition result.

[0115] Step S303: When it is determined that the gesture recognition result matches the preset focus activation gesture for the second camera, the focus function for the second camera is activated.

[0116] Specifically, the second camera is a regular camera. In some embodiments, when the first camera is a regular camera, the first camera and the second camera may refer to the same regular camera.

[0117] Step S304: Move your hand away from the head-mounted display device.

[0118] Specifically, such as Figure 5 As shown, the hand gradually moves away from the head-mounted display device.

[0119] Step S305: Monitor the change in target distance between the hand and the head-mounted display device through the gesture recognition module.

[0120] Step S306: Based on the focal length adjustment corresponding to the unit distance change and the target distance change, increase the focal length of the second camera.

[0121] Step S307: Display the target image captured by the second camera after focusing on the display component.

[0122] Step S308: Determine whether the clarity of the target image meets the preset requirements. If yes, proceed to step S312; otherwise, proceed to step S309.

[0123] Step S309: Determine whether the clarity of the target image has increased. If yes, proceed to step S304; otherwise, proceed to step S310.

[0124] Step S310: Move your hand in a direction closer to the head-mounted display device.

[0125] Specifically, such as Figure 6 As shown, the hand gradually approaches the head-mounted display device.

[0126] Step S311: Based on the focal length adjustment amount corresponding to the unit distance change and the target distance change, reduce the focal length of the second camera, and then execute step S307.

[0127] Step S312: Capture image B of the hand using the first camera.

[0128] Specifically, image B is as follows Figure 7 As shown, this includes the fist gesture.

[0129] Step S313: Perform gesture recognition on image B to obtain the gesture recognition result.

[0130] Step S314: When it is determined that the gesture recognition result matches the preset focus-off gesture for the second camera, the focus function for the second camera is turned off.

[0131] In this embodiment, motion recognition is performed on the collected first media information. When the motion recognition result matches a preset focusing activation action for the second shooting component, the second shooting component is focused based on the distance change characteristics between the target object and the head-mounted display device. The target media information collected by the second shooting component after focusing is then displayed on the display device. This eliminates the need for the user to constantly search for buttons on the head-mounted display device to focus, thereby improving focusing efficiency and the clarity of the collected media information. Moreover, the focusing method of this application is more in line with user habits, making it more intuitive and convenient.

[0132] Based on the same technical concept, this application provides a schematic diagram of a focusing device for a shooting component, applied to a head-mounted display device, such as... Figure 8 As shown, the device 800 includes:

[0133] Acquisition module 801 is used to acquire first media information of the target object through the first shooting component;

[0134] The matching module 802 is used to perform action recognition on the first media information, and to activate the focusing function for the second shooting component when it is determined that the action recognition result matches the preset focusing activation action for the second shooting component.

[0135] The focusing module 803 is used to monitor the distance change characteristics between the target object and the head-mounted display device, and to focus the second shooting component based on the distance change characteristics, and to display the target media information collected by the second shooting component after focusing on the display component.

[0136] Optionally, the focusing module 803 is specifically used for:

[0137] The second media information of the target object is acquired through the first imaging component;

[0138] By performing motion recognition on the second media information, the distance change characteristics between the target object and the head-mounted display device are obtained.

[0139] Optionally, the matching module 802 is further configured to:

[0140] The third media information of the target object is acquired through the first imaging component;

[0141] The third media information is subjected to motion recognition, and when the motion recognition result matches the preset focus-off action for the second shooting component, the focus function for the second shooting component is turned off.

[0142] Optionally, the distance change feature includes: the change in target distance between the target object and the head-mounted display device;

[0143] The focusing module 803 is specifically used for:

[0144] Based on the focal length adjustment corresponding to the unit distance change, and the target distance change, adjust the focal length of the second imaging component; or,

[0145] Based on the image distance adjustment amount corresponding to the unit distance change and the target distance change, the image distance of the second imaging component is adjusted.

[0146] Optionally, the focusing module 803 is specifically used for:

[0147] If the change in target distance is greater than 0, then based on the focal length adjustment corresponding to the unit change in distance and the change in target distance, the focal length of the second shooting component is increased.

[0148] If the change in target distance is less than 0, then based on the focal length adjustment corresponding to the unit distance change and the change in target distance, the focal length of the second shooting component is reduced.

[0149] Optionally, the focusing module 803 is specifically used for:

[0150] If the change in target distance is greater than 0, then based on the image distance adjustment amount corresponding to the unit distance change and the change in target distance, the image distance of the second imaging component is reduced.

[0151] If the change in target distance is less than 0, the image distance of the second imaging component is increased based on the image distance adjustment amount corresponding to the unit distance change and the change in target distance.

[0152] Optionally, the first shooting component and the second shooting component are the same shooting component.

[0153] Optionally, the first imaging component is a depth camera.

[0154] In this embodiment, motion recognition is performed on the collected first media information. When the motion recognition result matches a preset focusing activation action for the second shooting component, the second shooting component is focused based on the distance change characteristics between the target object and the head-mounted display device. The target media information collected by the second shooting component after focusing is then displayed on the display device. This eliminates the need for the user to constantly search for buttons on the head-mounted display device to focus, thereby improving focusing efficiency and the clarity of the collected media information. Moreover, the focusing method of this application is more in line with user habits, making it more intuitive and convenient.

[0155] Based on the same technical concept, embodiments of this application provide a computer device, which can be... Figure 1 The head-mounted display device shown, such as Figure 9 As shown, it includes at least one processor 901 and a memory 902 connected to at least one processor. In this embodiment, the specific connection medium between the processor 901 and the memory 902 is not limited. Figure 9 Taking the connection between processor 901 and memory 902 via a bus as an example, the bus can be divided into address bus, data bus, control bus, etc.

[0156] In this embodiment of the application, the memory 902 stores instructions that can be executed by at least one processor 901. By executing the instructions stored in the memory 902, at least one processor 901 can perform the steps of the focusing method of the above-mentioned shooting component.

[0157] The processor 901 is the control center of the computer device. It can connect to various parts of the computer device using various interfaces and lines. By running or executing instructions stored in the memory 902 and calling data stored in the memory 902, it can achieve focusing of the imaging component. Optionally, the processor 901 may include one or more processing units. The processor 901 may integrate an application processor and a modem processor. The application processor mainly handles the operating system, user interface, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 901. In some embodiments, the processor 901 and the memory 902 may be implemented on the same chip; in some embodiments, they may also be implemented on separate chips.

[0158] The processor 901 can be a general-purpose processor, such as a central processing unit (CPU), digital signal processor, application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component, capable of implementing or executing the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly manifested as being executed by a hardware processor, or executed by a combination of hardware and software modules within the processor.

[0159] Memory 902, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules. Memory 902 may include at least one type of storage medium, such as flash memory, hard disk, multimedia card, card-type memory, random access memory (RAM), static random access memory (SRAM), programmable read-only memory (PROM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), magnetic storage, magnetic disk, optical disk, etc. Memory 902 can be any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer device, but is not limited thereto. In the embodiments of this application, memory 902 can also be a circuit or any other device capable of implementing storage functions for storing program instructions and / or data.

[0160] Based on the same inventive concept, embodiments of this application provide a computer-readable storage medium storing a computer program executable by a computer device, which, when run on the computer device, causes the computer device to perform the steps of the focusing method of the above-described imaging component.

[0161] Those skilled in the art will understand that embodiments of the present invention can be provided as methods or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0162] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer apparatus or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0163] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer device or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0164] These computer program instructions may also be loaded onto a computer device or other programmable data processing equipment to cause a series of operational steps to be performed on the computer device or other programmable equipment to produce a process implemented by the computer device, thereby providing instructions that execute on the computer device or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0165] Although preferred embodiments of the invention have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including both the preferred embodiments and all changes and modifications falling within the scope of the invention.

[0166] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

Claims

1. A focusing method for a shooting component, applied to a head-mounted display device, characterized in that, include: The first media information of the target object is acquired through the first imaging component; The first media information is subjected to motion recognition, and when it is determined that the motion recognition result matches the preset focus activation action for the second shooting component, the focus function for the second shooting component is activated. The distance change characteristics between the target object and the head-mounted display device are monitored, and the second shooting component is focused based on the distance change characteristics. The target media information captured by the second shooting component after focusing is displayed in the display component. When the target media information becomes clear, the target object continues to move along the original direction of movement and triggers focusing until the clarity of the target media information reaches the preset requirement; When the target media information becomes blurry, the target object continues to move in the opposite direction and triggers focusing until the clarity of the target media information reaches the preset requirement; If, after multiple focus adjustments, the clarity of the target media information does not meet the preset requirements, and the target object cannot move further away from the head-mounted display device, then the focus adjustment function of the second shooting component is turned off, and the distance between the target object and the head-mounted display device is reduced; the focus adjustment function of the second shooting component is restarted until the clarity of the target media information meets the preset requirements. If the clarity of the target media information does not meet the preset requirements, and the target object cannot continue to approach the head-mounted display device, then the focusing function of the second shooting component is turned off, and the distance between the target object and the head-mounted display device is increased; the focusing function of the second shooting component is restarted until the clarity of the target media information meets the preset requirements.

2. The method as described in claim 1, characterized in that, The monitoring of distance changes between the target object and the head-mounted display device includes: The second media information of the target object is acquired through the first imaging component; By performing motion recognition on the second media information, the distance change characteristics between the target object and the head-mounted display device are obtained.

3. The method as described in claim 1, characterized in that, Also includes: The third media information of the target object is acquired through the first imaging component; The third media information is subjected to motion recognition, and when the motion recognition result matches the preset focus-off action for the second shooting component, the focus function for the second shooting component is turned off.

4. The method as described in claim 1, characterized in that, The distance change feature includes: the change in target distance between the target object and the head-mounted display device; The focusing of the second imaging component based on the distance change characteristics includes: Based on the focal length adjustment corresponding to the unit distance change, and the target distance change, adjust the focal length of the second imaging component; or, Based on the image distance adjustment amount corresponding to the unit distance change and the target distance change, the image distance of the second imaging component is adjusted.

5. The method as described in claim 4, characterized in that, The adjustment of the focal length of the second imaging component based on the focal length adjustment corresponding to the unit distance change and the target distance change includes: If the change in target distance is greater than 0, then based on the focal length adjustment corresponding to the unit change in distance and the change in target distance, the focal length of the second shooting component is increased. If the change in target distance is less than 0, then based on the focal length adjustment corresponding to the unit distance change and the change in target distance, the focal length of the second shooting component is reduced.

6. The method as described in claim 4, characterized in that, The adjustment of the image distance of the second imaging component based on the image distance adjustment amount corresponding to the unit distance change and the target distance change includes: If the change in target distance is greater than 0, then based on the image distance adjustment amount corresponding to the unit distance change and the change in target distance, the image distance of the second imaging component is reduced. If the change in target distance is less than 0, the image distance of the second imaging component is increased based on the image distance adjustment amount corresponding to the unit distance change and the change in target distance.

7. The method according to any one of claims 1 to 6, characterized in that, The first camera component and the second camera component are the same camera component.

8. The method as described in claim 7, characterized in that, The first imaging component is a depth camera.

9. A focusing device for a shooting component, applied to a head-mounted display device, characterized in that, include: The acquisition module is used to acquire first media information of the target object through the first shooting component; The matching module is used to perform action recognition on the first media information, and when it is determined that the action recognition result matches the preset focus activation action for the second shooting component, the focus function for the second shooting component is activated. The focusing module is used to monitor the distance change characteristics between the target object and the head-mounted display device, and to focus the second shooting component based on the distance change characteristics, and to display the target media information collected by the second shooting component after focusing on the display component. When the target media information becomes clear, the target object continues to move along the original direction of movement and triggers focusing until the clarity of the target media information reaches the preset requirement; When the target media information becomes blurry, the target object continues to move in the opposite direction and triggers focusing until the clarity of the target media information reaches the preset requirement; If, after multiple focus adjustments, the clarity of the target media information does not meet the preset requirements, and the target object cannot move further away from the head-mounted display device, then the focus adjustment function of the second shooting component is turned off, and the distance between the target object and the head-mounted display device is reduced; the focus adjustment function of the second shooting component is restarted until the clarity of the target media information meets the preset requirements. If the clarity of the target media information does not meet the preset requirements, and the target object cannot continue to approach the head-mounted display device, then the focusing function of the second shooting component is turned off, and the distance between the target object and the head-mounted display device is increased; the focusing function of the second shooting component is restarted until the clarity of the target media information meets the preset requirements.

10. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the steps of the method according to any one of claims 1 to 8.

11. A computer-readable storage medium, characterized in that, It stores a computer program executable by a computer device, which, when run on the computer device, causes the computer device to perform the steps of the method according to any one of claims 1 to 8.

Images