Projection control method, projector and electronic device
By integrating camera and binocular visual matching technology in the projector, the projection parameters are automatically adjusted, and the problem of long time to adjust the projection parameter and difficult to ensure the imaging effect in the existing technology is solved, and fast and accurate projection parameter adjustment is achieved, which improves the Imaging effect.
Patent Information
- Application Number
- PCT/CN2024/110186
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-08-11
- Filing Date
- 2024-08-06
- Publication Date
- 2025-02-20
AI Technical Summary
When adjusting projection parameters (such as projection focal length and projection angle), existing projectors require manual operation by users, which takes a long time and is difficult to ensure the best imaging effect.
By setting up the camera in the projector, taking the image after projection image, using binocular vision matching technology or depth image processing, the projection parameters of the projected structured light are automatically adjusted to achieve fast and accurate projection parameter adjustment.
It can quickly adjust projection parameters without a rangefinder, improve imaging effects, and reduce user operation complexity. It is suitable for low-cost, medium-cost and high-cost projector products.
Smart Images

Figure CN2024110186_20022025_PF_FP_ABST
Abstract
Description
Projection control method, projector and electronic equipment
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on August 11, 2023, with application number 202311016868.6 and application name “A projection control method, projector and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of projection imaging technology, and in particular to a projection control method, a projector, and an electronic device. Background Art
[0003] With the development of imaging technology, projectors are used in more and more life and work scenarios. The projector includes a controller and a projection component. The controller outputs the image to be displayed to the projection component in the form of a data signal. The projection component emits projection light based on the data signal, and images the image to be displayed on the projection surface through the projection light to complete the projection imaging. However, in actual applications, affected by the position and structure of the projection surface, it is necessary to emit projection light based on different projection parameters (such as projection focal length and / or projection angle, etc.) to obtain better imaging effects. If the projection parameters are adjusted manually by the user, the user is usually required to perform multiple and long adjustment operations. In addition, manual adjustment is difficult to ensure that the imaging effect achieves the best effect in the actual application scenario.
[0004] One improvement involves installing a camera in the projector and capturing the projected image with the camera. A controller adjusts the projection focal length multiple times based on the clarity of the captured image to achieve the desired projection focal length with optimal image clarity. However, this solution results in a long delay in automatic focus adjustment. Another improvement involves installing a rangefinder in the projector. The rangefinder measures the relative distance between the projector and the projection surface. Based on the measured relative distance, the controller adjusts the projection focal length of the projected light. However, this approach increases the component cost of the projector.
[0005] Summary of the Invention
[0006] The embodiments of the present application provide a projection control method, a projector, and an electronic device, which can quickly adjust the projection parameters of the projector to obtain a better imaging effect without the need for a rangefinder.
[0007] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:
[0008] In a first aspect, a projection control method is provided, the method being based on a projector. The projector includes a projection component and a camera. The method comprises: the projection component emitting projection structured light based on a first data signal. The first data signal is used to indicate a first image. The projection structured light is used to form a projection image of the first image on a projection surface. The first image includes a user projected image and / or a calibration feature image. The camera captures a first area to obtain a second data signal. The second data signal is used to indicate a second image. The projected image is partially or entirely located within the first area. A first control signal is obtained based on the second image. The first control signal is used to adjust projection parameters of the projection structured light.
[0009] In an embodiment of the present application, a structured light assembly is formed by the projector's own projection assembly and camera to implement algorithmic processing of the projected image of the first image and generate a first control signal to adjust the projection parameters of the projected structured light. This embodiment of the present application can algorithmically measure the relative distance between the projection assembly and the projection surface, etc., without the need for a range-finding sensor, and can adjust the projection parameters of the projected structured light to the target parameters with a single first control signal, without the need to output multiple control signals. This solution is applicable to low-cost, medium-cost, and high-cost projector products, and has high adjustment accuracy and low adjustment latency.
[0010] In a possible embodiment, when the first image includes the user projected image, the above-mentioned obtaining of the first control signal based on the second image includes: obtaining the first control signal based on the first image and the second image based on binocular vision matching technology. In an embodiment of the present application, there is no need to use a binocular camera. Only the second image captured by the camera is used, combined with the first image that has been acquired when the controller generates the first data signal, and the first image and the second image are algorithmically processed using binocular vision matching technology to generate the first control signal. Compared with the traditional binocular vision matching technology that uses a binocular camera to generate multiple second images and performs binocular vision matching on the multiple second images, this solution is based on the native common viewpoint between the depth image obtained by the binocular vision matching technology and the first image and the second image, and feature processing can be performed without additional complex matching processing operations. In theory, the resolution of the depth image can reach the same resolution as the first image of the projector.
[0011] In one possible embodiment, the obtaining of the first control signal based on the first image and the second image includes: obtaining a depth image based on the first image feature and the second image feature. The first image feature includes at least one reference image feature in the first image. The second image feature is a mapped image feature of the at least one reference image feature on the second image. The depth image is used to indicate the depth coordinates of the at least one reference image feature. The first control signal is obtained based on the depth coordinates of the at least one reference image feature. In an embodiment of the present application, a reference image feature is extracted from the first image as the first image feature, and a corresponding second image feature is extracted from the second image, and a depth coordinate calculation is performed based on the first image feature and the second image feature to obtain a depth image.
[0012] In one possible implementation, obtaining the first control signal based on the depth coordinates of at least one reference image feature includes: obtaining a target depth distance based on the depth coordinates of the at least one reference image feature. Obtaining the first control signal based on the target depth distance. In this embodiment of the present application, the target depth distance may be obtained based on the depth coordinates of the reference image feature. Corresponding target projection parameters may be determined based on the target depth distance. The first control signal may be generated based on the target projection parameters.
[0013] In one possible embodiment, the above-mentioned obtaining of the first control signal according to the target depth distance includes: obtaining the target projection parameter according to the parameter mapping relationship and the size of the target depth distance. The parameter mapping relationship is a preset mapping relationship between depth distances of different sizes and different projection parameters. The first control signal is obtained according to the target projection parameter. In an embodiment of the present application, a preset mapping relationship between the depth distance and the projection parameter can be preset. For example, when the projection parameter is the projection focal length, the focus curve (i.e., the mapping relationship between the depth distance and the motor angle) can be pre-set, and the projection focal length that needs to be adjusted is determined based on the depth distance actually calculated.
[0014] In one possible implementation, the distribution density of at least one reference image feature is less than a first threshold. In this embodiment of the present application, some projection parameters can be calculated without requiring a large number of reference image features. In this case, the distribution density of the reference image features can be reduced to reduce the data processing load and increase the processing rate.
[0015] In one possible embodiment, part or all of the projection surface is a three-dimensional structural surface. The distribution density of multiple reference image features on the three-dimensional structural surface is greater than a second threshold value. The method also includes: obtaining the structural parameters of the three-dimensional structural surface according to the depth coordinates corresponding to the three-dimensional structural surface. In an embodiment of the present application, the fixed projection surface may be a three-dimensional structural surface that is not a completely planar surface. Alternatively, during the projection process, there are moving objects or living bodies appearing in the projection area, so that part or all of the projection surface is a three-dimensional structural surface. Therefore, the distribution density of the reference image features can also be set to be larger, the structural parameters of the projection surface can be calculated by using multiple reference image features, and a series of processing operations can be performed based on the acquired structural parameters.
[0016] In some possible implementations, when the first image is a calibration feature image, or when the first image includes a user-projected image and a calibration feature image, the controller may employ a structured light image processing algorithm to generate the first control signal. In this case, the feature parameters of the calibration feature image may be directly stored within the controller. The controller then directly processes the stored feature parameters with the second image to generate the first control signal.
[0017] In some examples, when the first image is a calibration feature image, at least one reference image feature may be an image feature in the calibration feature image. The calibration feature image is used to provide some image content that is convenient for feature point extraction and calibration as reference image features to assist in the generation of depth images, etc. Exemplarily, the content of the calibration feature image (i.e., at least one reference image feature) may include one or more of calibration points, calibration lines, checkerboards, Gray codes, and resolution cards. In an embodiment of the present application, feature point extraction and feature matching between the first image and the second image can be achieved more accurately and quickly through the calibration feature image. However, in the process of adjusting the projection parameters, the projection processing of the user projected image is not performed, and the user cannot watch the movie normally, which slightly reduces the user experience.
[0018] In some examples, when the first image includes a user-projected image and a calibration image feature. Among them, a certain reference image feature in the at least one reference image feature can be an image feature in the user-projected image or an image feature in the calibration feature image. That is, at least one reference image feature can be all image content in the user-projected image; or all projection content in the calibration image feature; or part of the image content in the user-projected image and the other part of the projection content in the calibration image feature. The embodiment of the present application can perform feature processing based on the calibration image feature and / or the user-projected image, and the user can still watch the movie during the feature processing. For example, the calibration image feature is set at the edge of the user-projected image, and the user can watch the movie normally. At the same time, the calibration image feature is still retained to assist in feature processing.
[0019] In some examples, when the first image is a user-projected image, at least one reference image feature is an image feature in the user-projected image. In this embodiment of the present application, during the adjustment of projection parameters, no calibration image features are projected. A depth image is obtained by extracting first image features from the first image and extracting corresponding second image features from the second image features. In this embodiment of the present application, the user can directly view the projected content as the user-projected image, and the features in these projected contents can be used as feature content for feature extraction and calibration. The user is unaware of the reference image features, resulting in a better viewing experience.
[0020] In a possible implementation, the method further includes: when the first image is a user-projected image, using the first captured image as the second image. The first captured image is a captured image corresponding to the first image that displays valid image data. In an embodiment of the present application, when a user-projected image is used as the first image, there may be a situation where the user-projected image displays invalid image data, for example, the user-projected image displays a black screen (i.e., a black frame), or displays a white screen (i.e., a white frame), etc. In these cases where valid image data is not displayed, it is difficult to extract reference image features. Therefore, the captured image can be selected to perform feature processing on the first captured image corresponding to the first image that displays valid image data as the second image.
[0021] In a possible embodiment, the method further includes: generating a second control signal based on the projection angle of the projected structured light. The second control signal is used to adjust the shooting angle of the camera. In an embodiment of the present application, a second control signal can be generated according to the current projection angle of the projection component. The shooting angle of the camera is adjusted according to the second control signal. In actual applications, in some application scenarios, in order to achieve a better projection match between the projected structured light and the projection surface, the user will adjust the installation position, projection angle, etc. of the projector. At this time, the shooting angle of the camera can be adjusted so that the camera can better capture the projected image. The higher the image quality of the projected image captured in the second image, the higher the accuracy of the feature extraction processing, so as to improve the control accuracy of the first control signal.
[0022] In one possible embodiment, the projection parameters include at least one of a projection focal length and a projection angle. In an embodiment of the present application, a structured light device can be formed based on a projection component and a camera. In this case, the second image obtained by the camera can be processed to obtain a depth image. Based on the depth image, various projection parameters can be calculated, such as a target projection focal length and a target projection angle.
[0023] In one possible embodiment, after obtaining the first control signal based on the first image and the second image, the method further includes: obtaining the imaging clarity of the projected image based on the second image. Based on the imaging clarity of the projected image, at least one third control signal is obtained. The at least one third control signal is used to adjust the projection focal length of the projected structured light. In an embodiment of the present application, after the projection focal length of the second image is adjusted using the first control signal, multiple second images can be continuously captured by the camera. Based on the imaging clarity of the projected image in the multiple second images, the projection focal length can be fine-tuned multiple times using a climbing method to further improve the imaging quality based on the first control signal.
[0024] In a second aspect, an embodiment of the present application further provides a projector comprising a projection assembly, a camera, and a controller. The projection assembly is configured to emit projection structured light based on a first data signal. The first data signal is configured to indicate a first image. The projection structured light is configured to form a projection image of the first image on a projection surface. The camera is configured to capture a first area and obtain a second data signal. The second data signal is configured to indicate a second image. The projection image is partially or entirely located within the first area. The controller is configured to output a first data signal to the projection assembly, input a second data signal, and output a first control signal to the projection assembly based on the second image. The first control signal is configured to adjust projection parameters of the projection structured light.
[0025] In a possible implementation, the controller is specifically configured to: output a first control signal to the projection component according to the first image and the second image based on binocular vision matching technology.
[0026] In one possible embodiment, the projector further includes an angle adjuster. The camera is mounted on the angle adjuster. The controller is further configured to output a second control signal to the angle adjuster based on the projection angle of the projected structured light. The second control signal is used to adjust the camera's shooting angle.
[0027] In a possible implementation, the projection parameter includes at least one of a projection focal length and a projection angle.
[0028] In one possible embodiment, the controller is further configured to: determine the imaging clarity of the projected image based on the second image; and output at least one third control signal to the projection assembly based on the imaging clarity of the projected image. The at least one third control signal is used to adjust the projection focal length of the projected structured light.
[0029] In a third aspect, an embodiment of the present application further provides an electronic device, which includes a mounting portion and the projector described in the second aspect above; the projector is disposed on the mounting portion.
[0030] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, which includes instructions; when the instructions are executed on a processor, the processor executes the projection control method as described in the first aspect.
[0031] For the technical principles and technical effects of the second, third and fourth aspects, please refer to the relevant description of the first aspect above and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] FIG1 is a schematic structural diagram of a projector provided in an embodiment of the present application;
[0033] FIG2 is a schematic structural diagram of a first projector provided in an embodiment of the present application;
[0034] FIG3 is a schematic diagram of distance conversion of a first projector provided in an embodiment of the present application;
[0035] FIG4 is a schematic structural diagram of a second projector provided in an embodiment of the present application;
[0036] FIG5 is a schematic structural diagram of a third projector provided in an embodiment of the present application;
[0037] FIG6 is a flowchart diagram 1 of a projection control method provided in an embodiment of the present application;
[0038] FIG7 is a schematic diagram of feature matching between a first image and a second image provided by an embodiment of the present application;
[0039] FIG8 is a second flow chart of another projection control method provided in an embodiment of the present application;
[0040] FIG9 is a third flow chart of another projection control method provided in an embodiment of the present application;
[0041] FIG10 is a schematic diagram of a focus curve of depth distance and motor angle provided in an embodiment of the present application;
[0042] FIG11 is a schematic diagram of a first image for calibrating a feature image provided in an embodiment of the present application;
[0043] FIG12 is a schematic diagram of a first image including a calibration feature image and a user projection image provided by an embodiment of the present application;
[0044] FIG13 is a schematic diagram of a first image of a user projected image provided by an embodiment of the present application;
[0045] FIG14 is a fourth flow chart of another projection control method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0046] It should be noted that the terms "first", "second", etc. involved in the embodiments of the present application are only used to distinguish features of the same type and cannot be understood as indicating relative importance, quantity, order, etc.
[0047] The terms "exemplary" or "for example" in the embodiments of this application are used to indicate examples, illustrations, or descriptions. Any embodiment or design described in this application as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.
[0048] The terms "coupling" and "connection" involved in the embodiments of this application should be understood in a broad sense. For example, they may refer to a physical direct connection, or an indirect connection achieved through electronic devices, such as a connection achieved through resistors, inductors, capacitors or other electronic devices.
[0049] Autofocus, also known as automatic focus (AF), is primarily used in lens adjustable systems. This involves automatically adjusting the distance between the lens and the target surface to achieve clear imaging. Autofocus is commonly used in cameras and projectors. Generally, there are three common ways to implement autofocus: Method 1: the hill-climbing method. The hill-climbing method involves performing multiple focusing operations and determining the projection focal length with optimal imaging based on the image contrast and / or image clarity corresponding to the multiple focusing operations. Method 2: phase-detection AF (PDAF). The phase-detection focusing method has a faster focusing speed, but requires customization of imaging pixel parameters and is significantly affected by ambient lighting. Method 3: the range-finding focusing method. In the range-finding focusing method, a mapping relationship between distance and imaging focal length is preset. The relative distance is measured using a distance sensor to determine the target imaging focal length. Method 2 is used in camera autofocus. Methods 1 and 2 can also be applied to projector autofocus.
[0050] With the development of imaging technology, projectors are used in more and more life and work scenarios. The projector includes a controller and a projection component. The controller outputs the image to be displayed to the projection component in the form of a data signal. The projection component emits projection light based on the data signal, and images the image to be displayed on the projection surface through the projection light to complete the projection imaging. However, in actual applications, affected by the position and structure of the projection surface, it is necessary to emit projection light based on different projection parameters (such as projection focal length and / or projection angle, etc.) to obtain better imaging effects. If the projection parameters are adjusted manually by the user, the user is usually required to perform multiple and long adjustment operations. In addition, manual adjustment is difficult to ensure that the imaging effect achieves the best effect in the actual application scenario.
[0051] In order to improve the imaging effect of projection and reduce the complexity of user operation, an embodiment of the present application provides an electronic device. The electronic device includes a mounting portion and a projector. The projector is arranged on the mounting portion. As shown in Figure 1, the projector 100 includes a controller 10 and a projection assembly 20. The controller 10 is used to: generate a data signal based on an image for imaging as needed, and output the data signal to the projection assembly 20. The projection assembly 20 emits projection light at a certain projection focal length based on the data signal to form a projection image T1 on the projection surface T. However, due to the relative distance between the projection surface and the projector 100, the projection image T1 at this projection focal length may have problems such as unclearness. To this end, it is necessary to adjust the projection focal length of the projection light.
[0052] In some possible implementations, the projector 100 shown in FIG1 is a first projector. By capturing a projected image T1, the projection focal length of the projection light emitted by the first projector can be adjusted to enhance the focused imaging effect of the projected image T1. As shown in FIG2, the first projector 100A includes a first controller 10A, a first projection assembly 20A, and a first camera 30A.
[0053] In some examples, in the first projector 100A shown in FIG2 , a ramp-up method can be used to automatically adjust the projection focal length based on the captured projection image T1. In this case, the first controller 10A is configured to generate a first data signal based on the desired first image and output the first data signal to the first projection assembly 20A. The first projection assembly 20A emits projection light based on the first data signal to form the projection image T1 on the projection surface. The first controller 10A is further configured to output one or more step control signals to the first projection assembly 20A, which adjust the projection focal length of the projection light emitted. The first camera 30A is configured to capture the projection image T1 and output a first image data signal. The first image data signal indicates the captured image of the projection image T1. The first controller 10A is further configured to output at least one first focal length control signal based on the clarity of the content of the projection image T1 in the captured image. The projection focal length of the first projection assembly 20A is adjusted using the at least one first focal length control signal to improve the clarity of the projection image T1. In an embodiment of the present application, the projection focal length of the projection light emitted by the first projection assembly 20A is adjusted using one or more step control signals, and the projection image T1 is captured multiple times by the first camera 30A to obtain multiple captured images. The first controller 10A compares the clarity of the content of the projection image T1 in the multiple captured images to determine a target focal length for fine adjustment, and outputs a first focal length control signal based on the determined target focal length. The projection focal length of the first projection assembly 20A is adjusted multiple times using a ramping method using the first focal length control signal, and the projection focal length with the best clarity is selected to improve projection clarity, etc. The embodiment of the present application can be applied to medium-cost and high-cost projector products, but the use of this ramping method to adjust the projection focal length requires multiple adjustment operations, resulting in an excessively long automatic focus time. In addition, this solution cannot automatically adjust other projection parameters of the projector product.
[0054] In some examples, in the first projector 100A shown in FIG2 , a relative distance conversion method can be used to automatically adjust the projection focal length based on the captured projection image T1. In this case, the first controller 10A is configured to generate a first data signal based on the desired first image and output the first data signal to the first projection assembly 20A. The first projection assembly 20A emits projection light based on the first data signal to form a projection image T1 on the projection surface. The first camera 30A is configured to capture the projection image T1 and output a second image data signal. This second image data signal indicates a captured image of the projection image T1, with the entire image content of the projection image T1 located within the captured image. As shown in FIG3 , the first controller 10A is further configured to perform a relative distance conversion based on the distance h between the first projection assembly 20A and the first camera 30A, the image center a of the captured image, and the image center b of the projection image T1 in the captured image, thereby calculating the relative distance d between the first projector 100A and the projection surface T, and output a first focal length control signal to adjust the projection focal length of the first projector 100A. The embodiments of the present application can be applied to both low-cost and high-cost projector products. The focus adjustment of the first projector 100A is completed through a single control operation, shortening the time required for automatic focusing. However, in the scheme of FIG3 , the first camera 30A needs to capture the complete projected image T1 to achieve distance conversion, which places extremely high demands on the location of the first camera 30A. Therefore, the adjustment accuracy is limited by the accuracy of the distance h and the accuracy of the relative distance conversion. Furthermore, the calibration distance measurement method of this scheme has high limitations and a small range of applicable applications. At the same time, the accuracy of the distance measurement scheme of this scheme depends on the calibration relationship for converting relative distances, and this relationship is more nonlinear, and the distance solution is not completely unique, which may give a result with large errors. At the same time, this scheme cannot adjust other projection parameters.
[0055] In some possible implementations, the projector 100 shown in FIG1 is a second projector. The projection focal length of the projection light emitted by the second projector can be adjusted using a distance measurement method to enhance the focused imaging effect of the projected image T1. As shown in FIG4 , the second projector 100B includes a second controller 10B, a second projection assembly 20B, and a second distance sensor 30B. The second controller 10B is configured to generate a first data signal based on the desired first image and output the first data signal to the second projection assembly 20B. The second projection assembly 20B emits projection light based on the first data signal to form a projection image T1 on a projection surface. The second distance sensor 30B is configured to obtain the relative distance between the second projector 100B and the projection surface and output a first distance signal to the second controller 10B, indicating the relative distance between the second projector and the projection surface. The second controller 10B is configured to output a second focal length control signal to the second projection assembly 20B based on the first distance signal, which is used to adjust the projection focal length of the second projection assembly 20B.
[0056] For example, in the second projector 100B shown in FIG4 , the relative distance between the projection surface and the second projector 100B (or the second projection assembly 20B of the second projector 100B) can be measured by a second ranging sensor 30B. Based on the correspondence between the preset relative distance and the projection focal length, the projection focal length can be roughly adjusted to improve the clarity of the projection, etc. For example, in the second projector 100B shown in FIG4 , the target focal length can be obtained based on the relative distance actually measured. The focus adjustment direction and adjustment amount are determined based on the size relationship between the current focal length of the second projection assembly 20B and the target focal length. For example, the second ranging sensor 30B can be a TOF distance sensor, an ultrasonic distance sensor, an infrared distance sensor, etc.
[0057] For example, the second projector 100B shown in FIG4 further includes a second camera 40B configured to capture a projection image T1 and output a third image data signal. The third image data signal includes a captured image, including the projection image T1, and the number of image content pixels of the projection image T1 in the captured image indicates the capture clarity of the projection image T1. Based on adjusting the focus of the second projector 100B using the second focal length control signal, the second controller 10B is further configured to perform an imaging clarity comparison based on the number of image content pixels of the projection image T1 in the captured image, and output a third focal length control signal. The third focal length control signal then sets the projection focal length to the projection focal length corresponding to the optimal resolution among the multiple compared resolutions.
[0058] However, in the embodiment of the present application shown in Figure 4, when using a second ranging sensor 30B to achieve rapid focusing, the cost of the second ranging sensor 30B is relatively high, making this solution unsuitable for mid- to low-cost projector products. Furthermore, in the solution of measuring relative distances through depth imaging based on a TOF distance sensor, high requirements are placed on image resolution and image matching algorithms for captured images, requiring a relatively high-cost projector product to implement. Therefore, the embodiment shown in Figure 4 is difficult to apply to mid- to low-cost projector products. Furthermore, this solution cannot adjust other projection parameters.
[0059] In some possible embodiments, to enable high-precision, rapid, and automatic adjustment of projection parameters across projector products of varying costs, the projector 100 shown in FIG1 may be a third projector. As shown in FIG5 , the third projector 100C includes a third projection assembly 20C, a third camera 30C, and a third controller 10C. The third projection assembly 20C is configured to emit projected structured light based on a first data signal. The first data signal indicates a first image. The projected structured light forms a projection image T1 of the first image on a projection surface. The first image includes a user-projected image and / or a calibration feature image. The third camera 30C is configured to capture a first area and obtain a second data signal. The second data signal indicates a second image. The projection image T1 is partially or entirely located within the first area. The third controller 10C is configured to output a first data signal to the third projection assembly 20C, input a second data signal, and output a first control signal to the third projection assembly 20C based on the second image. The first control signal is used to adjust the projection parameters of the projected structured light.
[0060] In the embodiment of the present application as shown in Figure 5, the third controller 10C causes the third projector 100C to emit projected structured light through a first data signal. Then, the third camera 30C captures the first area to obtain a second image, which includes part or all of the projected image T1. By extracting and processing the content of the projected image T1 in the captured second image, the relative distance between the third projector 100C (or the third projection component 20C of the third projector 100C) and the projection surface is obtained, and a first control signal is output. The projection parameters of the projected structured light are adjusted by the first control signal. In the embodiment of the present application, a structured light measurement device can be formed by the third projection component 20C and the third camera 30C. Generally, cameras and controllers are provided in low-cost, medium-cost, and high-cost autofocus projector products. Therefore, the existing cameras and controllers in these products can be used to implement depth imaging based on structured light to obtain the relative distance of the projection. In the embodiments shown in Figures 2 and 4 , when camera-based autofocus employs a hill-climbing method, the camera must capture multiple projection images T1, and the controller analyzes the clarity of these projection images T1 to select the projection focal length with the best clarity. This approach requires multiple focus adjustments and results in a long delay. In the embodiment shown in Figure 3 , the camera-based approach for relative distance conversion requires only a single adjustment to achieve autofocus, but the focus accuracy is relatively low. In the embodiment shown in Figure 4 , while the inclusion of a second ranging sensor 30B improves the accuracy of projection focal length adjustment and reduces adjustment delay, the inclusion of this second ranging sensor 30B significantly increases cost. In the embodiment shown in Figure 5 , a structured light device is formed using a third camera 30C and a third projection assembly 20C. This structured light device enables depth imaging to generate a depth map, eliminating the need for an additional distance sensor or the need to consider alignment issues between the distance sensor and the third camera 30C. Relative distance can be determined through depth map analysis and output of a first control signal. At the same time, automatic focus adjustment can be achieved with a single adjustment operation using the first control signal, resulting in higher focus accuracy. Finally, the third controller 10C can not only measure distance based on the depth image but also calculate the projection angle, etc. Therefore, the third controller 10C can adjust at least one of the projection focal length and projection angle, etc.
[0061] In some possible implementations, when the first image is a user-projected image or includes a user-projected image, feature matching may be performed based on multiple images to generate a first control signal.
[0062] In some examples, the multiple images include multiple second images. Feature matching is performed based on the multiple second images to generate a first control signal. In the embodiment shown in Figure 5, the third camera 30C can be a binocular camera. Based on the binocular vision matching technology, the first control signal is output to the third projection component 20C according to the second image captured by the binocular camera. In the embodiment of the present application, multiple second images are generated by the binocular camera. The third controller 10C performs image feature matching on the second image generated by the binocular camera based on the binocular vision matching technology to obtain a depth image of the projected image T1. The relative distance or projection angle, etc. are calculated based on the depth image, and the relevant projection parameters are adjusted.
[0063] In some examples, the multiple images include a first image and a second image. Feature matching is performed based on the first image and the second image to generate a first control signal. In the embodiment shown in FIG5 , the first control signal can be output to the third projection assembly 20C based on the first image and the second image using binocular vision matching technology. In this embodiment of the present application, the third camera 30C is not limited to a binocular camera. The projected image T1 is the projection of the first image on the projection surface. In this embodiment, the first image can be used as a picture taken by the binocular camera on one side, and the second image can be used as a picture taken by the binocular camera on the other side. It is not necessary to actually use a binocular camera to capture multiple second images. Based on the binocular vision matching technology, binocular vision image feature processing is performed on the first and second images to generate a depth image. Based on the depth image, relative distance or projection angle, etc., is calculated, and relevant projection parameters are adjusted. In this embodiment of the present application, feature extraction and feature matching are performed based on the first and second images to generate a depth image. This depth image, the second image captured by the third camera 30C, and the first image have a native common viewpoint, eliminating the need for additional matching algorithms. Furthermore, the resolution of the resulting depth image can theoretically be comparable to the projection resolution of the third projector.
[0064] In some possible implementations, when the first image is a calibration feature image or includes a calibration feature image, feature matching can be performed based on the second image to generate the first control signal. In this case, feature parameters can be generated based on the calibration feature image in the first image. After receiving the second image, the third controller 10C directly calls the feature parameters to perform feature matching with the second image features in the second image to generate the first control signal.
[0065] In some possible embodiments, the third projector 100C further includes a first angle adjuster. The third camera 30C is mounted on the first angle adjuster. The third controller 10C is further configured to output a second control signal to the angle adjuster based on the projection angle of the projected structured light. The second control signal is used to adjust the shooting angle of the third camera 30C. Exemplarily, the angle adjuster may be a base, a rotating motor, an adjustable robotic arm, or the like. In this embodiment of the present application, the third controller 10C may generate a second control signal based on the current projection angle of the third projection assembly 20C. The angle of the first angle adjuster is adjusted based on the second control signal to adjust the shooting angle of the third camera 30C. In actual applications, in some scenarios, users may adjust the mounting position and projection angle of the third projector 100C to achieve better projection matching between the projected structured light and the projection surface. In this case, the shooting angle of the third camera 30C can be adjusted to better capture the projected image T1. Higher image quality of the projected image T1 captured in the second image increases the accuracy of feature extraction processing, thereby improving the control accuracy of the first control signal.
[0066] In some possible implementations, the third controller 10C is further configured to obtain the imaging clarity of the projected image T1 based on the second image. Based on the imaging clarity of the projected image T1, at least one third control signal is output to the third projection assembly 20C. The at least one third control signal is used to adjust the projection focal length of the projected structured light. In an embodiment of the present application, after adjusting the projection focal length of the second image using the first control signal, the third camera 30C may continue to capture multiple second images. Based on the imaging clarity of the projected image T1 in the multiple second images, the projection focal length may be fine-tuned multiple times using a ramping method to further improve the imaging quality based on the first control signal.
[0067] In some possible embodiments, the third projection assembly 20C includes a projection light group and an adjustment mechanism. The projection light group includes at least one projection light source. The at least one projection light source is configured to emit projection structured light. The adjustment mechanism is configured to receive a first control signal, a third control signal, and the like. The adjustment mechanism adjusts projection parameters of the projection structured light based on the first control signal or the third control signal. Exemplarily, the adjustment mechanism includes a focus motor. The focus motor can be controlled by the first control signal or the third control signal to adjust the projection interaction of the projection structured light. Exemplarily, the adjustment mechanism includes a second angle adjuster. The projection angle of the projection structured light can be adjusted by the second angle adjuster.
[0068] Based on the third projector 100C shown in FIG5 , a projection control method including steps S100 to S300 as shown in FIG6 can be implemented:
[0069] S100: Emitting projection structured light based on a first data signal.
[0070] For example, as shown in FIG6 , the third controller 10C generates a first data signal based on the first image to be imaged, and outputs the first data signal to the third projection assembly 20C. The third projection assembly 20C emits projection structured light based on the first data signal. The projection structured light forms a projection image T1 of the first image on the projection surface T.
[0071] S200 , photographing the projection image T1 to obtain a second image.
[0072] For example, as shown in Figure 6, the third camera 30C captures the first area and generates a second data signal. The second data signal indicates the second image; the projected image T1 is partially or entirely located within the first area. In this embodiment of the present application, if the projected image T1 is partially or entirely located within the first area, the image content of the projected image T1 can be partially or entirely presented in the captured second image.
[0073] In some possible implementations, the projection control method further includes: generating a second control signal based on the projection angle of the projected structured light. The second control signal is used to adjust the shooting angle of the third camera 30C. In an embodiment of the present application, a second control signal can be generated according to the current projection angle of the third projection assembly 20C. The angle of the first angle adjuster is adjusted according to the second control signal to adjust the shooting angle of the third camera 30C. In actual applications, in some application scenarios, the user will adjust the installation position, projection angle, etc. of the third projector 100C in order to achieve a better projection match between the projected structured light and the projection surface. At this time, the shooting angle of the third camera 30C can be adjusted so that the third camera 30C can better capture the projection image T1. The higher the image quality of the projection image T1 captured in the second image, the higher the accuracy of the feature extraction processing, so as to improve the control accuracy of the first control signal.
[0074] S300 , outputting a first control signal according to the second image to adjust projection parameters of the projected structured light.
[0075] In some possible implementations, the third camera 30C shown in Figures 5 and 6 may be a binocular camera. In this case, binocular vision matching may be performed based on the multiple second images captured by the binocular camera. A depth image may be obtained through operations such as feature extraction and feature matching, and projection parameters that need to be adjusted may be determined based on the depth image.
[0076] In some possible implementations, a first control signal can be output to the third projection assembly 20C based on the first and second images based on binocular vision matching technology. In this embodiment of the present application, the third camera 30C is not limited to a binocular camera. Projected image T1 is the projection of the first image on the projection surface. In this embodiment, the first image can be used as a photo taken by the binocular camera on one side, and the second image can be used as a photo taken by the binocular camera on the other side. There is no need to actually use a binocular camera to capture multiple second images. Based on binocular vision matching technology, binocular vision image feature processing is performed on the first and second images to obtain a depth image. Relative distance or projection angle, etc., are calculated based on the depth image, and relevant projection parameters are adjusted. In this embodiment of the present application, feature extraction and feature matching are performed based on the first and second images to obtain a depth image. This depth image, the second image captured by the third camera 30C, and the first image have a native common viewpoint, eliminating the need for additional matching algorithms. Furthermore, theoretically, the resolution of the resulting depth image can be comparable to the projection resolution of the third projector.
[0077] Exemplarily, the third controller 10C already knows the image content of the first image when generating the first data signal. After the third controller 10C obtains the second data signal, it obtains the content of the second image based on the second data signal. As shown in Figure 7, the first image is the image content of the projection image T1. The second image is a captured image obtained by photographing the projection image T1, and the captured image presents the image content of the projection image T1. Therefore, the first image and the second image can be regarded as binocular images captured by a binocular camera. Based on binocular vision matching technology, feature points are extracted from the first image and the second image to obtain at least one reference image feature, and feature matching is performed based on the at least one reference image feature to obtain a depth image. The depth image is used to calculate the projection parameters.
[0078] In some possible implementations, when the first control signal is obtained according to the first image and the second image, as shown in FIG8 , step S300 may include the following operations: step S310 to step S320:
[0079] S310 : Obtain a depth image according to the first image feature and the second image feature.
[0080] In an embodiment of the present application, as shown in FIG7 , the first image feature includes at least one reference image feature in the first image. The second image feature is a mapped image feature of the at least one reference image feature on the second image. The depth image is used to indicate the depth coordinate of the at least one reference feature image.
[0081] S320: Obtain a first control signal according to a depth coordinate of at least one reference feature image.
[0082] Exemplarily, step S320 may include the operations of step S321 to step S322 as shown in FIG9 :
[0083] S321 . Obtain a target depth distance according to a depth coordinate of at least one reference feature image.
[0084] S322: Obtain a first control signal according to the target depth distance.
[0085] For example, in step S322, the target projection parameters can be obtained based on the parameter mapping relationship and the size of the target depth distance. The parameter mapping relationship is a preset mapping relationship between depth distances of different sizes and different projection parameters. A first control signal is obtained based on the target projection parameters. In an embodiment of the present application, taking the projection parameters including the projection focal length as an example, as shown in Figure 10, the projection focal lengths of different motor angles can be set according to the depth distance, thereby generating a corresponding preset mapping relationship. According to the acquired depth coordinates, the preset mapping relationship is queried by the table lookup method to obtain the target depth distance. The target projection focal length is determined based on the target depth distance. The third projection component 20C is controlled by the first control signal to emit projection structured light at the target projection focal length to achieve a better imaging effect.
[0086] In some possible implementations, the distribution density of at least one reference image feature is less than a first threshold. In embodiments of the present application, in some examples, as shown in FIG11 , the first image is a calibration feature image P1. The at least one reference image feature is an image feature in the calibration feature image P1. The calibration feature image P1 is used to provide image content that facilitates feature point extraction and calibration as reference image features to assist in depth image generation, for example. Exemplarily, the content of the calibration feature image P1 (i.e., the at least one reference image feature) may include one or more of calibration points, calibration lines, a checkerboard, a Gray code, and a resolution card. In embodiments of the present application, the calibration feature image P1 can be used to more accurately and quickly extract feature points and match features between the first and second images. However, during the projection parameter adjustment process, the user projection image P2 is not projected, resulting in the user being unable to view the movie normally, slightly reducing the user experience. The calibration feature image P1 shown in FIG11 is a checkerboard. However, in actual applications, the calibration feature image P1 may also be lines, feature points, etc.
[0087] In some examples, as shown in FIG12 , the first image includes a user projected image P2 and a calibration image feature. Among them, a certain reference image feature in the at least one reference image feature is an image feature in the user projected image P2 or an image feature in the calibration feature image P1. That is, the at least one reference image feature may be entirely the image content in the user projected image P2; or entirely the projection content in the calibration image feature; or partially the image content in the user projected image P2 and partially the projection content in the calibration image feature. The embodiment of the present application may perform feature processing based on the calibration image feature and / or the user projected image P2, and the user may still watch the movie during the feature processing. For example, as shown in FIG12 , the calibration image feature is set at the edge of the user projected image P2, and the user may watch the movie normally, while the calibration image feature is still retained to assist in feature processing.
[0088] In some examples, as shown in FIG13 , the first image is a user-projected image P2, and at least one reference image feature is an image feature in the user-projected image P2. In this embodiment of the present application, during the adjustment of the projection parameters, no calibration image features are projected. A depth image is obtained by extracting first image features from the first image and extracting corresponding second image features from the second image features. In this embodiment of the present application, the user can directly view the projected content as the user-projected image P2, and the features in these projected contents can be used as feature content for feature extraction and calibration. The user is unaware of the reference image features, resulting in a better viewing experience.
[0089] For example, in the embodiment shown in FIG13 , when the first image is the user projected image P2, the first captured image is used as the second image. The first captured image is the captured image corresponding to the first image that displays valid image data. In the embodiment of the present application, when the user projected image P2 is used as the first image, there may be a situation where the user projected image P2 displays invalid image data, for example, the user projected image P2 displays a black screen (i.e., a black frame), or displays a white screen (i.e., a white frame), etc. In these cases where valid image data is not displayed, it is difficult to extract reference image features. Therefore, the captured image can be selected to use the first captured image corresponding to the first image that displays valid image data as the second image for feature processing, etc.
[0090] In some examples, feature extraction can be performed on the first image to obtain first image features. Feature extraction can be performed on the second image features to obtain second image features. Based on binocular vision matching technology, the first image features and the second image features are feature matched to obtain a depth image. The embodiments of the present application can be applied to any form of first image (for example, a first image including a user projected image and / or a calibration feature image).
[0091] In some examples, when the first image is a calibration feature image or includes a calibration feature image, the calibration feature image can be used as a reference image feature and corresponding feature parameters can be generated. In subsequent work, when a second image is input, the second image features can be extracted from the second image, and the feature parameters generated previously can be used as the first image features. Feature matching is performed based on the first and second image features to generate a first control signal.
[0092] Some projection parameters (such as projection focal length) can be adjusted without extracting too many reference image features. In this case, the distribution density of reference image features can be made smaller than a certain range to reduce the number of reference image features that need to be extracted, thereby reducing the amount of data processing.
[0093] In some possible implementations, part or all of the projection surface is a three-dimensional structural surface. The distribution density of multiple reference image features on the three-dimensional structural surface is greater than a second threshold value. The projection control method may further include: obtaining the structural parameters of the three-dimensional structural surface according to the depth coordinates corresponding to the three-dimensional structural surface. In an embodiment of the present application, the fixed projection surface may be a three-dimensional structural surface that is not a completely planar surface. Alternatively, during the projection process, there are moving objects or living bodies appearing in the projection area, so that part or all of the projection surface is a three-dimensional structural surface. Therefore, the distribution density of the reference image features may also be set to be larger, the structural parameters of the projection surface may be calculated using multiple reference image features, and a series of processing operations may be performed based on the acquired structural parameters.
[0094] In some possible implementations, as shown in FIG14 , the projection control method further includes the operation of step S400:
[0095] S400 , adjusting the projection focal length according to the imaging clarity of the projection image T1 .
[0096] For example, the third controller 10C shown in FIG6 can determine the imaging clarity of the projected image T1 based on the second image; and based on the imaging clarity of the projected image T1, obtain at least one third control signal. The third controller 10C outputs at least one third control signal to the third projection assembly 20C to adjust the projection focal length of the projected structured light. In this embodiment of the present application, after adjusting the projection focal length of the second image using the first control signal, the third camera 30C can continue to capture multiple second images. Based on the imaging clarity of the projected image T1 in the multiple second images, the projection focal length can be fine-tuned multiple times using a ramping method to further improve the imaging quality based on the first control signal.
[0097] Embodiments of the present application provide a projection control method, a projector, and an electronic device. The projector includes a projection assembly and a camera. The projection assembly and the camera form a structured light device. The projection assembly emits projected structured light to form a projection image T1 of a first image on a projection surface. The camera captures the projection image T1 to obtain a second image. Feature processing is performed on the second image to obtain a depth image. Target projection parameters can be calculated based on the depth image, and a first control signal is generated. The first control signal is used to emit projected structured light with the target projection parameters. Embodiments of the present application implement a structured light device based on the projection assembly and the camera, achieving depth measurement and other purposes without adding additional hardware devices (such as a ranging sensor). Furthermore, projection parameters can be precisely adjusted with a single adjustment operation based on the first control signal. Embodiments of the present application can be used in low-cost, mid-cost, and high-cost projector products. Furthermore, embodiments of the present application have low latency for adjusting projection parameters and maintain high adjustment accuracy. Furthermore, when the first and second images are treated as images captured by a binocular camera for binocular visual matching, the depth image and the first and second images have a native common viewpoint, which can reduce feature matching processing. At the same time, theoretically, it is possible to achieve a resolution of the depth image that is equal to the resolution of the first image.
[0098] The present application also provides a computer-readable storage medium including instructions. When the instructions are executed on a processor, the processor executes the projection control method described in the above embodiments (e.g., the method described in Figures 6, 8, 9, and 14).
[0099] The processor involved in the embodiments of the present application may be a chip. For example, it may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD), or other integrated chips.
[0100] The memory involved in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0101] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0102] Those skilled in the art will appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0103] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and modules described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0104] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules is merely a logical function division. In actual implementation, there may be other division methods, such as multiple modules or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.
[0105] The modules described as separate components may or may not be physically separate, and the components shown as modules may or may not be physical modules, that is, they may be located on a single device or distributed across multiple devices. Some or all of the modules may be selected to achieve the purpose of this embodiment based on actual needs.
[0106] In addition, the functional modules in the various embodiments of the present application may be integrated into one device, or each module may exist physically separately, or two or more modules may be integrated into one device.
[0107] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using a software program, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing computer program instructions on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, server or data center by wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) mode to another website, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more media that can be integrated. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (eg, a solid state disk (SSD)).
[0108] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.
Claims
1. A projection control method, characterized in that: Projector based; The projector comprises a projection component and a camera; the method comprises: The projection component emits projection structured light based on a first data signal; the first data signal is used to indicate a first image; the projection structured light is used to form a projection image of the first image on a projection surface; the first image includes a user projection image and / or a calibration feature image; The camera photographs the first area to obtain a second data signal; the second data signal is used to indicate a second image; the projected image is partially or entirely located within the first area; A first control signal is obtained according to the second image; the first control signal is used to adjust the projection parameters of the projection structured light.
2. The projection control method according to claim 1, characterized in that: When the first image includes the user projection image, obtaining a first control signal according to the second image includes: Based on binocular vision matching technology, the first control signal is obtained according to the first image and the second image.
3. The projection control method according to claim 2, characterized in that: The obtaining the first control signal according to the first image and the second image includes: A depth image is obtained according to a first image feature and a second image feature; the first image feature includes at least one reference image feature in the first image; the second image feature is a mapped image feature of the at least one reference image feature on the second image; the depth image is used to indicate a depth coordinate of the at least one reference image feature; The first control signal is obtained according to the depth coordinate of the at least one reference image feature.
4. The projection control method according to claim 3, characterized in that: The obtaining the first control signal according to the depth coordinate of the at least one reference image feature comprises: Obtaining a target depth distance according to a depth coordinate of the at least one reference image feature; The first control signal is obtained according to the target depth distance.
5. The projection control method according to claim 4, characterized in that: The obtaining the first control signal according to the target depth distance includes: Obtaining target projection parameters according to a parameter mapping relationship and the size of the target depth distance; the parameter mapping relationship is a preset mapping relationship between depth distances of different sizes and different projection parameters; The first control signal is obtained according to the target projection parameter.
6. The projection control method according to any one of claims 3 to 5, characterized in that: The distribution density of the at least one reference image feature is less than a first threshold.
7. The projection control method according to any one of claims 3 to 5, characterized in that: Part or all of the projection surface is a three-dimensional structure surface; the distribution density of the plurality of reference image features on the three-dimensional structure surface is greater than a second threshold; the method further comprises: The structural parameters of the three-dimensional structural surface are obtained according to the depth coordinates corresponding to the three-dimensional structural surface.
8. The projection control method according to any one of claims 2 to 7, characterized in that: The method further comprises: When the first image is a user projected image, the first captured image is used as the second image; the first captured image is a captured image corresponding to the first image displaying valid image data.
9. The projection control method according to any one of claims 1 to 8, characterized in that: The method further comprises: Based on the projection angle of the projected structured light, a second control signal is generated; the second control signal is used to adjust the shooting angle of the camera.
10. The projection control method according to any one of claims 1 to 9, characterized in that: The projection parameters include at least one of a projection focal length and a projection angle.
11. The projection control method according to any one of claims 1 to 10, characterized in that: After obtaining the first control signal according to the first image and the second image, the method further includes: Obtaining imaging clarity of the projection image according to the second image; At least one third control signal is obtained according to the imaging clarity of the projection image; the at least one third control signal is used to adjust the projection focal length of the projection structured light.
12. A projector, characterized in that: The projector comprises a projection component, a camera and a controller; wherein: The projection component is used to: emit projection structured light based on a first data signal; the first data signal is used to indicate a first image; the projection structured light is used to form a projection image of the first image on a projection surface; the first image includes a user projection image and / or a calibration feature image; The camera is used to: photograph a first area to obtain a second data signal; the second data signal is used to indicate a second image; the projected image is partially or entirely located within the first area; The controller is used to: Outputting the first data signal to the projection component; and inputting the second data signal; A first control signal is output to the projection component according to the second image; the first control signal is used to adjust the projection parameters of the projection structured light.
13. The projector according to claim 12, characterized in that: When the first image includes the user projection image, the controller is specifically configured to: Based on binocular vision matching technology, a first control signal is output to the projection component according to the first image and the second image.
14. The projector according to claim 12 or 13, characterized in that: The projector further comprises an angle adjuster; the camera is mounted on the angle adjuster; and the controller is further used for: Based on the projection angle of the projected structured light, a second control signal is output to the angle adjuster; the second control signal is used to adjust the shooting angle of the camera.
15. The projector according to any one of claims 12 to 14, characterized in that: The projection parameters include at least one of a projection focal length and a projection angle.
16. The projector according to claim 15, characterized in that The controller is also used for: Obtaining imaging clarity of the projection image according to the second image; According to the imaging clarity of the projection image, at least one third control signal is output to the projection component; the at least one third control signal is used to adjust the projection focal length of the projection structured light.
17. An electronic device, characterized in that: It comprises a mounting portion and a projector as described in any one of claims 12 to 16; the projector is arranged on the mounting portion.
18. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes instructions; when the instructions are executed on a processor, the processor is enabled to execute the projection control method according to any one of claims 1 to 11.
Citation Information
Patent Citations
Zooming method and device
CN107277380A
Depth imaging method and system
CN108924407A
Real-time focusing method, device and system and computer readable storage medium
CN114286064A
Image projection device and calibration method thereof
US20150189267A1
Auto keystone correction and auto focus adjustment
US20170374331A1
Cited By
Monocular three-dimensional target detection method based on group type dynamic query distribution algorithm
CN121962765A