Projection target object intelligent positioning method and system, medium and product

Abstract

A projection target object intelligent positioning method and system, a medium and a product relate to the technical field of projection display, and the method comprises the following steps: carrying out preprocessing operation on multi-angle image data of a projection target object to obtain three-dimensional feature information of the projection target object; matching the three-dimensional feature information with a preset standard feature library, and determining shape information, position information and direction information of the projection target object; determining an optimal projection position and an optimal projection angle of the projection equipment based on the shape information, the position information and the direction information of the projection target object; based on the shape information of the projection target object and the optimal projection position and the optimal projection angle of the projection equipment, performing picture adjustment operation on a preset image or a preset video to obtain projection content; and projecting the projection content to the projection target object. By implementing the method, the positioning accuracy of the projection target object can be improved.

Description

Technical Field

[0001] The present application relates to the field of projection display technology, and in particular to a method, system, medium and product for intelligently positioning a projection target. Background Art

[0002] With the rapid development of modern science and technology, projection technology is increasingly used in various fields. Whether in commercial display, education and training, home entertainment or professional performances, projection equipment plays a vital role. High-quality projection effects require not only high-quality projection equipment, but also rely on precise positioning of the projection target to ensure that the projection content can be perfectly presented on the surface of the target.

[0003] In the prior art, in order to achieve accurate positioning of the projection target, an edge detection algorithm is usually used to determine the edge contour of the projection target, and then an optical or mechanical alignment method is used, including adjusting the position and angle of the projection device, so as to project the image or video onto the surface of the projection target.

[0004] However, the existing technology still has some shortcomings in practical applications. The existing edge detection algorithm is easily disturbed in complex backgrounds and is difficult to adapt to the complex shapes and variable positions of the projected targets, resulting in reduced recognition accuracy and inaccurate positioning of the projected targets. Summary of the invention

[0005] The present application provides a projection target intelligent positioning method, system, medium and product for improving the accuracy of projection target positioning.

[0006] In a first aspect, the present application provides a method for intelligent positioning of a projection target, which is applied to a control system, the method comprising: performing a preprocessing operation on multi-angle image data of the projection target to obtain three-dimensional feature information of the projection target, the projection target being used to represent the object surface on which a projection device projects a preset image or a preset video, the preprocessing operation comprising denoising, graying, edge detection and feature extraction; matching the three-dimensional feature information with a preset standard feature library to determine shape information, position information and direction information of the projection target; determining an optimal projection position and an optimal projection angle of the projection device based on the shape information, position information and direction information of the projection target; performing a screen adjustment operation on the preset image or the preset video based on the shape information of the projection target, the optimal projection position and the optimal projection angle of the projection device to obtain projection content, the screen adjustment operation comprising resizing, adjusting scale, adjusting resolution and distortion correction; and projecting the projection content onto the projection target.

[0007] By adopting the above technical solution, the control system performs preprocessing operations on the multi-angle image data of the projection target to obtain the three-dimensional feature information of the projection target, and matches the three-dimensional feature information with the standard feature library, so as to accurately obtain the shape information, position information and direction information of the projection target. Based on the shape information, position information and direction information, the control system can intelligently determine the optimal projection position and the optimal projection angle of the projection device, and make targeted picture adjustments to the preset image or preset video. This adaptive picture adjustment operation includes resizing, adjusting the scale, adjusting the resolution and correcting the distortion, thereby ensuring that the projected content can perfectly fit the surface of the projection target. This series of intelligent processing greatly improves the accuracy and display effect of the projection, so that the projection content can be presented in high quality on projection targets of various shapes and positions, greatly enhancing the flexibility and applicability of the projection method. At the same time, the method also reduces the need for manual adjustment, improves the level of automation and ease of use.

[0008] In combination with some embodiments of the first aspect, in some embodiments, the optimal projection position and the optimal projection angle of the projection device are determined based on the shape information, position information and direction information of the projection target, specifically including: extracting the surface contour line of the projection target according to the shape information of the projection target; calculating the normal vectors of multiple preset points on the surface contour line to obtain multiple surface normal vectors of the projection target; determining multiple candidate position coordinates of the projection device according to the position information of the projection target; determining multiple candidate rotation angles of the projection device according to the direction information of the projection target; calculating the corresponding projection light direction based on each group of candidate position coordinates and candidate rotation angles; respectively calculating the deviation angle between each projection light direction and the multiple surface normal vectors; and determining the candidate position coordinates and candidate rotation angle corresponding to the projection light direction with the smallest deviation angle as the optimal projection position and the optimal projection angle.

[0009] By adopting the above technical solution, the control system determines the optimal projection position and the optimal projection angle of the projection device through a series of precise calculation steps, which greatly improves the accuracy of the projection effect. First, the control system extracts the surface contour of the projection target and calculates the normal vectors of multiple preset points, so as to accurately grasp the geometric features of the surface of the projection target. Then, the control system sets multiple candidate position coordinates and candidate position coordinates and candidate rotation angles, and calculates the corresponding projection light direction, so as to fully consider various possible projection schemes. Finally, the control system determines the optimal projection position and the optimal projection angle by calculating the deviation angle between each projection light direction and multiple surface normal vectors respectively, and selecting the projection scheme with the smallest deviation angle. This refined calculation process ensures that the projection light of the projection device irradiates the surface of the projection target at the optimal angle, minimizes the deformation and distortion of the picture, and significantly improves the projection quality and viewing experience. At the same time, this automated optimization process also greatly reduces the time and cost of manual debugging.

[0010] In combination with some embodiments of the first aspect, in some embodiments, the preset image or the preset video is subjected to a screen adjustment operation based on the shape information of the projection target, the optimal projection position and the optimal projection angle of the projection device to obtain the projection content. The screen adjustment operation includes adjusting the size, adjusting the ratio, adjusting the resolution and correcting the distortion, specifically including: determining the projection distance of the projection device according to the optimal projection position and the optimal projection angle; determining the display size and display ratio of the preset image or the preset video on the projection target according to the projection distance and the shape information of the projection target; and performing resolution adjustment and distortion correction on the preset image or the preset video according to the display size and the display ratio to obtain the projection content.

[0011] By adopting the above technical solution, a series of fine picture adjustment operations are performed to ensure that the projected content can perfectly adapt to the surface characteristics of the projection target. First, the control system calculates the projection distance, so that it can accurately grasp the spatial relationship between the projection device and the projection target. Then, based on the projection distance and the shape information of the projection target, the control system can intelligently determine the display size and display ratio of the preset image or video on the projection target. Finally, the control system adjusts the resolution and corrects the distortion of the preset image or preset video to ensure that the projected content presents the best visual effect on the surface of the projection target. This comprehensive picture adjustment process can not only effectively prevent the deformation and distortion of the projected content, but also ensure that the clarity and details of the content will not be lost due to the projection. At the same time, this automated adjustment process also greatly simplifies the difficulty of using the projection method, so that even for projection targets with complex shapes, high-quality projection effects can be easily achieved.

[0012] In combination with some embodiments of the first aspect, in some embodiments, after the step of projecting the projection content onto the projection target, the method also includes: during the projection process, if the position information or direction information of the projection target changes, updating the optimal projection position and the optimal projection angle in real time; adjusting the projection content according to the updated optimal projection position and the optimal projection angle and the shape information of the projection target.

[0013] By adopting the above technical solution, during the projection process, considering that the projection target may not be fixed, by real-time monitoring the position information and direction information of the projection target, when the position information or direction information of the projection target is detected to change, the control system updates the optimal projection position and the optimal projection angle in real time to ensure that the projection target can be accurately located, so as to project. This real-time response mechanism ensures that the projection device can adapt to environmental changes at any time and maintain the best projection effect. At the same time, the control system can also adjust the projection content in time according to the updated optimal projection position and the optimal projection angle and the shape information of the projection target. This dynamic adjustment capability not only improves the flexibility and stability of the projection method, but also greatly expands its application scenarios. For example, in occasions such as dynamic displays, interactive devices or mobile projections, this method can ensure that the projection content always remains in the best state, no matter how the projection target moves or rotates. This intelligent real-time adjustment function greatly enhances practicality and user experience, and provides strong technical support for various innovative visual presentations.

[0014] In combination with some embodiments of the first aspect, in some embodiments, after the step of projecting the projection content onto the projection target, the method further includes: storing the shape information, position information and direction information of the projection target in association with the optimal projection position, the optimal projection angle, and the picture adjustment operation data in a preset database.

[0015] By adopting the above technical solution, a comprehensive preset database is established and maintained, thereby greatly improving the learning ability and efficiency of the control system. This data storage mechanism establishes an "experience library" for the control system, enabling the control system to learn and accumulate from past projection experience. When encountering similar projection scenes, the control system can quickly retrieve relevant parameters from the preset database, greatly shortening the time for parameter calculation and parameter adjustment, and improving the response speed of the control system. At the same time, this preset database also provides a basis for the continuous optimization of the control system. By analyzing the stored data, the optimization direction of the projection effect can be found, and the algorithm and strategy can be continuously improved.

[0016] In combination with some embodiments of the first aspect, in some embodiments, the method also includes: obtaining multiple projection effect feedbacks; determining whether the current projection range or the current projection effect meets the preset requirements based on the projection effect feedback; if the current projection range does not meet the preset requirements, recalculating the optimal projection position and the optimal projection angle, and performing screen adjustment operations on the preset image or the preset video.

[0017] By adopting the above technical solution, the intelligent level and projection quality of the projection method are significantly improved by introducing feedback mechanism and adaptive adjustment. First, the control system obtains multiple projection effect feedbacks, and the projection effect feedback fully reflects the user's evaluation of the current projection. Then, the control system will evaluate whether the current projection range and the current projection effect meet the preset requirements based on these projection effect feedbacks. This evaluation mechanism ensures that the control system can promptly discover and respond to changes in projection quality. If it is found that the current projection range does not meet the preset requirements, the control system automatically triggers the recalculation of the optimal projection position and the optimal projection angle, and performs a new round of picture adjustments on the preset image or preset video. This closed-loop feedback and adjustment mechanism enables the control system to continuously optimize its own performance and adapt to various complex projection environments and demand changes. At the same time, this adaptive adjustment also greatly reduces the need for manual intervention and improves the automation level and ease of use of the control system. This intelligent optimization process not only ensures the continuous stability of projection quality, but also adapts to different viewing environments and user needs, greatly improving the practicality and user satisfaction of the projection method.

[0018] In combination with some embodiments of the first aspect, in some embodiments, after the step of determining whether the current projection range or the current projection effect meets the preset requirements based on the projection effect feedback, the method also includes: if the current projection effect does not meet the preset requirements, obtaining current projection parameters, the current projection parameters including projection brightness, projection contrast and color settings; determining a projection parameter adjustment amount based on the current projection effect; generating a projection parameter control instruction based on the projection parameter adjustment amount; and sending the projection parameter control instruction to the projection device to adjust the current projection effect.

[0019] By adopting the above technical solution, the optimization capability and adaptability of the projection effect are greatly improved through a refined projection parameter adjustment mechanism. When the control system detects that the current projection effect does not meet the preset requirements, a series of intelligent adjustment processes will be automatically triggered. First, the control system will obtain the current projection parameters to fully grasp the current projection state. Then, based on the current projection effect, the control system intelligently determines the amount of projection parameter adjustment required. This precise parameter adjustment ensures that each optimization can be targeted. Then, the control system will generate a projection parameter control instruction based on the determined projection parameter adjustment amount, and send the projection parameter control instruction to the projection device for execution. This automated projection parameter adjustment process can not only respond quickly to environmental changes, but also accurately control every detail of the projection effect, so that the control system can adapt to various complex projection environments, such as different light conditions, projection surface materials, etc., and always maintain the best display effect. At the same time, this intelligent projection parameter adjustment mechanism also greatly reduces the need for manual intervention and improves the ease of use and efficiency of the control system.

[0020] In a second aspect, an embodiment of the present application provides a control system, comprising: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the control system to execute the method described in the first aspect and any possible implementation method of the first aspect.

[0021] In a third aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when the computer program product is run on a control system, enables the control system to execute the method described in the first aspect and any possible implementation of the first aspect.

[0022] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, comprising instructions, which, when executed on a control system, enable the control system to execute the method described in the first aspect and any possible implementation of the first aspect.

[0023] It is understandable that the control system provided in the second aspect, the computer program product provided in the third aspect, and the computer storage medium provided in the fourth aspect are all used to execute the method provided in the embodiment of the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, which will not be repeated here.

[0024] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages: 1. By adopting the above technical solution, the control system performs preprocessing operations on the multi-angle image data of the projection target to obtain the three-dimensional feature information of the projection target, and matches the three-dimensional feature information with the standard feature library, so as to accurately obtain the shape information, position information and direction information of the projection target. Based on the shape information, position information and direction information, the control system can intelligently determine the optimal projection position and the optimal projection angle of the projection device, and make targeted picture adjustments to the preset image or preset video. This adaptive picture adjustment operation includes resizing, adjusting the scale, adjusting the resolution and correcting the distortion, thereby ensuring that the projected content can perfectly fit the surface of the projection target. This series of intelligent processing greatly improves the accuracy and display effect of the projection, so that the projection content can be presented with high quality on projection targets of various shapes and positions, greatly enhancing the flexibility and applicability of the projection method. At the same time, the method also reduces the need for manual adjustment, improves the level of automation and ease of use.

[0025] 2. By adopting the above technical solution, the control system determines the optimal projection position and the optimal projection angle of the projection device through a series of precise calculation steps, which greatly improves the accuracy of the projection effect. First, the control system extracts the surface contour of the projection target and calculates the normal vectors of multiple preset points, so as to accurately grasp the geometric features of the surface of the projection target. Then, the control system sets multiple candidate position coordinates and candidate position coordinates and candidate rotation angles, and calculates the corresponding projection light direction, so as to fully consider various possible projection schemes. Finally, the control system determines the optimal projection position and the optimal projection angle by calculating the deviation angle between each projection light direction and multiple surface normal vectors respectively, and selecting the projection scheme with the smallest deviation angle. This refined calculation process ensures that the projection light of the projection device irradiates the surface of the projection target at the optimal angle, minimizes the deformation and distortion of the picture, and significantly improves the projection quality and viewing experience. At the same time, this automated optimization process also greatly reduces the time and cost of manual debugging.

[0026] 3. By adopting the above technical solution, during the projection process, considering that the projection target may not be fixed, by real-time monitoring the position information and direction information of the projection target, when the position information or direction information of the projection target is detected to have changed, the control system updates the optimal projection position and the optimal projection angle in real time to ensure that the projection target can be accurately located, so as to project. This real-time response mechanism ensures that the projection device can adapt to environmental changes at any time and maintain the best projection effect. At the same time, the control system can also adjust the projection content in time according to the updated optimal projection position and the optimal projection angle and the shape information of the projection target. This dynamic adjustment capability not only improves the flexibility and stability of the projection method, but also greatly expands its application scenarios. For example, in occasions such as dynamic displays, interactive devices or mobile projections, this method can ensure that the projection content always remains in the best state, no matter how the projection target moves or rotates. This intelligent real-time adjustment function greatly enhances practicality and user experience, and provides strong technical support for various innovative visual presentations. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 This is a flow chart of a method for intelligently positioning a projection target in an embodiment of the present application; Figure 2 This is another flow chart of the method for intelligently positioning a projection target object in an embodiment of the present application; Figure 3 It is a schematic diagram of the structure of a physical device of the control system in an embodiment of the present application. DETAILED DESCRIPTION

[0028] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification of the present application, the singular expressions "one", "a kind of", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to any or all possible combinations comprising one or more of the listed items.

[0029] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0030] The following is a description of the process of the method provided by this implementation. Figure 1, which is a flow chart of the method for intelligent positioning of a projection target in an embodiment of the present application.

[0031] S101, performing a preprocessing operation on multi-angle image data of a projection target to obtain three-dimensional feature information of the projection target, where the projection target is used to represent the surface of an object on which a projection device projects a preset image or a preset video, and the preprocessing operation includes denoising, graying, edge detection, and feature extraction; The camera carried on the projection device shoots the projection target from multiple angles, and the control system obtains the multi-angle image data of the projection target. Of course, there are many other ways for the control system to obtain the multi-angle image data of the projection target, which are not limited here. The control system can use a variety of image processing technologies to pre-process the multi-angle image data of the projection target. First, the control system can perform denoising, that is, noise removal, to improve the quality of multi-angle image data; then, the control system can grayscale the image to simplify subsequent processing; then, the control system can use edge detection algorithms such as Canny or Sobel to identify the shape contour of the projection target; finally, the control system can extract feature points such as SIFT or SURF to obtain the unique features of the projection target.

[0032] It should be noted that the specific pre-processing operation technology used by the control system may vary according to the actual situation. For example, for projection targets with complex textures, the control system can use more complex texture analysis algorithms; for projection targets with special geometric shapes, the control system can use specialized shape recognition algorithms. In addition, the control system may combine multiple frames of image data and use technologies such as structured light or binocular stereo vision to more accurately reconstruct the three-dimensional structure of the projection target.

[0033] S102, matching the three-dimensional feature information with a preset standard feature library to determine shape information, position information and direction information of the projection target object; The shape information of the projection target is used to represent the geometric features and surface contour of the projection target, the position information is used to represent the position coordinates of the projection target in space, and the direction information is used to represent the orientation of the projection target.

[0034] First, the control system can collect three-dimensional model data of various projection targets. These three-dimensional model data can come from CAD models or be obtained through a three-dimensional scanner. Then, the control system determines the corresponding three-dimensional feature information, as well as the shape information, position information and direction information corresponding to the three-dimensional feature information through the three-dimensional model data of various projection targets, thereby obtaining a standard feature library.

[0035] After acquiring the three-dimensional feature information of the projection target, the control system matches this three-dimensional feature information with the preset standard feature library to determine the shape information, position information and direction information of the projection target. This matching process may involve a variety of algorithms and techniques. For example, the control system can use the ICP (Iterative Closest Point) algorithm to match the three-dimensional point cloud data, or use the RANSAC algorithm for feature matching. For the determination of shape information, the control system can use principal component analysis (PCA) to obtain the main geometric features of the projection target, or use Fourier descriptors to describe complex contour shapes. The determination of position information may involve coordinate transformation and spatial positioning algorithms, while the direction information may require analysis of the principal axis or face orientation of the projection target.

[0036] It should be noted that the control system may adopt a multi-level matching strategy in this step. For example, a rough match is performed first to determine the general category, and then a fine match is performed to determine the specific parameters. In addition, the control system may use machine learning algorithms, such as support vector machines (SVM) or deep learning networks, to improve the accuracy and efficiency of matching. For the standard feature library, the control system may update and optimize it regularly to adapt to new types of projected targets and improve matching performance.

[0037] S103, determining an optimal projection position and an optimal projection angle of the projection device based on the shape information, position information and direction information of the projection target; The optimal projection position of the projection device refers to the placement point of the projection device that can achieve an ideal projection effect, and the optimal projection angle refers to the optimal inclination of the projection device toward the projection target.

[0038] Based on the shape information, position information and direction information of the projection target determined in step S102, the control system begins to determine the optimal projection position and the optimal projection angle of the projection device. This process may involve complex optimization algorithms and decision-making mechanisms. For example, the control system may use a genetic algorithm or a particle swarm optimization algorithm to search for the best projection parameter combination, which includes the best projection position and the best projection angle. In this process, the control system needs to consider multiple factors, such as projection distance, projection angle, normal vector of the projection target surface, coverage of the projection area, etc. The control system may establish a multi-objective optimization strategy, taking into account factors such as projection effect, energy efficiency and equipment limitations. For example, the control system may give priority to making the projection light as perpendicular to the surface of the projection target as possible to reduce distortion; at the same time, the control system will also consider the heat dissipation requirements and power consumption limitations of the projection device to avoid being in an unfavorable position for a long time. In addition, the control system may predict possible obstructions or interference during the projection process and plan alternative plans in advance.

[0039] It should be noted that the control system may use a real-time feedback mechanism in this step to continuously adjust and optimize the projection position and projection angle according to the actual projection effect. For example, if it is detected that the projection effect of certain areas of the projection target is not good, the control system may fine-tune the projection angle or projection position in real time. For complex projection environments, the control system may adopt a strategy of multiple projection devices working together to achieve the best overall projection effect by optimizing the projection position and projection angle of each projection device.

[0040] Optionally, in general, determining the optimal projection position and the optimal projection angle of the projection device based on the shape information, position information and direction information of the projection target object can be achieved in the following manner: extracting the surface contour line of the projection target object according to the shape information of the projection target object; calculating the normal vectors of multiple preset points on the surface contour line to obtain multiple surface normal vectors of the projection target object; determining multiple candidate position coordinates of the projection device according to the position information of the projection target object; determining multiple candidate rotation angles of the projection device according to the direction information of the projection target object; calculating the corresponding projection light direction based on each set of candidate position coordinates and candidate rotation angles; respectively calculating the deviation angle between each projection light direction and the multiple surface normal vectors; and determining the candidate position coordinates and candidate rotation angle corresponding to the projection light direction with the smallest deviation angle as the optimal projection position and the optimal projection angle.

[0041] S104, performing a screen adjustment operation on the preset image or the preset video based on the shape information of the projection target, the optimal projection position and the optimal projection angle of the projection device to obtain projection content, wherein the screen adjustment operation includes resizing, adjusting the scale, adjusting the resolution and correcting the distortion; After determining the best projection position and the best projection angle, the control system begins to adjust the preset image or preset video according to the shape information of the projection target. This process involves multiple complex image processing and transformation operations. First, the control system calculates the projection distance, which may involve hardware such as laser ranging or depth cameras, or geometric calculations based on known spatial information. Then, the control system determines the most appropriate size and proportion of the preset image or preset video displayed on the projection target based on this projection distance and the shape information of the projection target. For example, for a projection target with a curved surface, the control system may need to perform nonlinear deformation on the preset image or preset video to ensure that the projected content appears normal to the observer. The control system may also need to adjust the resolution to ensure the clarity of the projected content, which may involve super-resolution algorithms or intelligent scaling technologies. For dynamic video content, the control system may need to adjust the frame rate in real time to adapt to the refresh rate of the projection device. In addition, the control system also needs to perform distortion correction, which may involve complex geometric transformations and interpolation algorithms. For example, for an irregular three-dimensional object, the control system may need to use three-dimensional mapping technology to accurately map a two-dimensional image to the surface of the object.

[0042] It should be noted that the control system will take into account the influence of ambient light in this step and dynamically adjust the brightness and contrast to ensure the best visual effect. For projection content containing text, the control system may need to pay special attention to maintaining the readability of the text, which may involve text recognition and re-rendering technology.

[0043] Optionally, based on the shape information of the projection target, the optimal projection position and the optimal projection angle of the projection device, a screen adjustment operation is performed on the preset image or the preset video to obtain the projection content. The screen adjustment operation includes adjusting the size, adjusting the ratio, adjusting the resolution and correcting the distortion, which can be achieved in the following manner: determining the projection distance of the projection device according to the optimal projection position and the optimal projection angle; determining the display size and display ratio of the preset image or the preset video on the projection target according to the projection distance and the shape information of the projection target; and adjusting the resolution and correcting the distortion of the preset image or the preset video according to the display size and the display ratio to obtain the projection content.

[0044] S105: Projecting the projection content onto the projection target object.

[0045] After the picture adjustment is completed, the control system will control the projection device to project the adjusted projection content onto the projection target. Although this step seems simple, it actually involves complex control and coordination processes. First, the control system needs to ensure that the projection device has been accurately moved to the optimal projection position and adjusted to the optimal projection angle, which may involve precise motor control and posture adjustment algorithms. Then, the control system needs to accurately control the light source of the projection device, including projection parameters such as brightness, color temperature, and color saturation. For laser projection devices, the control system may need to accurately control the intensity and timing of multiple laser light sources. The control system also needs to coordinate the transmission and display of the projection content to ensure smooth playback of images or video streams, which may involve high-speed data transmission and buffer management. For high-refresh-rate projection devices, the control system may need to perform frame interpolation or motion compensation to provide a smoother visual experience. In addition, the control system also needs to monitor the projection effect in real time and make fine adjustments. For example, if the reflective properties of the projection surface are detected to change (for example, due to changes in ambient light), the control system may need to adjust the projection parameters in real time. For situations where multiple projection devices need to work together, the control system needs to accurately control the timing and content of each projection device to ensure seamless splicing and synchronization.

[0046] It should be noted that the control system may also need to consider energy efficiency and equipment protection in this step. For example, while ensuring the projection effect, the control system may dynamically adjust the light source intensity to extend the equipment life and reduce energy consumption. For long-term projection tasks, the control system may implement intelligent heat dissipation strategies to ensure the stable operation of the projection equipment.

[0047] By adopting the above technical solution, the multi-angle image data of the projection target is preprocessed to obtain the three-dimensional feature information of the projection target, and the three-dimensional feature information is matched with the standard feature library, so as to accurately obtain the shape information, position information and direction information of the projection target. Based on the shape information, position information and direction information, the control system can intelligently determine the optimal projection position and the optimal projection angle of the projection device, and make targeted picture adjustments to the preset image or preset video. This adaptive picture adjustment operation includes resizing, adjusting the scale, adjusting the resolution and correcting the distortion, thereby ensuring that the projected content can perfectly fit the surface of the projection target. This series of intelligent processing greatly improves the accuracy and display effect of the projection, so that the projection content can be presented in high quality on projection targets of various shapes and positions, greatly enhancing the flexibility and applicability of the projection method. At the same time, the method also reduces the need for manual adjustment, improves the level of automation and ease of use.

[0048] The following is a more detailed description of the process of the method provided by this implementation. Figure 2, is another flow chart of the method for intelligent positioning of a projection target in an embodiment of the present application.

[0049] S201, performing a preprocessing operation on multi-angle image data of a projection target object to obtain three-dimensional feature information of the projection target object, where the projection target object is used to represent the surface of an object on which a projection device projects a preset image or a preset video, and the preprocessing operation includes denoising, graying, edge detection, and feature extraction; For details, please refer to step S101, which will not be described in detail here.

[0050] S202, matching the three-dimensional feature information with a preset standard feature library to determine shape information, position information and direction information of the projection target object; For details, please refer to step S102, which will not be described in detail here.

[0051] S203, determining an optimal projection position and an optimal projection angle of the projection device based on the shape information, position information and direction information of the projection target; For details, please refer to step S103, which will not be described in detail here.

[0052] S204, performing a screen adjustment operation on the preset image or the preset video based on the shape information of the projection target, the optimal projection position and the optimal projection angle of the projection device to obtain projection content, wherein the screen adjustment operation includes resizing, adjusting the scale, adjusting the resolution and correcting the distortion; For details, please refer to step S104, which will not be described in detail here.

[0053] S205: Projecting the projection content onto the projection target object.

[0054] For details, please refer to step S105, which will not be described in detail here.

[0055] S206, during the projection process, if the position information or direction information of the projection target changes, update the best projection position and the best projection angle in real time; Since the projection target may not be fixed, its position information or direction information will change according to its movement during the projection process. Therefore, the control system needs to re-update the position information, direction information and shape information of the projection target, and adjust the optimal projection position and the optimal projection angle in real time. The specific method of adjusting the optimal projection position and the optimal projection angle can be referred to step S103, which will not be repeated here.

[0056] S207, adjusting the projection content according to the updated optimal projection position and optimal projection angle and the shape information of the projection target object; After the projection target moves, the optimal projection position and the optimal projection angle of the projection device change, and the projection content projected by the projection device onto the projection target also needs to be adjusted accordingly to ensure that the projection device can adapt to changes in the environment at any time and maintain the best projection effect. The adjustment of the projection content can refer to step S104, which will not be repeated here.

[0057] S208, obtaining multiple projection effect feedbacks; Multiple projection effect feedback refers to feedback sent by multiple users to the control system about the projection effect of the projection device, which may specifically include the user's satisfaction with the current projection range and the current projection effect. The user can establish a communication connection with the control system in various ways, which are not limited here.

[0058] The control system collects multiple projection effect feedbacks from users. It should be noted that the control system needs to consider the real-time and reliability of the data when collecting these projection effect feedbacks. For example, the control system may use sliding window technology to smooth short-term fluctuations, or use anomaly detection algorithms to identify and filter unreliable projection effect feedback. The control system may also use multimodal fusion technology to comprehensively analyze projection effect feedback from different channels to obtain a more comprehensive and accurate projection effect evaluation.

[0059] S209, determining whether the current projection range or the current projection effect meets preset requirements according to the projection effect feedback; The control system can determine whether the current projection range or the current projection effect meets the preset requirements based on multiple projection effect feedbacks. The current projection range refers to the size and shape of the area currently covered by the projection device. The current projection effect is used to indicate the visual presentation quality of the projection image, such as clarity, brightness, and color. The preset requirements refer to the pre-set basis for judging whether the projection meets the standards. In the implementation of this application, it is used to indicate the user's satisfaction with the current projection range and the current projection effect.

[0060] For example, if two-thirds of the users in the multiple projection effect feedbacks are satisfied with the current projection range, then it can be considered that the current projection range meets the preset requirements, otherwise the current projection range does not meet the preset requirements. If two-thirds of the users in the multiple projection effect feedbacks are satisfied with the current projection effect, then it can be considered that the current projection effect meets the preset requirements, otherwise the current projection effect does not meet the preset requirements. The specific evaluation method is not limited here.

[0061] S210: If the current projection range does not meet the preset requirement, recalculate the optimal projection position and the optimal projection angle, and perform a screen adjustment operation on the preset image or the preset video; If it is determined according to step S209 that the current projection range does not meet the preset requirements, the control system needs to recalculate the optimal projection position and the optimal projection angle, and perform screen adjustment operations on the preset image or the preset video. Specifically, the control system will first calculate the optimal projection position and the optimal projection angle that can achieve the highest coverage rate based on the projection range and environmental conditions, which may involve complex geometric calculations and space optimization algorithms. Then, the control system will make corresponding screen adjustments to the preset image or preset video based on the new optimal projection position and the optimal projection angle. The screen adjustment operation may include image scaling, distortion correction, trapezoidal correction, etc., in order to ensure that under the new projection conditions, the picture can still maintain the correct proportion and shape and completely cover the target area.

[0062] S211. If the current projection effect does not meet the preset requirement, obtain current projection parameters, where the current projection parameters include projection brightness, projection contrast, and color settings; If it is determined according to step S209 that the current projection effect does not meet the preset requirements, the control system is connected to the projection device to obtain the current projection parameters of the projection device for subsequent adjustment. Specifically, the control system reads the current working status of the projection device and extracts key projection parameter data. These projection parameter data mainly include core indicators that affect the picture quality, such as projection brightness, projection contrast, and color settings. The purpose of obtaining these projection parameter data is to accurately understand the current projection setting status and provide basic data for subsequent parameter optimization and adjustment, so as to improve the projection effect in a targeted manner to meet the preset requirements.

[0063] In some embodiments, the current projection parameters can be obtained in a variety of ways. For example, first, the internal sensors of the projection device monitor the various projection parameter data in real time; then these projection parameter data are transmitted to the data processing module of the control system; finally, the projection parameter data is formatted to form a standardized parameter report. Optionally, the control system first sends a parameter query instruction to the projection device; then waits for the projection device to return a response data packet containing the current projection parameters; finally, the response data packet is parsed to extract the required projection brightness, projection contrast, and color settings. It is understandable that other methods can also be used to obtain the current projection parameters, such as directly reading the projection parameter data through the device API, or using external measurement equipment to detect the projection parameters, which is not limited here.

[0064] S212, determining a projection parameter adjustment amount according to the current projection effect; After acquiring and analyzing the current projection effect, the control system needs to calculate the specific projection parameter adjustment amount to optimize the projection effect. The control system can compare the current projection effect with the preset projection effect and analyze the difference between the two. Then, based on these differences, the control system will calculate the specific value that needs to be adjusted for each relevant projection parameter. This process may involve complex algorithms that consider the mutual influence between multiple projection parameters to determine the optimal projection parameter adjustment amount. The purpose of calculating the projection parameter adjustment amount is to accurately improve the projection effect so that it gradually approaches or reaches the preset target effect.

[0065] S213, generating a projection parameter control instruction based on the projection parameter adjustment amount; The projection parameter adjustment amount represents the specific value of each projection parameter that needs to be changed. The projection parameter control instruction refers to the specific operation command used to perform parameter adjustment. The generation process refers to the step of converting the projection parameter adjustment amount into an executable instruction.

[0066] After determining the projection parameter adjustment, the control system needs to convert these values ​​into specific instructions that the projection device can understand and execute. The control system can encode the adjustment of each projection parameter into corresponding control instructions according to the control protocol and instruction format of the projection device. This process involves converting abstract adjustments into specific hardware operation instructions, which may include setting new parameter values, adjusting hardware component status, etc.

[0067] S214, sending the projection parameter control instruction to the projection device to adjust the current projection effect; After generating the projection parameter control instruction, the control system needs to accurately transmit the projection parameter control instruction to the projection device and ensure its execution. The control system can establish a communication connection with the projection device, and then send the projection parameter control instruction to the projection device through a preset communication protocol. After receiving the projection parameter control instruction, the projection device will parse and execute the projection parameter control instruction, thereby adjusting the corresponding hardware parameters, such as light source brightness, color settings, etc.

[0068] S215, storing the shape information, position information and direction information of the projection target object in association with the optimal projection position, the optimal projection angle and the picture adjustment operation data in a preset database.

[0069] After completing the projection optimization, the control system needs to associate and store all relevant information for future use and analysis. The control system will integrate the shape information, position information and direction information of the projection target with the optimal projection position, the optimal projection angle and the picture adjustment operation data to form a complete data set. This data set will then be stored in the preset database to establish the correspondence between the projection target characteristics and the optimal projection settings.

[0070] The following describes the control system in the embodiment of the present invention from the perspective of hardware processing. Figure 3 , which is a schematic diagram of the structure of a physical device of the control system in an embodiment of the present application.

[0071] It should be noted that Figure 3 The structure of the control system shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0072] like Figure 3 As shown, the control system includes a central processing unit (CPU) 301, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 302 or the program loaded from the storage part 308 to the random access memory (RAM) 303, such as executing the method described in the above embodiment. In the RAM 303, various programs and data required for system operation are also stored. The CPU 301, the ROM 302 and the RAM 303 are connected to each other through the bus 304. The input / output (I / O) interface 305 is also connected to the bus 304.

[0073] The following components are connected to the I / O interface 305: an input section 306 including an audio input device, a button switch, etc.; an output section 307 including a liquid crystal display (LCD) and an audio output device, an indicator light, etc.; a storage section 308 including a hard disk, etc.; and a communication section 309 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 309 performs communication processing via a network such as the Internet. A drive 310 is also connected to the I / O interface 305 as needed. A removable medium 311, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 310 as needed so that a computer program read therefrom is installed into the storage section 308 as needed.

[0074] In particular, according to an embodiment of the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present invention includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication part 309, and / or installed from a removable medium 311. When the computer program is executed by the central processing unit (CPU) 301, various functions defined in the present invention are performed.

[0075] It should be noted that specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus, or device.

[0076] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present invention. Each box in the flowchart or block diagram may represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions marked in the box may also occur in an order different from that marked in the accompanying drawings.

[0077] Specifically, the control system of this embodiment includes a processor and a memory. The memory stores a computer program. When the computer program is executed by the processor, the projection target intelligent positioning method provided in the above embodiment is implemented.

[0078] As another aspect, the present invention further provides a computer-readable storage medium, which may be included in the control system described in the above embodiment; or may exist independently without being assembled into the control system. The above storage medium carries one or more computer programs, and when the above one or more computer programs are executed by a processor of the control system, the control system implements the projection target intelligent positioning method provided in the above embodiment.

[0079] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0080] As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrases "upon determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)", depending on the context.

[0081] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

Claims

1. A method for intelligently positioning a projection target, characterized in that: Applied to a control system, the method comprises: Performing a preprocessing operation on multi-angle image data of a projection target to obtain three-dimensional feature information of the projection target, wherein the projection target is used to represent the surface of an object on which a projection device projects a preset image or a preset video, wherein the preprocessing operation includes denoising, graying, edge detection, and feature extraction; Matching the three-dimensional feature information with a preset standard feature library to determine the shape information, position information and direction information of the projection target; Determine the best projection position and the best projection angle of the projection device based on the shape information, position information and direction information of the projection target; Based on the shape information of the projection target, the optimal projection position and the optimal projection angle of the projection device, the preset image or the preset video is subjected to a picture adjustment operation to obtain projection content, wherein the picture adjustment operation includes adjusting the size, adjusting the scale, adjusting the resolution and correcting the distortion; The projection content is projected onto the projection target object.

2. The method according to claim 1, characterized in that The determining the optimal projection position and the optimal projection angle of the projection device based on the shape information, the position information and the direction information of the projection target object specifically includes: Extracting a surface contour line of the projection target object according to the shape information of the projection target object; Calculate the normal vectors of a plurality of preset points on the surface contour line to obtain a plurality of surface normal vectors of the projection target object; Determining a plurality of candidate position coordinates of the projection device according to the position information of the projection target; Determining a plurality of candidate rotation angles of the projection device according to the direction information of the projection target object; Based on each set of candidate position coordinates and candidate rotation angles, calculate the corresponding projection light direction; Calculating the deviation angle between each projection light direction and the plurality of surface normal vectors respectively; The candidate position coordinates and candidate rotation angle corresponding to the projection light direction with the smallest deviation angle are determined as the optimal projection position and the optimal projection angle.

3. The method according to claim 1, characterized in that The image adjustment operation is performed on the preset image or the preset video based on the shape information of the projection target, the optimal projection position and the optimal projection angle of the projection device to obtain the projection content, wherein the image adjustment operation includes adjusting the size, adjusting the scale, adjusting the resolution and correcting the distortion, and specifically includes: Determine the projection distance of the projection device according to the optimal projection position and the optimal projection angle; Determining a display size and a display ratio of the preset image or the preset video on the projection target according to the projection distance and the shape information of the projection target; According to the display size and the display ratio, the preset image or the preset video is subjected to resolution adjustment and distortion correction to obtain the projection content.

4. The method according to claim 1, characterized in that: After the step of projecting the projection content onto the projection target, the method further includes: During the projection process, if the position information or direction information of the projection target changes, the optimal projection position and the optimal projection angle are updated in real time; The projection content is adjusted according to the updated optimal projection position and optimal projection angle and the shape information of the projection target object.

5. The method according to claim 1, characterized in that After the step of projecting the projection content onto the projection target, the method further includes: The shape information, position information and direction information of the projection target are associated with the optimal projection position, the optimal projection angle and the picture adjustment operation data and stored in a preset database.

6. The method according to claim 1, characterized in that The method further comprises: Get feedback on multiple projection effects; Determine whether the current projection range or the current projection effect meets preset requirements according to the projection effect feedback; If the current projection range does not meet the preset requirements, the optimal projection position and the optimal projection angle are recalculated, and a picture adjustment operation is performed on the preset image or the preset video.

7. The method according to claim 6, characterized in that After the step of determining whether the current projection range or the current projection effect meets the preset requirements according to the projection effect feedback, the method further includes: If the current projection effect does not meet the preset requirements, obtaining current projection parameters, wherein the current projection parameters include projection brightness, projection contrast, and color settings; Determining a projection parameter adjustment amount according to the current projection effect; generating a projection parameter control instruction based on the projection parameter adjustment amount; The projection parameter control instruction is sent to the projection device to adjust the current projection effect.

8. A control system, characterized in that: The control system includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the control system to execute the method described in any one of claims 1-7.

9. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on a control system, the control system is caused to execute the method according to any one of claims 1 to 7.

10. A computer program product, characterized in that When the computer program product is run on a control system, the control system is caused to execute the method according to any one of claims 1 to 7.

Images