Display method based on LCD projector and LCD projector
By detecting the projection area of the LCD projector and identifying face, face and posture, combining multimodal information to accurately identify the target person and adjusting the projection parameters, the problem of poor handling of blocking characters in the existing technology is solved, and the demonstration effect is improved.
Patent Information
- Application Number
- CN202411636382.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-15
- Publication Date
- 2025-02-25
- Estimated Expiration
- 2044-11-15
AI Technical Summary
Existing LCD projectors cannot effectively identify and process blocking characters during speeches, resulting in poor demonstration effects and the audience cannot clearly see the speaker's expressions and actions.
By detecting the projection area, identifying the obstructed object and facial recognition. If a face is recognized, facial and posture recognition will be performed. Combining residence time and multimodal information, the target person will be accurately identified and the projection parameters of the obstructed area will be adjusted to improve visibility.
Ensure that the target person's occlusion area is clearly visible, improve the demonstration effect, and avoid the poor demonstration effect caused by traditional projectors due to the inability to distinguish the identity of the person being blocked.
Smart Images

Figure CN119520749A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of projectors, and in particular to a display method based on an LCD projector and an LCD projector. Background Art
[0002] With the continuous development of display technology, LCD projectors have been widely used in conference rooms, classrooms and other scenes due to their advantages such as high definition and large-size display. LCD projectors achieve the effect of large-screen display by projecting images onto walls or screens. In the related technology, LCD projectors generally adopt an adjustable projection parameter system and a simple occlusion processing function. For occlusion processing, some projectors use technology based on infrared or ultrasonic sensors, which can detect whether there are objects in the projection area. When occlusion is detected, the system will issue a prompt sound or display a warning message on the screen.
[0003] However, this method will still cause the person to be blocked by the displayed content during the speech, and the audience will not be able to see the speaker's expressions and movements. Due to the projector display, the speaker's expressions and movements cannot convey information to the audience, resulting in poor presentation effects of the LCD projector. Summary of the invention
[0004] The present application provides a display method based on an LCD projector and an LCD projector, which are used to improve the demonstration effect of the LCD projector.
[0005] In a first aspect, the present application provides a display method based on an LCD projector, which is applied to an LCD projector, and the method includes: detecting a projection area of the LCD projector and identifying an obstructing object in the projection area; performing face recognition on the obstructing object, and if the obstructing object contains a face, determining the obstructing object as an obstructing person; performing face recognition on the obstructing person to obtain the facial expression of the obstructing person, and performing posture recognition on the obstructing person to obtain the body movement of the obstructing person; detecting the residence time of the obstructing person in the projection area, and if the residence time is greater than a preset time threshold, identifying whether the obstructing person is a target person based on the facial expression and the body movement; if the target person is the target person, determining the body contour position of the target person in the projection area, and determining the obstructing projection area occupied by the body contour position; and adjusting the projection parameters of the obstructing projection area so that the visibility of the obstructing projection area is higher than a preset visibility threshold.
[0006] By adopting the above technical solution, the LCD projector detects the projection area, identifies the obstructing object and determines the obstructing person, performs facial and posture recognition on the obstructing person, and obtains information such as facial expressions and body movements. Then, by detecting the dwell time of the obstructing person, combined with multimodal information such as facial expressions and body movements, the target person is accurately identified. Once it is determined to be the target person, the position of the body contour and the obstructed projection area are determined, and then the projection parameters of the area are adjusted to improve visibility, ensuring that the obstructed area where the target person is located is clearly visible, so that the viewer can see the target person, avoiding the problem of poor demonstration effect caused by the inability of traditional projectors to distinguish the identity of the obstructing person.
[0007] In combination with some embodiments of the first aspect, in some embodiments, the step of identifying whether the obstructed person is the target person based on the facial expression and the body movement specifically includes: inputting the facial expression into an expression feature extraction module in a preset multimodal feature fusion model to obtain a facial expression feature vector; inputting the body movement into a body movement feature extraction module in the preset multimodal feature fusion model to obtain a body movement feature extraction module; performing feature fusion on the facial expression feature vector and the body movement feature vector to obtain a fused feature vector; inputting the fused feature vector into a preset target person classifier to obtain a target person probability score; if the target person probability score is greater than a preset threshold, determining that the obstructed person is the target person.
[0008] By adopting the above technical solution, the facial expression is input into the expression feature extraction module of the preset multimodal feature fusion model to obtain the facial expression feature vector, the body movement is input into the body movement feature extraction module to obtain the body movement feature vector, and then the feature fusion is performed to obtain the fusion feature vector, and finally the preset target person classifier is input to obtain the target person probability score, so as to determine whether the occluded person is the target person. This multimodal feature fusion method makes full use of various information such as facial expressions and body movements, making the recognition of the target person more accurate and comprehensive.
[0009] In combination with some embodiments of the first aspect, in some embodiments, the step of adjusting the projection parameters of the obstructed projection area so that the visibility of the obstructed projection area is higher than a preset visibility threshold specifically includes: obtaining a current brightness value and a contrast value of the obstructed projection area; calculating the current visibility of the obstructed projection area according to the current brightness value and the current contrast value; if the current visibility is lower than the preset visibility threshold, increasing the brightness value of the obstructed projection area to obtain an optimized brightness value, and increasing the contrast value of the obstructed projection area to obtain an optimized contrast value; calculating the optimized visibility of the obstructed projection area according to the optimized brightness value and the optimized contrast value; if the optimized visibility is not lower than the preset visibility threshold, using the optimized brightness value and the optimized contrast value as new projection parameters of the obstructed projection area, and adjusting the projection settings of the LCD projector according to the new projection parameters.
[0010] By adopting the above technical solution, the current brightness value and contrast value of the blocked projection area are first obtained, and the current visibility is calculated. If the current visibility is lower than the preset threshold, the brightness value and contrast value are increased to obtain the optimized brightness value and contrast value, and the optimized visibility is calculated. If the optimized visibility is not lower than the preset threshold, the optimized brightness value and contrast value are used as new projection parameters to adjust the projection settings of the projector. The projection parameters can be dynamically adjusted according to the actual situation to ensure that the visibility of the blocked projection area is always higher than the preset visibility threshold, so that the human body in the blocked projection area can be clearly visible.
[0011] In combination with some embodiments of the first aspect, in some embodiments, after the step of adjusting the projection parameters of the obstructed projection area so that the visibility of the obstructed projection area is higher than a preset visibility threshold, the method further includes: real-time monitoring of the obstructed projection area to obtain a real-time brightness value and a real-time contrast value of the obstructed projection area; calculating the real-time visibility of the obstructed projection area according to the real-time brightness value and the real-time contrast value; if it is detected that the real-time visibility is lower than the preset visibility threshold, obtaining the current ambient light intensity of the LCD projector; dynamically adjusting the preset visibility threshold according to the current ambient light intensity to obtain an adjusted visibility threshold; comparing the real-time visibility with the adjusted visibility threshold; if the real-time visibility is still lower than the adjusted visibility threshold, re-executing the step of adjusting the projection parameters of the obstructed projection area until the real-time visibility is greater than or equal to the adjusted visibility threshold.
[0012] By adopting the above technical solution, the blocked projection area is monitored in real time, the real-time brightness value and the real-time contrast value are obtained, and the real-time visibility is calculated. If the real-time visibility is lower than the preset visibility threshold, the current ambient light intensity of the LCD projector is obtained, and the preset visibility threshold is dynamically adjusted to obtain the adjusted visibility threshold. The real-time visibility is compared with the adjusted visibility threshold. If the real-time visibility is still lower than the adjusted visibility threshold, the step of adjusting the projection parameters of the blocked projection area is re-executed until the real-time visibility is greater than or equal to the adjusted visibility threshold. The visibility of the blocked projection area can be timely optimized according to the change of the ambient light, ensuring that a clear projection effect can be provided under different environmental conditions, thereby enhancing the environmental adaptability and stability of the LCD projector.
[0013] In combination with some embodiments of the first aspect, in some embodiments, after the step of determining the body contour position of the target person in the projection area and determining the blocked projection area occupied by the body contour position, the method also includes: determining the position ratio of the blocked projection area in the projection area, and determining the screen position in the current screen played by the LCD projector according to the position ratio; detecting whether there is text content or graphic content at the screen position; if so, adjusting the projection parameters of the blocked projection area so that the visibility of the blocked projection area is higher than a preset visibility threshold.
[0014] By adopting the above technical solution, the position ratio of the blocked projection area in the projection area is determined, and the picture position in the current picture played by the LCD projector is determined according to the position ratio, and then it is detected whether there is text content or graphic content at the picture position. If so, the projection parameters of the blocked projection area are adjusted so that the visibility of the blocked projection area is higher than the preset visibility threshold, so that the body of the target person is not blocked by the text, and the demonstration effect is better.
[0015] In combination with some embodiments of the first aspect, in some embodiments, the step of determining the position ratio of the blocked projection area in the projection area, and determining the screen position in the current picture played by the LCD projector according to the position ratio, specifically includes: obtaining the boundary coordinates of the blocked projection area, the boundary coordinates of the projection area, and the resolution of the current playback picture of the LCD projector; calculating the horizontal position ratio and the vertical position ratio of the blocked projection area in the projection area according to the boundary coordinates of the blocked projection area and the boundary coordinates of the projection area; calculating the screen pixel coordinate range corresponding to the blocked projection area according to the horizontal position ratio, the vertical position ratio and the resolution; and determining the screen position corresponding to the blocked projection area in the current playback picture according to the screen pixel coordinate range.
[0016] By adopting the above technical solution, the boundary coordinates of the blocked projection area, the boundary coordinates of the projection area and the resolution of the current playback screen of the LCD projector are obtained, and the horizontal position ratio and vertical position ratio of the blocked projection area in the projection area are calculated according to these coordinates, and then the screen pixel coordinate range corresponding to the blocked projection area is calculated according to the ratio and resolution, and finally the screen position corresponding to the blocked projection area is determined in the current playback screen according to the range, so that the corresponding position of the blocked area in the playback screen can be accurately found, making the processing of the blocked projection area more accurate and effective.
[0017] In combination with some embodiments of the first aspect, in some embodiments, after the step of adjusting the projection parameters of the occluded projection area so that the visibility of the occluded projection area is higher than a preset visibility threshold, the method further includes: if the occluding object is identified as a non-human occluding object, performing shape analysis and size measurement on the non-human occluding object to obtain contour information and size data of the non-human occluding object; judging whether the non-human occluding object is a movable object based on the contour information and size data; and if it is judged to be a movable object, issuing a removal instruction to the user, wherein the removal instruction is in the form of an audio or visual prompt.
[0018] By adopting the above technical solution, when the obstructing object is identified as a non-human obstructing object, the system will perform shape analysis and size measurement on it, thereby obtaining the contour information and size data of the non-human obstructing object. Then, based on these contour information and size data, it can be determined whether the non-human obstructing object is a movable object. If it is determined to be a movable object, a removal instruction is issued to the user, and the instruction is conveyed to the user through audio or visual prompts. The user can receive prompts about the obstruction of the movable object in a timely manner, and thus take corresponding measures to remove the object, reduce the impact of the non-human obstructing object on the projected image, and improve the integrity and clarity of the projected image.
[0019] In a second aspect, an embodiment of the present application provides an LCD projector, comprising: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the LCD projector to perform the method described in the first aspect and any possible implementation method of the first aspect.
[0020] In a third aspect, an embodiment of the present application provides a computer program product comprising instructions, and when the computer program product runs on an LCD projector, the LCD projector executes the method described in the first aspect and any possible implementation manner of the first aspect.
[0021] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, comprising instructions. When the instructions are executed on an LCD projector, the LCD projector executes the method described in the first aspect and any possible implementation manner of the first aspect.
[0022] It is understandable that the LCD projector provided in the second aspect, the computer program product provided in the third aspect, and the computer storage medium provided in the fourth aspect are all used to execute the method provided in the embodiment of the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, which will not be repeated here.
[0023] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages: 1. This application detects the projection area through an LCD projector, identifies the obstructing object and determines the obstructing person, performs facial and posture recognition on the obstructed person, and obtains information such as facial expressions and body movements. Then, by detecting the dwell time of the obstructing person, combining multimodal information such as facial expressions and body movements, the target person is accurately identified. Once the target person is determined, the position of the body contour and the obstructed projection area are determined, and then the projection parameters of the area are adjusted to improve visibility, ensuring that the obstructed area where the target person is located is clearly visible, so that the viewer can see the target person, avoiding the problem of poor demonstration effect caused by the inability of traditional projectors to distinguish the identity of the obstructing person.
[0024] 2. This application first obtains the current brightness value and contrast value of the blocked projection area to calculate the current visibility. If the current visibility is lower than the preset threshold, the brightness value and contrast value are increased to obtain the optimized brightness value and contrast value, and the optimized visibility is calculated. If the optimized visibility is not lower than the preset threshold, the optimized brightness value and contrast value are used as new projection parameters to adjust the projection settings of the projector. The projection parameters can be dynamically adjusted according to the actual situation to ensure that the visibility of the blocked projection area is always higher than the preset visibility threshold, so that the human body in the blocked projection area can be clearly visible.
[0025] 3. The present application determines the position ratio of the blocked projection area in the projection area, determines the picture position in the current picture played by the LCD projector according to the position ratio, and then detects whether there is text content or graphic content at the picture position. If so, the projection parameters of the blocked projection area are adjusted to make the visibility of the blocked projection area higher than the preset visibility threshold, so that the body of the target person is not blocked by the text, and the demonstration effect is better. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] Figure 1 is a scene diagram of a display method based on an LCD projector in an embodiment of the present application; Figure 2 It is a flow chart of a display method based on an LCD projector in an embodiment of the present application; Figure 3 is another flow chart of a display method based on an LCD projector in an embodiment of the present application; Figure 4 It is a schematic diagram of a physical device structure of an LCD projector in an embodiment of the present application. DETAILED DESCRIPTION
[0027] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification of the present application, the singular expressions "one", "a kind of", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to any or all possible combinations comprising one or more of the listed items.
[0028] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.
[0029] For ease of understanding, the following describes the application scenarios of the embodiments of the present application. Figure 1 , Figure 1 It is a scene diagram of the display method based on the LCD projector in the embodiment of the present application.
[0030] exist Figure 1 In the projected area, the LCD projector projects an image onto the screen. There are occluding objects and target persons in the projection area. The occluding objects in the projection area are detected to identify whether there is a human face, thereby determining the occluding person. For the identified person, the system further recognizes facial expressions and postures to obtain their facial expressions and body movements. If the occluding person stays in the projection area for more than the preset threshold, the system will determine whether it is the target person based on its expression and movement. The "target person" is identified and located in the projection area. At the same time, non-human occluding objects are also detected. By adjusting the projection parameters of the occluding area, it is ensured that the visibility of the target person's area is higher than the preset value, so that the audience can clearly see the target person's face and body, which will not affect the target person's presentation effect.
[0031] The following describes the process of the method provided by this implementation in combination with the above scenario. Figure 2, which is a flow chart of a display method based on an LCD projector in an embodiment of the present application.
[0032] S201: Detect the projection area of the LCD projector and identify blocking objects in the projection area.
[0033] LCD projectors refer to projection devices that use liquid crystal display technology to project images or videos onto a screen or wall. Projection area refers to the entire image range projected by an LCD projector, which is usually rectangular in shape. Blocking objects refer to any objects that appear in the projection area and block or interfere with the projected image, including people, animals, furniture, etc.
[0034] Specifically, after the LCD projector starts working and projects the image, the system continuously monitors the entire projection area. This step uses image analysis technology to scan and analyze the projection area in real time to identify any obstructing objects. The system uses a camera or other sensor to capture real-time images of the projection area, and then analyzes these images through computer vision algorithms to detect any object outlines or moving objects that are different from the background, thereby identifying obstructing objects.
[0035] In some embodiments, the detection of the projection area and the identification of the occluding objects are achieved in a variety of ways: using a depth camera to scan the entire projection area; then, analyzing the obtained depth data to identify areas with significant depth differences from the background plane; finally, marking these areas as occluding objects. Optionally, a background image of the projection area is captured when there are no occluding objects; then, the image of the projection area is captured in real time and compared with the background image at the pixel level; finally, the significantly different areas are identified as occluding objects. In addition, there are other implementation methods, which are not limited here.
[0036] S202: Perform face recognition on the occluding object, and if the occluding object contains a face, determine the occluding object as an occluding person.
[0037] Among them, face recognition refers to the use of computer vision technology to detect and identify faces in images or videos. An occluded person refers to an occluded object that is identified as containing a face, that is, an occluded object determined to be a human. Specifically, after identifying the occluded object, the system performs further analysis on each occluded object, especially face recognition. If a face is detected in the occluded object, the system marks the occluded object as an occluded person.
[0038] In some embodiments, face recognition of occluded objects is achieved in a variety of ways: optionally, the image of the occluded object is input into a pre-trained convolutional neural network; then, the network outputs the area containing the face and its confidence; finally, based on a preset confidence threshold, it is determined whether a face exists. Optionally, the system uses a traditional feature point detection method for face recognition. The specific steps include: first, preprocessing the image of the occluded object, such as grayscale and histogram equalization; then, using a Haar cascade classifier or a similar algorithm to detect the face area; finally, searching for key feature points such as eyes, nose, and mouth in the detected area. If enough feature points are found, it is confirmed to be a face. In addition, there are other implementation methods, which are not limited here.
[0039] S203, performing facial recognition on the obstructing person to obtain the facial expression of the obstructing person, and performing posture recognition on the obstructing person to obtain the body movement of the obstructing person.
[0040] Among them, facial recognition refers to the process of analyzing and interpreting human faces using computer vision technology. Facial expressions represent the emotional state displayed on a person's face, such as smiling, frowning, and surprise. Posture recognition refers to the technology of understanding human posture by analyzing the position and movement of various parts of the human body. Body movements are used to represent the movement state of the human limbs and torso, such as waving, nodding, and shaking the head.
[0041] Specifically, the system performs fine recognition of the face of the occluded person, extracts facial features and analyzes facial expressions. This process usually involves locating key points of the face, such as the eyes, mouth, eyebrows, etc., and then judging the facial expression based on the relative position and changes of these key points. At the same time, the system also recognizes the overall posture of the occluded person, which includes analyzing the human body's skeletal structure, joint position, and relative movement of limbs to obtain information about limb movements.
[0042] In some embodiments, facial expression recognition and gesture recognition can be implemented in a variety of ways: optionally, a pre-trained convolutional neural network is used to extract facial features; then, the extracted features are input into an expression classifier; finally, the expression category and its confidence are output, and key points of the human body (such as shoulders, elbows, wrists, etc.) are detected; then, the relative positions and motion trajectories of these key points are analyzed; finally, the current body movements are matched according to a predefined gesture pattern library. Optionally, a 3D model of the face and body is constructed; then, the 2D image captured in real time is mapped onto the 3D model; finally, facial expressions and body movements are identified by analyzing the deformation of the 3D model. It is understandable that other methods can also be used for implementation, which are not limited here.
[0043] S204, detecting the stay time of the obstructing person in the projection area, and if the stay time is greater than a preset time threshold, identifying whether the obstructing person is a target person according to the facial expression and the body movement.
[0044] The dwell time refers to the length of time that the occluded person continues to exist in the projection area. The preset time threshold refers to a time standard preset by the system to determine whether the occluded person is worthy of further analysis. The target person refers to the occluded person that the system determines to be consistent with the target person who is giving a speech, and the target person's facial expressions and body movements have the characteristics of a person giving a speech.
[0045] Specifically, the system will start a timer to record the time the occluded person stays in the projection area. At this time, the system will use the facial expression and body movement information and a preset algorithm or model to determine whether the occluded person meets the characteristics of the target person.
[0046] In some embodiments, the detection of residence time and the identification of target persons can be achieved in a variety of ways: Optionally, the system can adopt a target tracking method based on computer vision. The specific steps include: first, assigning a unique ID to each detected occluding person; then, using a target tracking algorithm (such as a Kalman filter) to continuously track the position of each ID; finally, recording the cumulative time of each ID in the projection area and comparing it with a preset threshold. Optionally, the system can use a multimodal feature fusion method to identify the target person. The specific steps include: first, extracting facial expression feature vectors and body movement feature vectors; then, using a pre-trained feature fusion model to combine these feature vectors into a comprehensive feature representation; finally, inputting this comprehensive feature into the target person classifier to obtain a judgment result on whether it is the target person. It is understandable that other methods can also be used to achieve residence time detection and target person identification, such as combining environmental context information or using a deep learning model with a spatiotemporal attention mechanism, which is not limited here.
[0047] S205: If it is a target person, determine the body contour position of the target person in the projection area, and determine the blocked projection area occupied by the body contour position.
[0048] The target person refers to a specific person identified by the system that needs special attention or processing. The human body contour position represents the outer boundary line of the target person in the projection area. The blocked projection area refers to the part of the projection screen covered or blocked by the human body contour of the target person. The projection area is used to represent the entire screen range projected by the LCD projector.
[0049] Specifically, first, the system will accurately locate the position of the target person in the entire projection area. Then, the image processing algorithm is used to extract the human body outline of the target person, which usually includes the outer boundaries of the head, torso and limbs. Next, the system will calculate the specific position and size of this human body outline in the projection area. Finally, based on the position and size of this human body outline, the system determines the obstructed projection area, that is, the part of the projection screen covered by the human body outline.
[0050] In some embodiments, the determination of the human body contour position of the target person and the determination of the occluded projection area can be achieved in a variety of ways: Optionally, the system can adopt a human body segmentation method based on deep learning. The specific steps include: first, using a pre-trained semantic segmentation model to process the image of the projection area to obtain a pixel-level human body segmentation result; then, the segmentation result is post-processed, such as edge smoothing and small area removal, to obtain a more accurate human body contour; finally, the human body contour is aligned with the coordinate system of the projection area to calculate the exact position and size of the occluded projection area. Optionally, the system can use a method based on bone detection to determine the human body contour. The specific steps include: first, using a human body posture estimation algorithm to detect the key bone points of the target person; then, building a rough human body model based on these bone points; finally, through interpolation and fitting methods, the rough model is expanded to a complete human body contour, and the occluded projection area is calculated. It can be understood that other methods can also be used to determine the position of the human body contour and the occluded projection area, such as combining 3D reconstruction technology with multi-view images or using thermal imaging cameras to assist in positioning, which is not limited here.
[0051] S206: Adjust the projection parameters of the blocked projection area so that the visibility of the blocked projection area is higher than a preset visibility threshold.
[0052] Among them, projection parameters refer to various settings that control the display effect of the projected image, including brightness, contrast, color saturation, etc. Visibility refers to the clarity and recognizability of the projected image when it is blocked. The preset visibility threshold refers to the minimum acceptable visibility standard preset by the system.
[0053] Specifically, this step is performed immediately after the occluded projection area is determined. The system will first evaluate the visibility of the current occluded projection area, usually by calculating the contrast, clarity and other indicators in the area through image processing algorithms. If the visibility is found to be lower than the preset threshold, the system will begin to adjust the projection parameters. The adjustment process is usually iterative, and the system will gradually change parameters such as brightness and contrast, and re-evaluate visibility after each adjustment.
[0054] In some embodiments, the adjustment of the projection parameters of the occluded projection area can be achieved in a variety of ways: Optionally, the system can adopt a method based on image enhancement. The specific steps include: first, applying a contrast enhancement algorithm, such as histogram equalization or adaptive contrast enhancement, to the occluded projection area; then, adjusting the brightness in the area, the overall brightness needs to be increased to offset the shadows caused by occlusion; finally, fine-tuning the color saturation to ensure that the enhanced image maintains a natural appearance. Optionally, the system can use an adaptive adjustment method based on artificial intelligence. The specific steps include: first, using a machine learning model to analyze the characteristics of the occluded projection area, such as the degree of occlusion, ambient light, etc.; then, based on the analysis results, predicting the optimal parameter adjustment scheme; finally, gradually applying the predicted parameter adjustment, and monitoring the effect in real time, and making fine adjustments when necessary. It can be understood that other methods can also be used, which are not limited here.
[0055] The following is a more detailed description of the process of the method provided by this implementation. Figure 2 , is another flow chart of the display method based on the LCD projector in the embodiment of the present application.
[0056] S301: Detect the projection area of the LCD projector and identify the blocking objects in the projection area.
[0057] It can be understood that this step is similar to step S101 and will not be described in detail here.
[0058] S302: Perform face recognition on the occluding object, and if the occluding object contains a face, determine the occluding object as an occluding person.
[0059] It can be understood that this step is similar to step S102 and will not be described in detail here.
[0060] S303: performing facial recognition on the obstructing person to obtain the facial expression of the obstructing person, and performing posture recognition on the obstructing person to obtain the body movements of the obstructing person.
[0061] It can be understood that this step is similar to step S103 and will not be described in detail here.
[0062] S304, detecting the stay time of the obstructing person in the projection area, and if the stay time is greater than a preset time threshold, identifying whether the obstructing person is a target person according to the facial expression and the body movement.
[0063] This step specifically includes: Inputting the facial expression into an expression feature extraction module in a preset multimodal feature fusion model to obtain a facial expression feature vector; Inputting the limb movement into the limb movement feature extraction module in the preset multimodal feature fusion model to obtain a limb movement feature extraction module; Performing feature fusion on the facial expression feature vector and the body movement feature vector to obtain a fused feature vector; The fused feature vector is input into a preset target person classifier to obtain a target person probability score; If the target person probability score is greater than a preset threshold, the occluding person is determined to be the target person.
[0064] In these steps, facial expression refers to the emotional state displayed on a person's face, such as smiling, frowning, etc. Body movements refer to the movement states of human limbs and torso, such as waving, nodding, etc. The preset multimodal feature fusion model refers to a pre-trained machine learning model that can process multiple different types of input data. The feature vector is used to represent the mathematical representation form into which the original data is converted. The fused feature vector refers to a new comprehensive feature representation formed by combining multiple feature vectors. The preset target person classifier refers to a pre-trained algorithm model used to determine whether the input data belongs to the target person category. The target person probability score indicates the possibility of the input data being classified as the target person. The preset threshold refers to the judgment standard preset by the system, which is used to determine whether the occluded person is classified as the target person.
[0065] Specifically, after the facial expression and body movement information of the occluded person is obtained, this series of steps is immediately started. First, the facial expression data is input into the expression feature extraction module of the preset multimodal feature fusion model, and the key features are extracted and converted into vectors. At the same time, the body movement data is input into the body movement feature extraction module of the same model, and the features are also extracted and converted into vectors. Next, the two feature vectors are combined into a more comprehensive fused feature vector using a feature fusion algorithm. Then, this fused feature vector is input into the preset target person classifier to calculate a probability score indicating the possibility that the current occluded person is the target person. Finally, this probability score is compared with the preset threshold. If the score exceeds the threshold, the occluded person is judged as the target person, otherwise it is considered not to be the target person.
[0066] In some embodiments, multimodal feature fusion and target person recognition can be achieved in a variety of ways: using a multimodal feature fusion method based on an attention mechanism, including using a pre-trained visual model to process data, applying a cross-attention mechanism, and finally performing weighted summation to obtain a fused feature vector; using an integrated learning method to improve the accuracy of target person recognition, including training multiple different classifiers, inputting the fused feature vector into each classifier, and finally synthesizing the prediction results to obtain the final target person probability score. It is understandable that other methods can also be used to achieve multimodal feature fusion and target person recognition, such as using a graph neural network or an online learning method, which is not limited here.
[0067] S305: If it is a target person, determine the body contour position of the target person in the projection area, and determine the blocked projection area occupied by the body contour position.
[0068] It can be understood that this step is similar to step S205 and will not be described in detail here.
[0069] S306: Adjust the projection parameters of the blocked projection area so that the visibility of the blocked projection area is higher than a preset visibility threshold.
[0070] This step specifically includes: Get the current brightness and contrast value of the occluded projection area; Calculate the current visibility of the blocked projection area according to the current brightness value and the current contrast value; If the current visibility is lower than the preset visibility threshold, the brightness value of the blocked projection area is increased to obtain an optimized brightness value, and the contrast value of the blocked projection area is increased to obtain an optimized contrast value; Calculating the optimized visibility of the blocked projection area according to the optimized brightness value and the optimized contrast value; If the optimized visibility is not lower than the preset visibility threshold, the optimized brightness value and the optimized contrast value are used as new projection parameters of the blocked projection area, and the projection settings of the LCD projector are adjusted according to the new projection parameters.
[0071] Specifically, the blocked projection area refers to the part of the projection picture blocked by the human body. The brightness value indicates the brightness of the projection picture. The contrast value is used to indicate the degree of difference between the brightest part and the darkest part of the picture. Visibility refers to the clarity and recognizability of the projection picture when it is blocked. The preset visibility threshold indicates the minimum acceptable visibility standard preset by the system. The optimized brightness value and the optimized contrast value refer to the new brightness and contrast parameters after adjustment. The new projection parameters are used to indicate the adjusted projection settings, including the optimized brightness value and contrast value. LCD projector refers to a projection device that uses liquid crystal display technology.
[0072] Specifically, when the system detects that the projection area is blocked, it immediately starts to execute this series of steps. First, the system obtains the current brightness value and contrast value of the blocked projection area, which is usually achieved through a built-in optical sensor or image processing algorithm. Then, the system uses a predefined algorithm to calculate the current visibility based on these values. Next, the system compares the calculated visibility with the preset threshold. If it is lower than the threshold, the system will gradually increase the brightness value and contrast value, and recalculate the visibility after each increase until it reaches or exceeds the preset threshold. In this process, the system may use a complex optimization algorithm to balance the increase in brightness and contrast to achieve the best effect. Finally, when the optimized visibility meets the requirements, the system will set the new brightness value and contrast value as the new projection parameters of the blocked projection area and adjust the settings of the LCD projector accordingly.
[0073] In some embodiments, parameter optimization and visibility improvement of the occluded projection area can be achieved in a variety of ways: Optionally, the system can adopt an adaptive optimization method based on machine learning. The specific steps include: first, using a pre-trained neural network model, inputting current brightness value, contrast value, ambient light and other parameters, and predicting the optimal parameter adjustment direction; then, according to the prediction results, gradually adjusting the brightness and contrast, and using the image quality assessment algorithm to calculate the new visibility after each adjustment; finally, when the visibility reaches a preset threshold or the number of adjustments reaches an upper limit, stop the optimization process and apply the best parameters. Optionally, the system can use a multi-region segmented optimization strategy. The specific steps include: first, dividing the occluded projection area into multiple sub-areas, and optimizing parameters for each sub-area separately; then, applying different degrees of brightness and contrast enhancement to each sub-area, while considering the smooth transition between adjacent areas; finally, comprehensively evaluating the visibility of all sub-areas, if the overall visibility reaches the preset threshold, then applying the optimized parameters, otherwise continue to adjust. It can be understood that other methods can also be used to achieve parameter optimization of the occluded projection area, such as using a genetic algorithm to search for the best parameter combination, or combining the human eye visual characteristic model to optimize the parameters, which is not limited here.
[0074] S307: Monitor the blocked projection area in real time to obtain a real-time brightness value and a real-time contrast value of the blocked projection area.
[0075] Real-time monitoring refers to the continuous detection and tracking of the target area. The blocked projection area refers to the area where the human body blocks the projection area of the LCD projector. The real-time brightness value is the brightness and darkness value of the blocked projection area at the current moment. The real-time contrast value is the difference between the bright and dark parts of the blocked projection area at the current moment. The real-time brightness value and real-time contrast value are obtained by analyzing the image of the blocked projection area through image processing algorithms and extracting the corresponding brightness and contrast features.
[0076] Specifically, the system will continuously use cameras or sensors to collect and analyze images of the blocked projection area, and extract the brightness and contrast values of the blocked projection area at certain time intervals (for example, every 100ms). This can be achieved by calculating the histogram distribution and grayscale statistics of each collected image. The system will update these brightness and contrast values in real time to reflect the latest status of the blocked projection area. Continuously monitoring the blocked projection area and obtaining its real-time parameters is a key step in achieving subsequent dynamic adjustment.
[0077] S308: Calculate the real-time visibility of the blocked projection area according to the real-time brightness value and the real-time contrast value.
[0078] Real-time visibility refers to the clarity and recognizability of the occluded projection area at the current moment. Calculating real-time visibility based on real-time brightness and real-time contrast values means using brightness and contrast parameters to evaluate the visibility of the occluded area through a specific algorithm.
[0079] Specifically, the system will input the obtained real-time brightness value and real-time contrast value of the occluded projection area into the preset visibility calculation algorithm. The algorithm can calculate a numerical visibility score or parameter based on the brightness value and contrast value, combined with factors such as ambient lighting and image quality evaluation model. The calculated real-time visibility value can quantitatively indicate the visual effect of the current occluded projection area. The system will update the visibility value in real time. Calculating real-time visibility is a key step in achieving dynamic optimization.
[0080] S309: If it is detected that the real-time visibility is lower than the preset visibility threshold, the current ambient light intensity of the LCD projector is obtained.
[0081] The preset visibility threshold is the minimum acceptable visibility standard of the blocked projection area preset by the system. The current ambient light intensity is the real-time lighting condition of the environment where the LCD projector is located, such as indoor and outdoor, bright and dark, etc. Detecting that the real-time visibility is lower than the threshold and then obtaining the current light intensity is an operation to obtain environmental parameters for dynamic adjustment when it is recognized that the visibility of the blocked projection area is insufficient.
[0082] Specifically, the system will instantly compare the calculated real-time visibility of the obstructed projection area with the preset visibility threshold. If the visibility is lower than the threshold, the detection of ambient light intensity is triggered. This can be achieved by collecting data through the built-in photosensitive sensor of the LCD projector, or by using a camera to obtain images for analysis. After obtaining the data of the current light intensity, the system can dynamically adjust the relevant parameters according to the lighting conditions to improve the visibility of the obstructed area.
[0083] S310: Dynamically adjust the preset visibility threshold according to the current ambient light intensity to obtain an adjusted visibility threshold.
[0084] The current ambient light intensity is the real-time light condition of the environment where the LCD projector is located. The preset visibility threshold is the minimum acceptable visibility standard for the blocked projection area preset by the system. Adjusting the preset visibility threshold is to appropriately modify the originally set visibility standard according to the current light conditions. The adjusted visibility threshold is a new visibility standard that has been dynamically optimized.
[0085] Specifically, the system will dynamically adjust the preset visibility threshold according to the detected current ambient light intensity data. In a strong light environment, the visibility standard can be appropriately lowered due to the limited projection brightness; in a dark light environment, the visibility standard can be increased. The adjustment process can be implemented based on a preset mapping curve or a machine learning model. The adjusted new visibility threshold will replace the original preset value for subsequent visibility judgment, thereby achieving adaptive optimization.
[0086] S311. Compare the real-time visibility with the adjusted visibility threshold.
[0087] The real-time visibility is the visibility status of the current occluded projection area. Comparing the real-time visibility with the adjusted visibility threshold is an operation to determine whether the optimized visibility standard is met.
[0088] Specifically, the system will compare the calculated real-time visibility value of the occluded projection area with the new visibility threshold obtained in the previous step to see whether the current real-time visibility is higher than the new threshold. If it is higher, it means that the current visibility has met the requirements; if it is still lower than the new threshold, further adjustment of parameters is required to improve visibility. This comparison process can be performed in real time to determine whether the effect of parameter adjustment meets the requirements.
[0089] S312: If the real-time visibility is still lower than the adjusted visibility threshold, re-execute the step of adjusting the projection parameters of the blocked projection area until the real-time visibility is greater than or equal to the adjusted visibility threshold.
[0090] Projection parameter adjustment refers to changing the brightness, contrast and other parameters of the blocked projection area. This step means that if the comparison finds that the real-time visibility is still lower than the adjusted threshold requirement, the system needs to perform the process of adjusting the projection parameters again and continue to adjust until the real-time visibility improves and meets the new threshold requirement.
[0091] Specifically, if the visibility comparison result shows that the real-time visibility is still below the new threshold, the system will re-execute the process of adjusting the parameters of the occluded projection area. This usually includes continuing to increase the brightness, contrast, etc., in order to further improve visibility. The adjustment process is a closed-loop control. After each adjustment, the real-time visibility is calculated and compared, and it is continuously iterated until the standard is met. The implementation method can be to gradually increase the adjustment amplitude, or use a search algorithm to find the best parameter combination. When the visibility meets the new threshold requirement, the adjustment is completed, otherwise a new round of adjustment continues, and so on.
[0092] S313, determining the position ratio of the blocked projection area in the projection area, and determining the image position in the current image played by the LCD projector according to the position ratio; This step specifically includes: Obtain the boundary coordinates of the blocked projection area, the boundary coordinates of the projection area, and the resolution of the current playback image of the LCD projector; According to the boundary coordinates of the blocked projection area and the boundary coordinates of the projection area, the horizontal position ratio and the vertical position ratio of the blocked projection area in the projection area are calculated. Calculate the screen pixel coordinate range corresponding to the blocked projection area according to the horizontal position ratio, the vertical position ratio and the resolution; According to the picture pixel coordinate range, a picture position corresponding to the blocked projection area is determined in the current playing picture.
[0093] In these steps, the blocked projection area refers to the portion of the projection screen blocked by the object. The boundary coordinates represent the position and range of a certain area in space. The projection area refers to the entire area where the projector can project the screen. Resolution is used to represent the number of pixels in a digital image, usually expressed as the number of horizontal pixels multiplied by the number of vertical pixels. The horizontal position ratio and the vertical position ratio refer to the relative position of the blocked area in the entire projection area. The screen pixel coordinate range represents the pixel position corresponding to the blocked area in the digital image. The current playback screen refers to the image content being displayed by the projector.
[0094] Specifically, when the system detects that the projection area is blocked, it immediately starts to execute this series of steps. First, the system obtains the boundary coordinates of the blocked projection area and the entire projection area, which may be achieved through optical sensors or image processing algorithms. At the same time, the system also obtains the resolution information of the current playback screen. Next, the system uses mathematical calculation methods to calculate the relative position of the blocked area in the entire projection area based on the boundary coordinates of the two areas, and obtains the position ratio in the horizontal and vertical directions. This calculation process may involve coordinate system conversion and normalization processing. Then, the system combines these position ratios with the current picture resolution, and obtains the pixel coordinate range corresponding to the blocked area in the digital image through proportional conversion. This step may need to consider factors such as projection distortion and correction. Finally, the system accurately locates the picture position corresponding to the blocked area in the currently playing digital image based on the calculated pixel coordinate range. This positioning process may also need to consider factors such as image scaling and cropping to ensure the accuracy of positioning.
[0095] In some embodiments, the positioning and mapping of the occluded area can be achieved in a variety of ways: Optionally, the system can adopt a three-dimensional space mapping method based on a depth camera. The specific steps include: first, using a depth camera to capture the three-dimensional point cloud data of the projection area, including the occluded object and the projection surface; then, using the point cloud segmentation algorithm to identify the outline of the occluded object, and calculate its precise position and shape in the three-dimensional space; finally, using the projection matrix to map the occluded area in the three-dimensional space to the two-dimensional image plane to obtain the corresponding pixel coordinate range. Optionally, the system can use a real-time tracking method based on computer vision. The specific steps include: first, embedding invisible markers or feature patterns in the projection screen; then, using a high-speed camera to capture the projection screen in real time, and detecting the position changes of these markers through an image processing algorithm; finally, according to the deformation and occlusion of the markers, the accurate position and range of the occluded area are calculated. It can be understood that other methods can also be used to achieve the positioning and mapping of the occluded area, such as using a collaborative positioning system of multiple projectors and cameras, or combining a human posture estimation algorithm for more accurate occlusion prediction, which is not limited here.
[0096] S314: Detect whether there is text content or graphic content at the position of the picture.
[0097] Screen position refers to the position in the LCD projector playback screen that corresponds to the blocked projection area. Text content refers to the text or characters existing at the screen position. Graphic content refers to the graphic or picture elements at the screen position. Detecting whether there is text or graphic content at the screen position means analyzing the display content at the position to determine whether it contains text or graphic information.
[0098] Specifically, the system will first determine the pixel area of the corresponding screen position based on the position ratio of the blocked projection area in the entire projection screen. Then, the image processing algorithm is used to analyze the screen position to detect whether the area contains text or graphic information. For example, OCR technology is used to recognize text, and edge detection, feature matching, etc. are used to determine graphic elements. Finally, if text or graphics are detected at the screen position, it is confirmed that the position needs to be prioritized to ensure clarity.
[0099] S315: If yes, adjust the projection parameters of the blocked projection area so that the visibility of the blocked projection area is higher than a preset visibility threshold.
[0100] Projection parameter adjustment refers to changing the brightness, contrast and other parameters of the occluded projection area. Improving visibility means making the image in the occluded area clearer and more recognizable. The preset visibility threshold is the defined minimum acceptable visibility.
[0101] If text or graphic content is detected in the image position, the system will start the process of adjusting the parameters of the occluded projection area, with the goal of making the visibility of the area higher than the preset visibility threshold. The adjustment process involves gradually increasing the brightness and contrast of the occluded area while calculating the visibility of the area. When the visibility reaches or exceeds the preset threshold, the adjustment process ends. This ensures that the occluded projection area where the text or graphic content is located is displayed clearly and recognizable. The specific implementation method can be to use image enhancement algorithms to optimize for text and graphics, or to use machine learning models to predict the best parameter combination.
[0102] In some embodiments, after step S215, the method further includes: if the occluding object is identified as a non-human occluding object, performing shape analysis and size measurement on the non-human occluding object to obtain contour information and size data of the non-human occluding object; According to the contour information and the size data, it is determined whether the non-human blocking object is a movable object.
[0103] If it is determined to be a movable object, a removal instruction is issued to the user, and the removal instruction is in the form of an audio or visual prompt.
[0104] Specifically, contour information refers to the outer shape boundary of non-human occluded objects obtained through image analysis. Dimensional data refers to the size parameters of the occluded objects obtained by measurement. Movable objects refer to objects that can be moved by human power. Determining whether an object is movable is to infer its possibility of movement based on the characteristics of the object.
[0105] Specifically, the system will first extract the outline of the obstructing object and measure its length, width, height and other data. Then, based on these outline and size information, combined with the object database, the system determines the category of the non-human obstructing object. For lightweight or small objects, the system can infer that they are movable. On the contrary, for fixed or oversized objects, they are judged to be immovable. The outline and size features support the judgment of the mobility properties of the object.
[0106] If it is determined to be a movable object, a removal instruction is issued to the user, and the removal instruction is in the form of an audio or visual prompt.
[0107] The removal instruction is a prompt message to remind the user to remove the obstructing object. The audio prompt can be a voice broadcast. The visual prompt can be text, icons, etc. displayed on the screen. This step means that if it is determined that the obstructing object can be removed, the system will use a prompt sound or a screen prompt to notify the user to remove the movable obstructing object.
[0108] Specifically, when it is determined that the blocking object can be removed, the system will send a removal prompt to the user who is using it. This can be a voice prompt of "Please remove the blocking object" or a text or icon prompt that suddenly appears above the screen. The purpose is to attract the user's attention and remind them to remove the movable object to eliminate the projection occlusion. The prompt method should be obvious and not interrupt the user experience. Sending a removal prompt can effectively encourage users to actively eliminate the projection block and improve the projection effect.
[0109] The LCD projector in the embodiment of the present invention is described below from the perspective of hardware processing. Figure 4 , is a schematic diagram of a physical device structure of an LCD projector in an embodiment of the present application.
[0110] It should be noted that Figure 4 The structure of the LCD projector shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.
[0111] like Figure 4As shown, the LCD projector includes a central processing unit (CPU) 401, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 402 or the program loaded from the storage part 408 to the random access memory (RAM) 403, such as executing the method described in the above embodiment. In RAM403, various programs and data required for system operation are also stored. CPU401, ROM402 and RAM403 are connected to each other through bus 404. Input / output (I / O) interface 405 is also connected to bus 404.
[0112] The following components are connected to the I / O interface 405: an input section 406 including an audio input device, a button switch, etc.; an output section 407 including a liquid crystal display (LCD) and an audio output device, an indicator light, etc.; a storage section 408 including a hard disk, etc.; and a communication section 409 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 409 performs communication processing via a network such as the Internet. A drive 410 is also connected to the I / O interface 405 as needed. A removable medium 411, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 410 as needed so that a computer program read therefrom is installed into the storage section 408 as needed.
[0113] In particular, according to an embodiment of the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present invention includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication part 409, and / or installed from a removable medium 411. When the computer program is executed by the central processing unit (CPU) 401, various functions defined in the present invention are performed.
[0114] It should be noted that specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus, or device.
[0115] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present invention. Each box in the flowchart or block diagram may represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions marked in the box may also occur in an order different from that marked in the accompanying drawings.
[0116] Specifically, the LCD projector of this embodiment includes a processor and a memory. The memory stores a computer program. When the computer program is executed by the processor, the display method based on the LCD projector provided in the above embodiment is implemented.
[0117] As another aspect, the present invention further provides a computer-readable storage medium, which may be included in the LCD projector described in the above embodiment; or may exist independently without being assembled into the LCD projector. The above storage medium carries one or more computer programs, and when the above one or more computer programs are executed by a processor of the LCD projector, the LCD projector implements the display method based on the LCD projector provided in the above embodiment.
[0118] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
[0119] As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrases "upon determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)", depending on the context.
[0120] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.
Claims
1. A display method based on an LCD projector, characterized in that: Applied to an LCD projector, the method comprises: Detecting the projection area of the LCD projector and identifying obstructing objects in the projection area; Performing face recognition on the occluding object, and if the occluding object contains a face, determining the occluding object as an occluding person; Performing facial recognition on the obstructed person to obtain the facial expression of the obstructed person, and performing posture recognition on the obstructed person to obtain the body movements of the obstructed person; Detecting the stay time of the obstructing person in the projection area, and if the stay time is greater than a preset time threshold, identifying whether the obstructing person is a target person according to the facial expression and the body movement; If the target person is a target person, then determining the body contour position of the target person in the projection area, and determining the blocked projection area occupied by the body contour position; The projection parameters of the blocked projection area are adjusted so that the visibility of the blocked projection area is higher than a preset visibility threshold.
2. The method according to claim 1, characterized in that The step of identifying whether the obstructing person is a target person according to the facial expression and the body movement specifically includes: Inputting the facial expression into an expression feature extraction module in a preset multimodal feature fusion model to obtain a facial expression feature vector; Inputting the limb movement into the limb movement feature extraction module in the preset multimodal feature fusion model to obtain a limb movement feature extraction module; Performing feature fusion on the facial expression feature vector and the body movement feature vector to obtain a fused feature vector; Inputting the fused feature vector into a preset target person classifier to obtain a target person probability score; If the target person probability score is greater than a preset threshold, the obstructing person is determined to be the target person.
3. The method according to claim 1, characterized in that The step of adjusting the projection parameters of the shielded projection area so that the visibility of the shielded projection area is higher than a preset visibility threshold specifically includes: Obtaining the current brightness value and contrast value of the blocked projection area; Calculating the current visibility of the blocked projection area according to the current brightness value and the contrast value; If the current visibility is lower than the preset visibility threshold, the brightness value of the blocked projection area is increased to obtain an optimized brightness value, and the contrast value of the blocked projection area is increased to obtain an optimized contrast value; Calculating the optimized visibility of the blocked projection area according to the optimized brightness value and the optimized contrast value; If the optimized visibility is not lower than the preset visibility threshold, the optimized brightness value and the optimized contrast value are used as new projection parameters of the blocked projection area, and the projection settings of the LCD projector are adjusted according to the new projection parameters.
4. The method according to claim 1, characterized in that After the step of adjusting the projection parameters of the shielded projection area so that the visibility of the shielded projection area is higher than a preset visibility threshold, the method further includes: Performing real-time monitoring on the blocked projection area to obtain a real-time brightness value and a real-time contrast value of the blocked projection area; Calculating the real-time visibility of the blocked projection area according to the real-time brightness value and the real-time contrast value; If it is detected that the real-time visibility is lower than the preset visibility threshold, obtaining the current ambient light intensity of the LCD projector; Dynamically adjusting the preset visibility threshold according to the current ambient light intensity to obtain an adjusted visibility threshold; comparing the real-time visibility with the adjusted visibility threshold; If the real-time visibility is still lower than the adjusted visibility threshold, the step of adjusting the projection parameters of the blocked projection area is re-executed until the real-time visibility is greater than or equal to the adjusted visibility threshold.
5. The method according to claim 1, characterized in that After the steps of determining the human body contour position of the target person in the projection area and determining the blocked projection area occupied by the human body contour position, the method further includes: Determine the position ratio of the blocked projection area in the projection area, and determine the image position in the current image played by the LCD projector according to the position ratio; Detecting whether there is text content or graphic content at the position of the picture; If it exists, the projection parameters of the blocked projection area are adjusted so that the visibility of the blocked projection area is higher than a preset visibility threshold.
6. The method according to claim 5, characterized in that The step of determining the position ratio of the blocked projection area in the projection area, and determining the image position in the current image played by the LCD projector according to the position ratio specifically includes: Obtaining the boundary coordinates of the blocked projection area, the boundary coordinates of the projection area, and the resolution of the current playback image of the LCD projector; Calculate the horizontal position ratio and the vertical position ratio of the blocked projection area in the projection area according to the boundary coordinates of the blocked projection area and the boundary coordinates of the projection area. Calculating a screen pixel coordinate range corresponding to the blocked projection area according to the horizontal position ratio, the vertical position ratio and the resolution; According to the screen pixel coordinate range, a screen position corresponding to the blocked projection area is determined in the current playing screen.
7. The method according to claim 6, characterized in that After the step of adjusting the projection parameters of the shielded projection area so that the visibility of the shielded projection area is higher than a preset visibility threshold, the method further includes: If the occluding object is identified as a non-human occluding object, shape analysis and size measurement are performed on the non-human occluding object to obtain contour information and size data of the non-human occluding object; Determining whether the non-human occluding object is a movable object according to the contour information and the size data; If it is determined to be a movable object, a removal instruction is issued to the user, and the removal instruction is in the form of an audio or visual prompt.
8. An LCD projector, characterized in that: The LCD projector comprises: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code comprises computer instructions, and the one or more processors call the computer instructions to make the LCD projector execute the method as described in any one of claims 1-7.
9. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an LCD projector, the LCD projector is caused to execute the method according to any one of claims 1 to 7.
10. A computer program product, characterized in that When the computer program product is run on an LCD projector, the LCD projector is enabled to execute the method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Control method of projection terminal and apparatus thereof
CN107295320A
Avoiding dazzling of persons by a light source
CN111355940A
Display method of projection picture and laser projection equipment
CN112954285A
Image stitching of full field of view reference images
CN117372250A
Method and device for correlating data
JP2011211687A
Cited By
Projection adjustment method and system for synchronously acquiring projection image
CN121217904A