Information display system for engineering project management

Abstract

The invention provides an information display system for engineering project management. The information display system comprises a scene analysis module, a control module and a display module, wherein the scene analysis module is used for analyzing an image in front of the display module and analyzing a current display scene; the control module calls the display strategy and the display data according to the current display scene and controls the display module to display according to the display strategy and the display data; wherein the current display scene comprises multi-person display; the display data comprises corresponding interested content of each viewer; the display strategy comprises displaying the corresponding interested content of each viewer to the position of the sight direction. According to the information display system for engineering project management, the current display scene is analyzed, different contents are displayed according to the scene, the display contents are enriched, and contents concerned by different persons can be displayed according to different viewers.

Description

Technical Field

[0001] The present invention relates to the technical field of human-computer interaction, and in particular to an information display system oriented to engineering project management. Background Art

[0002] In order to intuitively display the construction target value and progress, a project progress management display device is generally used to facilitate the control and management of the construction progress;

[0003] However, the existing project progress management device requires staff to manually replace the schedule. Since the project construction progress changes very quickly, the manual replacement of the schedule will result in untimely replacement and updating of the schedule, which will make it impossible for staff to accurately manage the progress of the project, and in serious cases, it will affect the construction period.

[0004] The existing CN114974012B project progress management device for construction project management discloses that the display device can also be applied to projects such as power engineering, but its method of replacing the schedule still adopts a mechanical structure, that is, the schedule is printed out and then replaced with the old one by an automatic replacement device; its display content is only for the schedule, and it is unable to display richer content, and therefore it is unable to display content that different viewers are concerned about according to different viewers. Summary of the invention

[0005] One of the purposes of the present invention is to provide an information display system for engineering project management, which analyzes the current display scene and displays different contents according to the scene, thereby enriching the display content and being able to display contents of interest to different viewers.

[0006] An information display system for engineering project management provided by an embodiment of the present invention includes: a scene analysis module, a control module and a display module;

[0007] Among them, the scene analysis module analyzes the image in front of the display module to analyze the current display scene; the control module calls the display strategy and display data according to the current display scene and controls the display module to display according to the display strategy and display data;

[0008] Among them, the current display scene includes multi-person display; the display data includes: the content that each viewer is interested in; the display strategy includes: displaying the content that each viewer is interested in to a position in the direction of sight.

[0009] Preferably, the display module includes: a large-screen display.

[0010] Preferably, the scene analysis module includes: a camera and an image processor.

[0011] Preferably, the analysis step of the current display scene includes:

[0012] Extracting the human body contours, the facial areas of the human body contours, and the sight lines corresponding to each human body contour in the image;

[0013] When the human body contour is not extracted, the current display scene is determined to be a static display;

[0014] When a human body outline is extracted and the facial area in the human body outline where the sight line falls on the display module is identified as not being a project-related person, the current display scene is determined to be a static display.

[0015] Preferably, the current display scene is a static display, and the display strategy is a static display; the display data includes: a pre-configured engineering project introduction page.

[0016] Preferably, the analysis step of the current display scene also includes:

[0017] When the human body contour is extracted and the facial areas in the human body contour whose sight direction falls on the display module are all identified as engineering-related personnel, and the number of engineering-related personnel is greater than one, it is determined that the current display scene is a multi-person display.

[0018] Preferably, the analysis step of the current display scene also includes:

[0019] When a human body outline is extracted and the facial area in the human body outline whose sight direction falls on the display module is identified as engineering-related personnel and the number of engineering-related personnel is one, it is determined that the current display scene is a single-person display.

[0020] Preferably, the display strategy corresponding to the single-person display is dynamic display; the display data is retrieved based on the work number of the project-related personnel.

[0021] Preferably, the analysis step of the current display scene also includes:

[0022] When a human body outline is extracted and the facial area in the human body outline falling on the display module is not all identified as engineering-related personnel, and the number of engineering-related personnel is one, it is determined that the current display scene is a mixture of single-person display and static display;

[0023] When a human body outline is extracted and the facial area in the human body outline whose sight direction falls on the display module is recognized to be not all engineering-related personnel and the number of engineering-related personnel is greater than one, it is determined that the current display scene is a mixture of multi-person display and static display.

[0024] Preferably, the display strategy for the mixed display of single person and static display or the mixed display of multiple people and static display is to perform the single person display or the multiple people display by floating with the pre-configured project introduction page as the base.

[0025] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description and the accompanying drawings.

[0026] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0028] Figure 1 A schematic diagram of an information display system for engineering project management according to an embodiment of the present invention;

[0029] Figure 2 It is a schematic diagram of another information display system for engineering project management in an embodiment of the present invention;

[0030] Figure 3 Schematic diagram of the steps of association analysis in an embodiment of the present invention. DETAILED DESCRIPTION

[0031] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0032] The embodiment of the present invention provides an information display system for engineering project management. Figure 1 As shown, it includes: a scene analysis module 1, a control module 2 and a display module 3;

[0033] Among them, the scene analysis module 1 analyzes the image in front of the display module to analyze the current display scene; the control module 2 retrieves the display strategy and display data according to the current display scene and controls the display module 3 to display according to the display strategy and display data;

[0034] Among them, the current display scene includes multi-person display; the display data includes: the content that each viewer is interested in; the display strategy includes: displaying the content that each viewer is interested in to a position in the direction of sight.

[0035] Among them, the display module includes: a large-screen display.

[0036] Among them, the scene analysis module includes: a camera and an image processor.

[0037] Among them, the analysis steps of the current display scene include:

[0038] Extracting the human body contours, the facial areas of the human body contours, and the sight lines corresponding to each human body contour in the image;

[0039] When the human body contour is not extracted, the current display scene is determined to be a static display;

[0040] When a human body outline is extracted and the facial area in the human body outline where the sight line falls on the display module is not recognized as an engineering-related person, the current display scene is determined to be a static display;

[0041] When the human body contour is extracted and the facial area in the human body contour where the sight line falls on the display module is identified as all engineering-related personnel, and the number of engineering-related personnel is greater than one, it is determined that the current display scene is a multi-person display;

[0042] When a human body outline is extracted, and the facial area in the human body outline falling on the display module is identified as all engineering-related personnel, and the number of engineering-related personnel is one, it is determined that the current display scene is a single-person display;

[0043] When a human body outline is extracted and the facial area in the human body outline falling on the display module is not all identified as engineering-related personnel, and the number of engineering-related personnel is one, it is determined that the current display scene is a mixture of single-person display and static display;

[0044] When a human body outline is extracted and the facial area in the human body outline whose sight direction falls on the display module is recognized to be not all engineering-related personnel and the number of engineering-related personnel is greater than one, it is determined that the current display scene is a mixture of multi-person display and static display.

[0045] The current display scene is a static display, and the display strategy is a static display; the display data includes: a pre-configured project introduction page.

[0046] The display strategy corresponding to single-person display is dynamic display; the display data is retrieved based on the work number of the project-related personnel.

[0047] The display strategy for a mixture of single-person display and static display or a mixture of multi-person display and static display is to use the pre-configured project introduction page as the base plate (background) to suspend the single-person display or multi-person display.

[0048] The working principle and beneficial effects of the above technical solution are:

[0049] The information display system for engineering project management of the present invention comprehensively analyzes the number of people in front of the large-screen display, the identities of the people, and the sight lines of the people to determine the current display scene; different display strategies are adopted for different display scenes; in addition, different display contents are displayed according to different people, which enriches the display content and can display the contents of interest to different people according to different viewers. The contents of interest to each person are configured in the system according to their identities. For example, when a person is a construction worker, the contents of interest are configured as the work schedule for the day and / or the work schedule for tomorrow, and the position of the person in the work schedule is highlighted and displayed in the center of the area; when the person is the person in charge, the contents of interest are configured as the project schedule, etc.

[0050] When extracting the human body contour, it is necessary to query the pre-configured allowable size threshold range determination table according to the position of the center of the human body contour in the image to determine the allowable threshold range to screen the human body contour, so as to eliminate interference factors such as people and children who are far away from the display module, thereby improving the accuracy of display control; wherein, the allowable threshold range is the allowable range of pixels occupied in the width and length directions of the human body contour;

[0051] Among them, the step of determining whether the sight line direction corresponding to the human body contour falls on the display module includes: calling the sight line angle determination library corresponding to the position according to the position of the human body contour; extracting features of the human body contour and constructing a first analysis parameter set based on the extracted contour features; calling the first angle range from a pre-configured first angle range determination library according to the first analysis parameter set; extracting the facial area of ​​the human body contour to obtain the facial area; extracting features of the facial area and constructing a second analysis parameter set, calling the second angle range from a pre-configured second angle range determination library according to the second analysis parameter set; using the intersection of the second angle range and the second angle range as the interval range where the sight line angle corresponding to the human body contour is located; when the ratio of the part of the interval range where the sight line angle is located that falls in the verification interval corresponding to the position of the human body contour (the verification interval is composed of all angles at which the sight line of this position falls on the display module) to the interval range is greater than a preset ratio (0.5 to 1), it is determined that the sight line direction falls on the display module. Among them, the parameters in the first analysis parameter set include: parameters representing the height of the human body contour, parameters representing the shoulder width in the human body contour, parameters representing the hand length in the human body contour, parameters representing the head length in the human body contour, etc.; the first angle range determination library is constructed in advance by professionals for point analysis corresponding to each position in the image, and the first analysis parameter set in the first angle range determination library is correspondingly associated with the first angle range; the parameters in the second analysis parameter set include: parameters representing the area size of the facial area, parameters representing the coordinates of the nose tip, parameters representing the distance between the two eyes, parameters representing the coordinates of the center point between the two eyebrows, etc.; the second angle range determination library is constructed in advance by professionals for point analysis corresponding to each position in the image, and the second analysis parameter set in the second angle range determination library is correspondingly associated with the second angle range.

[0052] During the display module display process, there will be situations where a leader inspects or receives a customer. No matter if there are multiple people or one person accompanying them, it is determined that the display is not applicable to the current scenario. In one embodiment, Figure 2 As shown, the information display system for engineering project management also includes: a correlation analysis module 4, which is used to analyze the correlation between various human body contours to facilitate the correlation display of the control module;

[0053] Among them, Figure 3 As shown, the association analysis module 4 performs the following operations:

[0054] Step 1: Correlate the time when each human body contour first appears in the image as an analysis group;

[0055] First, it is necessary to analyze the time when the leaders inspect or receive customers to exclude the time when most workers can appear in front of the display device. Therefore, it is necessary to limit the appearance of each human body contour outside the preset time period (half an hour before the construction workers start work to the start time, the end time to half an hour after the end time, the lunch break, etc.). When the difference in the appearance time between two human body contours is less than or equal to the preset time threshold (any value from 10 seconds to 2 minutes), these human body contours can be associated as an analysis group;

[0056] Step 2: Identify the person corresponding to the human body contour in the analysis group;

[0057] In the inspection scene or the reception scene of the customer, there are usually engineering-related staff accompanying, so the identity of the personnel in the analysis group is identified to determine whether there are engineering-related staff in the analysis group;

[0058] Step 3: when there is no person in the preset reception staff database, determine that there is no correlation between the human body contours in the analysis group;

[0059] When leaders inspect or receive customers, they are usually accompanied by engineering-related staff. A reception staff database is configured in the system in advance, and the reception staff database stores the accompanying personnel. If no recognition is made, it means that the correlation analysis module is not the one that wants to be analyzed, and it can be determined that there is no correlation between the human body contours.

[0060] Step 4: When there are personnel in the preset reception personnel database, the non-engineering related personnel in the analysis group are arranged in the order of the time when they first appeared in the image to form an analysis queue;

[0061] Generally speaking, the reception targets are engineering-related personnel not stored in the system, so there is no need to further analyze whether the relevant staff are core personnel;

[0062] Step 5: sequentially extracting the human body contours of the people in the analysis queue from the time they first appear in the image to the time they stop moving, as behavior analysis data;

[0063] By analyzing the images of a series of human body contour areas in the image where the person enters, their behavior can be analyzed; in this way, by analyzing their behavior, it can be indirectly determined whether they are the core person of the reception, and targeted display can be achieved;

[0064] Step 6: Analyze the core person based on the behavioral analysis data;

[0065] The specific analysis steps are as follows: extract features from the behavior analysis data, construct an analysis parameter set based on the extracted features, and retrieve the corresponding possibility value from the pre-configured possibility value library based on the analysis parameter set; then determine the weight coefficient corresponding to the analysis queue order based on the pre-configured weight coefficient table; take the person with the largest product of the weight coefficient and the possibility value as the core person; among which, the parameters in the analysis parameter set include: parameters indicating the time the gaze falls on other people, parameters indicating clothing characteristics, parameters indicating whether conversations have occurred with other people and the time of the conversation, etc.; the possibility values ​​in the possibility value library are associated with the analysis parameter set in a one-to-one correspondence; the weight coefficient table is configured with weight coefficients corresponding to each order, and the weight coefficient of the earlier order is greater than the weight coefficient of the later order.

[0066] Step 7: associate other non-engineering related personnel whose distance to the core person is within the preset distance threshold as accompanying personnel; associate engineering related personnel whose distance to the core person is within the preset distance threshold as accompanying personnel;

[0067] Among them, the distance threshold is any value between 1 meter and 5 meters; by grouping and analyzing the personnel and then associating them, the control module displays the corresponding pre-configured display data (slide presentation document) of the highest authority engineering-related personnel among the associated personnel, combined with the explanation of the explainer among the accompanying personnel, to better present the project situation to customers or leaders.

[0068] In order to take into account both energy conservation and display functions, in one embodiment, the information display system for engineering project management further includes: a sleep module, which is used to analyze the situation in front of the display module and determine whether to enter the sleep mode or activate the display; in the sleep mode, the display module is controlled not to display; in the activated display mode, the display module is controlled to display;

[0069] The steps for the dormant module to analyze the situation before the display module are as follows:

[0070] When no human body outline is recognized in the image, timing is performed, and when the timing reaches the sleep threshold, the sleep mode is entered;

[0071] In the sleep mode, when a human body outline is recognized in the image, the behavior of the human body outline is analyzed, and whether to enter the activation display is determined based on the analysis result;

[0072] Among them, the behavioral analysis of human body contours includes:

[0073] Determine whether to point to the display module according to the moving direction of the position at the previous moment and the next moment; enter the activation display mode when pointing to it, otherwise, do not enter;

[0074] and / or,

[0075] It is determined whether the proportion of time that the human body contour's sight falls on the display module during movement is greater than a preset proportion threshold; if so, the activation display mode is entered, otherwise, it is not entered.

[0076] By comprehensively analyzing the sight and the moving direction, the intention of the person corresponding to the human body outline can be judged more accurately, and the sight can be used to improve the accuracy of the judgment of activating the dormant state. Among them, the time proportion is the ratio of the time when the sight falls on the display module to the total moving time, and the time proportion judgment is performed only when the total moving time is greater than the preset time (any value from 10 seconds to 1 minute).

[0077] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. An information display system for engineering project management, characterized in that: include: Scenario analysis module, control module and display module; Among them, the scene analysis module analyzes the image in front of the display module to analyze the current display scene; the control module calls the display strategy and display data according to the current display scene and controls the display module to display according to the display strategy and display data; Among them, the current display scene includes multi-person display; the display data includes: the content that each viewer is interested in; the display strategy includes: displaying the content that each viewer is interested in to a position in the direction of sight.

2. The information display system for engineering project management according to claim 1, characterized in that: The display module includes: a large-screen display.

3. The information display system for engineering project management according to claim 1, characterized in that: The scene analysis module includes: a camera and an image processor.

4. The information display system for engineering project management according to claim 1, characterized in that: The analysis steps for the current display scenario include: Extracting the human body contours, the facial areas of the human body contours, and the sight lines corresponding to each human body contour in the image; When the human body contour is not extracted, the current display scene is determined to be a static display; When a human body outline is extracted and the facial area in the human body outline where the sight line falls on the display module is identified as not being a project-related person, the current display scene is determined to be a static display.

5. The information display system for engineering project management as claimed in claim 4, characterized in that: If the current display scene is static display, the display strategy is static display; Display data includes: pre-configured project introduction page.

6. The information display system for engineering project management as claimed in claim 4, characterized in that: The analysis steps of the current display scenario also include: When the human body contour is extracted and the facial areas in the human body contour whose sight direction falls on the display module are all identified as engineering-related personnel, and the number of engineering-related personnel is greater than one, it is determined that the current display scene is a multi-person display.

7. The information display system for engineering project management according to claim 4, characterized in that: The analysis steps of the current display scenario also include: When a human body outline is extracted and the facial area in the human body outline whose sight direction falls on the display module is identified as engineering-related personnel and the number of engineering-related personnel is one, it is determined that the current display scene is a single-person display.

8. The information display system for engineering project management according to claim 7, characterized in that: The display strategy corresponding to single-person display is dynamic display; the display data is retrieved based on the work number of the project-related personnel.

9. The information display system for engineering project management according to claim 4, characterized in that: The analysis steps of the current display scenario also include: When a human body outline is extracted and the facial area in the human body outline falling on the display module is not all identified as engineering-related personnel, and the number of engineering-related personnel is one, it is determined that the current display scene is a mixture of single-person display and static display; When a human body outline is extracted and the facial area in the human body outline whose sight direction falls on the display module is recognized to be not all engineering-related personnel and the number of engineering-related personnel is greater than one, it is determined that the current display scene is a mixture of multi-person display and static display.

10. The information display system for engineering project management as claimed in claim 9, characterized in that: The display strategy for a mixture of single-person display and static display or a mixture of multi-person display and static display is to use the pre-configured project introduction page as the base for floating single-person display or multi-person display.

Images