Industrial park digital twin scene configuration method and system

Abstract

The invention relates to the field of digital twinning, and discloses an industrial park digital twinning scene configuration method comprising the following steps: collecting video data in an industrial park; creating and updating a three-dimensional model of the industrial park in real time; configuring other three-dimensional models of the area of the device within the three-dimensional model to be transparent; changing the style of the three-dimensional model of the abnormal equipment; and generating a digital twin video stream and sending the digital twin video stream to a monitoring end. According to the invention, a virtual digital twin three-dimensional model is constructed by using video data in a live broadcast form or a multi-segment video form acquired in real time, and in order to facilitate monitoring of the operation condition of equipment, the style of an abnormal three-dimensional model in the three-dimensional model is changed, so that the operation condition of the equipment is monitored. Therefore, the monitoring end can observe whether the monitoring end is abnormal or not more intuitively and visually. According to the invention, fusion of the industrial park and digital twinning can be better optimized, and equipment monitoring and industrial park monitoring are facilitated.

Description

Technical Field

[0001] The present invention relates to the field of digital twins, and in particular to a method for configuring digital twin scenarios in an industrial park by using digital twins to manage industrial equipment data. Background Art

[0002] In industrial parks, managing and monitoring the operating status of various facilities and equipment is a complex task. Traditional management methods often lack real-time and accuracy, making it difficult to achieve efficient management and optimal allocation of various resources in the park.

[0003] Digital Twin is a new technology that combines the physical world with the virtual world based on digital technology. It creates corresponding virtual entities by digitally modeling physical entities, thereby achieving seamless connection between the physical world and the virtual world. Digital Twin technology uses a variety of technical means, such as sensors, the Internet of Things (IoT), big data, artificial intelligence (AI), machine learning (ML), etc., to fully digitally replicate and simulate objects, processes or systems in the real world to achieve precise control and optimization of the real world.

[0004] The digital twin scene configuration system aims to achieve refined management and optimized configuration of various facilities and equipment within the park through virtual simulation and real-time monitoring.

[0005] Traditional digital twins rely solely on image scanning, synthesis, modeling, and virtual scene display, which cannot provide more useful value.

[0006] At present, how to better monitor equipment in industrial parks through digital twin technology is still a technical problem that needs to be urgently solved in the industry.

[0007] Therefore, there is a need to provide an industrial park digital twin scene configuration method that can better monitor the equipment in the industrial park through digital twin technology. Summary of the invention

[0008] The technical problem to be solved by the present invention is to provide an industrial park digital twin scene configuration method that can better monitor the equipment in the industrial park through digital twin technology.

[0009] The present invention provides a method for configuring a digital twin scene of an industrial park, comprising:

[0010] S100, collecting video data and equipment operation data in the industrial park, wherein the image data includes park environment video data and equipment video data;

[0011] S200, creating and updating a three-dimensional model of the industrial park in real time according to the video data;

[0012] S300, collecting the observation coordinate vector of the monitoring terminal, generating a field of view range frame according to the observation coordinate vector, determining whether there is a device in the three-dimensional model within the field of view range frame, and if so, configuring other three-dimensional models in the area of ​​the device within the three-dimensional model to be transparent;

[0013] S400, determining whether the operation data of the device is abnormal, and if so, changing the style of the three-dimensional model of the abnormal device;

[0014] S500: Generate a digital twin video stream based on the three-dimensional model and the field of view range frame and send it to the monitoring end.

[0015] The present invention provides a method for configuring a digital twin scene of an industrial park, wherein the step S300 configures other three-dimensional models of the area of ​​the device in the three-dimensional model to be transparent, including:

[0016] S311, obtaining a motion trajectory of the device in a first unit time, taking the maximum coordinate position of the motion trajectory of the device to construct a device trajectory model;

[0017] S312, using the outer edge of the device trajectory model that appears in the field of view range as the cutting surface and using the observation coordinate vector as the stretching direction to construct a transparent model;

[0018] S313: Make the part of the three-dimensional model that intersects with the transparent model transparent.

[0019] The present invention provides a method for configuring a digital twin scene of an industrial park, wherein S400 includes:

[0020] Determine whether the equipment operation data is abnormal. If so, determine whether there is a control abnormality in the equipment operation data. If there is a control abnormality, make the three-dimensional model within the first range of the equipment trajectory model transparent; determine whether there is an indicator abnormality in the equipment operation data, and add a large equipment trajectory model.

[0021] The present invention provides a method for configuring a digital twin scene of an industrial park, wherein S400 includes:

[0022] Determine whether the equipment operation data is abnormal. If so, determine whether there is a control abnormality in the equipment operation data. If there is a control abnormality, increase the equipment trajectory model in proportion to the equipment trajectory model; determine whether there is an indicator abnormality in the equipment operation data, and increase the longitudinal height of the large equipment trajectory model.

[0023] The present invention provides a method for configuring a digital twin scene of an industrial park, wherein a digital twin video stream is generated according to a three-dimensional model and a field of view range frame and sent to a monitoring end, comprising:

[0024] S501, determining whether the number of abnormal device trajectory models within the field of view exceeds a second threshold, if so, jumping to S502, if not, jumping to S503;

[0025] S502, determining whether the first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device, if so, reducing the first unit time, jumping to S311, and counting the number of jumps; when the number of jumps exceeds the fourth threshold, increasing the magnification ratio of the field of view range frame, jumping to S501, and recalculating the number of jumps;

[0026] S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

[0027] The present invention provides a method for configuring a digital twin scene of an industrial park, wherein a digital twin video stream is generated according to a three-dimensional model and a field of view range frame and sent to a monitoring end, comprising:

[0028] S501, determining whether the number of abnormal device trajectory models within the field of view exceeds a second threshold, if so, jumping to S502, if not, jumping to S503;

[0029] S502, judging whether the first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device, if so, reducing the first unit time, jumping to S311, and counting the number of jumps; when the number of jumps exceeds the fourth threshold, increasing the magnification ratio of the field of view frame, judging whether the magnification ratio of the field of view frame is lower than the third threshold, if so, increasing the second threshold, jumping to S501, and recalculating the number of jumps;

[0030] S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

[0031] The present invention provides an industrial park digital twin scene configuration system, comprising:

[0032] The park acquisition module is used to collect video data and equipment operation data in the industrial park, wherein the image data includes park environment video data and equipment video data;

[0033] A three-dimensional model generation module, which is used to create and update a three-dimensional model of the industrial park in real time according to the video data;

[0034] A transparency processing model, which is used to collect the observation coordinate vector of the monitoring end, generate a field of view range frame according to the observation coordinate vector, determine whether there is a device in the three-dimensional model within the field of view range frame, and if so, configure other three-dimensional models in the area of ​​the device in the three-dimensional model to be transparent;

[0035] An abnormality marking module is used to determine whether the operation data of the equipment is abnormal. If it is abnormal, the three-dimensional model of the abnormal equipment is changed;

[0036] The digital twin output module is used to generate a digital twin video stream based on the three-dimensional model and the field of view range frame and send it to the monitoring end.

[0037] The present invention provides a digital twin scene configuration system for an industrial park, wherein the other three-dimensional models of the area of ​​the device in the three-dimensional model are configured to be transparent, including:

[0038] S311, obtaining a motion trajectory of the device in a first unit time, taking the maximum coordinate position of the motion trajectory of the device to construct a device trajectory model;

[0039] S312, using the outer edge of the device trajectory model that appears in the field of view range as the cutting surface and using the observation coordinate vector as the stretching direction to construct a transparent model;

[0040] S313: Make the part of the three-dimensional model that intersects with the transparent model transparent.

[0041] The present invention provides a digital twin scene configuration system for an industrial park, wherein the step of judging whether the operation data of the equipment is abnormal and, if abnormal, changing the style of the three-dimensional model of the abnormal equipment comprises:

[0042] Determine whether the equipment operation data is abnormal. If so, determine whether there is a control abnormality in the equipment operation data. If there is a control abnormality, increase the equipment trajectory model in proportion to the equipment trajectory model; determine whether there is an indicator abnormality in the equipment operation data, and increase the longitudinal height of the large equipment trajectory model.

[0043] The present invention provides a digital twin scene configuration system for an industrial park, wherein the digital twin video stream is generated according to the three-dimensional model and the field of view range frame and sent to the monitoring end, comprising:

[0044] S501, determining whether the number of abnormal device trajectory models within the field of view exceeds a second threshold, if so, jumping to S502, if not, jumping to S503;

[0045] S502, judging whether the first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device, if so, reducing the first unit time, jumping to S311, and counting the number of jumps; when the number of jumps exceeds the fourth threshold, increasing the magnification ratio of the field of view frame, judging whether the magnification ratio of the field of view frame is lower than the third threshold, if so, increasing the second threshold, jumping to S501, and recalculating the number of jumps;

[0046] S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

[0047] The difference between the digital twin scene configuration method of an industrial park of the present invention and the prior art is that the digital twin scene configuration method of an industrial park of the present invention uses video data collected in real-time in the form of live broadcast or multiple video segments to construct a virtual digital twin three-dimensional model, and, in order to facilitate the monitoring of the operating status of the equipment, the style of the abnormal three-dimensional model will be changed in the above three-dimensional model, so that the monitoring end can more intuitively and visually observe whether it is abnormal. In addition, since the equipment usually appears inside or outside the factory, if the equipment is not inside, other three-dimensional models outside the equipment such as the factory that block the line of sight can be made transparent, so that the situation of the equipment can be observed more intuitively, and it is convenient to observe and monitor the entire park. The present invention can better optimize the integration of industrial parks and digital twins, and facilitate monitoring equipment and monitoring the industrial park itself.

[0048] The following is a further explanation of a method for configuring a digital twin scene of an industrial park in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 It is a method flow chart of a digital twin scene configuration method for an industrial park. DETAILED DESCRIPTION

[0050] like Figure 1 As shown, the present invention provides a method for configuring a digital twin scene of an industrial park, comprising:

[0051] S100, collecting video data and equipment operation data in the industrial park, wherein the image data includes park environment video data and equipment video data;

[0052] S200, creating and updating a three-dimensional model of the industrial park in real time according to the video data;

[0053] S300, collecting the observation coordinate vector of the monitoring terminal, generating a field of view range frame according to the observation coordinate vector, determining whether there is a device in the three-dimensional model within the field of view range frame, and if so, configuring other three-dimensional models in the area of ​​the device within the three-dimensional model to be transparent;

[0054] S400, determining whether the operation data of the device is abnormal, and if so, changing the style of the three-dimensional model of the abnormal device;

[0055] S500: Generate a digital twin video stream based on the three-dimensional model and the field of view range frame and send it to the monitoring end.

[0056] The present invention uses video data collected in real time in the form of live broadcast or multiple video segments to construct a virtual three-dimensional model of a digital twin, and in order to facilitate the monitoring of the operating status of the equipment, the style of the abnormal three-dimensional model in the above three-dimensional model is changed, so that the monitoring end can more intuitively and visually observe whether it is abnormal. In addition, since the equipment usually appears inside or outside the factory, if the equipment is not inside, other three-dimensional models outside the equipment such as the factory that block the line of sight can be made transparent, so that the situation of the equipment can be observed more intuitively, and it is convenient to observe and monitor the entire park. The present invention can better optimize the integration of industrial parks and digital twins, and facilitate monitoring of equipment and the industrial park itself.

[0057] The industrial park may be a factory park or an office park, for example, a processing plant, a warehouse, an office building, etc.

[0058] There are cameras in every place in the industrial park, which can live broadcast or record videos of every corner and every device in the entire industrial park, forming the above video data and the park environment video data and equipment video data in the video data. In other words, the above video data can be multiple interconnected videos or live streams.

[0059] Among them, when creating and updating the three-dimensional model of the industrial park, you can first use the existing three-dimensional model corresponding to the industrial park and equipment as the basis, use video data to identify the scene and configure the model, and then create and update the three-dimensional model. In other words, in order to reduce computing pressure, the above three-dimensional model is not always created, but is based on controlling the movement of the existing three-dimensional model through image recognition, and adding a part of new models that are not pre-stored and generated through video data, so as to finally synthesize the three-dimensional model of this industrial park.

[0060] The observation coordinate vector of the monitoring end can be captured by the gyroscope configured on the monitoring end. For example, if the monitoring end is a VR glasses, then the gyroscope on the VR glasses can collect the direction of the three-dimensional model that the user is looking at, and this direction is the observation coordinate vector of the monitoring end. The observation coordinate vector of the monitoring end can be configured with the starting position coordinates of this vector, that is, under the control of the user, from which position the user uses the observation coordinate vector to view the three-dimensional model. For example, if you look east, when the starting coordinate position of the vector is on the west side of the park, you can see all the scenes of the park; but when the starting coordinate position of the vector is on the east side of the park, you can see nothing.

[0061] The shape of the field of view frame and the zoom level of the lens can be set by the user, or adjusted according to the preset size of the system. The size of the field of view frame can be understood as a 16:9 square frame, a 4:3 square frame, a perfect circle frame, an elliptical frame, or a square frame. Further, the field of view frame is the input picture frame of the monitoring terminal.

[0062] Taking the shape of a 16:9 field of view frame as an example, the same shape of the field of view frame can be adjusted by the different lens zoom levels set by the user to adjust the amount of image in the field of view frame, just like the magnification in a zoom camera. This can be set and adjusted by the user, or the corresponding system preset can be made.

[0063] Among them, judging whether there is a device in the three-dimensional model within the field of view range frame is judging whether there is a three-dimensional model of the device or a device trajectory model of the device in the range frame.

[0064] In some embodiments, see Figure 1 , the step S300 configures other three-dimensional models of the area of ​​the device within the three-dimensional model to be transparent, including:

[0065] S311, obtaining a motion trajectory of the device in a first unit time, taking the maximum coordinate position of the motion trajectory of the device to construct a device trajectory model;

[0066] S312, using the outer edge of the device trajectory model that appears in the field of view range as the cutting surface and using the observation coordinate vector as the stretching direction to construct a transparent model;

[0067] S313: Make the part of the three-dimensional model that intersects with the transparent model transparent.

[0068] The present invention uses all the motion trajectories of the above-mentioned device as an extension of this model, that is, it is regarded as transforming a small device model that moves back and forth into a large device model that is a synthesis of various extreme positions that it can move. Therefore, when the user observes the device in the direction of the observation coordinate vector, if only the three-dimensional model of the location where the outer contour of the current device is located is transparent, then after the device moves, the three-dimensional model of the blocked device cannot be made transparent in time due to computing power and delay problems, resulting in problems such as smear, delayed display, and blocking of part of the device model. Instead, this device is completely generated into a larger model with all its previous motion trajectories, and its projection in the field of view range frame is used as the resection surface, similar to the resection section before resection in three-dimensional mapping software; the direction of the observation coordinate vector regarded as the range frame is used as the resection direction to generate a transparent model; the position where the three-dimensional model and the transparent model intersect can be made transparent in a more three-dimensional way, so that the user can see the equipment and other models of the industrial park in the field of view range frame, which truly optimizes the application of digital twins in monitoring plant equipment.

[0069] The above method is applicable to scenarios such as: air-conditioning outdoor units are being installed outside the factory building of the industrial park, and rail-mounted stackers are being used for warehousing and transportation inside the factory building of the industrial park. If a traditional digital twin system wants to see the stacker inside, it is necessary to hide all three-dimensional models outside the factory building in order to observe the stacker, and thus it is impossible to see the installation status of the air-conditioning outdoor unit outside the factory building. Similarly, if you want to see the installation status of the air-conditioning outdoor unit, you cannot hide the three-dimensional model of the factory building, and then you cannot observe the working status of the stacker.

[0070] The first unit time can be one minute, one hour, one day, one week, or one year, preferably one day, that is, one day is a cycle, and within this cycle, all the trajectories of the device movement are combined into a device trajectory model, so that it is convenient for users to observe the moving device. If the first unit is too small, it is not conducive to observing the movement of the device, and it is easy to cause the factory to not be transparent in time, which hinders users from observing the device. If the first unit is too large, too much area of ​​the factory will be transparent, which is not conducive to observing information outside the factory.

[0071] For example, if there is a device that keeps circling on a 400-meter runway, then the approximate shape of the device trajectory model is similar to the trajectory shape of the 400-meter runway, and its cross-section is similar to the shape of the device, which makes it easier for users to find the location of the transparent factory building. That is, the transparent factory building should also be similar to the trajectory shape of a 400-meter runway.

[0072] Among them, taking the outer edge of the equipment trajectory model that appears in the field of view range box as the cutting surface and constructing a transparent model with the observation coordinate vector as the stretching direction can be understood as, in the cutting of the solidworks software, a cutting trajectory and a cross section of the cutting trajectory are required, then, the cross section of the cutting trajectory is the cutting surface, and the cutting trajectory is the observation coordinate vector. In this way, cutting off or making transparent other three-dimensional models such as factory buildings that block the equipment trajectory model can facilitate users to better observe the movement trajectory of the equipment. That is, the three-dimensional models outside the equipment that intersect with the transparent model should be made transparent, which is convenient for users to view the equipment.

[0073] Among them, making the part of the 3D model that intersects with the transparent model transparent can be understood as: making the part of the 3D model that intersects with the transparent model transparent except for the 3D model of the device corresponding to the device trajectory model in the 3D model. This is to make the 3D model of this device opaque and make other 3D models that obstruct the user's vision transparent.

[0074] In some embodiments, see Figure 1 , the S400 includes:

[0075] Determine whether the equipment operation data is abnormal. If so, determine whether there is a control abnormality in the equipment operation data. If there is a control abnormality, make the three-dimensional model within the first range of the equipment trajectory model transparent; determine whether there is an indicator abnormality in the equipment operation data, and add a large equipment trajectory model.

[0076] The present invention distinguishes the abnormal type of the equipment and makes different forms of adjustments. For example, if the equipment control is abnormal, it may not run according to the original motion trajectory within the first unit time, and it is likely to run irregularly, such as a forklift running around. Then, we should directly make transparent or hide all three-dimensional models within the first range while being able to observe the outside of the factory building of a certain industrial park through digital twin technology, so as to observe the position where the equipment is running around, so as to further observe the abnormal situation of the equipment. Or, for example, if the equipment indicators are abnormal, the equipment may have problems such as air leakage, liquid leakage, smoke, and fire. Then, we should give the interior of the factory a larger vertical observable range while being able to observe the outside of the factory building of a certain industrial park through digital twin technology, so as to further observe the abnormal situation of the equipment.

[0077] Among them, the three-dimensional model of the equipment is the equipment model.

[0078] Among them, the equipment operation data can be used to identify whether the equipment operation data is abnormal and what kind of abnormality it is through existing technologies. For example, the abnormality of the equipment operation data can be control abnormality, indicator abnormality, operation abnormality, etc.

[0079] Among them, control anomalies mean that the equipment cannot operate correctly according to the control signal, for example, a stacker running off the track, a forklift running around, or a transporter crashing into a wall. Therefore, it is necessary to expand the scope of observation, that is, when it is impossible to predict its movement trend, it is also possible to see how it moves when it is running around without too much obstruction.

[0080] Among them, abnormal indicators refer to abnormal temperature, voltage, current, oil pressure, noise, and water pressure of the equipment. For example, a transport truck leaking oil or water, a forklift on fire, or a forklift emitting smoke, etc. Therefore, it is necessary to expand the vertical observation range, that is, to be able to see the problems of oil leakage, water leakage, fire, and smoke outside the equipment.

[0081] Among them, abnormal operation means that the equipment cannot operate normally, for example, a stacker cannot be raised or lowered due to a stuck drive component; a transport vehicle cannot be moved due to a stuck drive component. In other words, changing its color makes it easier for users to find the right location.

[0082] The first range can be a sphere drawn with the center point of the set of equipment trajectory models or the geometric center point of the three-dimensional model of the equipment as the center and 0.1 to 100 times the width of the equipment as the radius, preferably 3 times the width of the equipment. That is, we can increase the area of ​​the cut-off surface when the transparent model is stretched through the above form, that is, a larger circular cut-off surface than the original one, so that more transparency may block the three-dimensional model of the plant where we observe the equipment.

[0083] Each time a large equipment trajectory model is added, the original equipment trajectory model can be increased by 3% to 100%, preferably 8%, and the center of the collection is used as the origin of the increase.

[0084] As a variant embodiment of the present invention, see Figure 1 , the S400 includes:

[0085] Determine whether the equipment operation data is abnormal. If so, determine whether there is a control abnormality in the equipment operation data. If there is a control abnormality, increase the equipment trajectory model in proportion to the equipment trajectory model; determine whether there is an indicator abnormality in the equipment operation data, and increase the longitudinal height of the large equipment trajectory model.

[0086] The present invention distinguishes the abnormal type of the equipment and makes different forms of adjustments. For example, if the equipment control is abnormal, it may not run according to the original motion trajectory in the first unit time, and it is likely to run irregularly, such as a forklift running around. Then, while we can still observe the outside of the factory building of a certain industrial park through the digital twin technology, we should give more observable range inside the factory building to observe the location of the equipment running around, so as to further observe the abnormal situation of the equipment. Or, for example, if the equipment indicators are abnormal, the equipment may have problems such as air leakage, liquid leakage, smoke, and fire. Then, while we can still observe the outside of the factory building of a certain industrial park through the digital twin technology, we should give a larger vertical observable range inside the factory building to further observe the abnormal situation of the equipment.

[0087] If neither control abnormality nor indicator abnormality exists, the color style of the equipment is changed; for example, the three-dimensional model of the equipment is changed to red.

[0088] Among them, increasing the equipment trajectory model in proportion to the equipment trajectory model can be understood as increasing the equipment trajectory model in proportion to the equipment trajectory model by 3% to 100%, preferably by 8%, with the center of the equipment trajectory model as the increase origin.

[0089] In some embodiments, see Figure 1 , based on the 3D model and field of view, a digital twin video stream is generated and sent to the monitoring end, including:

[0090] S501, determining whether the number of abnormal device trajectory models within the field of view exceeds a second threshold, if so, jumping to S502, if not, jumping to S503;

[0091] S502, determining whether the first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device, if so, reducing the first unit time, jumping to S311, and counting the number of jumps; when the number of jumps exceeds the fourth threshold, increasing the magnification ratio of the field of view range frame, jumping to S501, and recalculating the number of jumps;

[0092] S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

[0093] The present invention is to make the number of abnormalities in the field of view frame within a reasonable range, for example, within three; thus, for a part of the device trajectory model, the device trajectory model with a larger motion range is far greater than the three-dimensional model of the device, and the device trajectory model of the device with a faster motion speed and not yet in the field of view frame is not used as the observation object in this field of view frame by means of reducing the first unit time. However, the first unit time cannot be reduced all the time. If it is reduced by 8% each time, the above steps are polled from S311 each time it is reduced. After reducing three times, it cannot be reduced anymore; instead, it is regarded as the abnormal scene at this time is too large, and there are indeed too many abnormal devices, and the magnification ratio of the field of view frame is increased, that is, the magnification ratio of the lens is increased in the form of optical zoom and electronic zoom, then, the total number of devices appearing in the field of view frame may be reduced, so that the user can focus more on the abnormal devices within this reasonable range and the specific situation of the abnormalities of the devices, and make targeted processing, thereby improving the observation and focus of the key equipment of the digital twin scene in the monitoring of the adaptation industrial park.

[0094] Among them, the second threshold can be 1 to 100, preferably 3, that is, when the user observes whether the equipment in the scene is abnormal through the digital twin technology, he can only see at most 3 abnormal equipment trajectory models at the same time.

[0095] Among them, the first threshold percentage can be 1% to 99%, preferably 20%, that is, 20% of the device trajectory model should not be larger than the three-dimensional model of the device, or should not be larger than the device model; that is, the device trajectory model should not be much larger than the three-dimensional model of the device, or should not be much larger than the device model. Then, once the above-mentioned problem of being much larger than occurs, it is bound to make it easy for users to see many device trajectory models in the same field of view, which will prevent the abnormal device that the user is focusing on from being focused on. Therefore, we should reduce the first unit time at this time to reduce the device trajectory model as much as possible, especially the device trajectory model of the device that is moving around randomly.

[0096] Among them, the fourth threshold can be 1 to 100 times, preferably 3 times, that is, the number of times we reduce the device trajectory model by reducing the first unit time should not be reduced three times in a row and still fail to make the number of device trajectory models of abnormal devices in the field of view range frame within a reasonable range, that is, within the second threshold; then, we should make the field of view range frame more focused at this time, that is, increase the magnification, so that the content in the field of view range frame is less, and the image of the position where the user is facing is more focused.

[0097] The magnification ratio may be 1.1 to 100 times, preferably 1.3 times, that is, the content of the original field of view frame is 1.3 times the content of the magnified field of view frame. The content of the center point of the field of view frame before and after magnification is the same, that is, it is the magnification origin.

[0098] It should be noted that the number of jumps in the above embodiment needs to be recalculated. After all, the first unit time is greatly adjusted each time the field of view frame is enlarged, so the content of the field of view frame can be adjusted step by step without superimposed adjustment.

[0099] As a variant embodiment of the present invention, see Figure 1 , based on the 3D model and field of view, a digital twin video stream is generated and sent to the monitoring end, including:

[0100] S501, determining whether the number of abnormal device trajectory models within the field of view exceeds a second threshold, if so, jumping to S502, if not, jumping to S503;

[0101] S502, judging whether the first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device, if so, reducing the first unit time, jumping to S311, and counting the number of jumps; when the number of jumps exceeds the fourth threshold, increasing the magnification ratio of the field of view frame, judging whether the magnification ratio of the field of view frame is lower than the third threshold, if so, increasing the second threshold, jumping to S501, and recalculating the number of jumps;

[0102] S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

[0103] The present invention is to make the number of abnormalities in the field of view frame within a reasonable range, for example, within three; thus, for a part of the device trajectory model, the device trajectory model with a larger motion range is far greater than the three-dimensional model of the device, and the device trajectory model of the device with a faster motion speed and not yet in the field of view frame is not used as the observation object in the field of view frame by reducing the first unit time. However, the first unit time cannot be reduced all the time. If it is reduced by 8% each time, the above steps are polled from S311 each time it is reduced. After three times of reduction, it cannot be reduced anymore; instead, it is considered that the abnormal scene at this time is too large and there are indeed too many abnormal devices, and the number of abnormal device trajectory models allowed to appear in the field of view frame is increased, and each jump will further reduce the size of the first unit time until the device trajectory model is closer and closer to the size of this device, so that a reasonable device trajectory model size can be configured according to the motion speed and motion amplitude of all devices in this industrial park; so that users can focus more on the abnormal devices within this reasonable range and the specific situation of the abnormalities of the devices, and make targeted processing, thereby improving the observation and focus of the key equipment of the digital twin scene in the adaptation of the industrial park monitoring.

[0104] Among them, the third threshold can be 1.1 to 100 times, that is, 10 times. If the magnification ratio of the increased field of view range box is too large, the user may not be able to see the overall situation. At this time, we should increase the number of device trajectory models of abnormal devices that we allow to see within the field of view range box at the same time.

[0105] Each time the second threshold is increased, the second threshold can be increased by 1. If this is not possible, the device trajectory model can allow for more abnormal devices to be seen.

[0106] The present invention provides an industrial park digital twin scene configuration system, comprising:

[0107] The park acquisition module is used to collect video data and equipment operation data in the industrial park, wherein the image data includes park environment video data and equipment video data;

[0108] A three-dimensional model generation module, which is used to create and update a three-dimensional model of the industrial park in real time according to the video data;

[0109] A transparency processing model, which is used to collect the observation coordinate vector of the monitoring end, generate a field of view range frame according to the observation coordinate vector, determine whether there is a device in the three-dimensional model within the field of view range frame, and if so, configure other three-dimensional models in the area of ​​the device in the three-dimensional model to be transparent;

[0110] An abnormality marking module is used to determine whether the operation data of the equipment is abnormal. If it is abnormal, the three-dimensional model of the abnormal equipment is changed;

[0111] The digital twin output module is used to generate a digital twin video stream based on the three-dimensional model and the field of view range frame and send it to the monitoring end.

[0112] The present invention uses video data collected in real time in the form of live broadcast or multiple video segments to construct a virtual three-dimensional model of a digital twin, and in order to facilitate the monitoring of the operating status of the equipment, the style of the abnormal three-dimensional model in the above three-dimensional model is changed, so that the monitoring end can more intuitively and visually observe whether it is abnormal. In addition, since the equipment usually appears inside or outside the factory, if the equipment is not inside, other three-dimensional models outside the equipment such as the factory that block the line of sight can be made transparent, so that the situation of the equipment can be observed more intuitively, and it is convenient to observe and monitor the entire park. The present invention can better optimize the integration of industrial parks and digital twins, and facilitate monitoring of equipment and the industrial park itself.

[0113] In some embodiments, see Figure 1 , configuring other three-dimensional models of the area of ​​the device within the three-dimensional model to be transparent includes:

[0114] S311, obtaining a motion trajectory of the device in a first unit time, taking the maximum coordinate position of the motion trajectory of the device to construct a device trajectory model;

[0115] S312, using the outer edge of the device trajectory model that appears in the field of view range as the cutting surface and using the observation coordinate vector as the stretching direction to construct a transparent model;

[0116] S313: Make the part of the three-dimensional model that intersects with the transparent model transparent.

[0117] In some embodiments, see Figure 1 , the determining whether the equipment operation data is abnormal, if abnormal, changing the style of the three-dimensional model of the abnormal equipment, including:

[0118] Determine whether the equipment operation data is abnormal. If so, determine whether there is a control abnormality in the equipment operation data. If there is a control abnormality, increase the equipment trajectory model in proportion to the equipment trajectory model; determine whether there is an indicator abnormality in the equipment operation data, and increase the longitudinal height of the large equipment trajectory model.

[0119] In some embodiments, see Figure 1 , generating a digital twin video stream according to the three-dimensional model and the field of view frame and sending it to the monitoring end, including:

[0120] S501, determining whether the number of abnormal device trajectory models within the field of view exceeds a second threshold, if so, jumping to S502, if not, jumping to S503;

[0121] S502, judging whether the first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device, if so, reducing the first unit time, jumping to S311, and counting the number of jumps; when the number of jumps exceeds the fourth threshold, increasing the magnification ratio of the field of view frame, judging whether the magnification ratio of the field of view frame is lower than the third threshold, if so, increasing the second threshold, jumping to S501, and recalculating the number of jumps;

[0122] S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

[0123] The embodiments described above are merely descriptions of preferred implementation modes of the present invention and are not intended to limit the scope of the present invention. Without departing from the design spirit of the present invention, various modifications and improvements made to the technical solutions of the present invention by ordinary technicians in this field should all fall within the protection scope determined by the claims of the present invention.

Claims

1. A method for configuring a digital twin scene in an industrial park, characterized in that: include S100, collecting video data and equipment operation data in the industrial park, wherein the image data includes park environment video data and equipment video data; S200, creating and updating a three-dimensional model of the industrial park in real time according to the video data; S300, collecting the observation coordinate vector of the monitoring terminal, generating a field of view range frame according to the observation coordinate vector, determining whether there is a device in the three-dimensional model within the field of view range frame, and if so, configuring other three-dimensional models in the area of ​​the device within the three-dimensional model to be transparent; S400, determining whether the operation data of the device is abnormal, and if so, changing the style of the three-dimensional model of the abnormal device; S500: Generate a digital twin video stream based on the three-dimensional model and the field of view range frame and send it to the monitoring end.

2. According to claim 1, a method for configuring a digital twin scene of an industrial park is characterized in that: The step S300 configures other three-dimensional models of the area of ​​the device within the three-dimensional model to be transparent, including: S311, obtaining a motion trajectory of the device in a first unit time, taking the maximum coordinate position of the motion trajectory of the device to construct a device trajectory model; S312, using the outer edge of the device trajectory model that appears in the field of view range as the cutting surface and using the observation coordinate vector as the stretching direction to construct a transparent model; S313: Make the part of the three-dimensional model that intersects with the transparent model transparent.

3. According to claim 2, a method for configuring a digital twin scene of an industrial park is characterized in that: The S400 includes: Determine whether the equipment operation data is abnormal. If so, determine whether there is a control abnormality in the equipment operation data. If there is a control abnormality, make the three-dimensional model within the first range of the equipment trajectory model transparent; determine whether there is an indicator abnormality in the equipment operation data, and add a large equipment trajectory model.

4. According to claim 2, a method for configuring a digital twin scene of an industrial park is characterized in that: The S400 includes: Determine whether the equipment operation data is abnormal. If so, determine whether there is a control abnormality in the equipment operation data. If there is a control abnormality, increase the equipment trajectory model in proportion to the equipment trajectory model; determine whether there is an indicator abnormality in the equipment operation data, and increase the longitudinal height of the large equipment trajectory model.

5. A method for configuring a digital twin scene of an industrial park according to any one of claims 3 or 4, characterized in that: Generate a digital twin video stream based on the 3D model and field of view and send it to the monitoring end, including: S501, determining whether the number of abnormal device trajectory models within the field of view exceeds a second threshold, if so, jumping to S502, if not, jumping to S503; S502, determining whether the first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device, if so, reducing the first unit time, jumping to S311, and counting the number of jumps; when the number of jumps exceeds the fourth threshold, increasing the magnification ratio of the field of view range frame, jumping to S501, and recalculating the number of jumps; S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

6. A method for configuring a digital twin scene of an industrial park according to any one of claims 3 or 4, characterized in that: Generate a digital twin video stream based on the 3D model and field of view and send it to the monitoring end, including: S501, determining whether the number of abnormal device trajectory models within the field of view exceeds a second threshold, if so, jumping to S502, if not, jumping to S503; S502, judging whether the first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device, if so, reducing the first unit time, jumping to S311, and counting the number of jumps; when the number of jumps exceeds the fourth threshold, increasing the magnification ratio of the field of view frame, judging whether the magnification ratio of the field of view frame is lower than the third threshold, if so, increasing the second threshold, jumping to S501, and recalculating the number of jumps; S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

7. An industrial park digital twin scene configuration system, characterized by: include The park acquisition module is used to collect video data and equipment operation data in the industrial park, wherein the image data includes park environment video data and equipment video data; A three-dimensional model generation module, which is used to create and update a three-dimensional model of the industrial park in real time according to the video data; A transparency processing model, which is used to collect the observation coordinate vector of the monitoring end, generate a field of view range frame according to the observation coordinate vector, determine whether there is a device in the three-dimensional model within the field of view range frame, and if so, configure other three-dimensional models in the area of ​​the device in the three-dimensional model to be transparent; An abnormality marking module is used to determine whether the operation data of the equipment is abnormal. If it is abnormal, the three-dimensional model of the abnormal equipment is changed; The digital twin output module is used to generate a digital twin video stream based on the three-dimensional model and the field of view range frame and send it to the monitoring end.

8. The industrial park digital twin scene configuration system according to claim 7, characterized in that: The step of configuring other three-dimensional models of the area of ​​the device within the three-dimensional model to be transparent includes: S311, obtaining a motion trajectory of the device in a first unit time, taking the maximum coordinate position of the motion trajectory of the device to construct a device trajectory model; S312, using the outer edge of the device trajectory model that appears in the field of view range as the cutting surface and using the observation coordinate vector as the stretching direction to construct a transparent model; S313: Make the part of the three-dimensional model that intersects with the transparent model transparent.

9. The industrial park digital twin scene configuration system according to claim 8, characterized in that: The determining whether the equipment operation data is abnormal, and if abnormal, changing the style of the three-dimensional model of the abnormal equipment, includes: Determine whether the equipment operation data is abnormal. If so, determine whether there is a control abnormality in the equipment operation data. If there is a control abnormality, increase the equipment trajectory model in proportion to the equipment trajectory model; determine whether there is an indicator abnormality in the equipment operation data, and increase the longitudinal height of the large equipment trajectory model.

10. The industrial park digital twin scene configuration system according to claim 9, characterized in that: The method of generating a digital twin video stream according to the three-dimensional model and the field of view range frame and sending the stream to the monitoring end includes: S501, determining whether the number of abnormal device trajectory models within the field of view exceeds a second threshold, if so, jumping to S502, if not, jumping to S503; S502, judging whether the first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device, if so, reducing the first unit time, jumping to S311, and counting the number of jumps; when the number of jumps exceeds the fourth threshold, increasing the magnification ratio of the field of view frame, judging whether the magnification ratio of the field of view frame is lower than the third threshold, if so, increasing the second threshold, jumping to S501, and recalculating the number of jumps; S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

Images