A method and system for configuring digital twin scenes in industrial parks

Abstract

The present invention relates to a digital twin field, and discloses a method for configuring a digital twin scene of an industrial park, including collecting video data within the industrial park; creating and updating a three-dimensional model of the industrial park in real time; configuring other three-dimensional models of the area of ​​the equipment in the three-dimensional model to be transparent; changing the style of the three-dimensional model of the abnormal equipment; generating a digital twin video stream and sending it to the monitoring end. The present invention uses video data collected in real time in the form of live broadcast or multiple video segments to construct a virtual three-dimensional model of a digital twin, and, in order to facilitate monitoring the operating status of the equipment, the style of the abnormal three-dimensional model in the above-mentioned three-dimensional model is changed, so that the monitoring end can more intuitively and visually observe whether it is abnormal. The present invention can better optimize the integration of the industrial park and the digital twin, and facilitate monitoring equipment and monitoring the industrial park itself.

Description

Technical Field

[0001] The present invention relates to the field of digital twins, and in particular to a method for configuring digital twin scenarios in industrial parks by using digital twins to manage industrial equipment data. Background Art

[0002] Managing and monitoring the operational status of various facilities and equipment within industrial parks is a complex task. Traditional management methods often lack real-time and precision, making it difficult to achieve efficient management and optimal allocation of various resources within the park.

[0003] Digital twins are a new technology based on digitalization that integrates the physical and virtual worlds. They achieve seamless integration by digitally modeling physical entities and creating corresponding virtual counterparts. Digital twins leverage a variety of technologies, such as sensors, the Internet of Things (IoT), big data, artificial intelligence (AI), and machine learning (ML), to comprehensively digitally replicate and simulate real-world objects, processes, or systems, enabling precise control and optimization of the real world.

[0004] The digital twin scene configuration system aims to achieve refined management and optimized configuration of various facilities and equipment within the park through virtual simulation and real-time monitoring.

[0005] Traditional digital twins rely solely on image scanning, synthesis, modeling, and virtual scene display, which cannot provide more useful value.

[0006] At present, how to better monitor equipment in industrial parks through digital twin technology is still a technical problem that urgently needs to be solved in the industry.

[0007] Therefore, there is a need to provide an industrial park digital twin scene configuration method that can better monitor the equipment in the industrial park through digital twin technology. Summary of the Invention

[0008] The technical problem to be solved by the present invention is to provide an industrial park digital twin scene configuration method that can better monitor the equipment in the industrial park through digital twin technology.

[0009] The present invention provides a method for configuring a digital twin scene in an industrial park, comprising:

[0010] S100: Collect video data and equipment operation data within the industrial park, wherein the image data includes park environment video data and equipment video data;

[0011] S200: Creating and updating a three-dimensional model of the industrial park in real time based on the video data;

[0012] S300: Collecting an observation coordinate vector from the monitoring terminal, generating a field of view frame based on the observation coordinate vector, determining whether a device exists in the three-dimensional model within the field of view frame, and if so, configuring other three-dimensional models in the area of ​​the device within the three-dimensional model to be transparent;

[0013] S400, determining whether the device operation data is abnormal; if abnormal, changing the style of the three-dimensional model of the abnormal device;

[0014] S500: Generate a digital twin video stream based on the three-dimensional model and the field of view range frame and send it to the monitoring end.

[0015] The present invention provides a method for configuring a digital twin scene of an industrial park, wherein the step S300 configures other three-dimensional models of the area of ​​the device within the three-dimensional model to be transparent, including:

[0016] S311. Obtain a motion trajectory of the device within a first unit time, and take the maximum coordinate position of the motion trajectory of the device to construct a device trajectory model;

[0017] S312, using the outer edge of the device trajectory model that appears within the field of view as the cutting surface and the observation coordinate vector as the stretching direction to construct a transparent model;

[0018] S313: Make the portion of the three-dimensional model that intersects with the transparent model transparent.

[0019] The present invention provides a method for configuring a digital twin scene of an industrial park, wherein S400 includes:

[0020] Determine whether the equipment operation data is abnormal. If so, determine whether there is a control abnormality in the equipment operation data. If so, make the three-dimensional model within the first range of the equipment trajectory model transparent. Determine whether there is an indicator abnormality in the equipment operation data, and add a large equipment trajectory model.

[0021] The present invention provides a method for configuring a digital twin scene of an industrial park, wherein S400 includes:

[0022] Determine whether the equipment operation data is abnormal. If so, determine whether there is a control abnormality in the equipment operation data. If so, increase the equipment trajectory model proportionally. Determine whether there is an indicator abnormality in the equipment operation data, and increase the vertical height of the large equipment trajectory model.

[0023] The present invention provides a method for configuring a digital twin scene in an industrial park, wherein a digital twin video stream is generated based on a three-dimensional model and a field of view range frame and sent to a monitoring terminal, comprising:

[0024] S501: Determine whether the number of abnormal device trajectory models within the field of view exceeds a second threshold. If so, jump to S502; if not, jump to S503.

[0025] S502: Determine whether a first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device. If so, reduce the first unit time, jump to S311, and count the number of jumps. When the number of jumps exceeds a fourth threshold, increase the magnification ratio of the field of view frame, jump to S501, and recalculate the number of jumps.

[0026] S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

[0027] The present invention provides a method for configuring a digital twin scene in an industrial park, wherein a digital twin video stream is generated based on a three-dimensional model and a field of view range frame and sent to a monitoring terminal, comprising:

[0028] S501: Determine whether the number of abnormal device trajectory models within the field of view exceeds a second threshold. If so, jump to S502; if not, jump to S503.

[0029] S502: Determine whether a first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device. If so, reduce the first unit time, jump to S311, and count the number of jumps. When the number of jumps exceeds a fourth threshold, increase the magnification ratio of the field of view frame, determine whether the magnification ratio of the field of view frame is lower than the third threshold, and if so, increase the second threshold, jump to S501, and recalculate the number of jumps.

[0030] S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

[0031] The present invention provides an industrial park digital twin scene configuration system, including

[0032] A park acquisition module is used to collect video data and equipment operation data within the industrial park, wherein the image data includes park environment video data and equipment video data;

[0033] A three-dimensional model generation module, which is used to create and update a three-dimensional model of the industrial park in real time based on the video data;

[0034] a transparency processing model for collecting the observation coordinate vector of the monitoring terminal, generating a field of view range frame based on the observation coordinate vector, determining whether a device exists in the three-dimensional model within the field of view range frame, and if so, configuring other three-dimensional models in the area of ​​the device within the three-dimensional model to be transparent;

[0035] An abnormality marking module is used to determine whether the equipment operation data is abnormal. If abnormal, the three-dimensional model of the abnormal equipment is changed;

[0036] The digital twin output module is used to generate a digital twin video stream based on the three-dimensional model and field of view range frame and send it to the monitoring end.

[0037] The present invention provides a digital twin scene configuration system for an industrial park, wherein the other three-dimensional models of the area of ​​the equipment within the three-dimensional model are configured to be transparent, including:

[0038] S311. Obtain a motion trajectory of the device within a first unit time, and take the maximum coordinate position of the motion trajectory of the device to construct a device trajectory model;

[0039] S312, using the outer edge of the device trajectory model that appears within the field of view as the cutting surface and the observation coordinate vector as the stretching direction to construct a transparent model;

[0040] S313: Make the portion of the three-dimensional model that intersects with the transparent model transparent.

[0041] The present invention provides a digital twin scene configuration system for an industrial park, wherein the determining whether the device operation data is abnormal and, if abnormal, changing the style of the three-dimensional model of the abnormal device includes:

[0042] Determine whether the equipment operation data is abnormal. If so, determine whether there is a control abnormality in the equipment operation data. If so, increase the equipment trajectory model proportionally. Determine whether there is an indicator abnormality in the equipment operation data, and increase the vertical height of the large equipment trajectory model.

[0043] The present invention provides a digital twin scene configuration system for an industrial park, wherein the digital twin video stream is generated according to the three-dimensional model and the field of view range frame and sent to the monitoring end, including:

[0044] S501: Determine whether the number of abnormal device trajectory models within the field of view exceeds a second threshold. If so, jump to S502; if not, jump to S503.

[0045] S502: Determine whether a first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device. If so, reduce the first unit time, jump to S311, and count the number of jumps. When the number of jumps exceeds a fourth threshold, increase the magnification ratio of the field of view frame, determine whether the magnification ratio of the field of view frame is lower than the third threshold, and if so, increase the second threshold, jump to S501, and recalculate the number of jumps.

[0046] S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

[0047] The difference between the digital twin scene configuration method of an industrial park of the present invention and the prior art is that the digital twin scene configuration method of an industrial park of the present invention uses video data collected in real-time in the form of live broadcast or multiple video segments to construct a virtual digital twin three-dimensional model, and, in order to facilitate the monitoring of the operating status of the equipment, the style of the abnormal three-dimensional model will be changed in the above three-dimensional model, so that the monitoring end can more intuitively and visually observe whether it is abnormal. In addition, since the equipment usually appears inside or outside the factory, if the equipment is not inside, the other three-dimensional models outside the equipment such as the factory that block the line of sight can be made transparent, so that the status of the equipment can be observed more intuitively, and it is convenient to observe and monitor the entire park. The present invention can better optimize the integration of industrial parks and digital twins, and facilitate monitoring equipment and monitoring the industrial park itself.

[0048] The following is a further explanation of the industrial park digital twin scene configuration method of the present invention with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 It is a method flow chart of the digital twin scene configuration method of an industrial park. DETAILED DESCRIPTION

[0050] like Figure 1 As shown, the present invention provides a method for configuring a digital twin scene of an industrial park, including:

[0051] S100: Collect video data and equipment operation data within the industrial park, wherein the image data includes park environment video data and equipment video data;

[0052] S200: Creating and updating a three-dimensional model of the industrial park in real time based on the video data;

[0053] S300: Collecting an observation coordinate vector from the monitoring terminal, generating a field of view frame based on the observation coordinate vector, determining whether a device exists in the three-dimensional model within the field of view frame, and if so, configuring other three-dimensional models in the area of ​​the device within the three-dimensional model to be transparent;

[0054] S400, determining whether the device operation data is abnormal; if abnormal, changing the style of the three-dimensional model of the abnormal device;

[0055] S500: Generate a digital twin video stream based on the three-dimensional model and the field of view range frame and send it to the monitoring end.

[0056] The present invention uses video data collected in real time in the form of live broadcast or multiple video segments to construct a virtual three-dimensional model of a digital twin, and in order to facilitate the monitoring of the operating status of the equipment, the style of the abnormal three-dimensional model in the above three-dimensional model is changed, so that the monitoring end can more intuitively and visually observe whether it is abnormal. In addition, since the equipment usually appears inside or outside the factory, if the equipment is not inside, other three-dimensional models outside the equipment such as the factory that block the line of sight can be made transparent, so that the status of the equipment can be observed more intuitively, and the entire park can be observed and monitored more conveniently. The present invention can better optimize the integration of industrial parks and digital twins, and facilitate monitoring of equipment and the industrial park itself.

[0057] The industrial park can be a factory park or an office park, for example, a processing plant, a warehouse, an office building, etc.

[0058] The industrial park is equipped with cameras at every location, capable of live streaming or recording every corner and every device within the park, generating the aforementioned video data, as well as the park environment video data and device video data within the video data. In other words, the aforementioned video data can be multiple interconnected video segments or live streams.

[0059] To create and update the 3D model of the industrial park, we can first use the existing 3D model corresponding to the industrial park and equipment as a basis, use video data to identify the scene and configure the model, and then create and update the three-dimensional model. In other words, to reduce computing power pressure, the above-mentioned 3D model is not constantly created. Instead, it is based on controlling the movement of the existing 3D model through image recognition, and a new part of the model generated by video data that is not pre-existing is added to finally synthesize the three-dimensional model of the industrial park.

[0060] The observation coordinate vector of the monitoring end can be captured by a gyroscope configured on the monitoring end. For example, if the monitoring end is a VR headset, the gyroscope on the VR headset can detect the direction in which the user is looking at the three-dimensional model, and this direction is the observation coordinate vector of the monitoring end. The observation coordinate vector of the monitoring end can be configured with the coordinates of the starting position of this vector, that is, under the control of the user, from which position the user uses the observation coordinate vector to view the three-dimensional model. For example, if the starting coordinate position of the vector is on the west side of the park, the entire park scene can be seen; however, if the starting coordinate position of the vector is on the east side of the park, nothing can be seen.

[0061] The shape of the field of view frame and the zoom level can be set by the user or adjusted based on a system preset size. The field of view frame can be sized as a 16:9 square, a 4:3 square, a perfect circle, an ellipse, or a square. Specifically, the field of view frame represents the input image frame of the monitoring terminal.

[0062] For example, a 16:9 field of view frame can be adjusted based on the user's lens zoom level, much like the magnification factor in a zoom camera. This can be set and adjusted by the user, or it can be preset by the system.

[0063] The determining whether there is a device in the three-dimensional model within the visual range frame is to determine whether there is a three-dimensional model of the device or a device trajectory model of the device in the range frame.

[0064] In some embodiments, see Figure 1 , the step S300 configuring other three-dimensional models of the area of ​​the device within the three-dimensional model to be transparent includes:

[0065] S311. Obtain a motion trajectory of the device within a first unit time, and take the maximum coordinate position of the motion trajectory of the device to construct a device trajectory model;

[0066] S312, using the outer edge of the device trajectory model that appears within the field of view as the cutting surface and the observation coordinate vector as the stretching direction to construct a transparent model;

[0067] S313: Make the portion of the three-dimensional model that intersects with the transparent model transparent.

[0068] The present invention uses all the motion trajectories of the above-mentioned device as an extension of this model, that is, it regards a small device model that moves back and forth as a large device model that is a composite of the various extreme positions it can move to. Therefore, when the user observes the device in the direction of the observation coordinate vector, if only the three-dimensional model of the location where the outer contour of the current device is located is transparent, then after the device moves, the three-dimensional model of the obstructed device cannot be made transparent in time due to computing power and delay issues, resulting in problems such as ghosting, delayed display, and obstruction of part of the device model. Instead, a larger model is generated for this device based entirely on all its previous motion trajectories, and its projection on the field of view range frame is used as the resection surface, similar to the resection section before resection in three-dimensional mapping software; the direction of the observation coordinate vector of the range frame is regarded as the resection direction to generate a transparent model; the position where the three-dimensional model and the transparent model intersect can be made transparent in a more three-dimensional way, making it easier for users to see the device and other models of the industrial park within the view frame of the field of view range frame, truly optimizing the application of digital twins in monitoring factory equipment.

[0069] The above method is applicable to scenarios such as the following: air-conditioning outdoor units are being installed outside the factory building of an industrial park, and rail-mounted stackers are being used for warehousing and transportation inside the factory building of the industrial park. If a traditional digital twin system wants to see the stacker inside, it needs to hide all three-dimensional models outside the factory building before observing the stacker, and thus it is impossible to see the installation status of the air-conditioning outdoor units outside the factory building. Similarly, if you want to see the installation status of the air-conditioning outdoor units, you cannot hide the three-dimensional model of the factory building, and then you cannot observe the working status of the stacker.

[0070] The first unit of time can be one minute, one hour, one day, one week, or one year, preferably one day. That is, within one day, all the trajectories of the device's movement are combined into a device trajectory model, making it easier for users to observe the moving device. If the first unit is too small, it will be difficult to observe the device's movement, and it may cause some factory buildings to not be transparent in time, hindering users from observing the equipment. If the first unit is too large, too much area of ​​the factory building will be transparent, making it difficult to observe information outside the factory building.

[0071] For example, if there is a device that keeps circling on a 400-meter runway, then the approximate shape of the device trajectory model is similar to the trajectory shape of the 400-meter runway, and its cross-section is similar to the shape of the device, so that it is easier for users to find the location of the transparent factory building. That is, the transparent factory building should also be similar to the trajectory shape of the 400-meter runway.

[0072] Among them, the outer edge of the equipment trajectory model that appears in the field of view range box is used as the cutting surface, and the observation coordinate vector is used as the stretching direction to construct a transparent model. It can be understood that in the cutting of the solidworks software, a cutting trajectory and a cross section of the cutting trajectory are required. Then, the cross section of the cutting trajectory is the cutting surface, and the cutting trajectory is the observation coordinate vector. In this way, other three-dimensional models such as factory buildings that block the equipment trajectory model can be cut off or made transparent, which can facilitate users to better observe the movement trajectory of the equipment. That is, the three-dimensional models outside the equipment that intersect with the transparent model should be transparent, which is convenient for users to view the equipment.

[0073] Making the portion of the 3D model that intersects the transparent model transparent can be understood as making the portion of the 3D model other than the 3D model of the device corresponding to the device trajectory model that intersects the transparent model transparent. This is done to make the 3D model of the device opaque, while making other 3D models that obstruct the user's view transparent.

[0074] In some embodiments, see Figure 1 , the S400 includes:

[0075] Determine whether the equipment operation data is abnormal. If so, determine whether there is a control abnormality in the equipment operation data. If so, make the three-dimensional model within the first range of the equipment trajectory model transparent. Determine whether there is an indicator abnormality in the equipment operation data, and add a large equipment trajectory model.

[0076] The present invention distinguishes the abnormal types of equipment and thus makes different forms of adjustments. For example, if the equipment control is abnormal, it may not run according to the original motion trajectory within the first unit time, and it is likely to run irregularly, such as a forklift running around. Then, while we can still observe the exterior of the factory building in a certain industrial park through digital twin technology, we should directly make transparent or hide all three-dimensional models within the first range in order to observe the location of the equipment running around, so as to further observe the abnormal situation of the equipment. Or, for example, if the equipment indicators are abnormal, the equipment may have problems such as air leakage, liquid leakage, smoke, or fire. Then, while we can still observe the exterior of the factory building in a certain industrial park through digital twin technology, we should give the interior of the factory a larger vertical observable range to further observe the abnormal situation of the equipment.

[0077] Among them, the three-dimensional model of the equipment is the equipment model.

[0078] Among them, the equipment operation data can be used to identify whether there is an abnormality in the equipment operation data and the type of abnormality. For example, the abnormality of the equipment operation data can be a control abnormality, an indicator abnormality, an operation abnormality, etc.

[0079] Control anomalies mean the equipment isn't operating correctly according to control signals. Examples include a stacker running off track, a forklift running wildly, or a truck ramming into a wall. Therefore, it's necessary to expand the scope of observation. That is, even when the equipment's movement is unpredictable, it's still possible to see its movements without excessive obstruction.

[0080] Abnormal indicators represent abnormalities in equipment temperature, voltage, current, oil pressure, noise, and water pressure. Examples include a truck leaking oil or water, a forklift catching fire, or a forklift emitting smoke. Therefore, it's necessary to expand the scope of vertical observation—that is, to detect oil, water, fire, or smoke leaks beyond the equipment itself.

[0081] An abnormal operation indicates that the equipment is not functioning properly, such as a stacker crane that cannot be raised or lowered due to a stuck drive component or a transport vehicle that cannot be moved due to a jam. Changing the color of the device makes it easier for users to find the correct location.

[0082] The first range can be a sphere drawn with the center point of the device trajectory model or the geometric center point of the device's three-dimensional model as the center, and a radius of 0.1 to 100 times the device's width, preferably three times the device's width. In other words, this form can increase the area of ​​the cutout surface when the transparent model is stretched, i.e., a larger circular cutout surface than the original one, thereby increasing transparency and potentially obstructing the three-dimensional model of the plant where the equipment is observed.

[0083] Each time a large device trajectory model is added, the original device trajectory model may be increased by 3% to 100%, preferably by 8%, with the center of the collection being the origin of the increase.

[0084] As a variant embodiment of the present invention, see Figure 1 , the S400 includes:

[0085] Determine whether the equipment operation data is abnormal. If so, determine whether there is a control abnormality in the equipment operation data. If so, increase the equipment trajectory model proportionally. Determine whether there is an indicator abnormality in the equipment operation data, and increase the vertical height of the large equipment trajectory model.

[0086] The present invention distinguishes the abnormal type of the equipment and thus makes different forms of adjustments. For example, if the equipment control is abnormal, it may not run according to the original motion trajectory within the first unit time, and it is likely to run irregularly, such as a forklift running around. Then, while we can still observe the exterior of the factory building in a certain industrial park through digital twin technology, we should give more observable range inside the factory building to observe the location of the equipment running around, so as to further observe the abnormal situation of the equipment. Or, for example, if the equipment indicators are abnormal, the equipment may have problems such as air leakage, liquid leakage, smoke, and fire. Then, while we can still observe the exterior of the factory building in a certain industrial park through digital twin technology, we should give a larger vertical observable range inside the factory building to further observe the abnormal situation of the equipment.

[0087] If neither control abnormality nor indicator abnormality exists, the color style of the equipment is changed; for example, the three-dimensional model of the equipment is changed to red.

[0088] The proportional increase of the device trajectory model can be understood as increasing the device trajectory model by 3% to 100%, preferably by 8%, with the center of the device trajectory model as the increase origin.

[0089] In some embodiments, see Figure 1 , generates a digital twin video stream based on the 3D model and field of view range frame and sends it to the monitoring end, including:

[0090] S501: Determine whether the number of abnormal device trajectory models within the field of view exceeds a second threshold. If so, jump to S502; if not, jump to S503.

[0091] S502: Determine whether a first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device. If so, reduce the first unit time, jump to S311, and count the number of jumps. When the number of jumps exceeds a fourth threshold, increase the magnification ratio of the field of view frame, jump to S501, and recalculate the number of jumps.

[0092] S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

[0093] The present invention aims to keep the number of abnormalities within the field of view within a reasonable range, for example, less than three. This allows for the screening of device trajectory models with a larger range of motion that is significantly larger than the device's three-dimensional model. By reducing the first unit time, the trajectory models of devices with faster motion and currently not within the field of view are excluded from observation within the field of view. However, the first unit time cannot be continuously reduced. For example, if the reduction is 8% each time, the polling steps above are repeated starting from S311 each time. After three reductions, further reduction is impossible. Instead, the abnormality is considered excessive and there are indeed too many abnormal devices. The magnification ratio of the field of view is increased, that is, the magnification ratio of the lens is increased through optical or electronic zoom. This reduces the total number of devices within the field of view, allowing the user to focus more closely on the abnormal devices within the reasonable range and the specific circumstances of the device abnormalities, allowing for targeted treatment. This improves the observation and focus of the digital twin scene on key devices in the monitoring of adaptive industrial parks.

[0094] Among them, the second threshold can be 1 to 100, preferably 3, that is, when the user observes whether the equipment in the scene is abnormal through digital twin technology, he can only see a maximum of 3 abnormal equipment trajectory models at the same time.

[0095] Among them, the first threshold percentage can be 1% to 99%, preferably 20%, that is, 20% of the device trajectory model should not be larger than the three-dimensional model of the device, or should not be larger than the device model; that is, the device trajectory model should not be much larger than the three-dimensional model of the device, or should not be much larger than the device model. Then, once the above-mentioned problem of being much larger than occurs, it is bound to make it easy for the user to see many device trajectory models within the same field of view, which will prevent the abnormal device that the user is focusing on from being viewed. Therefore, we should reduce the first unit time at this time to reduce the device trajectory model as much as possible, especially the device trajectory model of the device that is moving around randomly.

[0096] Among them, the fourth threshold can be 1 to 100 times, preferably 3 times. That is, the number of times we reduce the device trajectory model by reducing the first unit time should not be reduced three times in a row and still fail to make the number of device trajectory models of abnormal devices in the field of view range frame within a reasonable range, that is, within the second threshold. In this case, we should make the field of view range frame more focused at this time, that is, increase the magnification, so that less content appears in the field of view range frame and the image is more focused on the location where the user is facing.

[0097] The magnification ratio can be 1.1 to 100 times, preferably 1.3 times, i.e., the content of the original field of view frame is 1.3 times the content of the magnified field of view frame. Furthermore, the content of the center point of the field of view frame before and after magnification is the same, i.e., it is the magnification origin.

[0098] It should be noted that the jump times in the above embodiment need to be recalculated. After all, the first unit time is greatly adjusted each time the field of view frame is enlarged, so the content of the field of view frame can be adjusted step by step without superimposed adjustment.

[0099] As a variant embodiment of the present invention, see Figure 1 , generates a digital twin video stream based on the 3D model and field of view range frame and sends it to the monitoring end, including:

[0100] S501: Determine whether the number of abnormal device trajectory models within the field of view exceeds a second threshold. If so, jump to S502; if not, jump to S503.

[0101] S502: Determine whether a first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device. If so, reduce the first unit time, jump to S311, and count the number of jumps. When the number of jumps exceeds a fourth threshold, increase the magnification ratio of the field of view frame, determine whether the magnification ratio of the field of view frame is lower than the third threshold, and if so, increase the second threshold, jump to S501, and recalculate the number of jumps.

[0102] S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

[0103] The present invention aims to keep the number of abnormalities within the field of view within a reasonable range, for example, less than three. This allows for the screening of device trajectory models with larger movement ranges that are significantly larger than the device's three-dimensional model. By reducing the first unit time, device trajectory models of devices with faster movement speeds that are not currently within the field of view are excluded from observation within the current field of view. However, the first unit time cannot be continuously reduced. For example, if it is reduced by 8% each time, the polling steps above are repeated starting from S311 each time. After three reductions, further reduction is not possible. Instead, the abnormal scenario is considered too large and there are indeed too many abnormal devices. The number of abnormal device trajectory models allowed within the field of view is increased. Each jump further reduces the size of the first unit time until the device trajectory model approaches the size of the device. Thus, a reasonable device trajectory model size can be configured based on the movement speed and amplitude of all devices in the industrial park. This allows users to focus more on the abnormal devices within the reasonable range and the specific circumstances of the device abnormalities, and to make targeted treatments, thereby improving the observation and focus of the digital twin scene on key devices in the industrial park.

[0104] Among them, the third threshold can be 1.1 to 100 times, that is, 10 times. If the magnification ratio of the increased field of view range box is too large, the user may not be able to see the overall situation clearly. At this time, we should increase the number of device trajectory models of abnormal devices that we allow to be seen simultaneously within the field of view range box.

[0105] Each time the second threshold is increased, the second threshold can be increased by 1. If this is not enough, the device trajectory model can be allowed to see more abnormal devices.

[0106] The present invention provides an industrial park digital twin scene configuration system, including

[0107] A park acquisition module is used to collect video data and equipment operation data within the industrial park, wherein the image data includes park environment video data and equipment video data;

[0108] A three-dimensional model generation module, which is used to create and update a three-dimensional model of the industrial park in real time based on the video data;

[0109] a transparency processing model for collecting the observation coordinate vector of the monitoring terminal, generating a field of view range frame based on the observation coordinate vector, determining whether a device exists in the three-dimensional model within the field of view range frame, and if so, configuring other three-dimensional models in the area of ​​the device within the three-dimensional model to be transparent;

[0110] An abnormality marking module is used to determine whether the equipment operation data is abnormal. If abnormal, the three-dimensional model of the abnormal equipment is changed;

[0111] The digital twin output module is used to generate a digital twin video stream based on the three-dimensional model and field of view range frame and send it to the monitoring end.

[0112] The present invention uses video data collected in real time in the form of live broadcast or multiple video segments to construct a virtual three-dimensional model of a digital twin, and in order to facilitate the monitoring of the operating status of the equipment, the style of the abnormal three-dimensional model in the above three-dimensional model is changed, so that the monitoring end can more intuitively and visually observe whether it is abnormal. In addition, since the equipment usually appears inside or outside the factory, if the equipment is not inside, other three-dimensional models outside the equipment such as the factory that block the line of sight can be made transparent, so that the status of the equipment can be observed more intuitively, and the entire park can be observed and monitored more conveniently. The present invention can better optimize the integration of industrial parks and digital twins, and facilitate monitoring of equipment and the industrial park itself.

[0113] In some embodiments, see Figure 1 , configuring other three-dimensional models of the area of ​​the device within the three-dimensional model to be transparent includes:

[0114] S311. Obtain a motion trajectory of the device within a first unit time, and take the maximum coordinate position of the motion trajectory of the device to construct a device trajectory model;

[0115] S312, using the outer edge of the device trajectory model that appears within the field of view as the cutting surface and the observation coordinate vector as the stretching direction to construct a transparent model;

[0116] S313: Make the portion of the three-dimensional model that intersects with the transparent model transparent.

[0117] In some embodiments, see Figure 1 The determining whether the equipment operation data is abnormal, and if abnormal, changing the style of the three-dimensional model of the abnormal equipment, includes:

[0118] Determine whether the equipment operation data is abnormal. If so, determine whether there is a control abnormality in the equipment operation data. If so, increase the equipment trajectory model proportionally. Determine whether there is an indicator abnormality in the equipment operation data, and increase the vertical height of the large equipment trajectory model.

[0119] In some embodiments, see Figure 1 , generating a digital twin video stream based on the three-dimensional model and the field of view range frame and sending it to the monitoring end, including:

[0120] S501: Determine whether the number of abnormal device trajectory models within the field of view exceeds a second threshold. If so, jump to S502; if not, jump to S503.

[0121] S502: Determine whether a first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device. If so, reduce the first unit time, jump to S311, and count the number of jumps. When the number of jumps exceeds a fourth threshold, increase the magnification ratio of the field of view frame, determine whether the magnification ratio of the field of view frame is lower than the third threshold, and if so, increase the second threshold, jump to S501, and recalculate the number of jumps.

[0122] S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

[0123] The embodiments described above are merely descriptions of preferred implementations of the present invention and are not intended to limit the scope of the present invention. Without departing from the spirit of the present invention, various modifications and improvements made to the technical solutions of the present invention by ordinary technicians in this field should fall within the scope of protection determined by the claims of the present invention.

Claims

1. A method for configuring a digital twin scene in an industrial park, characterized by: include S100: Collect video data and equipment operation data within the industrial park, wherein the video data includes park environment video data and equipment video data; S200: Creating and updating a three-dimensional model of the industrial park in real time based on the video data; S300: Collecting an observation coordinate vector from the monitoring terminal, generating a field of view frame based on the observation coordinate vector, determining whether a device exists in the three-dimensional model within the field of view frame, and if so, configuring other three-dimensional models in the area of ​​the device within the three-dimensional model to be transparent; S400, determining whether the device operation data is abnormal; if abnormal, changing the style of the three-dimensional model of the abnormal device; S500: Generate a digital twin video stream based on the three-dimensional model and the field of view range frame and send it to the monitoring end; The step S300 of configuring other three-dimensional models of the area of ​​the device within the three-dimensional model to be transparent includes: S311. Obtain a motion trajectory of the device within a first unit time, and take the maximum coordinate position of the motion trajectory of the device to construct a device trajectory model; S312, using the outer edge of the device trajectory model that appears within the field of view as the cutting surface and the observation coordinate vector as the stretching direction to construct a transparent model; S313, making the portion of the three-dimensional model that intersects with the transparent model transparent; The S400 includes: Determine whether the equipment operation data is abnormal. If so, determine whether the equipment operation data has a control abnormality. If so, increase the equipment trajectory model by an equal proportion. Determine whether the equipment operation data has an indicator abnormality, and increase the vertical height of the large equipment trajectory model. Generate a digital twin video stream based on the 3D model and field of view and send it to the monitoring end, including: S501: Determine whether the number of abnormal device trajectory models within the field of view exceeds a second threshold. If so, jump to S502; if not, jump to S503. S502: Determine whether a first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device. If so, reduce the first unit time, jump to S311, and count the number of jumps. When the number of jumps exceeds a fourth threshold, increase the magnification ratio of the field of view frame, determine whether the magnification ratio of the field of view frame is lower than the third threshold, and if so, increase the second threshold, jump to S501, and recalculate the number of jumps. S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

2. An industrial park digital twin scene configuration system, characterized by: include The park collection module is used to collect video data and equipment operation data within the industrial park, wherein the video data includes park environment video data and equipment video data; A three-dimensional model generation module, which is used to create and update a three-dimensional model of the industrial park in real time based on the video data; a transparency processing model for collecting the observation coordinate vector of the monitoring terminal, generating a field of view range frame based on the observation coordinate vector, determining whether a device exists in the three-dimensional model within the field of view range frame, and if so, configuring other three-dimensional models in the area of ​​the device within the three-dimensional model to be transparent; An abnormality marking module is used to determine whether the equipment operation data is abnormal. If abnormal, the three-dimensional model of the abnormal equipment is changed; The digital twin output module is used to generate a digital twin video stream based on the 3D model and the field of view range frame and send it to the monitoring end; The step of configuring other three-dimensional models of the area of ​​the device within the three-dimensional model to be transparent includes: S311. Obtain a motion trajectory of the device within a first unit time, and take the maximum coordinate position of the motion trajectory of the device to construct a device trajectory model; S312, using the outer edge of the device trajectory model that appears within the field of view as the cutting surface and the observation coordinate vector as the stretching direction to construct a transparent model; S313, making the portion of the three-dimensional model that intersects with the transparent model transparent; The determining whether the equipment operation data is abnormal, and if abnormal, changing the style of the three-dimensional model of the abnormal equipment, includes: Determine whether the equipment operation data is abnormal. If so, determine whether the equipment operation data has a control abnormality. If so, increase the equipment trajectory model by an equal proportion. Determine whether the equipment operation data has an indicator abnormality, and increase the vertical height of the large equipment trajectory model. Generating a digital twin video stream based on the three-dimensional model and the field of view range frame and sending it to the monitoring end includes: S501: Determine whether the number of abnormal device trajectory models within the field of view exceeds a second threshold. If so, jump to S502; if not, jump to S503. S502: Determine whether a first threshold percentage of the device trajectory model is greater than the three-dimensional model of the device. If so, reduce the first unit time, jump to S311, and count the number of jumps. When the number of jumps exceeds a fourth threshold, increase the magnification ratio of the field of view frame, determine whether the magnification ratio of the field of view frame is lower than the third threshold, and if so, increase the second threshold, jump to S501, and recalculate the number of jumps. S503: Generate a digital twin video stream from the three-dimensional model within the field of view and send it to the monitoring end.

Images