Virtual sensor creating method and device

Abstract

The embodiment of the invention provides a virtual sensor creation method and device, and the method comprises the steps: building a three-dimensional model database of a virtual sensor based on a three-dimensional model of the sensor, extracting the feature data of the virtual sensor in the three-dimensional model database, carrying out the image recognition of the simulation data of a digital virtual production line, and obtaining a simulation result; acquiring simulation characteristics of the simulation model; and comparing the simulation characteristics with the characteristic data of the virtual sensor, if the comparison succeeds, determining the virtual sensor as a target virtual sensor, creating the corresponding target virtual sensor at the center coordinate of the simulation model, and associating equipment and / or parts in a preset range, thereby saving the time for building a digital virtual production line, and improving the production efficiency. The situation that a large amount of time needs to be consumed for checking due to repeated virtual sensor creation, placement and association operation is reduced, the construction quality of a digital virtual production line is improved, and the situation that virtual debugging is affected by manual misoperation is avoided.

Description

Technical Field

[0001] The present invention relates to the field of virtual debugging, and in particular to a virtual sensor creation method and a virtual sensor creation device. Background Art

[0002] Virtual debugging is a method of testing and debugging products or systems in a virtual environment using computer simulation technology. Modern product design is becoming more and more complex, involving more and more components and systems. Before actual manufacturing and assembly, virtual debugging can detect problems in the design early, reduce the number of physical prototypes, thereby reducing costs and accelerating time to market.

[0003] At present, digital virtual debugging technology is widely used in the automobile manufacturing industry, especially in the body-in-white welding debugging process. Virtual debugging technology can greatly save the on-site debugging and verification cycle.

[0004] The premise of virtual debugging is to build a digital virtual production line, create a virtual sensor unit in the digital virtual production line and associate it with the equipment or parts. The sensor unit is mainly used to detect the position of the equipment action, the position of the parts, and other in-place information; after detecting the in-place information, the in-place information is passed to the Programmable Logic Controller (PLC) for corresponding process logic processing to complete the production of parts.

[0005] Currently, sensor units are created by manually selecting them one by one, which is mainly divided into three steps: 1) Manually create sensor units one by one in the corresponding positions of the digital virtual production line fixture or equipment according to the electrical design drawings; 2) Manually find the precise position to complete the placement of the sensor unit and the equipment position; 3) Manually complete the association of the sensor unit with the equipment or parts.

[0006] This method has problems in the process of building a digital virtual production line, such as a large amount of repetitive work in creating virtual sensor units and performing position matching associations, and the manual creation operation is time-consuming and error-prone. Summary of the invention

[0007] In view of the above problems, embodiments of the present invention are proposed to provide a method and an apparatus for creating a virtual sensor that overcome the above problems or at least partially solve the above problems.

[0008] According to a first aspect of the present invention, a method for creating a virtual sensor is provided, the method comprising:

[0009] Constructing a 3D model database of virtual sensors based on the 3D model of the sensor;

[0010] Extracting feature data of the virtual sensor from the three-dimensional model database;

[0011] Performing image recognition on the area where the virtual sensor needs to be created in the simulation data of the digital virtual production line, and acquiring simulation features of the simulation model in the area;

[0012] Comparing the simulation features of the simulation model with the feature data of the virtual sensor, and if the comparison is successful, determining the virtual sensor as a target virtual sensor;

[0013] Creating the corresponding target virtual sensor at the center coordinates of the simulation model;

[0014] Associate the devices and / or parts within the preset range of the target virtual sensor.

[0015] Optionally, the constructing a three-dimensional model database of a virtual sensor based on the three-dimensional model of the sensor includes:

[0016] Preprocessing the three-dimensional model of the sensor;

[0017] Extracting the type of the sensor and corresponding feature data;

[0018] A three-dimensional model database of a virtual sensor is constructed based on the type of the sensor and the corresponding characteristic data.

[0019] Optionally, the simulation feature at least includes: a feature surface of the simulation model and feature data of the simulation model;

[0020] Performing image recognition on the area where the virtual sensor needs to be created in the simulation data of the digital virtual production line to obtain simulation features of the simulation model in the area includes:

[0021] Obtain simulation data for setting up digital virtual production lines;

[0022] Determine an area in the simulation data where the virtual sensor needs to be created;

[0023] Identify the simulation model within the area based on an image recognition algorithm;

[0024] Acquire a characteristic surface of the simulation model and characteristic data of the simulation model.

[0025] Optionally, the characteristic data at least includes: characteristic size, characteristic size value;

[0026] The step of comparing the simulation features of the simulation model with the feature data of the virtual sensor, and if the comparison is successful, determining the virtual sensor as a target virtual sensor, includes:

[0027] Extracting characteristic dimensions of the simulation model and characteristic dimension values ​​of the simulation model;

[0028] Comparing the characteristic size of the simulation model with the characteristic size of the virtual sensor in the three-dimensional model database, and / or comparing the characteristic size value of the simulation model with the characteristic size value of the virtual sensor in the three-dimensional model database;

[0029] If the characteristic size of the simulation model is the same as the characteristic size of the virtual sensor, and / or the characteristic size value of the simulation model is the same as the characteristic size value of the virtual sensor, then the virtual sensor is determined as the target virtual sensor.

[0030] Optionally, creating the corresponding target virtual sensor at the center coordinates of the simulation model includes:

[0031] Acquire the center coordinates of the simulation model based on the characteristic surface of the simulation model;

[0032] A target virtual sensor is created at the center coordinates of the simulation model.

[0033] Optionally, after associating the equipment and / or parts within a preset range of the target virtual sensor, the method further comprises:

[0034] Generate an information association table based on the information of the created target virtual sensor, wherein the information association table at least includes: the model, location information, associated device information and / or associated parts information of the virtual sensor;

[0035] The information association table is output.

[0036] Optionally, the method further comprises:

[0037] If the characteristic size of the simulation model is different from the characteristic size of the virtual sensor, and / or the characteristic size value of the simulation model is different from the characteristic size value of the virtual sensor, manually selecting a simulation model that does not match the target virtual sensor for definition;

[0038] The simulation features of the simulation model that is not matched to the target virtual sensor are obtained, and the three-dimensional model database is updated.

[0039] According to a second aspect of the present invention, a virtual sensor creation device is provided, the device comprising:

[0040] A database construction module, used for constructing a three-dimensional model database of a virtual sensor based on a three-dimensional model of the sensor;

[0041] A feature extraction module, used to extract feature data of the virtual sensor in the three-dimensional model database;

[0042] An image recognition module performs image recognition on an area in the simulation data of the digital virtual production line where the virtual sensor needs to be created, and obtains simulation features of the simulation model in the area;

[0043] A target virtual sensor confirmation module is used to compare the simulation characteristics of the simulation model with the characteristic data of the virtual sensor, and if the comparison is successful, the virtual sensor is determined as the target virtual sensor;

[0044] A target virtual sensor creation module, used to create the corresponding target virtual sensor at the center coordinates of the simulation model;

[0045] The association module is used to associate the equipment and / or parts within the preset range of the target virtual sensor.

[0046] According to a third aspect of the present invention, there is provided an electronic device, comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; the memory is used to store computer programs; and the processor is used to implement any one of the methods for creating and associating virtual sensors when executing the programs stored in the memory.

[0047] According to a fourth aspect of the present invention, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, any one of the methods for creating and associating virtual sensors is implemented.

[0048] The embodiments of the present invention include the following advantages:

[0049] In an embodiment of the present invention, a three-dimensional model database of a virtual sensor is constructed based on a three-dimensional model of the sensor; feature data of the virtual sensor in the three-dimensional model database is extracted; image recognition is performed on the area where the virtual sensor needs to be created in the simulation data for building a digital virtual production line, and simulation features of the simulation model in the area are obtained; the simulation features of the simulation model are compared with the feature data of the virtual sensor, and if the comparison is successful, the virtual sensor is determined as the target virtual sensor; the corresponding target virtual sensor is created at the center coordinates of the simulation model; and the equipment and / or parts within a preset range of the target virtual sensor are associated. In this way, virtual sensors can be quickly created and associated, which greatly saves construction time and inspection time, reduces the time required for repeated virtual sensor creation, placement, and association operations, improves the construction quality of digital virtual production lines, and avoids manual errors that affect virtual debugging.

[0050] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0052] Figure 1 is a flowchart of a method for creating a virtual sensor according to an embodiment of the present invention;

[0053] Figure 2 is a schematic diagram of a virtual sensor model of a square proximity switch provided by an embodiment of the present invention;

[0054] Figure 3 is a schematic diagram of a virtual sensor model of a cylindrical proximity switch provided by an embodiment of the present invention;

[0055] Figure 4 is a structural block diagram of an embodiment of a virtual sensor creation device of the present invention;

[0056] Figure 5 It is a schematic diagram of an electronic device provided by an embodiment of the present invention.

[0057] Figure 6 It is a schematic diagram of a computer-readable medium provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0058] The exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present invention and to enable the scope of the present invention to be fully conveyed to those skilled in the art.

[0059] The terms "first", "second", etc. in the specification and claims of the present invention are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of the same type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0060] In conjunction with the accompanying drawings, a virtual sensor creation method, device, electronic device and storage medium provided by the embodiments of the present invention are described in detail through specific embodiments and application scenarios.

[0061] With the improvement of computer hardware performance and the development of simulation software, we are able to simulate complex physical phenomena and system behaviors in a virtual environment, which provides a solid technical foundation for virtual debugging. The premise of virtual debugging is to build a digital virtual production line and create virtual sensor units in the digital virtual production line and associate them with equipment or parts.

[0062] Currently, the sensor unit creation method is to manually select and create one by one, which is mainly divided into three steps: 1) manually create sensor units one by one at the corresponding positions of the digital virtual production line fixture or equipment according to the electrical design drawings;

[0063] 2) Manually find the precise position and complete the placement of the sensor unit and the device;

[0064] 3) Manually complete the association of sensor units with equipment or parts.

[0065] This method has problems in the process of building a digital virtual production line, such as a large amount of repetitive work in creating virtual sensor units and performing position matching associations, and the manual creation operation is time-consuming and error-prone.

[0066] The embodiment of the present invention builds a three-dimensional model database of a virtual sensor based on the three-dimensional model of the sensor; extracts feature data of the virtual sensor in the three-dimensional model database; performs image recognition on the area where the virtual sensor needs to be created in the simulation data for building a digital virtual production line, and obtains the simulation features of the simulation model in the area; compares the simulation features of the simulation model with the feature data of the virtual sensor, and if the comparison is successful, determines the virtual sensor as the target virtual sensor; creates the corresponding target virtual sensor at the center coordinates of the simulation model; associates the equipment and / or parts within the preset range of the target virtual sensor, and in this way realizes the rapid creation and placement of virtual sensors, thereby greatly saving construction time and inspection time, reducing the large amount of time spent on repeated virtual sensor creation, placement, and association operations, improving the construction quality of digital virtual production lines, and avoiding manual errors that affect virtual debugging.

[0067] Reference Figure 1 , shows a flowchart of a method for creating a virtual sensor according to an embodiment of the present invention, which may specifically include the following steps:

[0068] Step 101, constructing a three-dimensional model database of a virtual sensor based on the three-dimensional model of the sensor;

[0069] In the virtual debugging process, sensors play a vital role, connecting the physical world and the virtual world. Sensors can sense whether equipment and parts are in place or whether they transmit signals to the programmable logic controller (PLC) for corresponding logical processing, ensuring the accuracy and effectiveness of virtual debugging.

[0070] In this embodiment, a three-dimensional model database of virtual sensors is constructed by acquiring three-dimensional models of various types of sensors.

[0071] Step 102, extracting feature data of the virtual sensor in the three-dimensional model database;

[0072] In this embodiment, different types of sensors have different characteristic data, and the type of the sensor can be determined by the acquired characteristic data of the sensor.

[0073] Step 103, performing image recognition on the area where the virtual sensor needs to be created in the simulation data of the digital virtual production line, and obtaining simulation features of the simulation model in the area;

[0074] The traditional method of creating and associating virtual sensors is to manually create virtual sensors one by one at the corresponding positions of digital virtual production line fixtures or equipment based on electrical design drawings. It is necessary to manually find the precise position, complete the placement of the virtual sensor and the equipment position, and complete the association of the virtual sensor with the equipment and / or parts.

[0075] In an embodiment of the present invention, after starting the simulation software, simulation data for building a digital virtual production line is imported, image recognition is performed on the simulation data for the digital virtual production line, and a three-dimensional model of the simulation data for building the digital virtual production line is extracted, wherein the simulation data includes at least an electrical design drawing, and image recognition is performed on the electrical design drawing to obtain simulation features of the simulation model in the design drawing.

[0076] It should be noted that the simulation data may include electrical design drawings, wiring diagrams, control logic diagrams, assembly drawings, etc., and can be adjusted according to the actual situation of building a digital virtual production line. This application does not make specific limitations on this.

[0077] Step 104, comparing the simulation features of the simulation model with the feature data of the virtual sensor, and if the comparison is successful, determining the virtual sensor as the target virtual sensor;

[0078] In an embodiment of the present invention, the simulation features of the acquired simulation model are compared with the feature data of the virtual sensor in the three-dimensional model database. If the comparison is successful, it means that there is a corresponding virtual sensor for the simulation model in the three-dimensional model database, and the virtual sensor can be confirmed as the target virtual sensor corresponding to the simulation model.

[0079] Step 105, creating the corresponding target virtual sensor at the center coordinate of the simulation model;

[0080] After comparing the simulation data of the simulation model with the characteristic data of the virtual sensor in the three-dimensional model database to obtain the target virtual sensor, the corresponding target virtual sensor is created at the center coordinate of the simulation model. The simulation model and the target virtual sensor are placed at the same center and keep the normal consistent.

[0081] Step 106 , associating the devices and / or parts within a preset range of the target virtual sensor.

[0082] After the target virtual sensor is created, the devices and / or parts within a preset range of the normal direction can be associated based on the center coordinate position information created by the target virtual sensor. For example, the devices and / or parts within 1 mm in the normal direction can be associated.

[0083] It should be noted that the preset range of the normal direction can be adjusted according to the conditions of different devices and / or parts, and this application does not make any specific limitations on this.

[0084] A virtual sensor creation method provided by an embodiment of the present invention builds a three-dimensional model database of a virtual sensor based on a three-dimensional model of the sensor; extracts feature data of the virtual sensor in the three-dimensional model database; performs image recognition on an area in the simulation data for building a digital virtual production line where the virtual sensor needs to be created, and obtains simulation features of the simulation model in the area; compares the simulation features of the simulation model with the feature data of the virtual sensor, and if the comparison is successful, determines the virtual sensor as a target virtual sensor; creates the corresponding target virtual sensor at the center coordinates of the simulation model; associates the equipment and / or parts within a preset range of the target virtual sensor, and in this way realizes the rapid creation and placement of virtual sensors, thereby greatly saving construction time and inspection time, reducing the large amount of time required for repeated virtual sensor creation, placement, and association operations, improving the construction quality of digital virtual production lines, and avoiding manual misoperations that affect virtual debugging.

[0085] In one embodiment of the present invention, the three-dimensional model database of the virtual sensor is constructed based on the three-dimensional model of the sensor, including:

[0086] Preprocessing the three-dimensional model of the sensor;

[0087] Extracting the type of the sensor and corresponding feature data;

[0088] A three-dimensional model database of a virtual sensor is constructed based on the type of the sensor and the corresponding characteristic data.

[0089] In an embodiment of the present invention, a sensor resource directory can be added to the background logic root directory (Sysroot), and various types of sensor three-dimensional models can be stored in the Sysroot basic database to build a three-dimensional model database for virtual sensors. By building a three-dimensional model database for virtual sensors, designers can quickly access and use these models, thereby speeding up product design and development. The acquired model data can be compared with the data in the three-dimensional model database of the virtual sensor to identify whether the model matches the virtual sensor.

[0090] After obtaining the three-dimensional model of the sensor, the data is preprocessed, including resizing, normalization, contrast enhancement, etc., to reduce the complexity of subsequent processing and improve recognition accuracy. In order to train the supervised learning algorithm, the simulation model in the picture can also be labeled, that is, the location and category of the model can be determined.

[0091] After preprocessing the three-dimensional model of the sensor, the type of the sensor and the corresponding characteristic data can be extracted. For example, in some embodiments, the types of sensors include at least: square proximity switches, cylindrical proximity switches, and based on different types of sensors, characteristic data of the sensors of that type are obtained.

[0092] It should be noted that the types of the above sensors can be adjusted according to actual usage or product requirements, and this application does not make any specific limitations on this.

[0093] In one embodiment of the present invention, the simulation features at least include: a feature surface of the simulation model and feature data of the simulation model;

[0094] Performing image recognition on the area where the virtual sensor needs to be created in the simulation data of the digital virtual production line to obtain simulation features of the simulation model in the area includes:

[0095] Obtain simulation data for setting up digital virtual production lines;

[0096] Determine an area in the simulation data where the virtual sensor needs to be created;

[0097] Identify the simulation model within the area based on an image recognition algorithm;

[0098] Acquire a characteristic surface of the simulation model and characteristic data of the simulation model.

[0099] In an embodiment of the present invention, after starting the simulation software, simulation data for building a digital virtual production line is imported, image recognition is performed on the simulation data for the digital virtual production line, and a three-dimensional model of the simulation data for building the digital virtual production line is extracted, wherein the simulation data includes at least an electrical design drawing, and image recognition is performed on the electrical design drawing to obtain simulation features of the simulation model in the design drawing.

[0100] In practical applications, appropriate image recognition algorithms can be selected according to specific needs. Commonly used algorithms include Convolutional Neural Network (CNN), region-based CNN (R-CNN), YOLOV algorithm, Single Shot MultiBox Detector (SSD), etc.

[0101] After the simulation model in the electrical design drawing is identified based on the image recognition algorithm, the characteristic surface and characteristic data of the simulation model can be obtained. By comparing the characteristic data of the simulation model with the characteristic data of the virtual sensor, the virtual sensor matching the simulation model can be determined.

[0102] In one embodiment of the present invention, the characteristic data at least includes: characteristic size, characteristic size value;

[0103] The step of comparing the simulation features of the simulation model with the feature data of the virtual sensor, and if the comparison is successful, determining the virtual sensor as a target virtual sensor, includes:

[0104] Extracting characteristic dimensions of the simulation model and characteristic dimension values ​​of the simulation model;

[0105] Comparing the characteristic size of the simulation model with the characteristic size of the virtual sensor in the three-dimensional model database, and / or comparing the characteristic size value of the simulation model with the characteristic size value of the virtual sensor in the three-dimensional model database;

[0106] If the characteristic size of the simulation model is the same as the characteristic size of the virtual sensor, and / or the characteristic size value of the simulation model is the same as the characteristic size value of the virtual sensor, then the virtual sensor is determined as the target virtual sensor.

[0107] In practical applications, different types of virtual sensors have different characteristic data. In practical applications, the characteristic data can be divided into characteristic size and characteristic size value.

[0108] Reference Figure 2 , Figure 2 Schematic diagram of a virtual sensor model of a square proximity switch provided by an embodiment of the present invention:

[0109] In the virtual sensor model of the square proximity switch, the side length L of the square proximity switch can be determined as the characteristic dimension, and the specific length of the side length L is determined as the characteristic dimension value. For example, in the virtual sensor model of the square proximity switch of model IM5172, its characteristic dimension is the side length L, and the characteristic dimension value is 51 mm.

[0110] Reference Figure 3 , Figure 3 Schematic diagram of a virtual sensor model of a cylindrical proximity switch provided in an embodiment of the present invention:

[0111] In the virtual sensor model of the cylindrical proximity switch, the thread diameter D of the cylindrical proximity switch can be determined as the characteristic dimension, and the specific length of the thread diameter D is determined as the characteristic dimension value. For example, in the virtual sensor model of the cylindrical proximity switch with model BI15U-MT30-AP6X-1141, its characteristic dimension is the thread diameter D, and the characteristic dimension value is 30mm; in the virtual sensor model of the cylindrical proximity switch with model BI4U-MT12-AP6X-1141, its characteristic dimension is the thread diameter D, and the characteristic dimension value is 12mm; in the virtual sensor model of the cylindrical proximity switch with model BI4U-MT18-AP6X-1141, its characteristic dimension is the thread diameter D, and the characteristic dimension value is 18mm.

[0112] In an embodiment of the present invention, by comparing the characteristic dimensions of the simulation model with the characteristic dimensions of the virtual sensor in the three-dimensional model database, and / or comparing the characteristic dimension values ​​of the simulation model with the characteristic dimension values ​​of the virtual sensor in the three-dimensional model database, the target virtual sensor corresponding to the simulation model can be more accurately obtained through comparison of the characteristic dimensions and / or characteristic dimension values.

[0113] If the characteristic size of the simulation model is the same as the characteristic size of the virtual sensor in the three-dimensional model database, and / or the characteristic size value of the simulation model is the same as the characteristic size value of the virtual sensor in the three-dimensional model database, then the simulation model and the virtual sensor in the three-dimensional model database are successfully matched, and the virtual sensor is determined as the target virtual sensor corresponding to the simulation model.

[0114] It should be noted that the types, characteristic dimensions, and characteristic dimension values ​​of the above sensors can be adjusted according to actual usage or product requirements, and this application does not make any specific limitations on this.

[0115] In one embodiment of the present invention, the step of creating the corresponding target virtual sensor at the center coordinate of the simulation model includes:

[0116] Acquire the center coordinates of the simulation model based on the characteristic surface of the simulation model;

[0117] A target virtual sensor is created at the center coordinates of the simulation model.

[0118] The center coordinates of the simulation model are determined based on the characteristic surface of the simulation model. Creating a target virtual sensor at the center coordinates of the simulation model can ensure that the position of the created target virtual sensor coincides with the position of the simulation data and maintains consistency. Specifically, the center of the characteristic surface of the target virtual sensor unit can be placed so as to coincide with the center of the characteristic surface of the simulation model and keep the normal vector consistent.

[0119] In one embodiment of the present invention, after associating the equipment and / or parts within a preset range of the target virtual sensor, the method includes:

[0120] Generate an information association table based on the information of the created target virtual sensor, wherein the information association table at least includes: the model, location information, associated device information and / or associated parts information of the virtual sensor;

[0121] The information association table is output.

[0122] In an embodiment of the present invention, after the target virtual sensor is created at the center coordinates of the simulation model in the electrical design drawing, the equipment and / or parts within a preset range in the normal direction are associated based on the center coordinate position information created by the target virtual sensor. In order to facilitate statistical data on all created virtual sensors, the model, location information, associated equipment information and / or associated parts information of the virtual sensor can be exported in the form of an information association table, so that the association between the virtual sensor and the corresponding equipment and parts can be quickly checked.

[0123] From the information association table, it can be quickly checked whether there are ungenerated virtual sensors and / or virtual sensors with incorrect signal association in the simulation data. If so, the virtual sensors can be manually created and associated.

[0124] In one embodiment of the present invention, the method further comprises:

[0125] If the characteristic size of the simulation model is different from the characteristic size of the virtual sensor, and / or the characteristic size value of the simulation model is different from the characteristic size value of the virtual sensor, manually selecting a simulation model that does not match the target virtual sensor for definition;

[0126] The simulation features of the simulation model that is not matched to the target virtual sensor are obtained, and the three-dimensional model database is updated.

[0127] In an embodiment of the present invention, if the characteristic dimensions of the simulation model are different from the characteristic dimensions of the virtual sensor in the three-dimensional model database, and / or the characteristic dimension value of the simulation model is different from the characteristic dimension value of the virtual sensor in the three-dimensional model database, then the simulation model does not match the corresponding target virtual sensor in the three-dimensional model database, and it is necessary to manually define the simulation model and update the simulation features of the simulation model that does not match the target virtual sensor to the three-dimensional model database.

[0128] In practical applications, if there is a simulation model of a virtual sensor that is missing or not matched to the three-dimensional model database in the electrical design drawing, the simulation model can be manually selected for definition. After the definition is completed, a corresponding virtual sensor is created at the center of the simulation model. Then, an image recognition algorithm is used to scan the environmental data in the electrical design drawing, and the same type of simulation model is automatically generated into a corresponding virtual sensor, which is memorized in the background.

[0129] A virtual sensor creation method provided by an embodiment of the present invention builds a three-dimensional model database of a virtual sensor based on a three-dimensional model of the sensor; extracts feature data of the virtual sensor in the three-dimensional model database; performs image recognition on an area in the simulation data for building a digital virtual production line where the virtual sensor needs to be created, and obtains simulation features of the simulation model in the area; compares the simulation features of the simulation model with the feature data of the virtual sensor, and if the comparison is successful, determines the virtual sensor as a target virtual sensor; creates the corresponding target virtual sensor at the center coordinates of the simulation model; associates the equipment and / or parts within a preset range of the target virtual sensor, and in this way realizes the rapid creation and placement of virtual sensors, thereby greatly saving construction time and inspection time, reducing the large amount of time required for repeated virtual sensor creation, placement, and association operations, improving the construction quality of digital virtual production lines, and avoiding manual misoperations that affect virtual debugging.

[0130] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0131] Reference Figure 4 , shows a structural block diagram of an embodiment of a virtual sensor creation device of the present invention, which may specifically include the following modules:

[0132] A database construction module 401 is used to construct a three-dimensional model database of a virtual sensor based on a three-dimensional model of the sensor;

[0133] A feature extraction module 402, used to extract feature data of the virtual sensor in the three-dimensional model database;

[0134] An image recognition module 403 is used to perform image recognition on the area where the virtual sensor needs to be created in the simulation data of the digital virtual production line, and obtain simulation features of the simulation model in the area;

[0135] A target virtual sensor confirmation module 404 is used to compare the simulation characteristics of the simulation model with the characteristic data of the virtual sensor, and if the comparison is successful, the virtual sensor is determined as the target virtual sensor;

[0136] A target virtual sensor creation module 405 is used to create the corresponding target virtual sensor at the center coordinate of the simulation model;

[0137] The association module 406 is used to associate the equipment and / or parts within the preset range of the target virtual sensor.

[0138] Optionally, the database construction module 401 includes:

[0139] A model preprocessing module, used for preprocessing the three-dimensional model of the sensor;

[0140] A model feature extraction module, used to extract the type of the sensor and corresponding feature data;

[0141] The model feature storage module is used to construct a three-dimensional model database of the virtual sensor based on the type of the sensor and the corresponding feature data.

[0142] Optionally, the simulation feature at least includes: a feature surface of the simulation model and feature data of the simulation model, and the image recognition module 403 includes:

[0143] A simulation data acquisition module is used to obtain simulation data for building a digital virtual production line;

[0144] A simulation data analysis module, used to determine the area in the simulation data where the virtual sensor needs to be created;

[0145] The simulation model image recognition module is used to recognize the simulation model in the area based on an image recognition algorithm; and obtain the characteristic surface of the simulation model and the characteristic data of the simulation model.

[0146] Optionally, the feature data at least includes: feature size and feature size value; the target virtual sensor confirmation module 404 includes:

[0147] A simulation model feature extraction module, used to extract the feature size of the simulation model and the feature size value of the simulation model;

[0148] A feature comparison module, used to compare the feature size of the simulation model with the feature size of the virtual sensor in the three-dimensional model database, and / or to compare the feature size value of the simulation model with the feature size value of the virtual sensor in the three-dimensional model database;

[0149] The feature judgment module is used to determine the virtual sensor as a target virtual sensor if the feature size of the simulation model is the same as the feature size of the virtual sensor, and / or the feature size value of the simulation model is the same as the feature size value of the virtual sensor.

[0150] Optionally, the target virtual sensor creation module 405 includes:

[0151] A center coordinate determination module, used for obtaining the center coordinates of the simulation model based on the characteristic surface of the simulation model;

[0152] The target virtual sensor creation submodule is used to create a target virtual sensor at the center coordinates of the simulation model.

[0153] Optionally, the device further comprises:

[0154] An information association table generating module, used to generate an information association table from the information of the created target virtual sensor, wherein the information association table at least includes: the model, location information, associated device information and / or associated parts information of the virtual sensor;

[0155] The information association table output module is used to output the information association table.

[0156] Optionally, the device further comprises:

[0157] A simulation model redefinition module, for manually selecting a simulation model that does not match the target virtual sensor for definition if the characteristic size of the simulation model is different from the characteristic size of the virtual sensor and / or the characteristic size value of the simulation model is different from the characteristic size value of the virtual sensor;

[0158] The database updating module is used to obtain the feature data of the simulation model that is not matched to the target virtual sensor and update the three-dimensional model database.

[0159] In an embodiment of the present invention, the device for creating and associating a virtual sensor provided by the embodiment of the present invention builds a three-dimensional model database of a virtual sensor based on a three-dimensional model of the sensor; extracts feature data of the virtual sensor in the three-dimensional model database; performs image recognition on the area where the virtual sensor needs to be created in the simulation data for building a digital virtual production line, and obtains simulation features of the simulation model in the area; compares the simulation features of the simulation model with the feature data of the virtual sensor, and if the comparison is successful, determines the virtual sensor as the target virtual sensor; creates the corresponding target virtual sensor at the center coordinates of the simulation model; associates the equipment and / or parts within the preset range of the target virtual sensor, and in this way realizes the rapid creation and placement of virtual sensors, thereby greatly saving construction time and inspection time, reducing the large amount of time required for repeated virtual sensor creation, placement, and association operations, improving the construction quality of digital virtual production lines, and avoiding manual errors that affect virtual debugging.

[0160] Based on the same inventive concept, another embodiment of the present invention provides an electronic device 500, such as Figure 5 shown. Figure 5 1 is a schematic diagram of an electronic device according to an embodiment of the present invention. The electronic device includes a memory 502, a processor 501, and a computer program stored in the memory and executable on the processor, and when executed by the processor, the steps in the method for creating and associating virtual sensors according to any of the above embodiments of the present invention are implemented.

[0161] Based on the same inventive concept, another embodiment of the present invention provides a computer-readable storage medium 601, such as Figure 6 shown. Figure 6 The present invention provides a schematic diagram of a computer-readable storage medium in an embodiment of the present invention. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the method for creating and associating virtual sensors as described in any of the above embodiments of the present invention are implemented.

[0162] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0163] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, embodiments of the present invention may take the form of complete hardware embodiments, complete software embodiments, or embodiments combining software and hardware. Furthermore, embodiments of the present invention may take the form of computer program products implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0164] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0165] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0166] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0167] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0168] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0169] The above is a detailed introduction to a virtual sensor creation method, device, electronic device and storage medium provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A method for creating a virtual sensor, characterized in that: Applied to a digital virtual production line, the method includes: Constructing a 3D model database of virtual sensors based on the 3D model of the sensor; Extracting feature data of the virtual sensor from the three-dimensional model database; Performing image recognition on the area where the virtual sensor needs to be created in the simulation data of the digital virtual production line, and acquiring simulation features of the simulation model in the area; Comparing the simulation features of the simulation model with the feature data of the virtual sensor, and if the comparison is successful, determining the virtual sensor as a target virtual sensor; Creating the corresponding target virtual sensor at the center coordinates of the simulation model; Associate the devices and / or parts within the preset range of the target virtual sensor.

2. The method according to claim 1, characterized in that The three-dimensional model database of the virtual sensor is constructed based on the three-dimensional model of the sensor, including: Preprocessing the three-dimensional model of the sensor; Extracting the type of the sensor and corresponding feature data; A three-dimensional model database of a virtual sensor is constructed based on the type of the sensor and the corresponding characteristic data.

3. The method according to claim 1, characterized in that The simulation features at least include: a feature surface of the simulation model and feature data of the simulation model; Performing image recognition on the area where the virtual sensor needs to be created in the simulation data of the digital virtual production line to obtain simulation features of the simulation model in the area includes: Obtain simulation data for setting up digital virtual production lines; Determine an area in the simulation data where the virtual sensor needs to be created; Identify the simulation model within the area based on an image recognition algorithm; Acquire a characteristic surface of the simulation model and characteristic data of the simulation model.

4. The method according to claim 3, characterized in that The characteristic data at least includes: characteristic size and characteristic size value; The step of comparing the simulation features of the simulation model with the feature data of the virtual sensor, and if the comparison is successful, determining the virtual sensor as a target virtual sensor, includes: Extracting characteristic dimensions of the simulation model and characteristic dimension values ​​of the simulation model; Comparing the characteristic size of the simulation model with the characteristic size of the virtual sensor in the three-dimensional model database, and / or comparing the characteristic size value of the simulation model with the characteristic size value of the virtual sensor in the three-dimensional model database; If the characteristic size of the simulation model is the same as the characteristic size of the virtual sensor, and / or the characteristic size value of the simulation model is the same as the characteristic size value of the virtual sensor, then the virtual sensor is determined as the target virtual sensor.

5. The method according to claim 3, characterized in that: The step of creating the corresponding target virtual sensor at the center coordinate of the simulation model includes: Acquire the center coordinates of the simulation model based on the characteristic surface of the simulation model; A target virtual sensor is created at the center coordinates of the simulation model.

6. The method according to claim 1, characterized in that After associating the equipment and / or parts within the preset range of the target virtual sensor, it includes: Generate an information association table based on the information of the created target virtual sensor, wherein the information association table at least includes: the model, location information, associated device information and / or associated parts information of the virtual sensor; The information association table is output.

7. The method according to claim 4, further comprising: If the characteristic size of the simulation model is different from the characteristic size of the virtual sensor, and / or the characteristic size value of the simulation model is different from the characteristic size value of the virtual sensor, manually selecting a simulation model that does not match the target virtual sensor for definition; The simulation features of the simulation model that is not matched to the target virtual sensor are obtained, and the three-dimensional model database is updated.

8. A virtual sensor creation device, characterized in that: Applied to a digital virtual production line, the device comprises: A database construction module, used for constructing a three-dimensional model database of a virtual sensor based on a three-dimensional model of the sensor; A feature extraction module, used to extract feature data of the virtual sensor in the three-dimensional model database; An image recognition module, used to perform image recognition on an area in the simulation data of the digital virtual production line where the virtual sensor needs to be created, and obtain simulation features of the simulation model in the area; A target virtual sensor confirmation module is used to compare the simulation characteristics of the simulation model with the characteristic data of the virtual sensor, and if the comparison is successful, the virtual sensor is determined as the target virtual sensor; A target virtual sensor creation module, used to create the corresponding target virtual sensor at the center coordinate of the simulation model; The association module is used to associate the equipment and / or parts within the preset range of the target virtual sensor.

9. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; The memory is used to store computer programs; The processor is used to implement the method according to any one of claims 1 to 7 when executing the program stored in the memory.

10. A computer-readable storage medium having instructions stored thereon, which, when executed by one or more processors, cause the processors to perform the method according to any one of claims 1 to 7.

Images