Intelligent signboard structure for raw material inspection of stock bin of mixing station and use method of intelligent signboard structure

By designing an automated intelligent sign structure in the mixing station silo, the robotic arm and face/height recognition module are used to automatically adjust the position of the sign, and protect the staff through protective covers, the difficulty of adjusting the position of the existing sign and The problem of construction debris damage improves work efficiency and safety.

CN118918623APending Publication Date: 2024-11-08CHINA CONSTR SECOND ENG BUREAU LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410931491.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-12
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

The existing mixing station silo signs can only be raised and lowered. The inconsistent height of the staff members leads to the position adjustment. They are easily damaged by construction debris outside the construction site, resulting in damage to the display screen and injury to the staff.

Method used

Design an intelligent signboard structure including signboards, robotic arms, protective covers, signboard control system and mixing station control system. Use the robotic arms and face/height recognition module to automatically adjust the position of signboards, and the protective cover protects staff. , the communication module and the mixing station are interconnected.

Benefits of technology

The automatic position adjustment of the signboard is realized, which improves work efficiency, reduces space occupation, avoids equipment damage and staff injuries, and enhances safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118918623A_ABST
    Figure CN118918623A_ABST
Patent Text Reader

Abstract

The invention provides a mixing station stock bin raw material inspection intelligent signboard structure and a using method, and belongs to the technical field of building construction, the mixing station stock bin raw material inspection intelligent signboard structure comprises a signboard, a mechanical arm, a protective cover, a signboard control system and a mixing station control system, and the signboard control system is used for controlling information displayed by the signboard and position adjustment; the data processing module comprises an image processing unit, a human body detection unit, a feature extraction unit, a key point positioning unit, a face matching unit, a data calibration unit and a data output unit. The problems that a signboard can only be lifted up and down, the heights of workers are different, the positions of the signboard need to be changed when the signboard is used by different workers, the signboard is generally arranged outside a mixing station bin, the mixing station is located near a building construction site, construction chippings splash, a display screen is damaged, and the display screen is damaged are solved. And a worker can be injured by a crashing object.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of building construction, and in particular, relates to a structure and a use method of an intelligent identification plate for raw material inspection in a mixing station silo. Background Art

[0002] After the gravel is brought into the concrete mixing station, the signboard can clearly indicate the type of material stored in each silo, the specification model, date of arrival, manufacturer, inspection date, etc., and can be used cyclically, especially by using push-pull signboards, which can easily and conveniently switch between "inspected" and "to be inspected", and clearly display whether the material has been inspected, so as to prevent the loading personnel from mistakenly using uninspected materials for concrete mixing.

[0003] At present, the identification plates of mixing station silos are fixed, which cannot prominently display the inspection status. It happens from time to time that the loading personnel mistakenly use uninspected materials for mixing concrete, and the content of the identification plates is generally changed by handwriting. There are a large number of silos, and manual updating of the content affects the timeliness of the data.

[0004] For example, Chinese patent application number CN202121053126.7 is an intelligent information identification device for concrete mixing station material yards, which displays information through LED display screens and mobile phones, but the signboard can only be raised and lowered, and the heights of the staff are inconsistent, resulting in different staff members needing to change the position of the signboard when using it, and the signboard is generally set outside the mixing station silo, and the mixing station is located near the construction site, which has the problem of construction debris splashing, causing the display screen to be damaged and the staff to be injured. For this reason, a safer intelligent signboard structure and method of use for raw material inspection in mixing station silos is designed. Summary of the invention

[0005] The embodiment of the present invention provides a structure and use method of an intelligent signboard for raw material inspection in a mixing station silo, which solves the problem that the signboard can only be raised and lowered, and the heights of the workers are inconsistent, resulting in the need to change the position of the signboard when different workers use it. In addition, the signboard is generally set outside the mixing station silo, and the mixing station is located near the construction site, so there is a problem of construction debris flying, which may cause the display screen to be damaged and the workers to be injured.

[0006] In view of the above problems, the technical solution proposed by the present invention is:

[0007] The present invention provides a mixing station silo raw material inspection intelligent sign structure, comprising a sign, a mechanical arm, a protective cover, a sign control system and a mixing station control system, wherein a display, a camera and a button are embedded on the front side of the sign;

[0008] The mechanical arm is arranged at the rear side of the identification plate, and comprises a driving arm, an adjusting arm, a connecting arm and a motor compartment, wherein the adjusting arm is located between the driving arm and the connecting arm, the connecting arm is screwed to the rear side of the identification plate, and the motor compartment is located at both ends of the driving arm;

[0009] The protective cover is arranged just above the identification plate, a connecting rod is arranged on the inner side of the protective cover, a fixing block for fixing the connecting rod is arranged on the inner side of the protective cover, a gear is arranged on the outer side of the connecting rod, a rotating shaft is arranged below the gear, and one end of the rotating shaft is connected to a motor;

[0010] The sign control system is used to control the information displayed on the sign and the position adjustment. The sign control system includes a data acquisition module, a face recognition module, a height recognition module, a data processing module, an alarm module, a data storage platform and a communication module;

[0011] The data acquisition module is used to collect movement data of the robotic arm and image data of the staff;

[0012] The face recognition module is used to recognize the face information of the staff;

[0013] The height recognition module is used to recognize the height information of the staff member;

[0014] The data processing module is used to process the information collected by the data collection module and provide data information to the face recognition module and the height recognition module. The data processing module includes an image processing unit, a human body detection unit, a feature extraction unit, a key point positioning unit, a face matching unit, a data calibration unit and a data output unit;

[0015] The image processing unit uses MATLAB language to perform preliminary processing on the staff image data collected by the collection module;

[0016] The human body detection unit recognizes the human body from the image processed by the image processing unit by using the human body segmentation technology;

[0017] The feature extraction unit extracts facial texture features from the image segmented by the human body detection unit using gray level co-occurrence matrix technology and other feature technologies;

[0018] The key point positioning unit uses posture estimation technology to locate key points of the human image of the human detection unit, including the head, torso, hands, legs and feet;

[0019] The face matching unit is used to identify and match the face information data in the data storage platform;

[0020] The data calibration unit is used to calibrate the paired data of the face pairing unit to check whether there is any error;

[0021] The data output unit is used to transmit the data proofread by the data calibration unit;

[0022] The alarm module is used to alarm when the displacement data of the robot arm and the image data of the staff collected by the data collection module exceed the threshold and the preset information;

[0023] The data storage platform is used to store information related to the identification card work, and the data storage platform includes an identity entry unit, an authority division unit, an information matching unit, an information tracking unit and an early warning unit;

[0024] The communication module uses wireless communication technology to exchange data between the sign control system and the mixing station control system.

[0025] As a preferred technical solution of the present invention, the driving arm is U-shaped, the motor compartment is arranged at both ends of the driving arm, and a motor a and a motor b are arranged inside the motor compartment, wherein the output end of one motor a is transmission-connected to the adjusting arm, and the output end of the other motor b is transmission-connected to the mounting block;

[0026] The side of the protective cover is of trapezoidal design, the connecting rod is fixedly connected to the fixed block, the connecting rod passes through the gear and is plugged into the gear, the gear is arranged at the center of the connecting rod, the outer surface of the rotating shaft is provided with a meshing groove adapted to the gear, the output end of the motor is rotatably connected to the rotating shaft, and the motor is embedded on the rear side of the identification plate.

[0027] As a preferred technical solution of the present invention, the data acquisition module includes a mechanical arm displacement acquisition unit and a human body image acquisition unit. The mechanical arm displacement acquisition unit uses a sensor to collect the movement state and actual position of the mechanical arm. The sensor includes a six-axis motion sensor, an angle sensor and an encoder, specifically including:

[0028] A, the sign control system controls the movement of the robotic arm, installs a six-axis motion sensor at the joint near the end of the robotic arm, captures the movement and direction of the end of the robotic arm, and fuses the data through the Kalman filter to obtain the posture and position of the robotic arm;

[0029] B, installing an angle sensor at the joint of the robotic arm to measure the rotation angle of the joint;

[0030] C, installing an encoder on the motor a and the motor b of the robot arm, the encoder is directly connected to the motor shafts of the motor a and the motor b, and provides position and speed information of the robot arm;

[0031] The human body image acquisition unit uses the camera to capture images of the staff, and the camera includes one or more of a binocular camera, a motion detection camera, or a camera with a pan / tilt function.

[0032] As a preferred technical solution of the present invention, the image processing unit uses MATLAB language to search and remove missing, blurred, and duplicate images of image data, establishes a mapping between image color and temperature value, converts the image into an array representing the temperature value, calculates the temperature difference of the image data with reference to the thermal stress model, and enhances the visual effect of the image;

[0033] The human body detection unit recognizes the human body from the image processed by the image processing unit by using the human body segmentation technology, specifically including: using the graphic data processed by the image processing unit, using the human body detection algorithm to detect the human body in the image, on this basis, using the region segmentation technology to segment the human body, and using the edge algorithm to extract the human body contour to obtain human body data;

[0034] The feature extraction unit uses the gray level co-occurrence matrix technology to extract facial texture features, specifically including: selecting a pixel point of the image data as the central pixel, and calculating the gray level difference between the central pixel and its surrounding pixels, and obtaining statistical characteristics by calculating the gray level co-occurrence matrix; using the calculated statistical characteristics as features, and representing the selected features as vectors or matrices for subsequent recognition tasks.

[0035] As a preferred technical solution of the present invention, the key point positioning unit performs key point positioning specifically including:

[0036] a. Use the VGG19 network to extract image features and generate feature maps;

[0037] b. Use the posture estimation technology to process the feature map, generate the PCM in the posture estimation technology to determine the position of each key point in the image, and determine the connection relationship between the key points through the PAF;

[0038] c. Combining the information of PCM and PAF, the algorithm is used to construct the human skeleton.

[0039] As a preferred technical solution of the present invention, the face recognition module and the height recognition module use the data processed by the data processing module to perform face and height recognition, and face recognition specifically includes: using the image data processed by the image processing unit, performing image segmentation to identify the human body through the human body detection unit, then extracting the features of the human body image through the feature extraction unit, using the face matching unit to compare the extracted face data with the face data stored in the data storage platform, using the data calibration unit to directly compare the face data stored in the data storage platform with the data to be calibrated using a direct comparison method, determine the deviation, adjust the recognized face information, and send the recognition information to the sign control system through the data output unit;

[0040] Height recognition specifically includes: using the segmented human body features to identify key parts of the human body through a key point positioning unit, obtaining the positions of the head and feet, calculating the height of the person in the image, and calculating the position to which the sign should be moved based on the identified height and head position, and sending identification information to the sign control system through a data output unit. After receiving the positioning information, the sign control system generates a movement instruction for the robotic arm, and the robotic arm moves the sign to the specified position according to the instruction.

[0041] As a preferred technical solution of the present invention, the identity input unit is used to input the identity information of the staff, including face, job position and job content;

[0042] The authority division unit is used to divide access rights according to the job content of the staff;

[0043] The information matching unit is used to provide the face recognition module with matching information of the face and the identity;

[0044] The information tracking unit is used to track the operation of the worker in the mixing plant control system after the facial recognition module fails to pair;

[0045] The early warning unit is used to give early warning prompts to staff members for forced operations that exceed their authority in the sign control system.

[0046] On the other hand, a method for inspecting raw materials in a mixing station silo and using an intelligent identification plate structure and method comprises the following steps:

[0047] S1, install the identification plate outside the mixing plant silo through the robotic arm, use the communication module to communicate with the mixing plant control system, remotely obtain the inspection information of the raw materials, display the inspection information of the raw materials through the display of the identification plate, and alarm through the alarm module when the raw materials are unqualified, and store the inspection information through the data storage platform;

[0048] S2, when manual inspection or modification is required, the staff member walks to the identification range of the sign, processes the image captured by the camera through the data processing module, uses the face recognition module to identify the staff member's authority, and uses the height recognition module to identify the staff member's height;

[0049] S3, based on the recognition result, the sign control system controls the robot arm to move the sign to a position where the staff can view it, and the staff views and operates the information on the sign according to their authority;

[0050] S4, while the sign is moving, the sign control system controls the motor, the motor drives the rotating shaft to rotate, the rotating shaft drives the gear to rotate using the meshing groove, the gear drives the protective cover connected to the connecting rod to rotate, and controls the protective cover to rotate forward until the protective cover can cover the staff underneath.

[0051] Compared with the prior art, the beneficial effects of the present invention are:

[0052] (1) The present invention sets the signboard in a hanging style. When no one is operating, it can be folded by a mechanical arm, thereby reducing the occupied space and preventing it from being damaged by passing mechanical equipment. The signboard and the staff using the signboard are protected by a protective cover to prevent them from being hit by construction debris.

[0053] (2) The present invention sets up a nameplate control system, uses a camera to cooperate with face recognition to identify the identity of the operator, uses posture estimation technology to identify the height of the operator, and controls the robot arm to move the nameplate to the face position of the staff member based on the height recognition data. Through automated face recognition and height recognition, the position of the person can be quickly and accurately located, thereby improving work efficiency.

[0054] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] Figure 1 It is a schematic diagram of the overall structure of an intelligent identification plate structure for raw material inspection in a mixing station silo disclosed in the present invention;

[0056] Figure 2 It is a partial structural schematic diagram of a raw material inspection intelligent identification plate structure for a mixing station silo disclosed in the present invention;

[0057] Figure 3It is a structural schematic diagram of part A of a partial structural schematic diagram of a raw material inspection intelligent identification plate structure for a mixing station silo disclosed in the present invention;

[0058] Figure 4 It is a schematic diagram of the rear structure of a raw material inspection intelligent identification plate structure for a mixing station silo disclosed in the present invention;

[0059] Figure 5 It is an electrical connection block diagram of a sign control system of an intelligent sign structure for raw material inspection in a mixing station silo disclosed in the present invention;

[0060] Figure 6 It is an electrical connection block diagram of a data storage platform of a sign control system of an intelligent sign structure for raw material inspection in a mixing station silo disclosed in the present invention;

[0061] Figure 7 It is a flow chart of a method for using a mixing station silo raw material inspection intelligent identification plate structure disclosed in the present invention;

[0062] Description of reference numerals: 100, identification plate; 101, display; 102, camera; 103, button; 200, mechanical arm; 201, mounting block; 202, driving arm; 203, adjusting arm; 204, connecting arm; 205, motor compartment; 300, protective cover; 301, fixing block; 302, connecting rod; 303, gear; 304, rotating shaft; 305, motor; 306, meshing groove; 400, identification plate control system; 401, data acquisition module; 4011, mechanical arm displacement acquisition unit; 4012, human image acquisition unit; 402, face recognition module; 403, human body image acquisition unit; 404, human face recognition module; 405, human body image acquisition unit; 406, human face recognition module; 407, human body image acquisition unit; 408, human body image acquisition unit; 409, human body image acquisition unit; 410, human body image acquisition unit; 411, human body image acquisition unit; 412, human body image acquisition unit; 413, human body image acquisition unit; 414, human body image acquisition unit; 415, human body image acquisition unit; 416, human body image acquisition unit; 417, human body image acquisition unit; 418, human body image acquisition unit; 419, human body image acquisition unit; 420, human body image acquisition unit; 421, human body image acquisition unit; 422, human body image acquisition unit; 423, human body image acquisition unit; 424, human body image acquisition unit; 425, human body image acquisition unit; 426, human body image acquisition unit; 427, human body image acquisition unit; 428, human body image acquisition unit; 429, human body image acquisition unit; 430, human body image acquisition unit; 431, human body image acquisition unit; 43 03. Height recognition module; 404. Data processing module; 4041. Image processing unit; 4042. Human body detection unit; 4043. Feature extraction unit; 4044. Key point positioning unit; 4045. Face matching unit; 4046. Data calibration unit; 4047. Data output unit; 405. Alarm module; 406. Data storage platform; 4061. Identity entry unit; 4062. Authority division unit; 4063. Information matching unit; 4064. Information tracking unit; 4065. Early warning unit; 407. Communication module; 500. Mixing station control system. DETAILED DESCRIPTION

[0063] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0064] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention claimed for protection, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0065] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0066] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present invention.

[0067] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0068] Embodiment 1

[0069] See attached Figure 1-6 As shown, the present invention provides a technical solution: an intelligent sign structure for raw material inspection of a mixing station silo, comprising a sign 100, a mechanical arm 200, a protective cover 300, a sign control system 400 and a mixing station control system 500, wherein a display 101, a camera 102 and a button 103 are embedded on the front side of the sign 100;

[0070] The mechanical arm 200 is arranged at the rear side of the identification plate 100, and the mechanical arm 200 includes a driving arm 202, an adjusting arm 203, a connecting arm 204 and a motor compartment 205. The adjusting arm 203 is located between the driving arm 202 and the connecting arm 204, the connecting arm 204 is screwed to the rear side of the identification plate 100, and the motor compartment 205 is located at both ends of the driving arm 202;

[0071] The protective cover 300 is arranged just above the identification plate 100, a connecting rod 302 is arranged inside the protective cover 300, a fixing block 301 for fixing the connecting rod 302 is arranged inside the protective cover 300, a gear 303 is arranged outside the connecting rod 302, a rotating shaft 304 is arranged below the gear 303, and one end of the rotating shaft 304 is connected to a motor 305;

[0072] The sign control system 400 is used to control the information displayed on the sign 100 and the position adjustment. The sign control system 400 includes a data acquisition module 401, a face recognition module 402, a height recognition module 403, a data processing module 404, an alarm module 405, a data storage platform 406 and a communication module 407;

[0073] The data acquisition module 401 is used to collect movement data of the robot arm 200 and image data of the staff;

[0074] The face recognition module 402 is used to recognize the face information of the staff;

[0075] The height recognition module 403 is used to recognize the height information of the staff member;

[0076] The data processing module 404 is used to process the information collected by the data collection module 401 and provide data information to the face recognition module 402 and the height recognition module 403. The data processing module 404 includes an image processing unit 4041, a human body detection unit 4042, a feature extraction unit 4043, a key point positioning unit 4044, a face matching unit, a data calibration unit 4046 and a data output unit 4047;

[0077] The image processing unit 4041 uses MATLAB language to perform preliminary processing on the staff image data collected by the collection module;

[0078] The human body detection unit 4042 recognizes the human body from the image processed by the image processing unit 4041 using the human body segmentation technology;

[0079] The feature extraction unit 4043 extracts facial texture features from the image segmented by the human body detection unit 4042 using gray level co-occurrence matrix technology and other feature technologies. Other feature technologies include edge-based HOG features, local binary pattern-based LBP features, etc., to improve the accuracy of recognition.

[0080] The key point positioning unit 4044 uses the posture estimation technology to locate the key points of the human image of the human body detection unit 4042, including the head, torso, hands, legs and feet;

[0081] The face matching unit is used to identify and match the face information data in the data storage platform 406;

[0082] The data calibration unit 4046 is used to calibrate the paired data of the face pairing unit to check whether there is any error;

[0083] The data output unit 4047 is used to transmit the data proofread by the data calibration unit 4046;

[0084] The alarm module 405 is used to generate an alarm when the displacement data of the robot arm 200 and the image data of the staff collected by the data collection module 401 exceed the threshold and the preset information;

[0085] The data storage platform 406 is used to store information related to the work of the identification plate 100, and the data storage platform 406 includes an identity entry unit 4061, an authority division unit 4062, an information matching unit 4063, an information tracking unit 4064 and an early warning unit 4065;

[0086] The communication module 407 uses wireless communication technology to exchange data between the sign control system 400 and the mixing station control system 500.

[0087] The embodiment of the present invention is also implemented through the following technical solutions.

[0088] In the embodiment of the present invention, the driving arm 202 is of U-shaped design, the motor compartment 205 is arranged at both ends of the driving arm 202, and the motor a and the motor b are arranged inside the motor compartment 205, wherein the output end of one motor a is transmission-connected to the adjusting arm 203, and the output end of the other motor b is transmission-connected to the mounting block 201, the identification plate 100 is mounted on the fixed surface through the mounting block 201, and the movement of the Io unlocking 203 is controlled by the motor a and the motor b;

[0089] The side of the protective cover 300 is of trapezoidal design. The connecting rod 302 is fixedly connected to the fixed block 301. The connecting rod 302 passes through the gear 303 and is plugged into the gear 303. The gear 303 is arranged at the center of the connecting rod 302. The outer surface of the rotating shaft 304 is provided with an engagement groove 306 adapted to the gear 303. The output end of the motor 305 is rotatably connected to the rotating shaft 304. The motor 305 is embedded in the rear side of the sign 100. The motor 305 is a micro motor. The rotation of the rotating shaft 304 is controlled by the motor 305. The engagement groove 306 on the outer side of the rotating shaft 304 drives the gear 303 to rotate, thereby driving the connecting rod 302 connected to the gear 303 to rotate, and the use angle adjustment of the protective cover 300 is realized through the connecting rod 303.

[0090] In addition, the installation direction of the motor a and the motor b in the driving arm 202 is not fixed, and they can be installed vertically or horizontally according to the actual site conditions, as long as they meet reasonable installation requirements.

[0091] In an embodiment of the present invention, the data acquisition module 401 includes a robot arm displacement acquisition unit 4011 and a human body image acquisition unit 4012. The robot arm displacement acquisition unit 4011 uses a sensor to collect the movement state and actual position of the robot arm 200. The sensor includes a six-axis motion sensor, an angle sensor and an encoder, specifically including:

[0092] A. The sign control system 400 controls the movement of the robot arm 200. A six-axis motion sensor is installed at the joint near the end of the robot arm 200 to capture the movement and direction of the end of the robot arm 200. The Kalman filter fuses the data to obtain the posture and position of the robot arm 200.

[0093] B, installing an angle sensor at the joint of the robot arm 200 to measure the rotation angle of the joint;

[0094] C. Install an encoder on the motor a and motor b of the robot arm 200. The encoder is directly connected to the motor 305 shaft of the motor a and motor b to provide position and speed information of the robot arm 200. The number of pulses output by the encoder is proportional to the rotation of the motor 305 shaft. The pulse signal of the encoder is read in real time and converted into position and speed information.

[0095] The data of the three sensors are fused using data fusion technology to monitor the real-time position, posture and speed of the robot arm 200;

[0096] The human image acquisition unit 4012 uses the camera 102 to capture the image of the staff. The camera 102 includes one or more of a binocular camera 102, a motion detection camera 102 or a camera 102 with a pan / tilt function. The binocular camera has the video acquisition function of near-infrared light and visible light. The motion detection camera 102 detects the movement in the picture by analyzing the changes in continuous video frames. A threshold can be set. When the picture changes exceed the threshold, an alarm is triggered. The camera 102 with a pan / tilt function can remotely control its position to identify human bodies in different positions.

[0097] In the embodiment of the present invention, the image processing unit 4041 uses the MATLAB language to search and remove missing, blurred, and duplicate images of the image data, establishes a mapping between image color and temperature value, converts the image into an array representing the temperature value, calculates the temperature difference of the image data with reference to the thermal stress model, and enhances the visual effect of the image. Functions in MATLAB, such as imhist, stretchlim, adapthisteq, etc., can be used for image enhancement;

[0098] The calculation formula of the thermal stress model is as follows:

[0099]

[0100] Among them, σ t is the thermal stress in the x, y, and z directions, τ t is the shear stress along the xy, yz, and xz planes, E is the elastic modulus, α is the expansion coefficient, △t is the change in human body temperature, and μ is the Poisson value. The MATLAB language is used to identify and extract the extreme values ​​of the maximum temperature difference of the human body, and the image is enhanced based on the image displayed according to the temperature difference.

[0101] The human body detection unit 4042 uses the human body segmentation technology to identify the human body in the image processed by the image processing unit 4041, specifically including: using the image data processed by the image processing unit 4041, using the human body detection algorithm to detect the human body in the image, such as Haar cascade classifier, YOLO, SSD, etc., on this basis, using the region segmentation technology to segment the human body, and using the edge algorithm to extract the human body contour, such as Canny edge detector, to obtain human body data;

[0102] The feature extraction unit 4043 uses the gray level co-occurrence matrix technology to extract facial texture features, specifically including: selecting a pixel point of the image data as the central pixel, and calculating the gray level difference between the central pixel and its surrounding pixels, and obtaining statistical characteristics such as energy, entropy, inertia, local stability, etc. by calculating the gray level co-occurrence matrix, and using the calculated statistical characteristics as features to describe the texture features of the image, and representing the selected features as vectors or matrices for subsequent recognition tasks.

[0103] In addition, the calculation formula of the gray level co-occurrence matrix is ​​as follows:

[0104] P ij =∑ x,y δ(I(x,y,i)δ(I(x+d·cosθ,y+d·sinθ)),j)

[0105] Among them, P ij is the gray value, I(x, y) is the gray value of the pixel at the (x, y) position, d is the distance between the pixel pairs, θ is the direction between the pixel pairs, and δ is the Kronecker function. When its parameter is equal to a certain value, the function returns 1, otherwise it returns 0. This function ensures that we only count those pixel pairs whose gray values ​​are equal to the specific value i or j. In actual calculations, since the gray-level co-occurrence matrix is ​​symmetric, usually only the sum of the upper triangle or the lower triangle is calculated, and then the result is multiplied by 2.

[0106] In the embodiment of the present invention, the key point positioning unit 4044 performs key point positioning specifically including:

[0107] a. Use the VGG19 network to extract image features and generate feature maps;

[0108] b. Use the posture estimation technology to process the feature map, generate the PCM in the posture estimation technology to determine the position of each key point in the image, and determine the connection relationship between the key points through the PAF;

[0109] c. Combining the information of PCM and PAF, use an algorithm to construct the human skeleton. The algorithm can be a graph theory algorithm, a Hungarian algorithm, etc.

[0110] In the embodiment of the present invention, the face recognition module 402 and the height recognition module 403 use the data processed by the data processing module 404 to perform face and height recognition. The face recognition specifically includes: using the image processing unit 4041 to process the image data, performing image segmentation to identify the human body through the human body detection unit 4042, then extracting the features of the human body image through the feature extraction unit 4043, using the face matching unit to compare the extracted face data with the face data stored in the data storage platform 406, and the data calibration unit 4046 uses the direct comparison method to directly compare the face data stored in the data storage platform 406 with the data to be calibrated, determine the deviation, and adjust the recognized face information. If the recognition result has a high degree of matching with the features of a person in the library, the recognized face information is matched with the person, and the recognition information is sent to the sign control system 400 through the data output unit 4047;

[0111] Height recognition specifically includes: using the segmented human body features to identify the key parts of the human body through the key point positioning unit 4044, obtaining the positions of the head and feet, calculating the height of the person in the image, and calculating the position to which the sign 100 should be moved based on the identified height and head position so that the user can view it comfortably, and sending identification information to the sign control system 400 through the data output unit 4047. After receiving the positioning information, the sign control system 400 generates a movement instruction for the robot arm 200, and the robot arm 200 moves the sign 100 to the specified position according to the instruction.

[0112] In addition, a fixed reference point is selected in the camera field of view, such as a point on the ground, and the distance from the reference point to the camera is recorded. The formula for calculating the specified position of the sign 100 is as follows:

[0113]

[0114] y b =y h

[0115] Among them, h is the height value, d is the distance from the reference point to the camera, h b is the real-time height of the sign, x h and h is the real-time position coordinate of the head, x b and b The location where the sign needs to be moved.

[0116] In the embodiment of the present invention, the identity input unit 4061 is used to input the identity information of the staff member, including face, job position and job content;

[0117] The authority division unit 4062 is used to divide the access rights according to the job content of the staff, namely management personnel, operation personnel, data entry personnel, etc.;

[0118] The information matching unit 4063 is used to provide the face recognition module 402 with matching information of the face and the identity;

[0119] The information tracking unit 4064 is used to track the operations of the staff member's account in the mixing plant control system 500 after the facial recognition module 402 fails to pair;

[0120] The warning unit 4065 is used to issue a warning to the staff for forced operations exceeding the authority in the sign control system 400.

[0121] Embodiment 2

[0122] See attached Figure 7 As shown, an embodiment of the present invention further provides a method for using a raw material inspection intelligent identification plate structure of a mixing station silo, comprising the following steps:

[0123] S1, the identification plate 100 is installed outside the mixing station silo by the robot arm 200, and the communication module 407 is used to communicate with the mixing station control system 500, so as to remotely obtain the inspection information of the raw materials, and the inspection information of the raw materials is displayed on the display 101 of the identification plate 100. When the raw materials are unqualified, an alarm is issued through the alarm module 405, and the inspection information is stored through the data storage platform 406;

[0124] S2, when manual inspection or modification is required, the staff member walks to the recognition range of the sign 100, performs image processing on the image captured by the camera 102 through the data processing module 404, detects human body data using the human body detection unit 4042, extracts facial features and human body features through the feature extraction unit 4043, pairs the facial features with the facial information in the data storage platform 406 through the face matching unit 4045, identifies the staff member's authority using the face recognition module 402, locates the key points of the human body data features through the key point positioning unit 4044, and calculates the staff member's height with the height recognition module 403 to obtain the staff member's height data;

[0125] S3, based on the recognition result, the sign control system 400 controls the motor a and the motor b of the robot arm 200 to move the sign 100 to a position where the staff can view it, and the staff views and operates the information on the sign 100 according to the authority;

[0126] S4, while the sign 100 is moving, the sign control system 400 controls the motor 305, the motor 305 drives the rotating shaft 304 to rotate, and the rotating shaft 304 drives the gear 303 to rotate by utilizing the meshing groove 306, and the gear 303 drives the protective cover 300 connected to the connecting rod 302 to rotate, and controls the protective cover 300 to rotate forward until the protective cover 300 can cover the staff underneath to protect the safety of the staff. The operating time of the motor 305, that is, the rotation range 303 of the gear, is preset in the system to specify the moving angle of the protective cover.

[0127] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

[0128] In the above detailed description, various features are grouped together in a single embodiment to simplify the disclosure. This method of disclosure should not be interpreted as reflecting an intention that the embodiments of the claimed subject matter require more features than are clearly stated in each claim. On the contrary, as reflected in the appended claims, the invention is in a state of having less than all the features of the disclosed individual embodiments. Therefore, the appended claims are hereby expressly incorporated into the detailed description, with each claim standing on its own as a separate preferred embodiment of the invention.

[0129] The above description includes examples of one or more embodiments. Of course, it is impossible to describe all possible combinations of components or methods for the purpose of describing the above embodiments, but it should be recognized by those skilled in the art that the various embodiments may be further combined and arranged. Therefore, the embodiments described herein are intended to cover all such changes, modifications and variations that fall within the scope of protection of the appended claims. In addition, with respect to the term "comprising" used in the specification or claims, the word is covered in a manner similar to the term "including", just as "including," is explained as a transitional word in the claims. In addition, any term "or" used in the specification of the claims is intended to mean "non-exclusive or".

Claims

1. An intelligent identification plate structure for raw material inspection in a mixing station silo, characterized in that: The system comprises a signboard (100), a mechanical arm (200), a protective cover (300), a signboard control system (400) and a mixing station control system (500), wherein a display (101), a camera (102) and a button (103) are embedded on the front side of the signboard (100); The mechanical arm (200) is arranged on the rear side of the identification plate (100), and the mechanical arm (200) comprises a driving arm (202), an adjusting arm (203), a connecting arm (204) and a motor compartment (205), wherein the adjusting arm (203) is located between the driving arm (202) and the connecting arm (204), the connecting arm (204) is screwed to the rear side of the identification plate (100), and the motor compartment (205) is located at both ends of the driving arm (202); The protective cover (300) is arranged directly above the identification plate (100); a connecting rod (302) is arranged on the inner side of the protective cover (300); a fixing block (301) for fixing the connecting rod (302) is arranged on the inner side of the protective cover (300); a gear (303) is arranged on the outer side of the connecting rod (302); a rotating shaft (304) is arranged below the gear (303); and one end of the rotating shaft (304) is connected to a motor (305); The sign control system (400) is used to control the information displayed on the sign (100) and the position adjustment, and the sign control system (400) comprises a data acquisition module (401), a face recognition module (402), a height recognition module (403), a data processing module (404), an alarm module (405), a data storage platform (406) and a communication module (407); The data acquisition module (401) is used to acquire movement data of the mechanical arm (200) and image data of a worker; The face recognition module (402) is used to recognize the face information of the staff member; The height recognition module (403) is used to recognize the height information of the staff member; The data processing module (404) is used to process the information collected by the data collection module (401) and provide data information to the face recognition module (402) and the height recognition module (403), and the data processing module (404) includes an image processing unit (4041), a human body detection unit (4042), a feature extraction unit (4043), a key point positioning unit (4044), a face matching unit, a data calibration unit (4046) and a data output unit (4047); The image processing unit (4041) uses MATLAB language to perform preliminary processing on the staff image data collected by the collection module; The human body detection unit (4042) uses a human body segmentation technology to identify a human body in the image processed by the image processing unit (4041); The feature extraction unit (4043) extracts facial texture features from the image segmented by the human body detection unit (4042) using gray level co-occurrence matrix technology and other feature technologies; The key point positioning unit (4044) uses posture estimation technology to locate key points of the human image of the human body detection unit (4042), including the head, torso, hands, legs and feet; The face matching unit is used to identify and match the face information data in the data storage platform (406); The data calibration unit (4046) is used to calibrate the paired data of the face pairing unit to check whether there is any error; The data output unit (4047) is used to transmit the data proofread by the data calibration unit (4046); The alarm module (405) is used to generate an alarm when the displacement data of the robot arm (200) and the image data of the staff collected by the data collection module (401) exceed a threshold value and preset information; The data storage platform (406) is used to store information related to the work of the identification plate (100), and the data storage platform (406) includes an identity entry unit (4061), an authority division unit (4062), an information matching unit (4063), an information tracking unit (4064) and an early warning unit (4065); The communication module (407) uses wireless communication technology to exchange data between the sign control system (400) and the mixing station control system (500).

2. According to claim 1, a raw material inspection intelligent identification plate structure for a mixing station silo is characterized in that: The driving arm (202) is of U-shaped design, the motor compartment (205) is arranged at both ends of the driving arm (202), a motor (305) a and a motor (305) b are arranged inside the motor compartment (205), the output end of one of the motors (305) a is drivingly connected to the regulating arm (203), and the output end of the other motor (305) b is drivingly connected to the mounting block (201); The side surface of the protective cover (300) is of trapezoidal design, the connecting rod (302) is fixedly connected to the fixing block (301), the connecting rod (302) passes through the gear (303) and is plugged into the gear (303), the gear (303) is arranged at the center of the connecting rod (302), the outer surface of the rotating shaft (304) is provided with a meshing groove (306) adapted to the gear (303), the output end of the motor (305) is rotatably connected to the rotating shaft (304), and the motor (305) is embedded on the rear side of the identification plate (100).

3. The intelligent identification plate structure for raw material inspection in a mixing station silo according to claim 2 is characterized in that: The data acquisition module (401) comprises a mechanical arm displacement acquisition unit (4011) and a human body image acquisition unit (4012), wherein the mechanical arm displacement acquisition unit (4011) uses a sensor to acquire the movement state and actual position of the mechanical arm (200), wherein the sensor comprises a six-axis motion sensor, an angle sensor and an encoder, and specifically comprises: A, the sign control system (400) controls the movement of the mechanical arm (200), installs a six-axis motion sensor at a joint near the end of the mechanical arm (200), captures the movement and direction of the end of the mechanical arm (200), and fuses the data through a Kalman filter to obtain the posture and position of the mechanical arm (200); B, installing an angle sensor at the joint of the mechanical arm (200) to measure the rotation angle of the joint; C, installing an encoder on the motor (305) a and the motor (305) b of the mechanical arm (200), the encoder being directly connected to the motor (305) shafts of the motor (305) a and the motor (305) b to provide position and speed information of the mechanical arm (200); The human body image acquisition unit (4012) uses the camera (102) to capture images of the staff member, and the camera (102) includes one or more of a binocular camera (102), a motion detection camera (102), or a camera (102) with a pan / tilt function.

4. The intelligent identification plate structure for raw material inspection in a mixing station silo according to claim 1 is characterized in that: The image processing unit (4041) uses MATLAB language to search and remove missing, blurred, and duplicated images of the image data, establishes a mapping between image color and temperature value, converts the image into an array representing the temperature value, calculates the temperature difference of the image data with reference to the thermal stress model, and enhances the visual effect of the image; The human body detection unit (4042) uses the human body segmentation technology to identify the human body in the image processed by the image processing unit (4041), specifically comprising: using the image data processed by the image processing unit (4041) to detect the human body in the image using the human body detection algorithm, on this basis, segmenting the human body using the region segmentation technology, and extracting the human body contour using the edge algorithm to obtain human body data; The feature extraction unit (4043) uses the gray level co-occurrence matrix technology to extract facial texture features, specifically including: selecting a pixel point of the image data as the central pixel, and calculating the gray level difference between the central pixel and its surrounding pixels, obtaining statistical characteristics by calculating the gray level co-occurrence matrix, using the calculated statistical characteristics as features, and representing the selected features as vectors or matrices for subsequent recognition tasks.

5. The intelligent identification plate structure for raw material inspection in a mixing station silo according to claim 4 is characterized in that: The key point positioning unit (4044) performs key point positioning specifically including: a. Use the VGG19 network to extract image features and generate feature maps; b. Use the posture estimation technology to process the feature map, generate the PCM in the posture estimation technology to determine the position of each key point in the image, and determine the connection relationship between the key points through the PAF; c. Combining the information of PCM and PAF, the algorithm is used to construct the human skeleton.

6. The intelligent identification plate structure for raw material inspection in a mixing station silo according to claim 5 is characterized in that: The face recognition module (402) and the height recognition module (403) use the data processed by the data processing module (404) to perform face and height recognition. The face recognition specifically includes: using the image processing unit (4041) to process the image data, performing image segmentation to recognize the human body through the human body detection unit (4042), then extracting the features of the human body image through the feature extraction unit (4043), using the face matching unit to compare the extracted face data with the face data stored in the data storage platform (406), using the data calibration unit (4046) to directly compare the face data stored in the data storage platform (406) with the data to be calibrated using a direct comparison method, determining the deviation, adjusting the recognized face information, and sending the recognition information to the sign control system (400) through the data output unit (4047); The height recognition specifically comprises: using the segmented human features to identify key parts of the human body through a key point positioning unit (4044), obtaining the positions of the head and feet, calculating the height of the person in the image, calculating the position to which the sign (100) should be moved based on the identified height and head position, sending identification information to the sign control system (400) through a data output unit (4047), and after receiving the positioning information, the sign control system (400) generates a movement instruction for the mechanical arm (200), and the mechanical arm (200) moves the sign (100) to the specified position according to the instruction.

7. The intelligent identification plate structure for raw material inspection in a mixing station silo according to claim 1 is characterized in that: The identity input unit (4061) is used to input the identity information of the staff member, including face, job position and job content; The authority division unit (4062) is used to divide access rights according to the job content of the staff; The information matching unit (4063) is used to provide the face recognition module (402) with matching information of the face and the identity; The information tracking unit (4064) is used to track the operation of the worker in the mixing plant control system (500) after the facial recognition module (402) fails to pair; The early warning unit (4065) is used to issue an early warning to the staff for forced operations that exceed their authority in the sign control system (400).

8. A method for using a raw material inspection intelligent identification plate structure for a mixing station silo, applied to a raw material inspection intelligent identification plate structure for a mixing station silo as claimed in any one of claims 1 to 7, characterized in that: The following steps are involved: S1, installing the identification plate (100) outside the material silo of the mixing station by means of a mechanical arm (200), communicating information between the identification plate (100) and the mixing station control system (500) by means of a communication module (407), obtaining inspection information of the raw materials remotely, displaying the inspection information of the raw materials by means of a display (101) of the identification plate (100), giving an alarm by means of an alarm module (405) when the raw materials are unqualified, and storing the inspection information by means of a data storage platform (406); S2, when manual inspection or modification is required, the staff member walks to the identification range of the sign (100), processes the image captured by the camera (102) through the data processing module (404), identifies the staff member's authority using the face recognition module (402), and identifies the staff member's height using the height recognition module (403); S3, based on the recognition result, the sign control system (400) controls the mechanical arm (200) to move the sign (100) to a position where the staff can view it, and the staff views and operates the information on the sign (100) according to their authority; S4, while the sign (100) is moving, the sign control system (400) controls the motor (305), the motor (305) drives the rotating shaft (304) to rotate, the rotating shaft (304) drives the gear (303) to rotate by means of the meshing groove (306), the gear (303) drives the protective cover (300) connected to the connecting rod (302) to rotate, and the protective cover (300) is controlled to rotate forward until the protective cover (300) can cover the staff underneath.