Distributed x-ray security inspection machine image judging system and method

Abstract

The application discloses a distributed X-ray security inspection machine image judgment system and method. A mode selection unit determines an image judgment mode according to the number of packages passing through an X-ray security inspection machine within a preset time length. In the self-image judgment mode, an image acquisition unit acquires an initial X-ray image sequence, and a local image processing unit processes the initial X-ray image sequence to obtain a pseudo-color X-ray image sequence, and an image judgment display unit obtains an image judgment result. In the hybrid image judgment mode or the external image judgment mode, the image acquisition unit sends a specified initial X-ray image in the initial X-ray image sequence to a cloud image processing unit, the cloud image processing unit processes the received specified initial X-ray image to obtain a pseudo-color X-ray image, and the image judgment display unit obtains the image judgment result. The distributed X-ray security inspection machine image judgment system provided by the application improves the balance of image judgment work, and each X-ray security inspection machine can complete on-demand image judgment, thereby further improving the image judgment efficiency compared with the scheme of centralized personnel image judgment.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of urban rail transit security technology, and in particular to a distributed X-ray security inspection machine image judging system and method. BACKGROUND

[0002] In order to ensure the security and stability of urban rail transit lines and stations, the existing urban rail transit station entrance security inspection points are usually provided with X-ray security inspection machines, and one or more X-ray security inspection machines are installed at each security inspection point of each station according to the number of passengers. The X-ray security inspection machine uses a conveyor belt to send the checked luggage into a track-type channel. When the luggage enters the channel, a ray source emits an X-ray beam. Using line scanning imaging technology, as the conveyor belt rotates, the luggage is gradually cut and penetrated by the X-ray beam and then transmitted to an X-ray detection box. An X-ray perspective view of the luggage is gradually formed on the X-ray detection box, so as to obtain an X-ray scanning image. The X-ray scanning image is displayed on a display, and then a judging officer manually judges the X-ray scanning image to determine whether there is any prohibited item.

[0003] In the traditional security inspection mode, the judging officer performs the judging operation at the X-ray security inspection machine. However, the passenger flow of rail transit is not balanced in time and space, which causes the judging work of the judging officer to be unbalanced. During the peak period, the work is busy, and during the low-peak period, the work is relatively idle. The urban line is busy, and the suburban line is relatively idle, which causes a certain degree of waste of the security judging officer manpower. SUMMARY

[0004] The embodiments of the present application provide a distributed X-ray security inspection machine image judging system and method to solve the problem of unbalanced judging work.

[0005] In a first aspect, the present application provides a distributed X-ray security inspection machine image judging system, which comprises a cloud server and a plurality of X-ray security inspection machines connected to each other through a network. The cloud server comprises a cloud image processing unit. Each of the X-ray security inspection machines comprises a mode selection unit, an image acquisition unit, a local image processing unit, and a judging display unit.

[0006] The mode selection unit is configured to count the number of packages passing through the X-ray security inspection machine within a preset time period, and determine a judging mode according to the number of packages. When the number of packages is greater than a preset number threshold, the judging mode is determined to be a self-judging mode. When the number of packages is not greater than the preset number threshold, the judging mode is determined to be a mixed-judging mode or an external-judging mode.

[0007] an image acquisition unit, configured to acquire an initial X-ray image sequence, and send the initial X-ray image sequence to a local image processing unit in a self-diagram mode, or send a designated initial X-ray image in the initial X-ray image sequence to a cloud image processing unit in a hybrid-diagram mode or an external-diagram mode;

[0008] the local image processing unit, configured to process the received initial X-ray image sequence to obtain a pseudo-color X-ray image sequence, and send the pseudo-color X-ray image sequence to a diagram display unit; and the cloud image processing unit, configured to process the received designated initial X-ray image to obtain a pseudo-color X-ray image, and send the pseudo-color X-ray image to the diagram display unit;

[0009] the diagram display unit, configured to perform automatic diagramming operation on each pseudo-color X-ray image, and display a diagramming result, or display the pseudo-color X-ray images in sequence, so that a security officer performs diagramming operation on the pseudo-color X-ray images to obtain a diagramming result.

[0010] In a second aspect, the present application provides a distributed X-ray security inspection machine diagramming method, which comprises:

[0011] counting a number of packages passing through an X-ray security inspection machine within a preset time period, and determining a diagramming mode according to the number of packages; when the number of packages is greater than a preset number threshold, the diagramming mode is determined to be a self-diagramming mode, and when the number of packages is not greater than the preset number threshold, the diagramming mode is determined to be a hybrid-diagramming mode or an external-diagramming mode;

[0012] acquiring an initial X-ray image sequence, and sending the initial X-ray image sequence to a local image processing unit in a self-diagramming mode, or sending a designated initial X-ray image in the initial X-ray image sequence to a cloud image processing unit in a hybrid-diagramming mode or an external-diagramming mode; so that the local image processing unit processes the received initial X-ray image sequence to obtain a pseudo-color X-ray image sequence, and sends the pseudo-color X-ray image sequence to a diagram display unit; and so that the cloud image processing unit processes the received designated initial X-ray image to obtain a pseudo-color X-ray image;

[0013] performing automatic diagramming operation on each pseudo-color X-ray image, and displaying a diagramming result, or displaying the pseudo-color X-ray images in sequence, so that a security officer performs diagramming operation on the pseudo-color X-ray images to obtain a diagramming result.

[0014] The application provides a distributed X-ray security inspection machine image judgment system and method. In the application, the distributed X-ray security inspection machine image judgment system comprises a cloud server and X-ray security inspection machines connected with each other through a network. The cloud server comprises a cloud image processing unit. Each X-ray security inspection machine comprises a mode selection unit, an image acquisition unit, a local image processing unit and an image judgment display unit. The mode selection unit determines the image judgment mode as a self-image judgment mode, a mixed image judgment mode or an external image judgment mode according to the number of packages in a preset time period of the X-ray security inspection machine. In the self-image judgment mode, the image acquisition unit acquires an initial X-ray image sequence, and the local image processing unit processes the initial X-ray image sequence to obtain a pseudo-color X-ray image sequence, and then the image judgment display unit obtains an image judgment result. In the mixed image judgment mode or the external image judgment mode, the image acquisition unit sends a specified initial X-ray image in the initial X-ray image sequence to the cloud image processing unit, and the cloud image processing unit processes the received specified initial X-ray image to obtain a pseudo-color X-ray image, and then the image judgment display unit obtains an image judgment result. The distributed X-ray security inspection machine image judgment system provided by the application sets the local image processing unit and the cloud image processing unit, realizes local processing or on-demand distribution of the initial X-ray image sequence acquired by each X-ray security inspection machine, improves the balance of image judgment work, and each X-ray security inspection machine can complete on-demand image judgment, thereby further improving the image judgment efficiency compared with the scheme of centralized personnel image judgment. BRIEF DESCRIPTION OF DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the embodiments of the application, the following will briefly introduce the drawings needed to be used in the embodiment description. Obviously, the drawings in the following description are only some embodiments of the application, and other drawings can be obtained by those skilled in the art without any creative effort based on these drawings.

[0016] Figure 1 The first distributed X-ray security inspection machine image judgment system structure diagram provided by the application;

[0017] Figure 2 The second distributed X-ray security inspection machine image judgment system structure diagram provided by the application;

[0018] Figure 3 The third distributed X-ray security inspection machine image judgment system structure diagram provided by the application;

[0019] Figure 4 The fourth distributed X-ray security inspection machine image judgment system structure diagram provided by the application;

[0020] Figure 5 The fifth distributed X-ray security inspection machine image judgment system structure diagram provided by the application;

[0021] Figure 6 A sixth distributed X-ray security inspection machine image recognition system structure schematic diagram is provided for the present application;

[0022] Figure 7 A distributed X-ray security inspection machine image recognition process schematic diagram is provided for the present application. DETAILED DESCRIPTION

[0023] In order to make the purpose and embodiments of the present application more clear, the following will combine the drawings in the exemplary embodiments of the present application to clearly and completely describe the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments.

[0024] It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the following described embodiments, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and general meanings.

[0025] The terms "first", "second", "third" and the like in the specification and claims of the present application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit the specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchanged under appropriate circumstances.

[0026] The terms "include" and "have" and any variations thereof are intended to cover but not exclusive inclusion, for example, a product or device including a series of components does not necessarily limit to all components clearly listed, but can include other components not clearly listed or inherent to these products or devices.

[0027] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware or / and software code capable of performing functions associated with the element.

[0028] Finally, it should be noted that: the above examples are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for part or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0029] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed. Various modifications and variations are possible in light of the above teachings. The embodiments were chosen and described in order to explain the principles of the application and their practical application and to enable others skilled in the art to best use them and various embodiments with various modifications as are suited to the particular use contemplated.

[0030] Figure 1 The distributed X-ray security inspection machine image judging system structure schematic diagram provided in the present application comprises: a cloud server 11 and various X-ray security inspection machines 22 connected with each other through a network; the cloud server 11 comprises: a cloud image processing unit 111; each of the various X-ray security inspection machines 22 comprises: a mode selection unit 221, an image acquisition unit 222, a local image processing unit 223 and an image judging display unit 224;

[0031] The mode selection unit 221 is configured to count the number of passing packages within a preset time period of the X-ray security inspection machine, and determine the image judging mode according to the number of passing packages; wherein when the number of passing packages is greater than a preset number threshold, the image judging mode is determined to be a self-image judging mode, and when the number of passing packages is not greater than the preset number threshold, the image judging mode is determined to be a mixed image judging mode or an external image judging mode;

[0032] The image acquisition unit 222 is configured to acquire an initial X-ray image sequence, and send the initial X-ray image sequence to the local image processing unit 223 in the self-image judging mode, and send a designated initial X-ray image in the initial X-ray image sequence to the cloud image processing unit 111 in the mixed image judging mode or the external image judging mode;

[0033] The local image processing unit 223 is configured to process the received initial X-ray image sequence to obtain a pseudo-color X-ray image sequence, and send the pseudo-color X-ray image sequence to the image judging display unit 224; and the cloud image processing unit 111 is configured to process the received designated initial X-ray image to obtain a pseudo-color X-ray image, and send the pseudo-color X-ray image to the image judging display unit 224;

[0034] The image judging display unit 224 is configured to perform automatic image judging operation on each received pseudo-color X-ray image, and display the image judging result, or display the pseudo-color X-ray images in sequence, so that the security inspector performs image judging operation on the pseudo-color X-ray images to obtain the image judging result.

[0035] Figure 1The distributed X-ray security inspection machine image judgment system shown in FIG. 1 includes a cloud server and three X-ray security inspection machines. The three X-ray security inspection machines are merely for illustration, and the number of X-ray security inspection machines in the distributed X-ray security inspection machine image judgment system is not limited by the present application. The cloud server is connected to and communicates with each X-ray security inspection machine through a network. Each X-ray security inspection machine includes a mode selection unit, an image acquisition unit, a local image processing unit, and an image judgment display unit.

[0036] The mode selection unit in each X-ray security inspection machine determines its image judgment mode according to the number of packets passing through it. Specifically, for a certain X-ray security inspection machine, the mode selection unit in the X-ray security inspection machine counts the number of packets passing through the X-ray security inspection machine within a preset time period and determines the image judgment mode according to the number of packets. When the number of packets is greater than a preset number threshold, the image judgment mode is determined to be a self-image judgment mode, and when the number of packets is not greater than the preset number threshold, the image judgment mode is determined to be a hybrid image judgment mode or an external image judgment mode.

[0037] For example, the preset number threshold is 800, and the preset time period is 1 hour. When the number of packets passing through the X-ray security inspection machine within 1 hour is greater than 800, the image judgment mode is determined to be a self-image judgment mode, and when the number of packets passing through the X-ray security inspection machine within 1 hour is not greater than 800, the image judgment mode is determined to be a hybrid image judgment mode or an external image judgment mode. Specifically, when the number of packets passing through the X-ray security inspection machine within 1 hour is not greater than 800, it can be further determined whether the number of packets passing through the X-ray security inspection machine within 1 hour is less than 100. If it is less than 100, the image judgment mode is determined to be an external image judgment mode, and if it is between 100 and 800, the image judgment mode is determined to be a hybrid image judgment mode.

[0038] The self-image judgment mode means that the image judgment display unit only performs image judgment on the pseudo-color X-ray image converted from the initial X-ray image collected by the local image acquisition unit. The external image judgment mode means that the image judgment display unit only performs image judgment on the pseudo-color X-ray image converted from the initial X-ray image from the cloud server. The hybrid image judgment mode means that the image judgment display unit performs image judgment on the pseudo-color X-ray image converted from the initial X-ray image collected by the local image acquisition unit and on the pseudo-color X-ray image converted from the initial X-ray image from the cloud server.

[0039] The image acquisition unit acquires an initial X-ray image sequence. In the self-interpretation mode, the initial X-ray image sequence is sent to the local image processing unit. In the mixed interpretation mode or the external interpretation mode, the specified initial X-ray images in the initial X-ray image sequence are sent to the cloud image processing unit. Specifically, in the mixed interpretation mode, part of the specified initial X-ray images in the initial X-ray image sequence, for example, half or one-third of the acquired initial X-ray image sequence, are sent to the cloud image processing unit. In the external interpretation mode, all the initial X-ray images in the initial X-ray image sequence are sent to the cloud image processing unit. The specified initial X-ray images can be all the initial X-ray images acquired by the specified image acquisition unit, or part of the initial X-ray images acquired by the specified image acquisition unit, for example, 300 or 400 images specified in time sequence, etc.

[0040] The local image processing unit processes the received initial X-ray image sequence to obtain a pseudo-color X-ray image sequence and sends it to the interpretation display unit. The cloud image processing unit processes the received specified initial X-ray images to obtain a pseudo-color X-ray image and sends it to the interpretation display unit. The interpretation display unit here refers to the interpretation display unit in the X-ray security inspection machine in the mixed interpretation mode or the external interpretation mode. The interpretation display unit performs automatic interpretation operation on each pseudo-color X-ray image and displays the interpretation result, or displays each pseudo-color X-ray image in sequence to enable the security inspector to perform interpretation operation on each pseudo-color X-ray image to obtain the interpretation result.

[0041] Among them, the present application provides two interpretation methods. First, the interpretation display unit is configured with a trained interpretation network model, and each pseudo-color X-ray image is input into the interpretation network model to obtain and display the interpretation result. The interpretation result includes image violation or image non-violation. Second, the interpretation display unit displays each pseudo-color X-ray image in sequence, and the security inspector of the X-ray security inspection machine observes each pseudo-color X-ray image to obtain the interpretation result.

[0042] The existing technology interpretation system essentially introduces a centralized interpretation workstation and a server, which schedules through the server and interprets through the interpretation workstation, changing the 1:1 interpretation mode to the M:N interpretation mode. The existing scheme has the following application defects: in actual use, the use of centralized interpretation workstations requires centralized interpretation rooms, and many existing lines do not have available interpretation rooms; in addition, the concentration of interpreters for interpretation requires a 30-minute shift every hour, which requires additional scheduling for shift changes, but in the security inspection point, the security inspector can rotate with the hand inspector without additional scheduling.

[0043] To solve the above technical problems, and application problems. The present application provides a kind of distributed X-ray security inspection machine judging system. Distributed here refers to that X-ray security inspection machine judging system generally includes multiple X-ray security inspection machines, multiple X-ray security inspection machines can be reasonably dispersedly arranged at each entrance and / or exit of station, so that the staff who operates or utilizes each X-ray security inspection machine for judging operation can also be correspondingly dispersedly arranged at each entrance and / or exit of station, to avoid the congestion or reduce the work efficiency caused by the excessive concentration of staff. X-ray security inspection machine judging system includes cloud server and each X-ray security inspection machine connected by network. Each X-ray security inspection machine determines judging mode according to the number of packages passing through within its own preset time length, and sends the specified initial X-ray image in the collected initial X-ray image sequence to cloud server in mixed judging mode or external judging mode. Each X-ray security inspection machine has both local judging and remote judging modes, and each X-ray security inspection machine can complete on-demand judging without providing additional judging station, so as to achieve the purpose of reducing staff and increasing efficiency. The present application does not need to provide a separate room for centralized judging, and can realize efficient judging by using the original X-ray security inspection machine operation table.

[0044] In the present application, the distributed X-ray security inspection machine judging system includes: cloud server and each X-ray security inspection machine connected by network; the cloud server includes: cloud image processing unit; each of the X-ray security inspection machines includes: mode selection unit, image acquisition unit, local image processing unit and judging display unit; the mode selection unit determines the judging mode as self-judging mode, mixed judging mode or external judging mode according to the number of packages passing through within the preset time length of X-ray security inspection machine; in self-judging mode, the image acquisition unit acquires initial X-ray image sequence and the local image processing unit processes the initial X-ray image sequence to obtain pseudo-color X-ray image sequence, and then obtains judging result based on the judging display unit. In mixed judging mode or external judging mode, the image acquisition unit sends the specified initial X-ray image in the initial X-ray image sequence to the cloud image processing unit, and the cloud image processing unit processes the received specified initial X-ray image to obtain pseudo-color X-ray image, and then obtains judging result based on the judging display unit. The distributed X-ray security inspection machine judging system provided by the present application sets local image processing unit and cloud image processing unit, realizes local processing or on-demand distribution of initial X-ray image sequence collected by each X-ray security inspection machine, improves the balance of judging work, and each X-ray security inspection machine can complete on-demand judging, which further improves the judging efficiency compared with the scheme of centralized personnel judging.

[0045] Figure 2 The structure diagram of the distributed X-ray security inspection machine judging system provided by the present application is shown in Figure 2 The cloud server 11 also includes: a first cloud image storage unit 112;

[0046] The image acquisition unit 222 is further configured to send the designated initial X-ray image in the initial X-ray image sequence to the first cloud image storage unit 112 in the hybrid or external interpretation mode.

[0047] The local image processing unit 223 is further configured to receive the initial X-ray image sent by the first cloud image storage unit 112 in the hybrid or external interpretation mode, process the initial X-ray image to obtain a pseudo-color X-ray image, and send the pseudo-color X-ray image to the interpretation display unit 224.

[0048] The first cloud image storage unit in the cloud server is configured to store the initial X-ray image sent by the image acquisition unit in the X-ray security inspection machine, and send the stored initial X-ray image to the local image processing unit in the X-ray security inspection machine in the hybrid or external interpretation mode. The local image processing unit processes the initial X-ray image to obtain a pseudo-color X-ray image, and sends the pseudo-color X-ray image to the interpretation display unit.

[0049] Figure 3 A distributed X-ray security inspection machine interpretation system structure diagram is provided in the present application, as shown in Figure 3 The cloud server 11 further includes a second cloud image storage unit 113.

[0050] The first cloud image storage unit 112 is further configured to send the stored initial X-ray image to the cloud image processing unit 111.

[0051] The cloud image processing unit 111 is configured to process the received initial X-ray image to obtain a pseudo-color X-ray image, and send the pseudo-color X-ray image to the second cloud image storage unit 113.

[0052] The second cloud image storage unit 113 is configured to send the stored pseudo-color X-ray image to the interpretation display unit 224.

[0053] In the present application, the first cloud image storage unit in the cloud server is configured to store the initial X-ray image sent by the image acquisition unit in the X-ray security inspection machine, and send the stored initial X-ray image to the cloud image processing unit. The cloud image processing unit processes the received initial X-ray image to obtain a pseudo-color X-ray image, and sends the pseudo-color X-ray image to the second cloud image storage unit. The second cloud image storage unit is configured to store the pseudo-color X-ray image sent by the cloud server, and send the stored pseudo-color X-ray image to the interpretation display unit.

[0054] In the present application, the first cloud image storage unit is also used for storing each initial X-ray image, the each initial X-ray image carries its own identification information, the identification information at least includes one of image size, source physical location, source X-ray security check machine model and source IP address; according to the identification information of each initial X-ray image itself, the each initial X-ray image is sorted, and the specified initial X-ray image is sent to the cloud image processing unit according to the sorting result.

[0055] After the image acquisition unit acquires the initial X-ray image, the initial X-ray image carries identification information, the identification information at least includes one of image size, source physical location, source X-ray security check machine model and source IP address. The first cloud image storage unit sorts each initial X-ray image according to the identification information of each initial X-ray image itself stored.

[0056] For example, each initial X-ray image is classified according to size, and the priority of the initial X-ray image with larger size is higher, then each initial X-ray image is sorted according to size from large to small, and then the specified number of initial X-ray images in front of the sorting is sent to the cloud image processing unit.

[0057] For another example, each initial X-ray image is classified according to source physical location, and the priority of the initial X-ray image of different source physical location is different, then each initial X-ray image is sorted according to the order of source physical location priority from high to low, and then the specified number of initial X-ray images in front of the sorting is sent to the cloud image processing unit.

[0058] For another example, each initial X-ray image is classified according to source X-ray security check machine model, and the priority of the initial X-ray image of different source X-ray security check machine model is different, then each initial X-ray image is sorted according to the order of source X-ray security check machine model priority from high to low, and then the specified number of initial X-ray images in front of the sorting is sent to the cloud image processing unit.

[0059] Similarly, the second cloud image storage unit is also used for storing each pseudo-color X-ray image, each pseudo-color X-ray image carries its own identification information, the identification information at least includes one of image size, source physical location, source X-ray security check machine model and source IP address; according to the identification information of each pseudo-color X-ray image itself, the each pseudo-color X-ray image is sorted, and the specified pseudo-color X-ray image is sent to the image display unit according to the sorting result.

[0060] It should be further explained that each pseudo-color X-ray image carries its own identification information which is the same as the identification information carried by the initial X-ray image corresponding to each pseudo-color X-ray image. This process will not be described again. The sorting of each initial X-ray image can be combined with multiple items in the identification information, such as image size, source physical location, source X-ray security inspection machine model, and source IP address.

[0061] The image judgment display unit is specifically configured to, for each pseudo-color X-ray image, input the pseudo-color X-ray image into the trained image judgment network model, and obtain an image judgment result of the pseudo-color X-ray image based on the trained image judgment network model.

[0062] The training process of the image judgment network model is as follows: input the sample pseudo-color X-ray image in the sample set and the corresponding label information into the image judgment network base model. The label information includes sample image judgment result information of the corresponding sample pseudo-color X-ray image, specifically, a rule-violating sample image or a non-rule-violating sample image, and includes a preset article existing in the rule-violating sample image, such as a gun or a knife. By iteratively updating the weight parameters of each structure layer in the image judgment network base model, when the requirements are met, the training is completed to obtain the image judgment network model.

[0063] Figure 4 The distributed X-ray security inspection machine image judgment system structure provided in the present application is shown in the schematic diagram as shown in Figure 4 The image judgment display unit 224 includes a display unit 2241 and at least two image judgment sub-units 2242.

[0064] The at least two image judgment sub-units 2242 are respectively configured to, for each pseudo-color X-ray image, obtain an image judgment result of the pseudo-color X-ray image based on the trained image judgment network model, and send each image judgment result to the display unit 2241.

[0065] The display unit 2241 is configured to, for each pseudo-color X-ray image, if the proportion of the image judgment result of the presence of the preset article in the pseudo-color X-ray image exceeds a set threshold, display the image judgment result of the presence of the preset article in the pseudo-color X-ray image.

[0066] In the present application, for the same pseudo-color X-ray image, the pseudo-color X-ray image is input into each sub-unit of image interpretation respectively, each sub-unit of image interpretation obtains the image interpretation result corresponding to the pseudo-color X-ray image respectively, and sends to the display unit. The display unit judges the proportion of the image interpretation result of the preset object in each image interpretation result of the pseudo-color X-ray image. For example, there are 10 image interpretation results in the pseudo-color X-ray image, and there are 9 image interpretation results of the preset object, so the proportion of the image interpretation result of the preset object in each image interpretation result is 9 / 10=90%. The threshold value is set to be 80%, 85% and the like. If the proportion of the image interpretation result of the preset object in the pseudo-color X-ray image exceeds the set threshold value, the image interpretation result of the preset object in the pseudo-color X-ray image is displayed. Thus, the image interpretation is more accurate.

[0067] Figure 5 The distributed X-ray security inspection machine image interpretation system structure provided in the present application is shown in FIG. 1, which comprises an X-ray security inspection machine 200, a visible light image acquisition unit 226, a judgment unit 220, a display unit 224 and an alarm unit 225. Figure 5 The X-ray security inspection machine 200 further comprises an alarm unit 225.

[0068] The display unit 224 is used for sending an alarm instruction to the alarm unit 225 if it is determined that the image interpretation result is that there is a preset object in the pseudo-color X-ray image.

[0069] The alarm unit 225 is used for outputting alarm prompt information when receiving the alarm instruction, wherein the alarm prompt information at least includes one of sound, vibration and light forms.

[0070] The alarm unit 225 can be a sound alarm, thereby emitting sound prompt information, or a vibration alarm or a light alarm. The alarm unit 225 can be any one or any two of a sound alarm, a vibration alarm and a light alarm, or simultaneously include a sound alarm, a vibration alarm and a light alarm.

[0071] Figure 6 The distributed X-ray security inspection machine image interpretation system structure provided in the present application is shown in FIG. 1, which comprises an X-ray security inspection machine 200, a visible light image acquisition unit 226, a judgment unit 220, a display unit 224 and an alarm unit 225. Figure 6 The X-ray security inspection machine 200 further comprises a visible light image acquisition unit 226.

[0072] The visible light image acquisition unit is used for triggering snapshot and acquiring the visible light image of the object when the object enters the X-ray security inspection machine.

[0073] The display unit 224 is used for sending an alarm instruction to the alarm unit 225 if it is determined that the image interpretation result is that there is a preset object in the pseudo-color X-ray image.

[0074] Figure 7 The distributed X-ray security inspection machine image interpretation process provided in the present application is shown in FIG. 2, which comprises the following steps:

[0075] S101: count the number of passing packages in a preset time period of the X-ray security inspection machine, and determine a picture judging mode according to the number of passing packages; wherein when the number of passing packages is greater than a preset number threshold, the picture judging mode is determined to be a self-picture judging mode, and when the number is not greater than the preset number threshold, the picture judging mode is determined to be a mixed-picture judging mode or an external-picture judging mode.

[0076] S102: collect an initial X-ray image sequence, in the self-picture judging mode, send the initial X-ray image sequence to a local image processing unit, and in the mixed-picture judging mode or the external-picture judging mode, send a designated initial X-ray image in the initial X-ray image sequence to a cloud image processing unit; so that the local image processing unit processes the received initial X-ray image sequence to obtain a pseudo-color X-ray image sequence and sends the pseudo-color X-ray image sequence to a picture judging display unit; so that the cloud image processing unit processes the received designated initial X-ray image to obtain a pseudo-color X-ray image.

[0077] S103: perform picture judging operation on each pseudo-color X-ray image, and display the automatic picture judging result, or display the pseudo-color X-ray images in sequence so that the security inspector performs picture judging operation on the pseudo-color X-ray images to obtain the picture judging result.

[0078] The distributed X-ray security inspection machine picture judging method provided in the application is applied to each X-ray security inspection machine in the distributed X-ray security inspection machine picture judging system.

[0079] The distributed X-ray security inspection machine picture judging system provided in the application has the X-ray projection and imaging function of the X-ray security inspection machine, has the networking function between the cloud server and each X-ray security inspection machine, can upload the picture judging task to the cloud server in sequence, the X-ray security inspection machine has the local picture judging and remote picture judging functions, has the manual switching function of the local picture judging and the remote picture judging, has the visible light image acquisition device function, and the position of the visible light image acquisition device is not limited to the entrance position, the exit position and the inside of the channel of the security inspection machine. The manual switching function of the local picture judging and the remote picture judging is as follows: the X-ray security inspection machine is controlled by a button after being turned on, and the default is the local picture judging mode, when the switching button is pressed, the remote picture judging mode is switched, and when the switching button is pressed, the local picture judging mode is switched.

[0080] The local image judgment software and the remote image judgment software are deployed on the same workstation, and an independent control software app_control is abstracted to artificially control the switching of the local image judgment software and the remote image judgment software. When the system is enabled, the local image judgment software (including sipapp) is automatically started and the remote image judgment software (including app_control) is started. The sipapp is responsible for the communication of the security inspection machine and the centralized image judgment, and the dispatching software is responsible for the collection of all key messages and sending instructions to the sipapp and the remote image judgment software, so as to maintain the independence of the local image judgment software and the remote image judgment software.

[0081] The distributed X-ray security inspection machine image judgment system provided in the application uses a development control program app_control which is always running in the background and can receive all key messages. Two custom key messages are defined, such as ctrl+5 to trigger the local image judgment software to be on top, and ctrl+6 to trigger the remote image judgment software to be on top. When ctrl+5, the sipapp needs the local image judgment software to be on top, and a custom message is sent to the remote image judgment software to hide; when ctrl+6, the sipapp needs the local image judgment software to be hidden, and a custom message is sent to the remote image judgment software to be on top.

[0082] Although the preferred embodiments of the application have been described, those skilled in the art can make further changes and modifications to the embodiments once they know the basic inventive concept. Therefore, the appended claims are intended to be interpreted as including all the preferred embodiments and all changes and modifications falling within the scope of the application.

[0083] Obviously, those skilled in the art can make various modifications and variations to the application without departing from the spirit and scope of the application. Thus, if these modifications and variations of the application fall within the scope of the claims of the application and their equivalent technologies, the application also intends to include these modifications and variations.

Claims

1. A distributed X-ray security inspection machine image interpretation system, characterized in that, The system comprises a cloud server and X-ray security inspection machines connected with each other through a network; the cloud server comprises a cloud image processing unit; each of the X-ray security inspection machines comprises a mode selection unit, an image acquisition unit, a local image processing unit and a picture display unit; The mode selection unit is configured to count the number of packages passing through the X-ray security inspection machine within a preset time period, and determine a picture judging mode according to the number of packages; when the number of packages is greater than a preset threshold, the picture judging mode is determined to be a self-picture judging mode; when the number of packages is not greater than the preset threshold, the picture judging mode is determined to be a mixed-picture judging mode or an external-picture judging mode; The image acquisition unit is configured to acquire an initial X-ray image sequence, and send the initial X-ray image sequence to the local image processing unit in the self-picture judging mode, or send a designated initial X-ray image in the initial X-ray image sequence to the cloud image processing unit in the mixed-picture judging mode or the external-picture judging mode; The local image processing unit is configured to process the received initial X-ray image sequence to obtain a pseudo-color X-ray image sequence, and send the pseudo-color X-ray image sequence to the picture display unit; the cloud image processing unit is configured to process the received designated initial X-ray image to obtain a pseudo-color X-ray image, and send the pseudo-color X-ray image to the picture display unit; The picture display unit is configured to perform automatic picture judging operation on each pseudo-color X-ray image, and display the picture judging result, or display the pseudo-color X-ray images in sequence, so that a security inspector performs picture judging operation on the pseudo-color X-ray images to obtain the picture judging result; The picture display unit is specifically configured to input the pseudo-color X-ray image into a trained picture judging network model for each pseudo-color X-ray image, and obtain the picture judging result of the pseudo-color X-ray image based on the trained picture judging network model; The picture display unit comprises a display unit and at least two picture judging sub-units; The at least two picture judging sub-units are respectively configured to obtain the picture judging result of the pseudo-color X-ray image based on the trained picture judging network model for each pseudo-color X-ray image, and send each picture judging result to the display unit; The display unit is configured to display the picture judging result of the pseudo-color X-ray image in which the preset object exists, if the proportion of the picture judging result of the pseudo-color X-ray image in which the preset object exists exceeds a set threshold for each pseudo-color X-ray image.

2. The system of claim 1, wherein, The cloud server further comprises a first cloud image storage unit; The image acquisition unit is further configured to send the designated initial X-ray image in the initial X-ray image sequence to the first cloud image storage unit in the mixed-picture judging mode or the external-picture judging mode; The local image processing unit is further configured to receive the initial X-ray image sent by the first cloud image storage unit, process the initial X-ray image to obtain a pseudo-color X-ray image, and send the pseudo-color X-ray image to the picture display unit in the mixed-picture judging mode or the external-picture judging mode.

3. The system of claim 2, wherein, The cloud server further comprises a second cloud image storage unit; The first cloud image storage unit is further configured to send the stored initial X-ray image to the cloud image processing unit; The cloud image processing unit is configured to process the received initial X-ray image to obtain a pseudo-color X-ray image and send the pseudo-color X-ray image to a second cloud image storage unit. The second cloud image storage unit is configured to send the stored pseudo-color X-ray image to the image interpretation display unit.

4. The system of claim 3, wherein, The first cloud image storage unit is further configured to store each initial X-ray image, and each initial X-ray image carries its own identification information, which at least includes one of an image size, a source physical location, a source X-ray security inspection machine model, and a source IP address; sort each initial X-ray image according to its own identification information, and send a specified initial X-ray image to the cloud image processing unit according to a sorting result.

5. The system of claim 3, wherein, The second cloud image storage unit is further configured to store each pseudo-color X-ray image, and each pseudo-color X-ray image carries its own identification information, which at least includes one of an image size, a source physical location, a source X-ray security inspection machine model, and a source IP address; sort each pseudo-color X-ray image according to its own identification information, and send a specified pseudo-color X-ray image to the image interpretation display unit according to a sorting result.

6. The system of claim 1, wherein, The X-ray security inspection machine further comprises an alarm unit. The image interpretation display unit is configured to send an alarm instruction to the alarm unit if it is determined that the image interpretation result is that a preset item exists in the pseudo-color X-ray image. The alarm unit is configured to output an alarm prompt information when the alarm instruction is received, and the alarm prompt information at least includes one of a sound, a vibration, and a light form.

7. The system of claim 1, wherein, The X-ray security inspection machine further comprises a visible light image acquisition unit. The visible light image acquisition unit is configured to trigger a snapshot when an item enters the X-ray security inspection machine, and acquire a visible light image of the item. The image interpretation display unit is configured to determine a corresponding visible light image by a time difference and a contour matching algorithm if it is determined that the image interpretation result is that a preset item exists in the pseudo-color X-ray image.

8. A method for distributed X-ray security inspection machine image interpretation, characterized in that, The method comprises: counting a number of packages passing through the X-ray security inspection machine within a preset time period, and determining an image interpretation mode according to the number of packages; when the number of packages is greater than a preset number threshold, the image interpretation mode is determined to be a self-image interpretation mode; when the number of packages is not greater than the preset number threshold, the image interpretation mode is determined to be a mixed image interpretation mode or an external image interpretation mode; acquiring an initial X-ray image sequence, sending the initial X-ray image sequence to a local image processing unit in the self-image interpretation mode, and sending a specified initial X-ray image in the initial X-ray image sequence to a cloud image processing unit in the mixed image interpretation mode or the external image interpretation mode; so that the local image processing unit processes the received initial X-ray image sequence to obtain a pseudo-color X-ray image sequence, and sends the pseudo-color X-ray image sequence to an image interpretation display unit; and so that the cloud image processing unit processes the received specified initial X-ray image to obtain a pseudo-color X-ray image. The automatic image interpretation operation is performed on each pseudo-color X-ray image, and the image interpretation result is displayed, or the pseudo-color X-ray images are displayed in sequence, so that the security officer performs the image interpretation operation on the pseudo-color X-ray images to obtain the image interpretation result; The image interpretation display unit is configured to input the pseudo-color X-ray image into a trained image interpretation network model, and obtain the image interpretation result of the pseudo-color X-ray image based on the trained image interpretation network model; The image interpretation display unit includes a display unit and at least two image interpretation sub-units; The at least two image interpretation sub-units are respectively configured to obtain the image interpretation result of the pseudo-color X-ray image based on the trained image interpretation network model, and send each image interpretation result to the display unit; The display unit is configured to display the image interpretation result of the pseudo-color X-ray image if the proportion of the image interpretation result of the preset object in the pseudo-color X-ray image exceeds a set threshold.

Images