Inspection table equipment and method

Abstract

The invention discloses inspection table equipment and a method. The inspection table equipment comprises a local server, a first screen, a second screen and a third screen. The local server establishes bidirectional connection with different systems on the inspection table equipment, performs bidirectional communication with the different systems, and displays windows corresponding to the different systems on different screens of the inspection table equipment through instructions respectively; the first screen is located below the front side of the inspection table equipment and displays a window according to an instruction of the local server side; the second screen is positioned above the front surface of the inspection table equipment and displays a window according to an instruction of the local server; and the third screen is positioned on the back surface of the inspection table equipment and is used for displaying a window according to an instruction of the local server. The method is used for solving the problems that existing checking equipment generally has inconvenience in checking system display content, long operation processing time, imperfect commodity information and the like, improving the checking efficiency of entry travelers and facilitating operation and checking of customs officers.

Description

Technical Field

[0001] The present application relates to the field of customs passenger inspection commodity inspection equipment, and in particular to an inspection station device and method. Background Art

[0002] Customs inspection refers to the administrative law enforcement behavior of the customs to conduct actual inspection of goods after accepting the declaration of the customs declaration unit to determine whether the nature, origin, condition, quantity and value of the inbound and outbound goods are consistent with the details filled in on the goods declaration form. Inspection is a power granted by the state to the customs in accordance with the law, and it is also an indispensable and important link in the customs clearance process.

[0003] At present, there are many types of goods at the customs site, the inventory is cumbersome, the manual inspection and input are inefficient, the commodity prices are all based on manual query or experience judgment, the inspection time is long, and there is a bad experience for both customs officers and passengers. The inspection equipment currently in use generally has problems such as inconvenient system display content, long operation processing time, and incomplete commodity information. The above problems make it impossible to quickly and accurately implement the collection, exemption, deduction, and refund in accordance with the law and ensure the uniformity of law enforcement standards when there are a wide range of inbound and outbound passengers and a wide variety of commodities. Summary of the invention

[0004] The purpose of this application is to provide an inspection station device and method to solve the common problems of existing inspection equipment, such as inconvenient system display content, long operation processing time, incomplete commodity information, etc., to improve the inspection efficiency of inbound passengers and facilitate customs officials to operate inspections.

[0005] In a first aspect, the present application proposes an inspection station device, comprising:

[0006] The local server establishes a two-way connection with a plurality of systems on the inspection station device, and displays windows corresponding to the plurality of systems on the screen of the inspection station device, respectively, wherein the plurality of systems include an inspection system, an inspection auxiliary system, and a passenger terminal system;

[0007] The first screen is located at the lower front of the inspection station device and displays a window according to the instructions of the local server;

[0008] The second screen is located above the front of the inspection station device and displays a window according to the instructions of the local server;

[0009] The third screen is located at the back of the inspection station device and displays a window according to the instructions of the local server.

[0010] In some possible embodiments, the different systems include an inspection system, an inspection assistance system, and a passenger-side system, and the local server is specifically used for:

[0011] Receiving a connection establishment request sent by the inspection system when opening the inspection system webpage of the business end, and establishing a two-way connection with the inspection system; according to the window identifier corresponding to the inspection system and the preset screen setting, moving the window of the inspection system to the first screen for display;

[0012] receiving a connection establishment request sent by the inspection auxiliary system and the passenger terminal system when logging in in response to the inspection system login instruction, and establishing a two-way connection with the inspection auxiliary system and the passenger terminal system respectively;

[0013] Receiving a window movement instruction sent by the inspection system, wherein the window movement instruction includes a window identifier corresponding to the inspection auxiliary system / passenger terminal system and screen position information of the corresponding window;

[0014] According to the window identification and screen position information corresponding to the inspection assistance system / passenger-end system, the window corresponding to the inspection assistance system is moved to the second screen for display, and the window corresponding to the passenger-end system is moved to the third screen for display.

[0015] In some possible embodiments, the local server is further used for:

[0016] When establishing a two-way connection with the inspection system, record the correspondence between the inspection system and the communication port and socket of the two-way connection; based on the window identifier carried in the window display instruction sent by the inspection system, record the correspondence between the inspection system and the communication port of the two-way connection and the inspection system window identifier;

[0017] When establishing a two-way connection with the inspection assistance system / passenger-side system, the correspondence between the inspection assistance system / passenger-side system and the communication port and socket of the two-way connection is recorded; based on the socket and window identifiers carried in the window message corresponding to the inspection assistance system / passenger-side system, the correspondence between the inspection assistance system / passenger-side system and the two-way connection communication port and the window identifier corresponding to the inspection assistance system / passenger-side system is recorded.

[0018] In some possible embodiments, there are multiple inspection assistance systems, and the local server is further used for:

[0019] When it is determined that the multiple inspection assistance systems are opened for the first time at the same time, the window corresponding to the inspection assistance system displayed on top by default is moved to the foreground of the second screen for display;

[0020] Receive an inspection auxiliary system display switching instruction generated by the inspection system according to the operation, and move the window corresponding to the inspection auxiliary system indicated by the instruction to the foreground of the second screen for display.

[0021] In some possible embodiments, the local server is further used for:

[0022] Receiving a data interaction instruction sent by the inspection system / inspection auxiliary system / passenger terminal system to display generated data to a designated system, and determining a corresponding communication port in a bidirectional connection according to the window identifier of the designated system carried in the data interaction instruction and the corresponding relationship between the records;

[0023] The generated data is sent to a window display of the designated system based on the corresponding communication port in the bidirectional connection.

[0024] In some possible embodiments, the local server is further used for:

[0025] Receive a window control message sent by the inspection system / inspection auxiliary system / passenger terminal system, determine the corresponding communication port in the two-way connection according to the window identifier carried in the window control message and the recorded correspondence, and control the corresponding window based on the communication port according to the window command in the window control message;

[0026] Receive a window control message for display control of an inspection assistance system generated by the inspection system according to an operation, determine the corresponding communication port in a two-way connection according to the window identifier in the window control message, and control the window of the corresponding inspection assistance system based on the communication port according to the window command in the window control message.

[0027] In some possible embodiments, the local server is further used for:

[0028] Receive the system shutdown command sent by the inspection system, close the window corresponding to the inspection system displayed on the first screen, the window corresponding to the inspection auxiliary system displayed on the second screen, and the window corresponding to the passenger-side system displayed on the third screen, and disconnect the two-way connection with the inspection system / inspection auxiliary system / passenger-side system.

[0029] In some possible embodiments, a server is further included, which detects, identifies and verifies the commodity pictures taken by the camera through the algorithm module, and the server is also used to:

[0030] The receiving inspection system controls multiple cameras arranged on the ceiling of the inspection table equipment to take photos of the goods in the inspection area and send the goods photos;

[0031] Using a target detection algorithm to obtain the location of the product, using an information extraction algorithm based on the location to obtain the barcode and text information of the product, and using the barcode and text information to search for matching product information in a product database;

[0032] The returned product information is sent to the inspection system.

[0033] In some possible embodiments, the product database includes a static database and a dynamic database. When the server fails to find matching product information in the static database using barcodes and text information, it can also search for matching product information through an external network and store the found matching product information in the dynamic database.

[0034] In a second aspect, the embodiment of the present application further proposes a multi-screen display method based on an inspection station device, comprising:

[0035] In response to the user's operation instruction, the local server establishes a two-way connection with different systems on the inspection station device to communicate with the different systems in a two-way manner;

[0036] The local server displays windows corresponding to different systems on different screens of the inspection station device through instructions;

[0037] The different screens include a first screen located below the front of the inspection station device, a second screen located above the front of the inspection station device, and a third screen located at the back of the inspection station device.

[0038] The present application proposes an inspection station device and method, wherein the inspection station device includes a local server, a first screen, a second screen and a third screen. The local server establishes a two-way connection with different systems on the inspection station device, communicates with the different systems in a two-way manner, and displays the windows corresponding to different systems on different screens of the inspection station device through instructions; the first screen is located at the lower front of the inspection station device, and displays the window according to the instructions of the local server; the second screen is located at the upper front of the inspection station device, and displays the window according to the instructions of the local server; the third screen is located at the back of the inspection station device, and displays the window according to the instructions of the local server. It is used to solve the common problems of existing inspection equipment, such as the inconvenient viewing of system display content, long operation processing time, incomplete commodity information, etc., improve the inspection efficiency of incoming passengers, and facilitate customs officials to operate inspections.

[0039] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or be understood by practicing the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. Obviously, the drawings introduced below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0041] Figure 1 A schematic diagram of an application environment of an embodiment of the present application;

[0042] Figure 2 This is a structural diagram of an inspection station device according to an embodiment of the present application;

[0043] Figure 3 This is a flow chart of realizing multi-screen interaction by using a local server in an inspection station device according to an embodiment of the present application;

[0044] Figure 4 A flow chart of establishing a two-way connection between a local server and an inspection system in one embodiment of the present application;

[0045] Figure 5 A flowchart of establishing a two-way connection between a local server and an inspection assistance system / passenger system in one embodiment of the present application;

[0046] Figure 6 This is a schematic diagram of multiple screens of an inspection station device in one embodiment of the present application;

[0047] Figure 7 This is a schematic diagram of the operation flow of the inspection station device in one embodiment of the present application;

[0048] Figure 8 This is a flow chart of a local server for implementing data interaction between different systems in one embodiment of the present application;

[0049] Fig. 9 This is a schematic diagram of a window control method implemented by a local server in one embodiment of the present application;

[0050] Fig.10 This is a schematic diagram of a second window control method implemented by a local server in one embodiment of the present application;

[0051] Fig.11 This is a flowchart of a local server being also used to control multiple windows in one embodiment of the present application;

[0052] Fig.12 This is a specific flow chart of the inspection station equipment in one embodiment of the present application;

[0053] Fig.13 This is a specific example flow chart of interaction among multiple screens of a verification station device in one embodiment of the present application;

[0054] Fig.14 This is a schematic diagram of a window of a commodity valuation page at a business end in one embodiment of the present application;

[0055] Fig.15 This is a schematic diagram of a window corresponding to a passenger-side system in one embodiment of the present application;

[0056] Fig.16 This is a schematic diagram of a window for uploading passenger clearance system by a business end in one embodiment of the present application;

[0057] Fig.17 This is a schematic diagram of the location of the camera on the ceiling of the inspection station equipment in one embodiment of the present application;

[0058] Fig.18 This is a camera workflow diagram in one embodiment of the present application;

[0059] Fig.19 This is a schematic diagram of a multi-screen interactive display method based on an inspection station device in one embodiment of the present application. DETAILED DESCRIPTION

[0060] To further illustrate the technical solution provided by the embodiment of the present application, this is described in detail below in conjunction with the accompanying drawings and specific implementation methods. Although the embodiment of the present application provides the method operation steps as shown in the following embodiments or drawings, more or fewer operation steps may be included in the method based on routine or no creative labor. In the steps where there is no necessary causal relationship logically, the execution order of these steps is not limited to the execution order provided by the embodiment of the present application. The method can be executed in the order of the method shown in the embodiment or drawings or in parallel during the actual processing process or when the control device is executed.

[0061] In view of the wide variety of commodities on the customs site, cumbersome inventory, low efficiency of manual inspection and input, the commodity prices are all based on manual inquiry or experience judgment, the inspection time is long, and there is a bad experience for both customs officers and passengers. In the case of a wide range of inbound and outbound passengers and a wide variety of commodities, it is impossible to quickly and accurately implement the collection, exemption, deduction and refund in accordance with the law and ensure the uniformity of law enforcement standards. In addition, the inspection equipment currently in use in the relevant technology generally has problems such as inconvenient viewing of system display content, long operation processing time, and incomplete commodity information. In order to improve the inspection efficiency of inbound passengers and facilitate customs officials to operate inspections, this application proposes an inspection table device.

[0062] The following is a detailed description of an inspection station device in an embodiment of the present application in conjunction with the accompanying drawings.

[0063] See also Figure 1, is a schematic diagram of an application environment according to an embodiment of the present application. The application scenario of the embodiment of the present application is an application scenario of commodity inspection by an inspection station device, which mainly includes a front-end inspection station device 10, a server 20, and a database 30. The front-end inspection station device 10 is used to take a photo of the commodity in the inspection area on the inspection station device, send the commodity picture to the server, and the server recognizes the commodity picture to obtain a barcode, compares the barcode with the barcode in the database, and if the comparison is successful, sends the commodity information corresponding to the successfully matched barcode to the inspection station device for commodity inspection.

[0064] like Figure 2 The structure diagram of an inspection station device in an embodiment of the present application is shown, including an inspection area 201, a business end 202, and a passenger end 203.

[0065] Among them, the inspection area 201 is used to take pictures of the goods, identify the goods with one click through machine vision AI intelligence, and obtain the goods information; the business end 202 is used to count the inspected goods, and can perform data processing and data interaction between different systems according to instructions; the passenger end 203 is used to display the goods information to the passengers and perform data interaction between different systems according to the passengers' operations.

[0066] An inspection station device in an embodiment of the present application adopts a machine vision AI intelligent one-click recognition inspection method to quickly complete the inspection, identification, and valuation of batch commodities, and automatically calculate the inspected duty-paid price and tax payment amount, thereby improving the inspection accuracy and changing the existing manual inspection method. The inspection process is shortened from 20 minutes to 8 minutes, which is about 2.5 times more efficient. In addition, the screen display part integrates the existing inspection system, inspection auxiliary system (machine inspection image system, passenger clearance system and other business systems) and passenger-side system to complete the interactive control of multiple systems and multiple roles on three screens, changing the existing system fragmentation and data non-communication situation, and improving the uniformity of customs officers' experience.

[0067] In the inspection station device of the embodiment of the present application, a local server, a first screen, a second screen and a third screen are included, wherein:

[0068] The local server establishes a two-way connection with different systems on the inspection station device, communicates with the different systems in a two-way manner, and displays windows corresponding to different systems on different screens of the inspection station device through instructions;

[0069] The first screen is located at the lower front of the inspection station device and displays a window according to the instructions of the local server;

[0070] The second screen is located above the front of the inspection station device and displays a window according to the instructions of the local server;

[0071] The third screen is located at the back of the inspection station device and displays a window according to the instructions of the local server.

[0072] See also Figure 3 , is a flow chart of realizing multi-screen interaction by using a local server in an inspection station device according to an embodiment of the present application. Through the local server, it is possible to directly control the windows of multiple systems. The local server is mainly used for:

[0073] Step 301, receiving a connection establishment request sent by the inspection system when the inspection system webpage of the business end is opened, and establishing a two-way connection with the inspection system;

[0074] In order to facilitate user operation and passengers to check the inspection results, this application proposes to adopt a multi-screen interaction method for the multiple systems of the inspection station equipment. The multiple systems of the inspection station equipment include the inspection system on the business side, the inspection assistance system on the business side and the passenger side system. The inspection assistance system on the business side includes at least one system, which may include but is not limited to the passenger clearance system, the machine inspection image system and the taxation system.

[0075] By entering the URL of the inspection system in the browser of the inspection station device and opening the inspection system webpage of the business end, the inspection system sends a connection establishment request to the local server in response to the window display instruction of the inspection system webpage, and establishes a two-way connection with the local server. The two-way connection can be, but is not limited to, a websocket connection. In the embodiment of the present application, the inspection system is integrated with other systems. When the inspection system is started, other systems are started, but the inspection system first establishes a connection with the local server and displays the inspection system webpage on the first screen.

[0076] Step 302, according to the window identification corresponding to the inspection system and the preset screen setting, the window of the inspection system is moved to the first screen for display;

[0077] The local server will pre-acquire the screen settings of the Windows computer, determine the multiple screens of the inspection station equipment, and set the screen identifier according to the position of each screen. In response to the window display instruction of the inspection system web page, it can obtain the window identifier corresponding to the inspection system, and according to the window identifier of the inspection system, move the window of the inspection system to the default first screen for display.

[0078] Step 303, receiving connection establishment requests sent by the service-side inspection auxiliary system and the passenger-side system in response to the inspection system login instruction to log in, and establishing two-way connections with the inspection auxiliary system and the passenger-side system respectively;

[0079] After the inspection system is started, the inspection system webpage is displayed. Log in by entering the account and password on the inspection system webpage, triggering the business-side inspection auxiliary system and the passenger-side system to establish a two-way connection with the local server. The two-way connection can be but is not limited to a websocket connection.

[0080] Step 304, receiving a window movement instruction sent by the inspection system to move the window corresponding to the inspection auxiliary system / passenger terminal system, wherein the window movement instruction includes a window identifier corresponding to the inspection auxiliary system / passenger terminal system and screen position information of the corresponding window;

[0081] After the inspection assistance system / passenger-side system establishes a connection with the local server, the local server has the ability to communicate with the inspection assistance system / passenger-side system. The window display of the inspection assistance system / passenger-side system is controlled by the inspection system. By inputting corresponding instructions in the inspection system, the window corresponding to the inspection assistance system / passenger-side system is controlled to open.

[0082] Step 305, according to the window identifier corresponding to the inspection auxiliary system / passenger-side system and the window movement instruction, the window corresponding to the inspection auxiliary system is moved to the second screen for display, and the window corresponding to the passenger-side system is moved to the third screen for display.

[0083] Since the local server has established a two-way connection with the inspection system / inspection auxiliary system / passenger end system, it can directly control the windows of multiple systems, and the inspection system can realize window control of the inspection auxiliary system / passenger end system through the local server. The embodiment of the present application can integrate multiple systems and multiple screens to realize interactive control between the screens of multiple systems.

[0084] In the inspection station device of the embodiment of the present application, a local server is used to realize multi-screen interaction, which can not only realize data interaction between windows, but also operate the local browser handle, realize screen movement, and maximum and minimum window control, replacing the common cloud service and the inability to control the browser handle.

[0085] In some possible embodiments, Figure 4 As shown, the local server is also used for:

[0086] Step 401, when establishing a bidirectional connection with the inspection system, recording the correspondence between the inspection system and the communication port and socket of the bidirectional connection;

[0087] The above-mentioned two-way connection is a websocket connection. After the connection is established, the communication port and socket can be obtained, thereby recording the correspondence between the inspection system and the communication port and socket of the two-way connection. Subsequently, through the communication port that receives the data, it can be determined that the data is sent by the inspection system.

[0088] Step 402, based on the window identifier carried in the window display instruction sent by the inspection system, record the correspondence between the inspection system and the communication port of the bidirectional connection and the inspection system window identifier.

[0089] When the local server receives the window display instruction sent by the inspection system, it determines that it is sent by the inspection system based on the communication port that receives the window display instruction, then obtains the window identifier in the window display instruction, and records the correspondence between the inspection system and the communication port of the two-way connection and the inspection system window identifier.

[0090] In some possible embodiments, Figure 5 As shown, the local server is also used for:

[0091] Step 501, recording the correspondence between the inspection auxiliary system / passenger end system and the communication port and socket of the bidirectional connection;

[0092] When the local server establishes a two-way connection with the inspection auxiliary system / passenger end system, the communication port and socket can be obtained, and the corresponding relationship between the inspection auxiliary system / passenger end system and the communication port and socket of the two-way connection can be recorded.

[0093] Step 502, based on the socket and window identifier carried in the window message corresponding to the inspection auxiliary system / passenger-side system, record the correspondence between the inspection auxiliary system / passenger-side system and the two-way connection communication port and the window identifier corresponding to the inspection auxiliary system / passenger-side system.

[0094] The inspection assistance system / passenger-end system responds to the inspection system login instruction and sends the corresponding window message to the local server. After receiving the window message, the local server determines that it is the inspection assistance system / passenger-end system based on the port that receives the window message, and further records the correspondence between the inspection assistance system / passenger-end system and the two-way connection communication port and the window identifier corresponding to the inspection assistance system / passenger-end system based on the window identifier carried in the window message.

[0095] In some possible embodiments, there are multiple inspection assistance systems. When it is determined that the corresponding windows of the multiple inspection assistance systems are opened for the first time at the same time, the window corresponding to the inspection assistance system that is displayed on top by default is moved to the front of the second screen for display.

[0096] As mentioned above, the window display of the inspection assistance system is controlled by the inspection system. The inspection station equipment of the embodiment of the present application can open the windows of multiple systems at the same time through one-key control according to instructions. The local server moves the window corresponding to the inspection assistance system that is displayed on top by default to the front of the second screen for display, and other windows are displayed in an overlaid form.

[0097] In a possible embodiment, the first screen displays the window corresponding to the inspection system of the business end, the second screen displays the window corresponding to the inspection auxiliary system, and the third screen displays the window corresponding to the passenger end system. There are multiple inspection auxiliary systems in the embodiment of the present application, which may include but are not limited to passenger customs clearance system, machine inspection image system and tax collection system.

[0098] Among them, the first screen displays the window of the inspection system, which is used for intelligent inspection, identification, price recommendation, taxation, etc. of goods; the second screen displays the windows of the above three inspection auxiliary systems; and the third screen displays the window of the passenger-side system.

[0099] like Figure 6 As shown, in the embodiment of the present application, an inspection station device includes the above three screens, the above first screen is located at the lower front of the inspection station device, the above second screen is located at the upper front of the inspection station device, the first screen displays the window of the inspection system, which is used for intelligent inspection, identification, price recommendation, taxation, etc. of goods; the second screen displays the inspection auxiliary system window, which is used to display the window corresponding to the inspection auxiliary system, wherein the inspection auxiliary system may include but is not limited to the passenger customs clearance system, the machine inspection image system and the taxation system. The above third screen is located on the back of the inspection station device, and displays the window of the passenger-side system, which is mainly used to confirm the identity of passengers, inspect goods and confirm and communicate tax payment information, and display tax QR codes.

[0100] In the embodiment of the present application, the inspection system controls the switching of the inspection auxiliary system window displayed at the front, and the local server receives the inspection auxiliary system display switching instruction generated by the inspection system according to the operation, and moves the window corresponding to the inspection auxiliary system indicated by the instruction to the front of the second screen for display. There are two ways for the inspection system to generate the inspection auxiliary system display switching instruction according to the operation, one of which is to trigger the corresponding instruction switching by operating the corresponding button on the inspection system, and another possible way is for the inspection system to automatically switch according to the current business scenario.

[0101] The three systems on the second screen of the embodiment of the present application correspond to three windows respectively, with different window labels. The three windows are stacked on the second screen. According to the business scenario, which system needs to be interacted with, the corresponding system window is switched to the front. For example, when the goods are inspected, it is necessary to find the goods according to the location of the items displayed on the baggage inspection map. At this time, the inspection system on the first screen will notify the local server to switch the window of the machine inspection image system to the front of the second screen; when the goods are inspected, it is necessary to upload the inspected goods information to the passenger clearance system. At this time, the inspection system will notify the local server to switch the passenger clearance system to the front of the second screen; when the tax calculation in the inspection system is completed, the tax payment is required and the payment result is viewed, the local server is notified to switch the tax collection system to the front of the second screen to display the tax payment result.

[0102] like Figure 7 As shown, it is a schematic diagram of the operation flow of the inspection station device in the embodiment of the present application. According to the URL address of the inspection system entered, the login page is opened to log in according to the instructions, and multiple windows corresponding to multiple systems are opened at the same time of login, and the windows corresponding to each system are displayed on the corresponding screen through the local server.

[0103] The embodiment of the present application can directly control the windows corresponding to multiple systems by introducing a local server, and automatically move the windows corresponding to different systems to the corresponding screens.

[0104] In some possible embodiments, the local server introduced by the embodiments of the present application can also realize data flow between different systems. Figure 8 As shown, the process of the local server for realizing data interaction between different systems includes:

[0105] Step 801, receiving a data interaction instruction sent by the inspection system / inspection auxiliary system / passenger terminal system to display generated data to a designated system;

[0106] For any of the above-mentioned multiple systems, if data is generated through related operations and needs to be uploaded to other systems, the system can send a data interaction instruction to the local server, and the data interaction instruction carries the window identifier of the other system and the display command of the generated data.

[0107] Step 802, determining the corresponding communication port in the bidirectional connection according to the window identifier of the designated system carried in the data interaction instruction and the recorded correspondence;

[0108] As mentioned above, since the correspondence between the above-mentioned inspection system / inspection auxiliary system / passenger-side system and the two-way connection communication port and the window identification corresponding to the above-mentioned inspection auxiliary system / passenger-side system is recorded in advance, the corresponding communication port can be found through the above-mentioned window identification.

[0109] Step 803: Based on the corresponding communication port in the bidirectional connection, the generated data is sent to the window display of the designated system.

[0110] In this embodiment, when business data interaction is required, the inspection system / inspection auxiliary system / passenger end system will send the data to be displayed to the local server through websocket. The local server determines the data source according to the window identifiers of the windows corresponding to the multiple systems and sends the data to the corresponding window of the corresponding designated system to achieve multi-screen display. For example, after the inspection system generates the QR code information for tax payment, it will be sent by the inspection system to the passenger end system through the local server for passengers to scan and pay.

[0111] In some possible embodiments, the present embodiment can also implement window control through a local server, such as Fig. 9 and Fig.10 As shown, the control of the window mainly includes the following two methods:

[0112] Fig. 9 In the first mode shown, the local server receives the window control message sent by the inspection system / inspection auxiliary system / passenger terminal system, determines the corresponding communication port in the two-way connection according to the correspondence between the window identifier and the record carried in the window control message, and controls the corresponding window based on the communication port according to the window command in the window control message;

[0113] In the embodiment of the present application, the window-oriented control is implemented by the local server, so any system can communicate with the local server through the window operation of the system to achieve corresponding control of the window.

[0114] Fig.10 The second method shown is to receive the inspection assistance system display control instruction generated by the inspection system according to the operation, the display control instruction carries a window control message with the window identifier of the specified inspection assistance system, and determine the corresponding communication port in the two-way connection according to the window identifier of the specified inspection assistance system and the recorded correspondence, and control the window of the specified inspection assistance system based on the communication port according to the window command in the window control message.

[0115] In the embodiment of the present application, the local server can directly control the position, full screen, maximum, minimum and other operations of multiple windows. Therefore, when window control is required, such as full screen, top, minimize, move, query window status, etc., it is only necessary to send the inspection auxiliary system display control instruction to the local server. The local server receives the message and performs corresponding window processing on the window of the designated inspection auxiliary system according to the command type of the window command in the display control instruction. For example, the tax collection window is topped, switched to the front display command, maximized, minimized, etc.

[0116] In some possible embodiments, Fig.11 As shown, the local server is also used to control multiple windows, and its process includes:

[0117] Step 1101, receiving a system shutdown instruction sent by the inspection system;

[0118] Step 1102, close the windows corresponding to all systems displayed on the first screen, the second screen and the third screen, and disconnect the two-way connection with the inspection system / inspection auxiliary system / passenger end system.

[0119] Combine the following Fig.12 Taking the inspection system, the inspection auxiliary system includes the passenger clearance system, the machine inspection image system and the tax collection system as an example, the specific process of the inspection station equipment described in the embodiment of the present application is given, such as Fig.12 As shown, including:

[0120] Step 1201, verify that the system establishes a connection with the local server;

[0121] When the inspection system webpage on the business side is opened, the inspection system will establish a two-way communication protocol websocket connection with the local server, and the local server will record the correspondence between the inspection system and the communication port and socket socket of the two-way connection, so that the inspection system can communicate with it through the communication port and socket socket of the websocket in the future.

[0122] Step 1202, the local server moves the window of the inspection system to the first screen for display according to the window identifier corresponding to the inspection system and the preset screen setting;

[0123] The local server will obtain the screen settings of the Windows computer, identify the three screens (lower screen, upper screen, and back screen) with screen1, screen2, and screen3 respectively, identify the corresponding window of the business-side inspection system with MainWin, and display the corresponding window MainWin of the inspection system on screen1 by default.

[0124] Step 1203, the local server records the correspondence between the inspection system and the communication port of the two-way connection and the inspection system window identifier;

[0125] Based on the window identifier carried in the window display instruction sent by the inspection system, after recording the correspondence between the inspection system and the communication port of the two-way connection and the inspection system window identifier, communication with the inspection system can be carried out through the websocket communication port and the inspection system window identifier.

[0126] Step 1204, when the inspection system is logged in, the inspection auxiliary system and the passenger terminal system are logged in at the same time and establish two-way connections with the local server respectively;

[0127] When the business end logs into the inspection system, the inspection assistance system and the passenger end system of the business end also log in in response to the inspection system login instruction, start the passenger end window and the machine inspection image system window, the passenger clearance system window, and the taxation system window, and different windows have different window identifications; the inspection assistance system and the passenger end system will respectively establish a two-way communication protocol websocket connection with the local server, and record the corresponding relationship between the inspection assistance system / passenger end system and the communication port and socket of the two-way connection, so as to communicate with the inspection assistance system / passenger end system through the websocket communication port and socket socket in the future.

[0128] Step 1205: After logging into the inspection system, a window movement instruction is sent to the local server, wherein the window movement instruction includes the window identifier corresponding to the inspection auxiliary system / passenger terminal system and the screen position information of the corresponding window;

[0129] When the window is successfully opened, the inspection system will send a window movement instruction to the local server to move multiple windows corresponding to the inspection auxiliary system and the passenger-side system, so that multiple windows can be moved to the specified screen at the same time.

[0130] Step 1206, the local server moves the window corresponding to the inspection assistance system to the second screen for display, and moves the window corresponding to the passenger-side system to the third screen for display based on the window identification and screen position information corresponding to the inspection assistance system / passenger-side system.

[0131] The local server identifies the corresponding windows of the business-side inspection assistance system (machine inspection image system, passenger clearance system and taxation system) as MachineWin, LvtongWin and TaxWin according to the windows computer screen settings and the window identification and screen position information corresponding to the inspection assistance system / passenger-side system obtained in the above steps, and displays the corresponding window of the inspection assistance system on screen2. The passenger-side system on the passenger-side uses PassengerWin as the window identification and displays the corresponding window of the passenger-side system on screen3.

[0132] Step 1207, the local server records the correspondence between the inspection auxiliary system / passenger end system and the two-way connection communication port and the window identifier corresponding to the inspection auxiliary system / passenger end system;

[0133] Based on the socket and window identifier carried in the window message sent by the inspection assistance system / passenger-side system, after recording the correspondence between the inspection assistance system / passenger-side system and the two-way connection communication port and the window identifier corresponding to the inspection assistance system / passenger-side system, communication with the inspection assistance system / passenger-side system can be carried out through the websocket communication port and the window identifier corresponding to the inspection assistance system / passenger-side system.

[0134] Step 1208, the inspection system sends a window control message for display control of the inspection auxiliary system generated according to the operation to the local server, and controls the local server to control the window of the corresponding inspection auxiliary system;

[0135] When window control is required, such as full screen, top, minimized, moved, querying window status, etc., you only need to send a window control message to the local server. The local server will determine the window identifier in the above window control message and the corresponding communication port in the two-way connection, and control the window of the corresponding inspection assistance system based on the communication port according to the window command in the window control message.

[0136] Step 1209, the inspection system sends a system shutdown instruction to the local server;

[0137] Step 1210, the local server closes the window corresponding to the inspection system displayed on the first screen, the window corresponding to the inspection assistance system displayed on the second screen, and the window corresponding to the passenger-side system displayed on the third screen, and disconnects the two-way connection with the inspection system / inspection assistance system / passenger-side system.

[0138] In an embodiment of the present application, the local server establishes a two-way connection with the inspection system / inspection assistance system / passenger-side system respectively, and records the correspondence between the inspection system / inspection assistance system / passenger-side system and the communication port of the two-way connection, the window identifier corresponding to the inspection system / inspection assistance system / passenger-side system and the socket. When receiving data messages in subsequent work, the corresponding window identifier can be identified to send the message to a different window.

[0139] The following is a specific example of interaction with the inspection station device provided by the embodiment of the present application. Fig.13 As shown, specifically including:

[0140] Step 1301, the inspection station device communicates with the local server according to the instruction, and controls the inspection system on the first screen to identify the goods through the AI ​​identification function, and outputs a list of goods to be inspected. Each piece of product information includes the product name, quantity, brand, specification, category and recommended price;

[0141] Step 1302, the inspection station device enters the product valuation page according to the instruction, such as Fig.14 As shown, after communicating with the passenger to confirm the direction of the goods' circulation (taxation or return), tax-paid price, and tax rate, the inspection system automatically calculates the tax amount;

[0142] Step 1303, according to the instruction, the commodity information and tax payment information are used as generated data, and a data interaction instruction is sent to the local service through the "display to the passenger terminal" button, instructing the local server to send the generated data to the passenger terminal for display, such as Fig.15 As shown, the local server will generate data and display it in the window corresponding to the passenger system displayed on the second screen. According to the confirmation instruction, the inspection system will carry out the subsequent tax collection process;

[0143] Step 1304, the inspection station equipment sends the commodity information to be taxed or returned to the passenger clearance system through the local server according to the instruction issued by clicking the "Upload New Travel Pass" button. Fig.16 As shown, a tax payment slip and tax payment QR code information are generated for passengers to scan and pay.

[0144] The above steps complete the process from commodity inspection and valuation to passenger confirmation to tax bill generation in the passenger clearance system, with friendly interaction between the three screens and the system.

[0145] In the embodiment of the present application, the specific process of inspecting the goods by the inspection system is as follows: the passenger's goods are placed in batches on the inspection table equipment; the goods are photographed by three high-definition industrial cameras on the ceiling, and the photographed goods photos are output; the goods pictures taken by the camera are input into the algorithm module for detection and identification. This embodiment adopts barcode detection and recognition, text recognition, image search and recognition and other intelligent recognition algorithms, combined with the product information database, and finally outputs the name, brand, quantity, specifications of the product and gives the product price and price source.

[0146] In the embodiment of the present application, the inspection system is used to obtain product images by controlling the camera to take pictures. Specifically, the inspection system controls multiple cameras arranged on the ceiling of the inspection table equipment to take pictures of the products in the inspection area and send them to the server; the server uses a target detection algorithm to obtain the location of the product, and based on the barcode and text information used at the location, uses the barcode and text information to search for matching product information in the database; the product information returned by the server is received and displayed.

[0147] In order to achieve a high success rate in recognizing product images, the embodiment of the present application adopts a multi-camera photography method. The inspection station equipment processes the three cameras corresponding to the inspection area when taking photos, which can solve problems such as edge image deformation and uneven illumination. The cameras located on the ceiling are mainly used to take photos of products in the inspection area. Fig.17 shown.

[0148] Fig.17 Shown in the figure is a partial structure of the ceiling of the inspection station equipment in the embodiment of the present application. There are three separate cameras on the ceiling, including camera 1701, camera 1702 and camera 1703, which are used to take pictures of the goods on the inspection station equipment at any angle. The corresponding inspection station equipment table is provided with a precision scale 1704, which can weigh small and valuable items.

[0149] The multi-camera photography method used in the embodiment of the present application mainly includes photography, streaming, rotation, file storage, and database data storage. Fig.18 shown.

[0150] First, the inspection system on the business end of the inspection station equipment controls the camera, clicks to take a photo, and after receiving the command, the CS end determines the camera to be used and sends a photo instruction. Multiple cameras are used to take photos, capture streams, rotate and store the goods, completing the photo workflow.

[0151] In the embodiment of the present application, the above-mentioned detection and recognition of the commodity pictures taken by the camera using the algorithm module is to use the intelligent recognition algorithm to recognize the commodity pictures taken by the above-mentioned multiple cameras and placed at any angle on the inspection platform, and estimate the price of the commodity. In order to achieve this goal, the embodiment of the present application first needs to use a target detection algorithm to obtain the position of the commodity in the commodity picture; then use a variety of intelligent recognition algorithms to obtain commodity information such as barcodes, texts, images, etc.; finally, use the obtained commodity information in combination with the commodity database to obtain the price of the commodity, thereby improving the efficiency of customs officers' inspection of inbound items. Specifically, the intelligent recognition algorithm may include but is not limited to the target detection algorithm and a variety of intelligent recognition algorithms involved in the above operations. In the customs passenger inspection scenario, the inspection station equipment involved in this application is the first in the industry to use AI to empower passenger inspection services, replacing the customs on-site manual inquiry, manual entry, and lack of supervision mechanism inspection methods.

[0152] In some possible embodiments, the above-mentioned product database includes a static database and a dynamic database. When the server fails to find matching product information in the static database using barcodes and text information, it can also search for matching product information through an external network and store the found matching product information in the dynamic database.

[0153] In view of the wide variety of commodity information and its rapid iteration, a huge database is needed to quickly and accurately display commodity information and estimate commodity prices during commodity inspection. This application adopts a combination of static database and dynamic database, dynamically accesses data from well-known websites, establishes a dynamic query mechanism for commodity information, and realizes dynamic query, continuous updating and expansion of commodity prices.

[0154] Among them, a secure connection and authorized open connection are established between the commodity databases, and data security is ensured by means of transmission encryption, data encryption, and binding of decryption private keys with inspection station equipment. When identifying commodities, the corresponding data is first queried from the static database according to the identified barcode. If the data is found, it is directly returned to the front-end for display; if the data is not found, the commodity data is dynamically obtained through an external website, and the obtained commodity data will be stored in the dynamic database for easy use in the next inspection query.

[0155] Based on the same inventive concept, the embodiment of the present application also proposes a multi-screen display method based on the inspection station device, such as Fig.19 As shown, including:

[0156] Step 1901, in response to the user's operation instruction, the local server establishes a two-way connection with different systems on the inspection station device to communicate with the different systems in a two-way manner;

[0157] Step 1902, the local server displays windows corresponding to different systems on different screens of the inspection station device through instructions;

[0158] Step 1903, the different screens include a first screen located at the lower front of the inspection station device, a second screen located at the upper front of the inspection station device, and a third screen located at the back of the inspection station device.

[0159] The inspection station equipment and method proposed in the embodiment of the present application integrates the existing business system of the customs, completes the interactive control of multiple systems and multiple roles on three screens, realizes the simultaneous interaction of multiple users and multiple business systems, and displays them on different screen ends, changing the existing system fragmentation, a single screen, can not meet the business needs and the situation that the data do not communicate with each other, and improves the experience and convenience of customs officers and friendly interaction methods. At the same time, the intelligent auxiliary platform for airport customs travel inspection and inspection business, when the inspection personnel inspect the items carried by the inbound passengers, identifies the commodity information through AI recognition and other methods, and then matches the tax-paid price database of the inbound commodities, can quickly and accurately estimate the commodity price, and provide a reference for the customs personnel to estimate the tax-paid price. The machine vision method adopted can intelligently identify the commodity with one click AI. In the customs travel inspection scenario, the inspection station equipment involved in this application is the first in the industry to use AI to empower the travel inspection business, replacing the customs on-site manual inquiry, manual entry, and lack of supervision mechanism inspection methods, and in view of the current inspection equipment There are problems of incomplete commodity data or untimely updates, this application also enriches commodity information by combining static and dynamic query data.

[0160] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. An inspection station device, characterized in that: include: The local server establishes a two-way connection with different systems on the inspection station device, communicates with the different systems in a two-way manner, and displays windows corresponding to different systems on different screens of the inspection station device through instructions; The first screen is located at the lower front of the inspection station device and displays a window according to the instructions of the local server; The second screen is located above the front of the inspection station device and displays a window according to the instructions of the local server; The third screen is located at the back of the inspection station device and displays a window according to the instructions of the local server.

2. The device according to claim 1, characterized in that The different systems include an inspection system, an inspection auxiliary system and a passenger terminal system, and the local server is specifically used for: Receiving a connection establishment request sent by the inspection system when the inspection system webpage of the business end is opened, and establishing a two-way connection with the inspection system; According to the window identification corresponding to the inspection system and the preset screen setting, the window of the inspection system is moved to the first screen for display; receiving a connection establishment request sent by the inspection auxiliary system and the passenger terminal system when logging in in response to the inspection system login instruction, and establishing a two-way connection with the inspection auxiliary system and the passenger terminal system respectively; receiving a window movement instruction sent by the inspection system, wherein the window movement instruction includes a window identifier corresponding to the inspection auxiliary system / passenger terminal system and screen position information of the corresponding window; According to the window identification and screen position information corresponding to the inspection assistance system / passenger-end system, the window corresponding to the inspection assistance system is moved to the second screen for display, and the window corresponding to the passenger-end system is moved to the third screen for display.

3. The device according to claim 2, characterized in that The local server is also used for: When establishing a two-way connection with the inspection system, record the correspondence between the inspection system and the communication port and socket of the two-way connection; based on the window identifier carried in the window display instruction sent by the inspection system, record the correspondence between the inspection system and the communication port of the two-way connection and the inspection system window identifier; When establishing a two-way connection with the inspection auxiliary system / passenger terminal system, record the correspondence between the inspection auxiliary system / passenger terminal system and the communication port and socket of the two-way connection; Based on the socket and window identifiers carried in the window message sent by the inspection assistance system / passenger-side system, the correspondence between the inspection assistance system / passenger-side system and the two-way connection communication port and the window identifier corresponding to the inspection assistance system / passenger-side system is recorded.

4. The device according to claim 2 or 3, characterized in that There are multiple inspection auxiliary systems, and the local server is also used for: When it is determined that the multiple inspection assistance systems are opened for the first time at the same time, the window corresponding to the inspection assistance system displayed on top by default is moved to the foreground of the second screen for display; Receive an inspection auxiliary system display switching instruction generated by the inspection system according to the operation, and move the window corresponding to the inspection auxiliary system indicated by the instruction to the foreground of the second screen for display.

5. The device according to claim 2 or 3, characterized in that The local server is also used for: Receiving a data interaction instruction sent by the inspection system / inspection auxiliary system / passenger terminal system to display generated data to a designated system, and determining a corresponding communication port in a bidirectional connection according to a window identifier of the designated system carried in the data interaction instruction; The generated data is sent to a window display of the designated system based on the corresponding communication port in the bidirectional connection.

6. The device according to claim 2 or 3, characterized in that The local server is also used for: Receive a window control message sent by the inspection system / inspection auxiliary system / passenger terminal system, determine the corresponding communication port in the bidirectional connection according to the window identifier carried in the window control message, and control the corresponding window based on the communication port according to the window command in the window control message; Receive a window control message for display control of an inspection assistance system generated by the inspection system according to an operation, determine the corresponding communication port in a two-way connection according to the window identifier in the window control message, and control the window of the corresponding inspection assistance system based on the communication port according to the window command in the window control message.

7. The device according to claim 2 or 3, characterized in that The local server is also used for: Receive the system shutdown command sent by the inspection system, close the window corresponding to the inspection system displayed on the first screen, the window corresponding to the inspection auxiliary system displayed on the second screen, and the window corresponding to the passenger-side system displayed on the third screen, and disconnect the two-way connection with the inspection system / inspection auxiliary system / passenger-side system.

8. The device according to claim 1, characterized in that It also includes a server, which detects, identifies and verifies the product pictures taken by the camera through the algorithm module, and the server is also used to: The receiving inspection system controls multiple cameras arranged on the ceiling of the inspection table equipment to take photos of the goods in the inspection area and send the goods photos; Using a target detection algorithm to obtain the location of the product, using an information extraction algorithm based on the location to obtain the barcode and text information of the product, and using the barcode and text information to search for matching product information in a product database; The returned product information is sent to the inspection system.

9. The device according to claim 8, characterized in that The commodity database includes a static database and a dynamic database. When the server fails to find matching commodity information in the static database using barcodes and text information, it searches for matching commodity information through an external network and stores the found matching commodity information in the dynamic database.

10. A multi-screen display method based on an inspection station device, comprising: In response to the user's operation instruction, the local server establishes a two-way connection with different systems on the inspection station device to communicate with the different systems in a two-way manner; The local server displays windows corresponding to different systems on different screens of the inspection station device through instructions; The different screens include a first screen located below the front of the inspection station device, a second screen located above the front of the inspection station device, and a third screen located at the back of the inspection station device.

Images