Checking method and device

Abstract

The invention discloses a commodity checking method and device, and the method is applied to a mobile terminal, and comprises the steps: building a bidirectional connection with a checking table having a binding relationship; in response to the auxiliary checking instruction, photographing the commodity to obtain a commodity picture; commodity identification identification is carried out on the commodity picture, the commodity identification obtained through identification is sent to a background server, and the background server returns matched commodity information in a database according to the commodity identification; and the server interacts with the checking table and assists the checking table in checking the commodity based on the commodity information. According to the commodity checking method and device provided by the invention, automatic focusing or distance moving can be realized through the camera on the mobile terminal, full pictures of commodities with different sizes can be shot, and the defects of firmware of an existing checking table can be overcome. Meanwhile, auxiliary inspection is carried out through interaction with the inspection table, and a new inspection way can be provided.

Description

Background Art

[0002] Customs inspection refers to the administrative law enforcement behavior of the customs to conduct actual inspection of goods after accepting the declaration of the customs declaration unit to determine whether the nature, origin, condition, quantity and value of the inbound and outbound goods are consistent with the details filled in on the goods declaration form. Inspection is a power granted by the state to the customs in accordance with the law, and it is also an indispensable and important link in the customs clearance process.

[0003] At present, when the customs uses the inspection table to inspect cosmetics and tobacco products, the artificial intelligence one-click recognition efficiency is relatively high and the recommendation success rate is also relatively high. However, for bag products, due to the large differences in their shapes and sizes, and the limitations of the fixed camera on the inspection table, the distance cannot be adjusted, and the pictures of the bags taken are incomplete, so they cannot be well matched, identified, and successfully recommended. Summary of the invention

[0004] The purpose of this application is to provide an inspection method and equipment to solve the problems of existing inspection equipment due to the limitations of fixed cameras, such as the inability to adjust the distance and the incomplete picture of the bag taken, so as to improve the inspection efficiency of inbound passengers and facilitate customs officials to operate inspections.

[0005] In a first aspect, an embodiment of the present application provides a commodity inspection method, which is applied to a mobile terminal, comprising:

[0006] Establish a two-way connection with the inspection station with which the binding relationship exists;

[0007] In response to the auxiliary inspection instruction, taking a photo of the product to obtain a product picture;

[0008] Identify the commodity image and send the identified commodity identification to the backend server, which returns matching commodity information in the database according to the commodity identification.

[0009] Interact with the inspection station and assist the inspection station in inspecting the commodity based on the commodity information.

[0010] The present application adopts the camera of a mobile terminal to take pictures, which can automatically adjust the focus or move the distance, and can take full pictures of large and small objects. All types of goods can be detected and identified, which can help improve the recognition effect of the inspection station. It can solve the problem that the inspection station in the prior art is structurally designed, and the camera is fixed on the ceiling. The focal length is suitable for goods such as cosmetics, but for large or small goods such as bags, the quality of the pictures taken is poor, which affects the detection and identification of the goods.

[0011] In some possible embodiments, in response to the auxiliary inspection instruction, taking a photo of the product includes:

[0012] receiving an auxiliary inspection instruction sent by the inspection station, wherein the auxiliary inspection instruction includes passenger information and inspection ID;

[0013] Displaying the passenger information and inspection ID on the inspection interface;

[0014] According to the passenger information confirmation operation after comparing the passenger information in the auxiliary inspection instruction with the actual passenger information, the commodity is photographed in response to the auxiliary inspection instruction.

[0015] In the embodiment of the present application, one mobile terminal can only be bound to one inspection station. After the inspection station scans the passport and obtains the passenger's identity information, the mobile terminal needs to match the passenger information with the actual passenger information. After the match is successful, auxiliary inspection is started to ensure the accuracy of the inspection user and avoid errors when synchronizing data.

[0016] In some possible embodiments, interacting with the inspection station and assisting the inspection station in inspecting the commodity based on the commodity information includes:

[0017] Displaying the product information on the inspection interface, generating an inspection result of the product information according to a product information confirmation operation after comparing the displayed product information with the actual product information, and synchronizing the inspection result to the inspection station for display; or

[0018] The commodity information is sent to the inspection station, which displays the commodity information and generates an inspection result of the commodity information based on a commodity information confirmation operation after comparing the displayed commodity information with the actual commodity information.

[0019] The mobile terminal will interact with the inspection station through a two-way connection, and can synchronize the inspection results or commodity information of the mobile terminal to the inspection station, and propose two auxiliary inspection methods for the existing inspection technology. Different methods can be used to complete the inspection according to user habits to assist in rapid customs clearance.

[0020] In some possible embodiments, the commodity identification is performed on the commodity image, including at least one of the following methods:

[0021] Scan the barcode / QR code of the product image to obtain the barcode / QR code identification of the product;

[0022] Performing image recognition on the product image to obtain an image identifier of the product;

[0023] Optical character recognition is performed on the product photo to obtain a text identifier of the product.

[0024] The mobile terminal can use any of the methods such as barcode / QR code scanning, image recognition or optical character recognition, taking advantage of the convenience of the mobile terminal and camera photography, to identify the product identification of the product image, and send the identified product identification to the backend server. The backend server returns the matching product information in the database based on the product identification, which can improve the accuracy of product identification and facilitate product inspection.

[0025] In some possible embodiments, the mobile terminal may further include:

[0026] Record the commodity information or inspection results;

[0027] In response to an inspection and tracing instruction for a designated commodity, the commodity information or inspection result of the designated commodity is searched and displayed according to the recorded commodity information or inspection result.

[0028] The mobile terminal can also save the product information or inspection results, and provide an inspection backtracking function, so that users can search for past inspection operations based on the recorded product information or inspection results. It is reliable and can assist the inspection station in inspection.

[0029] In a second aspect, the present application also provides a commodity inspection method, which is applied to an inspection station, including:

[0030] In response to the mobile terminal management instruction, switching to the mobile terminal management interface;

[0031] Binding the inspection station to at least one mobile terminal according to a binding operation in the mobile terminal management interface;

[0032] Establish a two-way connection with the bound mobile terminal;

[0033] The mobile terminal interacts with the mobile terminal, and based on the commodity information obtained by the mobile terminal from the background server, the mobile terminal assists in checking the commodity.

[0034] This application adds a mobile terminal management interface to the management system of the inspection station to bind the inspection station with at least one mobile terminal. One inspection station can be bound to multiple mobile terminals. After the device is successfully bound, the mobile terminal can perform auxiliary inspection with the inspection station.

[0035] In some possible embodiments, the interacting with the mobile terminal includes:

[0036] Scan the passenger's relevant documents to obtain passenger information;

[0037] An auxiliary inspection instruction is sent to the mobile terminal, wherein the auxiliary inspection instruction includes passenger information and inspection ID.

[0038] The inspection counter scans the passenger's passport with a passport scanner, obtains the passenger's name, passport number and other identity information, and then sends the passenger information and inspection ID to the mobile terminal through a two-way connection to confirm that the current mobile terminal and the inspection counter are inspecting the same passenger.

[0039] In some possible embodiments, the interacting with the mobile terminal, based on the commodity information obtained by the mobile terminal from the backend server, the mobile terminal assists in checking the commodity, includes:

[0040] receiving and displaying the verification result of synchronization of the mobile terminal; or

[0041] The product information sent by the mobile terminal is received and displayed, and a verification result of the product information is generated and displayed according to a product information confirmation operation after comparing the displayed product information with the actual product information.

[0042] The inspection station receives the inspection results / commodity information sent by the mobile terminal and displays them on the page of the inspection station, which means that the auxiliary inspection operation through the mobile terminal is completed, and the subsequent commodity inventory and taxation work process can be carried out.

[0043] In a third aspect, an embodiment of the present application further provides a commodity inspection device, including: a memory and a processor, wherein:

[0044] The memory is used to store programs executable by the processor;

[0045] The processor is used to read the program in the memory and execute a commodity inspection method as described in any one of the first aspect or the second aspect above.

[0046] This application mainly uses mobile terminals to assist inspection stations for inspection. The camera on the mobile terminal can automatically adjust the focus or move the distance, and can take full pictures of goods of different sizes. It can solve the shortcomings of the existing inspection station firmware and improve the convenience of inspection.

[0047] In a fourth aspect, an embodiment of the present application further proposes a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable the computer to execute a commodity inspection method as described in any one of the above-mentioned first aspect or the above-mentioned second aspect.

[0048] The present application discloses a commodity inspection method and device, which is applied to a mobile terminal and includes: establishing a two-way connection with an inspection station with which a binding relationship exists; taking a photo of a commodity in response to an auxiliary inspection instruction to obtain a commodity image; identifying the commodity identification of the commodity image, and sending the identified commodity identification to a background server, which returns matching commodity information in a database according to the commodity identification; interacting with the inspection station and assisting the inspection station in inspecting the commodity based on the commodity information. The present application proposes a commodity inspection method and device, which can automatically adjust the focus or move the distance through the camera on the mobile terminal, and can take full pictures of commodities of different sizes, which can solve the shortcomings of the existing inspection station firmware. At the same time, by interacting with the inspection station for auxiliary inspection, a new inspection method can also be provided.

[0049] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or be understood by practicing the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the written description, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. Obviously, the drawings introduced below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0051] Figure 1 A schematic diagram of an application environment of an embodiment of the present application;

[0052] Figure 2 This is a schematic diagram of a commodity inspection system in an embodiment of the present application;

[0053] Figure 3 A schematic diagram of a mobile terminal management interface on a checking station in an embodiment of the present application;

[0054] Figure 4 This is a flow chart of assisting inspection by a mobile terminal in an embodiment of the present application;

[0055] Figure 5 This is a flow chart of a mobile terminal used to match passenger information in an embodiment of the present application;

[0056] Figure 6 This is a schematic diagram of interaction in method 1 in the embodiment of the present application;

[0057] Figure 7 This is a schematic diagram of the inspection result interface on the inspection table in the embodiment of this application;

[0058] Figure 8 This is a schematic diagram of interaction in the second mode in the embodiment of the present application;

[0059] Fig. 9 This is a schematic diagram of the product information interface on the inspection platform in the embodiment of this application;

[0060] Fig.10 This is a schematic diagram of the interaction process of three parties in a commodity inspection system in an embodiment of the present application;

[0061] Fig.11 This is a schematic diagram of the interaction process of three parties in another commodity inspection system in an embodiment of the present application;

[0062] Fig.12 This is a schematic diagram of a process for a mobile terminal to perform backtracking inspection in an embodiment of the present application;

[0063] Fig.13 This is a schematic diagram of a page of a mobile terminal in an embodiment of the present application;

[0064] Fig.14 This is a specific flow chart of using a mobile terminal to assist in commodity inspection in an embodiment of the present application;

[0065] Fig.15 This is a flow chart of a commodity inspection method applied to a mobile terminal in an embodiment of the present application;

[0066] Fig.16 This is a flow chart of a commodity inspection method applied to an inspection station in an embodiment of the present application;

[0067] Fig.17 This is a schematic diagram of a mobile terminal device in an embodiment of the present application;

[0068] Fig.18 This is a schematic diagram of an inspection station device in an embodiment of the present application;

[0069] Fig.19 This is a schematic diagram of the structure of a commodity inspection device in an embodiment of the present application. DETAILED DESCRIPTION

[0070] To further illustrate the technical solution provided by the embodiment of the present application, this is described in detail below in conjunction with the accompanying drawings and specific implementation methods. Although the embodiment of the present application provides the method operation steps as shown in the following embodiments or drawings, more or fewer operation steps may be included in the method based on routine or no creative labor. In the steps where there is no necessary causal relationship logically, the execution order of these steps is not limited to the execution order provided by the embodiment of the present application. The method can be executed in the order of the method shown in the embodiment or drawings or in parallel during the actual processing process or when the control device is executed.

[0071] In view of the fact that when the customs currently uses the inspection table to inspect cosmetics and tobacco products, the artificial intelligence one-click recognition efficiency is high and the recommendation success rate is also high, but for bag products, due to their large differences in shape and size, due to the limitations of the fixed camera on the inspection table, the distance cannot be adjusted, and the picture of the bag taken is incomplete, so it cannot be well matched for identification and successful recommendation. At the same time, in order to improve the inspection efficiency of inbound passengers and facilitate customs officials to operate inspections, this application proposes an inspection method and equipment.

[0072] A checking method and device in an embodiment of the present application are described in detail below with reference to the accompanying drawings.

[0073] See also Figure 1 , is a schematic diagram of an application environment according to an embodiment of the present application. The embodiment of the present application is applied to an application scenario of an inspection station inspecting goods, and mainly includes an inspection station 1, a mobile terminal 2, a backend server 3 and a database 4. The inspection station 1 is used to bind with the mobile terminal 2, and the mobile terminal 2 assists in the inspection of goods. The mobile terminal 2 is used to take pictures of the goods, and based on the backend server 3 and the database 4, the corresponding product information is queried to assist the inspection station 1 in inspecting the goods.

[0074] The present application embodiment first proposes a commodity inspection system applied to the above scenario, the system comprising an inspection station 1, a mobile terminal 2 and a backend server 3, such as Figure 2 shown.

[0075] When the commodity is inspected, the inspection station 1 in the commodity inspection system responds to the mobile terminal management instruction and switches to the mobile terminal management interface. Figure 3 As shown, the device code of the inspection station 1 and the device IDs of multiple mobile terminals 2 will be displayed on the mobile terminal management interface. The mobile terminal 2 and the inspection station 1 are in the same local area network. According to the binding operation of the mobile terminal management interface, the inspection station 1 is bound to at least one mobile terminal 2, and is bound to the target mobile terminal 2 according to the device ID of the corresponding mobile terminal. At the same time, a two-way connection is established with the bound mobile terminal 2. The corresponding mobile terminal 2 establishes a two-way connection with the inspection station 1 with which there is a binding relationship. Unbinding operations can also be performed on the mobile terminal management interface. The inspection station 1 responds to the user's unbinding instruction, unbinds from the target mobile terminal 2 according to the device ID of the corresponding mobile terminal, and disconnects the two-way connection with the mobile terminal.

[0076] Before using the mobile terminal 2 for auxiliary inspection, the inspection station 1 must be bound to the mobile terminal 2. One mobile terminal 2 can only be bound to one inspection station 1, so that the results of the mobile terminal 2 can be correctly synchronized to the corresponding bound inspection station 1.

[0077] In the embodiment of the present application, the inspection station has a unique device code, and the mobile terminal also has a unique device ID. The present application adds a mobile terminal management interface to the management system of the inspection station to bind the device code of the inspection station with the device ID of at least one mobile terminal. One inspection station can be bound to multiple mobile terminals, while one mobile terminal can only be bound to one inspection station. After confirming that the binding is successful, the mobile terminal can assist in the inspection of the corresponding inspection station.

[0078] After the two-way connection is established, the inspection station 1 interacts with the mobile terminal 2 , and based on the commodity information obtained by the mobile terminal 2 from the backend server 3 , the mobile terminal 2 assists in inspecting the commodity.

[0079] In some possible embodiments, the inspection station 1 scans the passenger's relevant documents to obtain the passenger information, and sends an auxiliary inspection instruction to the mobile terminal 2, wherein the auxiliary inspection instruction includes the passenger information and the inspection ID.

[0080] The corresponding mobile terminal 2, such as Figure 4 As shown, it is used to perform the following steps:

[0081] Step 401, in response to the auxiliary inspection instruction sent by the inspection station 1, take a photo of the product to obtain a product picture;

[0082] Step 402, identifying the commodity image, and sending the identified commodity identification to the backend server 3, and the backend server 3 returns the matching commodity information in the database according to the commodity identification;

[0083] Step 403: interact with the inspection station 1 and assist the inspection station 1 to inspect the commodity based on the commodity information.

[0084] In the embodiment of the present application, by taking photos of goods through the mobile terminal 2, it is possible to obtain clearer product pictures than those obtained by taking photos with a fixed camera. At the same time, based on the interaction with the background server 3, the accuracy of product identification can be improved, which is helpful for product inspection.

[0085] At present, for unfamiliar commodities, when inspecting commodities, the query is mainly performed through Taobao's picture recognition function. Compared with Taobao's recognition function, the results of Taobao's recognition are full of a large number of redundant, pirated and fake recommendations, and the user's screening and judgment time is relatively long. In the embodiment of the present application, the backend server 3 is connected to the database, and the database is derived from the customs price database, duty-free shop prices, receipt prices, etc. The recommendation is more accurate and closer to the actual price of the commodity, which can better assist the inspection station in commodity inspection.

[0086] In some possible embodiments, the mobile terminal 2 responds to the auxiliary inspection instruction and before taking a photo of the product, Figure 5 As shown, it is also used to perform the following steps:

[0087] Step 501, receiving the auxiliary inspection instruction sent by the inspection station 1, wherein the auxiliary inspection instruction includes passenger information and inspection ID;

[0088] Step 502, displaying the passenger information and verification ID on the verification interface;

[0089] Step 503, based on the passenger information confirmation operation after comparing the passenger information in the auxiliary inspection instruction with the actual passenger information, take a photo of the product in response to the auxiliary inspection instruction.

[0090] The mobile terminal 2 matches the passenger information with the actual passenger information, and starts auxiliary verification after the match is successful, which can ensure the accuracy of the verification user and avoid errors when synchronizing data.

[0091] In some possible embodiments, the mobile terminal 2 assists the inspection station 1 in inspecting the commodity based on the commodity information, in one of the following two ways:

[0092] Method 1: Figure 6 As shown, the mobile terminal 2 displays the product information on the inspection interface, generates the inspection result of the product information according to the product information confirmation operation after comparing the displayed product information with the actual product information, and synchronizes the inspection result to the inspection station 1 for display;

[0093] The inspection station 1 bound to the mobile terminal 2 receives and displays the inspection result of the mobile terminal 2. The corresponding inspection interface is as follows: Figure 7 shown.

[0094] Figure 7 Among the identified commodities, the commodities with serial numbers 1-2 are the inspection results synchronized after inspection by the mobile terminal, which are directly displayed on the inspection interface of the inspection station and automatically summarized with the commodities already inspected by the inspection station, making it convenient for the inspection station to carry out subsequent work.

[0095] Method 2: Figure 8 As shown, the mobile terminal 2 sends the product information to the inspection station 1, and the inspection station 1 bound to the mobile terminal 2 receives and displays the product information sent by the mobile terminal 2. The corresponding product information interface is as shown in FIG. Fig. 9 As shown, the inspection station 1 generates and displays the inspection result of the commodity information according to the commodity information confirmation operation after comparing the displayed commodity information with the actual commodity information.

[0096] Fig. 9 As shown in the figure, when the mobile terminal sends the product information, the corresponding inspection station pops up the product information interface, which includes the product picture taken by the mobile terminal camera and the product information returned by the mobile terminal for reference. The user can determine the corresponding product information in the reference product according to the actual product, and add the reference product to the Figure 7 The identified commodity items in the inspection interface shown assist the inspection station in inspection and facilitate the inspection station to carry out subsequent work.

[0097] In the embodiment of the present application, the inspection station receives the inspection results / commodity information sent by the mobile terminal and displays them on the page of the inspection station, which completes the operation of auxiliary inspection through the mobile terminal, and the subsequent commodity inventory and taxation workflow can be carried out.

[0098] The following takes the inspection result of the inspection station 1 synchronizing the mobile terminal 2 in the commodity inspection system as an example. The inspection station 1 and the mobile terminal 2 have been successfully bound. The interaction process of the three in the commodity inspection system is given as follows: Fig.10 As shown:

[0099] Step 1, the inspection station 1 sends an auxiliary inspection instruction to the mobile terminal 2;

[0100] Step 2, the mobile terminal 2 takes a photo of the product in response to the auxiliary inspection instruction sent by the inspection station 1 to obtain a product picture;

[0101] Step 3, the mobile terminal 2 identifies the product identity of the product image, and sends the identified product identity to the backend server 3;

[0102] Step 4, the backend server 3 returns matching product information in the database according to the product identifier;

[0103] Step 5, the mobile terminal 2 displays the product information on the inspection interface, and generates an inspection result of the product information according to the product information confirmation operation after comparing the displayed product information with the actual product information;

[0104] Step 6, the mobile terminal 2 synchronizes the inspection result to the inspection station 1;

[0105] Step 7: the inspection station 1 receives and displays the inspection result synchronized by the mobile terminal 2.

[0106] The following takes the example of the commodity inspection system in which the inspection station 1 receives the commodity information sent by the mobile terminal 2. The inspection station 1 and the mobile terminal 2 have been successfully bound. The interaction process of the three in the commodity inspection system is given as follows: Fig.11 As shown:

[0107] Step 1, the inspection station 1 sends an auxiliary inspection instruction to the mobile terminal 2;

[0108] Step 2, the mobile terminal 2 takes a photo of the product in response to the auxiliary inspection instruction sent by the inspection station 1 to obtain a product picture;

[0109] Step 3, the mobile terminal 2 identifies the product identity of the product image, and sends the identified product identity to the backend server 3;

[0110] Step 4, the backend server 3 returns matching product information in the database according to the product identifier;

[0111] Step 5, the mobile terminal 2 sends the commodity information to the inspection station 1;

[0112] Step 6: the inspection station 1 receives and displays the product information sent by the mobile terminal 2, and generates and displays the inspection result of the product information based on the product information confirmation operation after comparing the displayed product information with the actual product information.

[0113] A commodity inspection system proposed in an embodiment of the present application includes an inspection station, a mobile terminal and a backend server. For batch commodities, one-click identification and intelligent price recommendation can be performed through the inspection station. However, for a small number of commodities that are not suitable for placement and large commodities, they can be identified by free multi-angle shooting through the camera of the mobile terminal, which effectively supplements and improves the overall recognition effect, and is an aid and improvement to the use and promotion of the inspection station. Compared with replacing the hardware structure or camera components of the inspection station, even if they are replaced, there is still a problem that it cannot be fully adapted to the use of all objects and commodities, and the replacement cost is relatively high. In the embodiment of the present application, taking pictures and assisting inspection through the mobile terminal can not only effectively solve some shortcomings of the inspection station firmware, but also provide users with more ways to inspect commodities, and it is more convenient to use without being limited to the inspection station.

[0114] In some possible embodiments, the mobile terminal 2 performs commodity identification on the commodity image in at least one of the following ways:

[0115] Scan the barcode / QR code of the product image to obtain the barcode / QR code identification of the product;

[0116] Performing image recognition on the product image to obtain an image identifier of the product;

[0117] Optical character recognition is performed on the product photo to obtain a text identifier of the product.

[0118] In the embodiment of the present application, the technology of the mobile terminal 2 performing barcode / QR code scanning, image recognition and optical character recognition on the product image is a mature technical means in the inspection field and will not be described in detail here.

[0119] In some possible embodiments, the mobile terminal 2 in the commodity inspection system, such as Fig.12 As shown, it is also used to perform the following steps:

[0120] Step 1201, recording the commodity information or inspection results;

[0121] Step 1202, in response to the inspection and tracing instruction for the designated product, the product information or inspection result of the designated product is searched and displayed according to the recorded product information or inspection result.

[0122] In an embodiment of the present application, the mobile terminal 2 can also save the product information or inspection results, and provide an inspection backtracking function, so that users can search for past inspection operations based on the recorded product information or inspection results. It is reliable and can assist the inspection station 1 in inspection.

[0123] In some possible embodiments, the mobile terminal 2 is also used to query the price of the product. On the page of the mobile terminal 2, there are two buttons, namely, a bind button and a query button. Fig.13 As shown, based on the user's click operation, in response to the user's click binding operation, the above-mentioned auxiliary inspection operation with the bound inspection station is performed; in response to the user's click query operation, the product is photographed, and the product identification of the product picture is identified, and the identified product identification is sent to the background server 3, and the background server 3 returns the matching product information according to the product identification in the database, and displays the product information on the mobile terminal.

[0124] In an embodiment of the present application, the mobile terminal 2 can also be used alone as a handheld portable commodity query device to assist on-site users to conveniently query the price information of commodities based on the database in the background server 3 at any time through the above-mentioned barcode / QR code scanning, image recognition and optical character recognition of the commodity pictures.

[0125] The following is a specific process of using the mobile terminal 2 in the above commodity inspection system to bind with the inspection station 1 to assist in commodity inspection, wherein the auxiliary inspection is performed by directly returning the inspection result, such as Fig.14 shown.

[0126] Step 1: Click the verification button on the mobile terminal page to start verification;

[0127] Step 2, determine whether the current mobile terminal is bound to the inspection station;

[0128] If binding has not been performed, a prompt will appear on the page stating that the mobile terminal has not been bound. Please bind the device with the inspection station first.

[0129] Step 3, determine whether the inspection counter is conducting passenger inspection;

[0130] When the passenger information has not been confirmed, a prompt will be displayed on the page indicating that there is currently no inspection in progress.

[0131] Step 4, receiving the auxiliary inspection instruction sent by the inspection station, the auxiliary inspection instruction including passenger information and inspection ID, displaying the passenger information and inspection ID on the inspection interface, performing a passenger information confirmation operation after comparing the passenger information in the auxiliary inspection instruction with the actual passenger information, and taking a photo of the product in response to the auxiliary inspection instruction;

[0132] Step 5, identifying the product identity of the product image, sending the identified product identity to the backend server, and receiving the product information returned by the backend server;

[0133] Step 6: Display the product information on the inspection interface, and generate the inspection result of the product information according to the product information confirmation operation after comparing the displayed product information with the actual product information.

[0134] Step 7: Synchronize the inspection result to the inspection station.

[0135] Based on the same inventive concept, the present application embodiment also proposes a commodity inspection method, such as Fig.15 As shown, it is applied to a mobile terminal, including:

[0136] Step 1501, establishing a two-way connection with the inspection station with which a binding relationship exists;

[0137] Step 1502, in response to the auxiliary inspection instruction, taking a photo of the product to obtain a product image;

[0138] Step 1503, identifying the commodity image, and sending the identified commodity identification to a backend server, which returns matching commodity information in a database according to the commodity identification;

[0139] Step 1504, interact with the inspection station, and assist the inspection station in inspecting the commodity based on the commodity information.

[0140] In some possible embodiments, in response to the auxiliary inspection instruction, taking a photo of the product includes:

[0141] receiving an auxiliary inspection instruction sent by the inspection station, wherein the auxiliary inspection instruction includes passenger information and inspection ID;

[0142] Displaying the passenger information and inspection ID on the inspection interface;

[0143] According to the passenger information confirmation operation after comparing the passenger information in the auxiliary inspection instruction with the actual passenger information, the commodity is photographed in response to the auxiliary inspection instruction.

[0144] In some possible embodiments, interacting with the inspection station and assisting the inspection station in inspecting the commodity based on the commodity information includes:

[0145] Displaying the product information on the inspection interface, generating an inspection result of the product information according to a product information confirmation operation after comparing the displayed product information with the actual product information, and synchronizing the inspection result to the inspection station for display; or

[0146] The commodity information is sent to the inspection station, which displays the commodity information and generates an inspection result of the commodity information based on a commodity information confirmation operation after comparing the displayed commodity information with the actual commodity information.

[0147] In some possible embodiments, the commodity identification is performed on the commodity image, including at least one of the following methods:

[0148] Scan the barcode / QR code of the product image to obtain the barcode / QR code identification of the product;

[0149] Performing image recognition on the product image to obtain an image identifier of the product;

[0150] Optical character recognition is performed on the product photo to obtain a text identifier of the product.

[0151] In some possible embodiments, the mobile terminal may further include:

[0152] Record the commodity information or inspection results;

[0153] In response to an inspection and tracing instruction for a designated commodity, the commodity information or inspection result of the designated commodity is searched and displayed according to the recorded commodity information or inspection result.

[0154] Based on the same inventive concept, the present application embodiment also proposes a commodity inspection method, such as Fig.16As shown, it is applied to the inspection station, including:

[0155] Step 1601, in response to the mobile terminal management instruction, switching to the mobile terminal management interface;

[0156] Step 1602, binding the inspection station with at least one mobile terminal according to the binding operation of the mobile terminal management interface;

[0157] Step 1603, establish a bidirectional connection with the bound mobile terminal;

[0158] Step 1604, interacting with the mobile terminal, based on the commodity information obtained by the mobile terminal from the background server, the mobile terminal assists in checking the commodity.

[0159] In some possible embodiments, the interacting with the mobile terminal includes:

[0160] Scan the passenger's relevant documents to obtain passenger information;

[0161] An auxiliary inspection instruction is sent to the mobile terminal, wherein the auxiliary inspection instruction includes passenger information and inspection ID.

[0162] In some possible embodiments, the interacting with the mobile terminal, based on the commodity information obtained by the mobile terminal from the backend server, the mobile terminal assists in checking the commodity, includes:

[0163] receiving and displaying the verification result of synchronization of the mobile terminal; or

[0164] The product information sent by the mobile terminal is received and displayed, and a verification result of the product information is generated and displayed according to a product information confirmation operation after comparing the displayed product information with the actual product information.

[0165] Based on the same inventive concept, the present application embodiment also proposes a mobile terminal, such as Fig.17 As shown, including:

[0166] A two-way connection establishing unit 1701 is used to establish a two-way connection with an inspection station with which a binding relationship exists;

[0167] The commodity unit 1702 is used to take a picture of the commodity in response to the auxiliary inspection instruction to obtain a commodity picture;

[0168] The commodity identification unit 1703 is used to identify the commodity identification of the commodity image and send the identified commodity identification to the backend server, and the backend server returns the matching commodity information according to the commodity identification in the database;

[0169] The auxiliary inspection unit 1704 is used to interact with the inspection station and assist the inspection station in inspecting the commodity based on the commodity information.

[0170] Based on the same inventive concept, the present application embodiment also proposes an inspection station, such as Fig.18 As shown, including:

[0171] The mobile terminal management unit 1801 switches to the mobile terminal management interface in response to the mobile terminal management instruction;

[0172] The mobile terminal binding unit 1802 binds the inspection station with at least one mobile terminal according to the binding operation of the mobile terminal management interface;

[0173] A two-way connection establishing unit 1803 is configured to establish a two-way connection with a bound mobile terminal;

[0174] The auxiliary inspection unit 1804 interacts with the mobile terminal, and based on the commodity information obtained by the mobile terminal from the background server, the mobile terminal assists in inspecting the commodity.

[0175] Those skilled in the art will appreciate that various aspects of the present application may be implemented as a system, method or program product. Therefore, various aspects of the present application may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to as "circuit", "module" or "system" herein.

[0176] Refer to the following Fig.19 A commodity inspection device 190 according to this embodiment of the present application is described. Fig.19 The device 190 shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0177] like Fig.19 As shown, a commodity inspection device 190 is presented in the form of a general electronic device. The components of a commodity inspection device 190 may include but are not limited to: at least one processor 191, at least one memory 192, and a bus 193 connecting different system components (including the memory 192 and the processor 191).

[0178] Bus 193 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a processor, or a local bus using any of a variety of bus architectures.

[0179] The memory 192 may include a readable medium in the form of a volatile memory, such as a random access memory (RAM) 1921 and / or a cache memory 1922 , and may further include a read-only memory (ROM) 1923 .

[0180] Memory 192 may also include a program / utility 1925 having a set (at least one) of program modules 1924, such program modules 1924 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0181] A commodity inspection device 190 may also communicate with one or more external devices 194 (e.g., keyboards, pointing devices, etc.), may also communicate with one or more devices that enable a user to interact with a commodity inspection device 190, and / or communicate with any device that enables the commodity inspection device 190 to communicate with one or more other electronic devices (e.g., routers, modems, etc.). Such communication may be performed through an input / output (I / O) interface 195. In addition, a commodity inspection device 190 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through a network adapter 196. As shown, the network adapter 196 communicates with other modules for a commodity inspection device 190 through a bus 193. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with a commodity inspection device 190, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0182] In some possible implementations, various aspects of a commodity inspection method provided by the present application may also be implemented in the form of a program product, which includes a program code. When the program product is run on a computer device, the program code is used to enable the computer device to execute the steps of a commodity inspection method according to various exemplary embodiments of the present application described above in this specification.

[0183] The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0184] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A commodity inspection method, characterized in that: Applied to mobile terminals, including: Establish a two-way connection with the inspection station with which the binding relationship exists; In response to the auxiliary inspection instruction, taking a photo of the product to obtain a product picture; Identify the commodity image and send the identified commodity identification to the backend server, which returns matching commodity information in the database according to the commodity identification. Interact with the inspection station and assist the inspection station in inspecting the commodity based on the commodity information.

2. The method according to claim 1, characterized in that The step of taking a photo of the product in response to the auxiliary inspection instruction includes: receiving an auxiliary inspection instruction sent by the inspection station, wherein the auxiliary inspection instruction includes passenger information and inspection ID; Displaying the passenger information and inspection ID on the inspection interface; According to the passenger information confirmation operation after comparing the passenger information in the auxiliary inspection instruction with the actual passenger information, the commodity is photographed in response to the auxiliary inspection instruction.

3. The method according to claim 1, characterized in that The interacting with the inspection station to assist the inspection station in inspecting the commodity based on the commodity information includes: Displaying the product information on the inspection interface, generating an inspection result of the product information according to a product information confirmation operation after comparing the displayed product information with the actual product information, and synchronizing the inspection result to the inspection station for display; or The commodity information is sent to the inspection station, which displays the commodity information and generates an inspection result of the commodity information based on a commodity information confirmation operation after comparing the displayed commodity information with the actual commodity information.

4. The method according to claim 1, characterized in that The step of identifying the product image includes at least one of the following methods: Scan the barcode / QR code of the product image to obtain the barcode / QR code identification of the product; Performing image recognition on the product image to obtain an image identifier of the product; Optical character recognition is performed on the product photo to obtain a text identifier of the product.

5. The method according to claim 3, characterized in that: Applied to mobile terminals, also includes: Record the commodity information or inspection results; In response to an inspection and tracing instruction for a designated commodity, the commodity information or inspection result of the designated commodity is searched and displayed according to the recorded commodity information or inspection result.

6. A commodity inspection method, characterized in that: Applied to inspection stations, including: In response to the mobile terminal management instruction, switching to the mobile terminal management interface; Binding the inspection station to at least one mobile terminal according to a binding operation in the mobile terminal management interface; Establish a two-way connection with the bound mobile terminal; The mobile terminal interacts with the mobile terminal, and based on the commodity information obtained by the mobile terminal from the background server, the mobile terminal assists in checking the commodity.

7. The method according to claim 6, characterized in that The interacting with the mobile terminal includes: Scan the passenger's relevant documents to obtain passenger information; An auxiliary inspection instruction is sent to the mobile terminal, wherein the auxiliary inspection instruction includes passenger information and inspection ID.

8. The method according to claim 6, characterized in that The interaction with the mobile terminal, based on the commodity information obtained by the mobile terminal from the backend server, the mobile terminal assists in checking the commodity, including: receiving and displaying the verification result of synchronization of the mobile terminal; or The product information sent by the mobile terminal is received and displayed, and a verification result of the product information is generated and displayed according to a product information confirmation operation after comparing the displayed product information with the actual product information.

9. A commodity inspection device, characterized in that: include: A memory and a processor, wherein: The memory is used to store programs executable by the processor; The processor is used to read the program in the memory and execute a commodity inspection method as described in any one of claims 1-5 or claims 6-8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to enable the computer to execute a commodity inspection method as described in any one of claims 1-5 or claims 6-8.

Images