Device binding system and method

Abstract

The embodiment of the present specification provides a device binding system and method, the device binding system comprising a task execution device and a server; the server is configured to determine the association relationship of a target point and at least one associated collection device, and send a travel instruction to the task execution device, wherein the travel instruction carries the position information of the target point; the task execution device is configured to travel to the target point in response to the travel instruction and send an image acquisition instruction to the server; the server is configured to collect the initial image of the target point through the at least one associated collection device in response to the image acquisition instruction, generate an image set and send the image set to the task execution device; the task execution device is further configured to determine a target image from the image set and feed back to the server; the server is configured to determine the target collection device corresponding to the target image from the at least one associated collection device, and establish a binding relationship for the target point and the target collection device.

Description

TECHNICAL FIELD

[0001] Embodiments of the present specification relate to the technical field of computer technology, and particularly relate to a device binding method. BACKGROUND

[0002] With the development of computer technology and the improvement of people's safety awareness and standard awareness, the application range of video shooting is becoming more and more extensive. In the scene of video shooting in public places such as shopping malls and supermarkets, due to the mixed personnel in public places such as shopping malls and supermarkets, the range is relatively wide, so the installed shooting equipment is also relatively more. Although multiple shooting equipment at different positions can meet the all-around shooting of shopping malls, supermarkets and other places, they cannot achieve relatively accurate point-to-point shooting. In the prior art, in order to realize that the shooting equipment shoots the specified shelf or point, manual statistics are usually required, and the association between the point and the shooting equipment is established. However, this method will consume a large amount of human resources, and the processing efficiency of manual statistics and association is low. Therefore, an effective scheme is urgently needed to solve the above problems. SUMMARY

[0003] Therefore, the embodiments of the present specification provide a device binding system. One or more embodiments of the present specification also relate to a device binding method, a computing device, a computer readable storage medium and a computer program to solve the technical defects in the prior art.

[0004] According to a first aspect of the embodiments of the present specification, a device binding system is provided, comprising: a task execution device and a server;

[0005] The server is configured to determine the association relationship between the target point and at least one associated collection device, and send a travel instruction to the task execution device, wherein the travel instruction carries the position information of the target point;

[0006] The task execution device is configured to travel to the target point in response to the travel instruction and send an image acquisition instruction to the server;

[0007] The server is configured to collect an initial image of the target point through the at least one associated collection device in response to the image acquisition instruction, generate an image set and send the image set to the task execution device;

[0008] The task execution device is further configured to determine a target image from the image set and feed back to the server;

[0009] The server is configured to determine a target acquisition device corresponding to the target image from the at least one associated acquisition device, and establish a binding relationship between the target point and the target acquisition device.

[0010] According to a second aspect of the embodiments of the present specification, a device binding method is provided, comprising:

[0011] The server determines the association relationship between the target point and the at least one associated acquisition device, and sends a travel instruction to the task execution device, wherein the travel instruction carries the position information of the target point;

[0012] The task execution device travels to the target point in response to the travel instruction and sends an image acquisition instruction to the server;

[0013] The server responds to the image acquisition instruction, acquires an initial image of the target point through the at least one associated acquisition device, generates an image set and sends the image set to the task execution device;

[0014] The task execution device determines a target image from the image set and feeds back to the server;

[0015] The server determines a target acquisition device corresponding to the target image from the at least one associated acquisition device, and establishes a binding relationship between the target point and the target acquisition device.

[0016] According to a third aspect of the embodiments of the present specification, a computing device is provided, comprising:

[0017] a memory and a processor;

[0018] The memory is used to store computer executable instructions, and the processor is used to execute the computer executable instructions, which realize the steps of the above-mentioned device binding method when executed by the processor.

[0019] According to a fourth aspect of the embodiments of the present specification, a computer readable storage medium is provided, which stores computer executable instructions, which realize the steps of the above-mentioned device binding method when executed by the processor.

[0020] According to a fifth aspect of the embodiments of the present specification, a computer program is provided, wherein when the computer program is executed in a computer, the computer executes the steps of the above-mentioned device binding method.

[0021] An embodiment of the present specification provides a device binding system, comprising: a task execution device and a server; the server is configured to determine the association relationship between a target point and at least one associated collection device, and send a travel instruction to the task execution device, wherein the travel instruction carries the position information of the target point; the task execution device is configured to travel to the target point in response to the travel instruction and send an image acquisition instruction to the server; the server is configured to collect the initial image of the target point through the at least one associated collection device in response to the image acquisition instruction, generate an image set and send the image set to the task execution device; the task execution device is further configured to determine a target image from the image set and feed back to the server; the server is configured to determine the target collection device corresponding to the target image from the at least one associated collection device, and establish a binding relationship between the target point and the target collection device. The binding between the target point and the target collection device is automatically completed through the task execution device, the binding difficulty between the point and the collection device is reduced, and the binding efficiency is improved. BRIEF DESCRIPTION OF DRAWINGS

[0022] Figure 1 is a structural diagram of a device binding system provided by an embodiment of the present specification;

[0023] Figure 2 is a structural diagram of a device binding system provided by an embodiment of the present specification;

[0024] Figure 3 is an interaction diagram of a device binding system provided by an embodiment of the present specification;

[0025] Figure 4 is a flowchart of a device binding system provided by an embodiment of the present specification;

[0026] Figure 5 is a flowchart of a device binding system provided by an embodiment of the present specification;

[0027] Figure 6 is a flowchart of a device binding method provided by an embodiment of the present specification;

[0028] Figure 7 is a schematic diagram of a device binding method provided by an embodiment of the present specification;

[0029] Figure 8 is a structural block diagram of a computing device provided by an embodiment of the present specification. DETAILED DESCRIPTION

[0030] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present description. However, the present description can be practiced without the specific details. In other instances, well-known methods, procedures, components, and circuits have not been described in detail so as not to obscure the present description. The present description can be practiced with the specific details presented.

[0031] The terminology used in this description is for the purpose of describing particular embodiments only and is not intended to be limiting of one or more embodiments of the present description. As used in this description and the appended claims, the singular forms "a," "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0032] It will be understood that, although the terms first, second, etc. can be used herein to describe various information, these terms are not intended to denote a temporal sequence, but are used only to distinguish one piece of information from another. For example, a first item can be termed a second item, and, similarly, a second item can be termed a first item without departing from the scope of one or more embodiments of the present description. As used herein, the term "if' can be interpreted to mean "when" or "upon" or "in response to determining" taking into account the context in which the term is used.

[0033] In the present description, a device binding system is provided, and the present description also relates to a device binding method, a computing device, a computer-readable storage medium, and a computer program, which are described in detail one by one in the following embodiments.

[0034] Referring to Figure 1 , Figure 1 is a structural diagram of a device binding system provided by an embodiment of the present description.

[0035] Figure 1The application discloses a device binding system and a method thereof. The device binding system comprises a server and a task execution device. In a scene where a commodity point and an image collection device are bound, and the image collection device collects images of the commodity point in real time, the server is configured to select a target point from a plurality of commodity points, determine at least one associated collection device associated with the target point, and send a marching instruction carrying position information of the target point to the task execution device based on the target point and the associated collection device. The image collection device can be a camera or any device with an image collection function. The task execution device marches to the target point in response to the marching instruction and reports to the server. The server collects an initial image of the target point through the at least one associated collection device, generates an image set and sends the image set to the task execution device. The task execution device selects an image that can completely shoot the target point and has a better shooting angle from the image set as a target image and feeds back to the server. The server determines a target collection device corresponding to the target image from the at least one associated collection device, and establishes a binding relationship between the target point and the target collection device. Thus, the target collection device can collect images of the target point in real time, and through image analysis, it is determined whether the commodity placed at the target point is out of stock. If so, the business personnel can be immediately notified to restock. Thus, manual inspection is avoided, and the workload of the business personnel is reduced.

[0036] In actual application, the binding between the commodity point and the camera can be realized, and the commodity point or region to be shot and the corresponding camera are associated to establish an association relationship, which is used to issue region information in the business supervision process, automatically capture images of the corresponding region to the supervisor for supervision and inspection. The region information includes, but is not limited to, the goods sufficiency of the commodity point, the operation specification degree of the business personnel corresponding to the commodity point and other information.

[0037] Referring to Figure 2 , Figure 2 is a structural schematic diagram of a device binding system provided by an embodiment of the present application. The device binding system 200 comprises a server 210 and a task execution device 220.

[0038] The server 210 is configured to determine an association relationship between a target point and at least one associated collection device, and send a marching instruction to the task execution device 220. The marching instruction carries position information of the target point.

[0039] The task execution device 220 is configured to march to the target point in response to the marching instruction and send an image acquisition instruction to the server 210.

[0040] The server 210 is configured to collect an initial image of the target point by the at least one associated acquisition device in response to the image acquisition instruction, generate an image set and send the image set to the task execution device 220;

[0041] The task execution device 220 is further configured to determine a target image from the image set and feed back to the server 210;

[0042] The server 210 is configured to determine a target acquisition device corresponding to the target image from the at least one associated acquisition device, and establish a binding relationship between the target point and the target acquisition device.

[0043] Specifically, the target point refers to a point that needs to be associated, and the target point includes but is not limited to each commodity placing point of a shelf in a shopping mall, a vegetable commodity pile head, a packing table, a commodity processing table, a cash register and other positions with fixed functions in the shopping mall; wherein the shelf can contain multiple commodity placing points, the shelf is regarded as a plurality of rows and columns of commodity placing cells, and each cell can be regarded as a target point; the associated acquisition device refers to a device with image acquisition and video acquisition functions, including but not limited to a shooting device, a camera, a video camera, a camera and other devices; the task execution device 220 refers to a device that can move and execute a specified action, including but not limited to a robot, a movable terminal and other devices, when the task execution device 220 is a robot, the robot can receive a travel instruction from the server 210 and execute the instruction; when the task execution device 220 is a movable terminal, the terminal can receive a travel instruction from the server 210, and a person can hold the movable terminal to execute the travel instruction, correspondingly, the travel instruction is an instruction sent to the task execution device 220, which is used to drive the task execution device 220 to move to a specified position.

[0044] An image acquisition command is a computer command used to acquire images. Task execution device 220 sends an image acquisition command to server 210, indicating that task execution device 220 has reached the target location. An initial image refers to an image acquired by at least one associated acquisition device for the target location. The initial image includes the target location. Because each associated acquisition device is installed at a different location, the angle of the initial image containing the target location is also different. The initial images acquired by each associated acquisition device form an image set. After receiving the image set, task execution device 220 selects an initial image as the target image from the image set based on the target location contained in each initial image. When selecting the target image, the selection can be based on the acquisition angle of the target location in each initial image and the completeness of the location area. Correspondingly, the target acquisition device refers to the acquisition device corresponding to the target image; that is, the selected target image was captured by the target acquisition device.

[0045] Based on this, server 210 determines the target location and at least one associated acquisition device within the corresponding location area. It then sends a movement command carrying the target location's location information to task execution device 220. Upon receiving the movement command, task execution device 220 moves to the target location and sends an image acquisition command to server 210. Upon receiving the image acquisition command, server 210 acquires initial images of the target location using at least one associated acquisition device, generates an image set based on the initial images, and sends the image set to task execution device 220. Each associated acquisition device can acquire at least one initial image of the target location. After receiving the image set from server 210, task execution device 220 determines the target image in the image set based on the location features of the target location contained in each initial image and sends it back to server 210. Upon receiving the target image, server 210 determines the target acquisition device corresponding to the target image from among the at least one associated acquisition device and establishes a binding relationship between the target location and the target acquisition device.

[0046] In actual application, when determining the at least one associated collection device associated with the target point, the point region corresponding to the target point can be determined. A circular region is drawn with the target point as the center and a fixed distance value as the radius, and the collection device installed within the circular region can be used as the associated collection device corresponding to the target point. The point region can also be a square region or a region of any other arbitrary shape with the target point as the center. When selecting the target image in the image set, the target point feature of each initial image in the image set can be selected, where the target point feature can be the image collection angle of the target point, the completeness of the target point display, and the like. That is, when selecting the target image, an image with a more complete display of the target point is selected, and an image close to the front view or the top view of the target point is selected. Therefore, after the collection device is bound to the target point, the state of the target point can be clearly known.

[0047] For example, in the case of applying the embodiment to a supermarket scene, the target point is a fruit and vegetable fresh food shelf point or a food product shelf point in the supermarket, the associated collection device is a camera installed at a fixed position in the supermarket, and the task execution device can be a robot or a mobile terminal such as a mobile phone or a tablet computer operated by a business staff. The server or the business staff determines the apple shelf point that needs to be bound to the camera and at least one camera that can capture the apple shelf point, sends a movement instruction to the mobile terminal, so that the business staff knows the apple shelf point that needs to be bound, and moves to the point. When the business staff carrying the mobile terminal arrives at the apple shelf point, sends an image acquisition instruction to the server, and controls at least one camera to collect images containing the apple shelf point, each camera collects images to form an image set and sends it to the mobile terminal, and the business staff selects a better image as the target image and feeds back to the server. The server determines the only one camera corresponding to the target image and establishes the binding relationship between the camera and the apple shelf point. The one-to-one binding and shooting between the camera and the apple shelf point are realized. It should be noted that the image acquisition instruction and the image selection can be automatically completed by the robot, thereby reducing the consumption of human resources.

[0048] In summary, the binding between the target point and the target collection device is automatically completed by the task execution device, which reduces the binding difficulty between the point and the collection device and improves the binding efficiency.

[0049] Further, after the task execution device 220 travels to the position corresponding to the target point, considering that the task execution device 220 cannot be identified after reaching the position corresponding to the target point, the task execution device 220 can be caused to carry a marked article and then travel to the target point. In this embodiment, the task execution device 220 is further configured to, in response to the travel instruction, carry the marked article and travel to the target point; obtain the position information corresponding to the target point, perform the specified action at the target point, and send an image acquisition instruction to the server 210.

[0050] Specifically, the marked article refers to an article that can be identified and has a marking function. In the case of a mobile terminal as the task execution device 220, a business staff needs to carry the mobile terminal and travel to the target point. Since the business staff and irrelevant personnel cannot be distinguished, the business staff can wear specified clothes or wear specified accessories (including but not limited to hats, bracelets, and other accessories) before traveling. In the case of a robot as the task execution device 220, the robot can also wear specified clothes to facilitate identification of the position of the robot. The position information can represent the position of the target point. When the target point is a commodity shelf, the position information represents the area or coordinate information of the commodity shelf. The specified action includes but is not limited to raising the arm, walking around the target point, and the like, which are used to confirm the target point that needs to be bound at present.

[0051] Based on this, the task execution device 220 carries the marked article and travels to the target point in response to the travel instruction after receiving the travel instruction. The position information corresponding to the target point is obtained by scanning the business code such as the two-dimensional code or the bar code at the target point. The task execution device 220 sends an image acquisition instruction to the server 210 after performing the specified action at the target point.

[0052] In actual application, after the task execution device reaches the target point and obtains the position information corresponding to the target point, the image acquisition instruction can be triggered by performing the specified action, that is, the server receives the image acquisition instruction after detecting that the specified action is correctly performed. The task execution device can also generate the image acquisition instruction after performing the specified action and then send it to the server.

[0053] In the above example, before the business personnel carries the mobile terminal to the apple shelf point, in order to distinguish the business personnel and the non-business personnel, the business personnel can be equipped with specified clothes, hats, or bracelets and other accessories, so that the business personnel wears the specified clothes or wears the specified accessories to reach the apple shelf point. After reaching, the position of the apple shelf point and the business personnel is confirmed by scanning the business code such as the two-dimensional code or the bar code at the apple shelf point. The business personnel makes a specified action such as raising hands or walking around the apple shelf point to confirm that the business personnel has reached the specified position, and image shooting can be performed. It should be noted that the two position determination methods of scanning the business code or making the specified action can be executed in sequence or selectively.

[0054] In summary, by carrying the marker to the target point, obtaining the position information corresponding to the target point, and making the specified action at the target point, the server can more accurately determine whether the task execution device reaches the target point, thereby avoiding the problem of misjudgment.

[0055] Further, considering that the way of scanning the business code of the target point and then sending the image acquisition instruction to the server 210 is relatively cumbersome, if the business code of the target point cannot be recognized, the efficiency of the point binding will be affected, therefore, the task execution device 220 can be further configured to, in response to the travel instruction, carry the marker to the target point, and stay at the target point for a preset length of time and send the image acquisition instruction to the server 210.

[0056] Based on this, the preset length of time is a time period set in advance according to actual needs, which is an empirical value. After receiving the travel instruction from the server 210, the task execution device 220 carries the marker to the target point in response to the travel instruction. After staying at the target point for a preset length of time, the image acquisition instruction is sent to the server 210. In actual application, after the task execution device 220 carries the marker to the target point, the image acquisition instruction can be sent to the server 210 by clicking the confirmation control, indicating that the task execution device 220 has reached the target point, and the server 210 can perform image collection on the target point.

[0057] In the above example, after the service personnel carrying the mobile terminal wearing the designated clothes reaches the apple shelf point, stands at the apple shelf point for 3-5 seconds, clicks the start calibration control displayed in the mobile terminal, sends an image acquisition instruction to the server, and waits for the feedback of the server. After waiting for 5 seconds, if the server has not fed back the image, an abnormal prompt information is displayed in the interface of the mobile terminal, and the service personnel selects to end this image acquisition or re-sends the image acquisition instruction to the server.

[0058] In summary, after the task execution device receives the travel instruction, the service personnel travels to the target point carrying the marker according to the travel instruction, and after staying at the target point for a preset length of time, sends an image acquisition instruction to the server, and then provides the server with the time of tracking and confirming the location of the task execution device. Instead of scanning the business code, the preset length of time is used to simplify the operation process.

[0059] Further, after establishing the binding relationship between the target point and the target collection device, considering that the target point can be used to place goods, and the target goods type placed by the target point can be changed according to the demand, the binding between the target collection device and the target goods can be realized by establishing the relationship between the target goods and the target collection device, and then the image collected by the target collection device can be used to check the remaining goods at any time. When the goods inventory is detected to be insufficient, the service personnel can be notified to supplement the goods at the target point. In this embodiment, the server 210 is further configured to acquire the target goods corresponding to the target point; according to the binding relationship between the target point and the target collection device, determine the target collection device corresponding to the target goods.

[0060] Based on this, the target goods refer to the goods placed in the target point for consumers to choose. The server 210 selects the target goods corresponding to the target point from a plurality of goods; determines the target collection device having a binding relationship with the target point, takes the target collection device corresponding to the target point as the target collection device corresponding to the target goods, establishes the corresponding relationship between the target collection device and the target goods, and then when the goods inventory placed in the target point is detected to be insufficient, the name of the goods with insufficient inventory can be quickly determined.

[0061] In the above example, after establishing the binding relationship between the apple shelf location and the corresponding camera, the image of the apple shelf location can be collected in real time, and then the inventory quantity of the apples can be determined by the business personnel or through artificial intelligence recognition. However, in this scenario, only the occurrence of insufficient inventory of the apple shelf location can be detected, and the type of goods that caused the insufficient inventory cannot be detected. Therefore, a relationship between the camera and the apple goods can be established, and the occurrence of insufficient inventory of the apples placed in the apple shelf location can be directly detected, and the business personnel can be immediately notified to restock the apples placed in the apple shelf location.

[0062] In summary, by determining the target collection device corresponding to the target goods, the business personnel can avoid the need to confirm which goods are placed in the specified location after receiving the information about restocking the goods in the target location, thereby improving the work efficiency of the business personnel.

[0063] Further, in the case of adding a new type of goods, since the goods database does not store this type of goods, if the collection device is to capture the goods placed in the target location, a relationship between the target collection device corresponding to the target location and the target goods needs to be established. In this embodiment, the server 210 is further configured to obtain at least one to-be-assigned goods information, determine the to-be-assigned goods corresponding to the target location based on the to-be-assigned goods information, and determine the target collection device corresponding to the to-be-assigned goods based on the binding relationship between the target location and the target collection device.

[0064] Based on this, the to-be-assigned goods can be a newly added goods, or all goods whose placement positions are to be determined in the case of re-determining the placement positions of the goods. The server 210 obtains at least one to-be-assigned goods information, determines the to-be-assigned goods corresponding to the target location based on the to-be-assigned goods information, and determines the target collection device corresponding to the to-be-assigned goods based on the binding relationship between the target location and the target collection device, thereby realizing the binding between the target collection device and the to-be-assigned goods.

[0065] In the above example, in the scenario of adding three different brands of potato chips in the supermarket, the shelves are allocated for the three different brands of potato chips "potato chip 1, potato chip 2, and potato chip 3". Shelf 1 is a three-row and three-column shelf, and shelf 1 has nine commodity points. In the case of establishing a binding relationship between camera A and point shelf 1, camera A binds the nine commodity points in shelf 1, and can place potato chip 1, potato chip 2, and potato chip 3 in shelf 1, that is, place potato chip 1 in the first row and the first column, place potato chip 2 in the second row and the first column, and place potato chip 3 in the third row and the first column, and establish a relationship between the camera A and the goods placed in each point. In the case of insufficient inventory in shelf 1, the image containing shelf 1 collected by camera A can analyze which potato chip has insufficient inventory, and the business personnel can be informed to replenish the corresponding potato chip, avoiding the business personnel from checking the commodity name at the specified point after receiving the insufficient commodity information, thereby improving the work efficiency of the business personnel.

[0066] In summary, by determining the target collection device corresponding to the to-be-allocated commodity, the association relationship between the to-be-allocated commodity and the target collection device is established, and the type of commodity can be quickly judged by analyzing the image collected by the target collection device for the to-be-allocated commodity, thereby improving the processing efficiency.

[0067] Further, after establishing the binding relationship between the target point and the target collection device, considering that the target point can be a row of shelves in the supermarket, and the shelves contain multiple points where goods can be placed, and each point can place different goods, in order to monitor the commodity inventory of each point in real time and facilitate the description of the point where the goods are insufficient, an association relationship between the point information code corresponding to the point and the target point can be established. In this embodiment, the server 210 is further configured to identify the point information code from the image of the target point collected by the target collection device, and establish an association relationship between the target point and the identified point information code.

[0068] Based on this, the server 210 identifies the target point in the image of the target point collected by the target collection device, and further identifies the point information code corresponding to the target point. An association relationship between the target point and the identified point information code is established, and when the target collection device collects the image of the target point, the point information code corresponding to the target point can be determined according to the collected image of the target point, and the commodity information placed in the target point can be determined when the target point is placed with goods. The point information code has uniqueness and is used to represent the number or position of the target point. A unique target point can be determined by the point information code. The point information code can be a string composed of numbers and / or characters, can be a two-dimensional code, a bar code, or can be a word, and the present embodiment does not make any limitation thereto.

[0069] In the above example, if the target point is a four-row and four-column commodity shelf, the commodity shelf contains 16 commodity points. In order to distinguish different commodity points on the same shelf, each commodity point corresponds to a business code, which represents the position of the commodity point. The image of the target point is collected by the camera, and then the business code of each commodity point is determined according to the image, and the association between the business code and the commodity point is established. Then, after the goods are placed in the commodity point, the placement of the goods in each commodity point in the shelf can be determined by collecting the image of the shelf.

[0070] In summary, by recognizing the point information code from the collected image of the target point, the association between the target point and the recognized point information code is established, and then when the goods are placed in the target point and the goods at the target point are out of stock, the shelf position and the goods placed on the shelf can be determined according to the point information code, and then the business personnel can be notified to replenish the goods when the goods on the shelf are out of stock.

[0071] Further, considering that there may be target points without point information codes, in order to facilitate the management of the target points, a point information code can be generated for the target point. In this embodiment, the server 210 is further configured to recognize the commodity information stored in the target point from the image of the target point collected by the target collection device, create a point information code according to the commodity information, and establish an association between the target point and the created point information code.

[0072] Based on this, by collecting the image containing the target point by the target collection device, the server 210 recognizes the commodity information stored in the target point from the image of the target point, creates a point information code according to the commodity information, and establishes an association between the target point and the created point information code. The association between the goods, the target point and the point information code is established, and the goods placed in the target point in the image can be determined by collecting the image of the target point by the target collection device.

[0073] In the above example, if the target point is a four-row and four-column commodity shelf, the commodity shelf contains 16 commodity points. In order to distinguish different commodity points on the same shelf, a business code can be created for each commodity point according to the category or name of the goods placed in each commodity point, which represents the position of the commodity point. The image of the target point is collected by the camera, and then the business code of each commodity point is determined according to the image, and the association between the business code and the commodity point is established. Then, after the goods are placed in the commodity point, the placement of the goods in each commodity point in the shelf can be determined by collecting the image of the shelf.

[0074] In summary, in the case that the target point does not have a point information code, a point information code corresponding to the target point is generated according to the commodity information stored in the target point, and an association between the target point and the point information code is established. Then, when the commodity is placed in the target point and the commodity in the target point is out of stock, the shelf position and the commodity information placed on the shelf can be determined according to the point information code, and the business personnel can be notified to replenish the commodity when the commodity on the shelf is out of stock.

[0075] Further, when establishing the binding relationship between the target point and the target collection device, the binding relationship may fail to be established due to network factors and the like. In order not to affect subsequent image collection, the binding result, such as binding success, binding failure or abnormality, can be fed back to the task execution device 220 when establishing the binding relationship. In this embodiment, the server 210 is further configured to send the binding result to the task execution device 220.

[0076] Based on this, after the server 210 receives the target image sent by the task execution device 220 and establishes the binding relationship between the target point and the target collection device based on the target image, the server 210 sends the binding result to the task execution device 220, wherein the binding result includes binding success and binding failure between the target point and the target collection device. The reason for the binding failure can be network factors or human intervention interrupting the binding operation. In actual application, the server 210 can feed back the binding result to the task execution device 220 at a fixed interval.

[0077] In the above example, after the binding relationship between the commodity point and the camera corresponding to the commodity point is established, whether the binding relationship between the commodity point and the camera is successfully established or not, the binding success or binding failure result is fed back to the business personnel. By feeding back the binding result to the mobile terminal, the business personnel is informed of the binding result. Whether to re-establish the binding relationship between the commodity point and the camera is determined by the business personnel.

[0078] In summary, when establishing the binding relationship between the target point and the target collection device, the binding result is fed back to the task execution device in real time, and then the binding relationship between the target point and the target collection device can be established again in the case that the binding result is a binding failure.

[0079] Further, after the task execution device 220 sends the image acquisition instruction to the server 210, considering that the server 210 can not receive the image acquisition instruction due to network factors, or the server 210 fails to send the image set to the task execution device 220, in this case, after the task execution device 220 sends the image acquisition instruction to the server 210, if the task execution device 220 does not receive the image set fed back by the server 210 within a preset time length, the task execution device 220 can send the image acquisition instruction to the server 210 again. In this embodiment, the task execution device 220 is further configured to send the image acquisition instruction to the server 210 again in the case that the task execution device 220 does not receive the image set within the preset time length.

[0080] Based on this, the preset time length is determined, after the task execution device 220 sends the image acquisition instruction to the server 210, the task execution device 220 waits for the preset time length, and in the case that the task execution device 220 does not receive the image set fed back by the server 210 within the preset time length, or the image set fed back by the server 210 is incorrect, the task execution device 220 can send the image acquisition instruction to the server 210 again, so that the server 210 can send the image set to the task execution device 220 again.

[0081] In the above example, after the business personnel sends the image acquisition instruction for the commodity point to the server through the mobile terminal, the business personnel waits for 5-8 seconds, and if the server does not send the image set to the mobile terminal within the 5-8 seconds, the business personnel can operate the mobile terminal to send the image acquisition instruction to the server again, or the business personnel can choose to terminate the reception of the image set.

[0082] In summary, the device binding system provided in one embodiment of the present specification includes a task execution device and a server; the server is configured to determine the association relationship between a target point and at least one associated collection device, and send a travel instruction to the task execution device, wherein the travel instruction carries the position information of the target point; the task execution device is configured to travel to the target point in response to the travel instruction and send an image acquisition instruction to the server; the server is configured to collect the initial image of the target point through the at least one associated collection device in response to the image acquisition instruction, generate an image set and send the image set to the task execution device; the task execution device is further configured to determine a target image from the image set and feed back to the server; and the server is configured to determine the target collection device corresponding to the target image from the at least one associated collection device, and establish a binding relationship between the target point and the target collection device. The binding between the target point and the target collection device is automatically completed through the task execution device, the binding difficulty between the point and the collection device is reduced, and the binding efficiency is improved.

[0083] Figure 3An interaction schematic diagram of a device binding system provided by one embodiment of the present application is shown, which includes a server 310 and a task execution device 320, and specifically includes the following steps:

[0084] Step S302: The server determines a target point, generates a point calibration task based on the target point, and sends the point calibration task to the task execution device.

[0085] In the scene of security inspection point calibration, the security inspection point to be calibrated is determined, a point calibration task is created based on the security inspection point, and is sent to the task execution device. The task execution device can be a mobile terminal, and a business personnel operates the mobile terminal to execute the point calibration task. The task execution device can also be a robot, which executes the point calibration task by calibrating the security inspection point, and can know whether there is a security risk through image analysis of the security inspection point.

[0086] Step S304: The task execution device receives the point calibration task, and determines the position information of the target point based on the point calibration task.

[0087] The business personnel holds the mobile terminal, receives the point calibration task, and determines the position information of the security inspection point.

[0088] Step S306: The task execution device carries a marker, and travels to the target point based on the position information.

[0089] The business personnel carries the mobile terminal, and travels to the security inspection point while wearing specified clothes.

[0090] Step S308: The task execution device scans the position code, executes a specified action, and sends an image acquisition instruction to the server; or stays at the target point for a preset length of time and sends an image acquisition instruction to the server.

[0091] The business personnel can calibrate the security inspection point and the camera in a code calibration manner or a non-code calibration manner. If the image set is not received within a preset time length, the image acquisition instruction is sent to the server again.

[0092] Figure 4 For the flowchart of code calibration, as shown in Figure 4As shown, the business personnel take the point calibration task in the way of facial recognition or space clicking (also can be in the way of mobile phone flashlight recognition), wear the specified clothes or wear the specified hat, go to the security inspection point, scan the location code of the security inspection point, make the specified action such as hand raising and walking around the security inspection point, realize sending the image acquisition instruction to the server, and then realize the irradiation range confirmation. Wait for the server to feed back at least one image collected by the camera near the security inspection point, and then select an image, bind the camera corresponding to the image and the security inspection point.

[0093] Figure 5 As shown in the flowchart of non-code calibration, Figure 5 The server issues a point calibration task, the business personnel take the point calibration task, wear the specified clothes or wear the specified hat, go to the security inspection point, stand at the security inspection point for 3-5 seconds, and click the start calibration button displayed on the task execution device to send the image acquisition instruction to the server, and then wait for the server to feed back at least one image collected by the camera near the security inspection point. In the case that the server feeds back the calibration picture, the business personnel checks the camera that needs to be calibrated, and completes the calibration; in the case that the task execution device held by the business personnel does not display the feedback calibration picture, the business personnel can choose to re-identify or choose to skip, that is, end the point calibration task.

[0094] Step S310: The server responds to the image acquisition instruction and collects the initial image of the target point through at least one associated collection device and sends it to the task execution device.

[0095] After receiving the image acquisition instruction, the server determines at least one camera installed in the area corresponding to the security inspection point, each camera performs image collection on the security inspection point, and sends the collected image to the task execution device, and the business personnel selects a target image from multiple images.

[0096] Step S312: The task execution device determines the target image in the initial image and feeds back to the server.

[0097] The business personnel send the target image to the server through the task execution device. It can also send a binding instruction to the server by clicking the target image.

[0098] Step S314: The server determines the target collection device corresponding to the target image from at least one associated collection device, and establishes a binding relationship between the target point and the target collection device.

[0099] After the server receives the target image or the binding instruction, a camera corresponding to the target image, i.e., the camera that takes the target image, is determined. A binding relationship between the security inspection point and the camera is established.

[0100] In summary, by interacting between the task execution device and the server, the point binding between the target point and the target collection device can be achieved, and then the point image of the target point can be collected in real time by the target collection device. By analyzing the point image, the corresponding commodity inventory of the point can be determined, and then the business personnel can be timely notified to replenish the goods when the commodity inventory at the point is insufficient.

[0101] Corresponding to the above system embodiment, the present specification also provides a device binding method, Figure 6 A flowchart of a device binding method provided by an embodiment of the present specification is shown, which specifically includes the following steps:

[0102] Step S602: The server determines the association relationship between the target point and at least one associated collection device, and sends a travel instruction to the task execution device, wherein the travel instruction carries the location information of the target point;

[0103] Step S604: The task execution device travels to the target point in response to the travel instruction and sends an image acquisition instruction to the server;

[0104] Step S606: The server collects the initial image of the target point through the at least one associated collection device in response to the image acquisition instruction, generates an image set and sends the image set to the task execution device;

[0105] Step S608: The task execution device determines a target image from the image set and feeds back to the server;

[0106] Step S610: The server determines the target collection device corresponding to the target image from the at least one associated collection device, and establishes a binding relationship between the target point and the target collection device.

[0107] In specific implementation, the task execution device can be a mobile phone, a tablet computer or other portable mobile terminal. The business personnel can operate the mobile terminal to complete the binding between the point and the camera. The target point can be a commodity exhibition stand in a marketing activity. By binding the commodity exhibition stand and the camera, whether the commodity exhibition stand is built in accordance with the building specification can be detected in real time.

[0108] In actual application, in the scene of point position calibration of operation table in a shopping mall, the operation table can be an article packing table, a cashier, a slaughtering table and the like which need to be processed or handled by business personnel, and correspondingly, the task execution device can be a mobile terminal such as a mobile phone and a tablet computer with a screen and an operation interface; the acquisition device can be an image / video acquisition device such as a camera. By establishing the binding relationship between the operation table and the camera, the image of the operation table can be collected in real time through the camera, and then whether the work of the business personnel corresponding to the operation table is standardized can be determined by analyzing the collected image.

[0109] Figure 7 is a schematic diagram of a device binding method provided by an embodiment of the present specification, as shown in Figure 7 When the server issues a point position calibration task, the business personnel takes the point position calibration task through the mobile terminal. The mobile terminal displays interface (1), and when calibrating the point position of the operation table, there are four point position calibration tasks, which can calibrate the point position of the operation table in the seafood area, the operation table in the chicken area, the operation table in the beef area and the operation table in the mutton area respectively. The business personnel selects a point position calibration task, wears the specified clothes, and stays at the point position to be calibrated for 3 seconds, and then starts image collection. After determining to execute the seafood area operation table calibration task, the business personnel clicks the "go to calibration" button corresponding to the "seafood area operation table", and the mobile terminal displays interface (2). The interface (2) prompts the business personnel to "arrive at the specified point position and stand for 3-5 seconds, position seafood area operation table". The business personnel starts point position calibration by clicking the "I have arrived, start calibration" button, and can also choose to "skip" the current calibration task. The image of the point position is collected by the camera associated with the point position and displayed to the business personnel through the mobile terminal, and the business personnel selects a target image with better shooting effect (clear point position image and clear shooting range, etc.). Correspondingly, the camera corresponding to the target image is the camera bound with the seafood area operation table.

[0110] After calibration is completed, in addition to the point calibration success, there can be a calibration failure, at which time the interface (3) is displayed. In the case of calibration exception, the abnormal reason is displayed in the corresponding area, for example, calibration failure due to network factors, identification of business personnel failure, etc. At this time, the camera can re-image collection, or re-select the task to the task receiving step. The business personnel can choose "re-identify calibration", or choose "skip", and fill in the skip reason. The skip reason can be to end the execution of the task, select other task execution, etc. After the operation station point calibration is successful, the mobile terminal display interface (4) is displayed. At this time, the seafood area operation station and the chicken area operation station have completed calibration, and the business personnel can choose to re-calibrate the point calibration task, or modify the point photo, so that the camera re-images the point and returns the re-collected image, or re-executes the point calibration task. If no modification or re-calibration is required, click "complete task" to end the point calibration.

[0111] In summary, through the operation of the business personnel operating the mobile terminal, the operation station and the like can be bound between the point and the camera, and then the camera can collect the point image in real time. Through analysis of the point image, the working standard of the business personnel corresponding to the point can be determined.

[0112] Optionally, the task execution device carries a marker to the target point in response to the marching instruction; acquires position information corresponding to the target point, performs a specified action at the target point, and sends an image acquisition instruction to the server.

[0113] Optionally, the task execution device carries a marker to the target point in response to the marching instruction; stays at the target point for a preset length of time and sends an image acquisition instruction to the server.

[0114] Optionally, the server acquires a target commodity corresponding to the target point;

[0115] According to the binding relationship between the target point and the target collection device, a target collection device corresponding to the target commodity is determined.

[0116] Optionally, the server acquires at least one to-be-distributed commodity information, determines a to-be-distributed commodity corresponding to the target point based on the to-be-distributed commodity information, and determines a target collection device corresponding to the to-be-distributed commodity according to the binding relationship between the target point and the target collection device.

[0117] Optionally, the server identifies a point information code from an image of the target point collected by the target collection device, and establishes an association relationship between the target point and the identified point information code.

[0118] Optionally, the server identifies the commodity information stored in the target point from the image of the target point collected by the target collection device, creates a point information code according to the commodity information, and establishes an association between the target point and the created point information code.

[0119] Optionally, the server sends the binding result to the task execution device.

[0120] Optionally, the task execution device re-sends the image acquisition instruction to the server if the image set is not received within a preset time length.

[0121] To sum up, the device binding method provided by one embodiment of the present specification, the server determines the association between the target point and the at least one associated collection device, and sends a travel instruction to the task execution device, wherein the travel instruction carries the location information of the target point; the task execution device travels to the target point in response to the travel instruction and sends an image acquisition instruction to the server; the server collects the initial image of the target point through the at least one associated collection device in response to the image acquisition instruction, generates an image set and sends the image set to the task execution device; the task execution device determines the target image from the image set and feeds back to the server; the server determines the target collection device corresponding to the target image from the at least one associated collection device, and establishes a binding relationship between the target point and the target collection device. The binding between the target point and the target collection device is automatically completed through the task execution device, the binding difficulty between the point and the collection device is reduced, and the binding efficiency is improved.

[0122] The above is a schematic scheme of the device binding method of the present embodiment. It should be noted that the technical scheme of the device binding method belongs to the same concept as the technical scheme of the device binding system described above, and the details of the technical scheme of the device binding method that are not described in detail can be referred to the description of the technical scheme of the device binding system.

[0123] Figure 8 The structure block diagram of a computing device 800 according to one embodiment of the present specification is shown. The components of the computing device 800 include but are not limited to a memory 810 and a processor 820. The processor 820 is connected with the memory 810 through a bus 830, and a database 850 is used to save data.

[0124] The computing device 800 also includes an access device 840 that enables the computing device 800 to communicate via one or more networks 860. Examples of such networks include a public switched telephone network (PSTN), a local area network (LAN), a wide area network (WAN), a personal area network (PAN), or combinations of such networks, such as the Internet. The access device 840 can include one or more of any type of network interface (for example, a network interface card (NIC)), such as an IEEE 802.11 wireless local area network (WLAN) wireless interface, a Worldwide Interoperability for Microwave Access (Wi-MAX) interface, an Ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a Bluetooth interface, a Near Field Communication (NFC) interface, or the like.

[0125] In one embodiment of the present application, the above-mentioned components of the computing device 800, as well as other components not shown in FIG. 8, can be connected to each other by a bus. It should be understood that Figure 8 the computing device structure diagram shown is only for the purpose of example, and is not a limitation on the scope of the present application. Those skilled in the art can add or replace other components as needed. Figure 8 the computing device structure diagram shown is only for the purpose of example, and is not a limitation on the scope of the present application. Those skilled in the art can add or replace other components as needed.

[0126] The computing device 800 can be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (for example, a tablet computer, a personal digital assistant, a laptop computer, a notebook computer, a netbook, and the like), a mobile phone (for example, a smartphone), a wearable computing device (for example, a smart watch, smart glasses, and the like), or other types of mobile devices, or a stationary computing device such as a desktop computer or a personal computer (PC). The computing device 800 can also be a mobile or stationary server. Among them, the processor 820 is used to execute the following computer executable instructions, which are executed by the processor to implement the steps of the above device binding method.

[0127] The above is a schematic scheme of the computing device of the embodiment. It should be noted that the technical scheme of the computing device and the technical scheme of the device binding method described above belong to the same concept, and the details of the technical scheme of the computing device that are not described in detail can be referred to the description of the technical scheme of the device binding method.

[0128] An embodiment of the present specification further provides a computer readable storage medium, which stores computer executable instructions, and the computer executable instructions are executed by a processor to implement the steps of the device binding method.

[0129] The above is a schematic scheme of the computer readable storage medium of the embodiment. It should be noted that the technical scheme of the storage medium and the technical scheme of the device binding method described above belong to the same concept, and the details of the technical scheme of the storage medium that are not described in detail can be referred to the description of the technical scheme of the device binding method.

[0130] An embodiment of the present specification further provides a computer program, and when the computer program is executed in a computer, the computer program causes the computer to execute the steps of the device binding method.

[0131] The above is a schematic scheme of the computer program of the embodiment. It should be noted that the technical scheme of the computer program and the technical scheme of the device binding method described above belong to the same concept, and the details of the technical scheme of the computer program that are not described in detail can be referred to the description of the technical scheme of the device binding method.

[0132] The above describes specific embodiments of the present specification. Other embodiments are within the scope of the appended claims. In some cases, the acts or steps recited in the claims can be performed in a different order than the order described in the embodiments and still achieve desirable results. In addition, the processes depicted in the figures do not necessarily require the particular order shown or sequential order in order to achieve the desired results. In some implementations, multitasking and parallel processing can be advantageous or necessary.

[0133] The computer readable medium can include any entity or apparatus capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal, software distribution medium, etc. It should be noted that the computer readable medium can include appropriate additions or subtractions according to the requirements of legislation and patent practice in the jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals.

[0134] It should be noted that for the foregoing method embodiments, the descriptions are expressed as a combination of a series of actions for the sake of simplicity and brevity, but those skilled in the art should appreciate that the embodiments of the present specification are not limited by the order of the described actions, because according to the embodiments of the present specification, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should appreciate that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to the embodiments of the present specification.

[0135] In the above embodiments, the description of each embodiment has its own focus, and the parts not described in detail in a certain embodiment can be referred to the related description of other embodiments.

[0136] The preferred embodiments of the present specification disclosed above are only used to help explain the present specification. The alternative embodiments do not describe all the details and limit the invention to the specific embodiments described. Obviously, according to the content of the embodiments of the present specification, many modifications and changes can be made. The present specification selects and describes these embodiments in order to better explain the principles and practical applications of the embodiments of the present specification, so that those skilled in the art can well understand and use the present specification. The present specification is limited by the claims and their entire scope and equivalents.

Claims

1. A device binding system, comprising: Task execution equipment and servers; The server is configured to determine the association between a target location and at least one associated acquisition device, and to send a movement command to the task execution device, wherein the movement command carries the location information of the target location; The task execution device is configured to move to the target location in response to the movement command and send an image acquisition command to the server. The movement to the target location and sending the image acquisition command in response to the movement command includes: the task execution device carrying a marker item to the target location; the task execution device scanning a location code to obtain location information corresponding to the target location; performing a specified action and sending the image acquisition command to the server; or staying at the target location for a preset time length and sending the image acquisition command to the server. The server is configured to, in response to the image acquisition instruction, acquire initial images of the target location through the at least one associated acquisition device, generate an image set, and send the image set to the task execution device; The task execution device is further configured to determine a target image from the image set and feed it back to the server; The server is configured to determine the target acquisition device corresponding to the target image from the at least one associated acquisition device, and to establish a binding relationship between the target point and the target acquisition device.

2. The system according to claim 1, wherein the server is further configured to acquire the target product corresponding to the target location; Based on the binding relationship between the target location and the target acquisition device, the target acquisition device corresponding to the target product is determined.

3. The system according to claim 1, wherein the server is further configured to acquire at least one product information to be allocated, and determine the product to be allocated corresponding to the target location based on the product information to be allocated; Based on the binding relationship between the target location and the target acquisition device, the target acquisition device corresponding to the product to be allocated is determined.

4. The system according to claim 1, wherein the server is further configured to identify a location information code from the image of the target location acquired by the target acquisition device, and to establish an association between the target location and the identified location information code.

5. The system according to claim 1, wherein the server is further configured to identify the product information stored at the target location from the image of the target location acquired by the target acquisition device, create a location information code based on the product information, and establish an association between the target location and the created location information code.

6. The system according to claim 1, wherein the server is further configured to send a binding result to the task execution device.

7. The system according to claim 1, wherein the task execution device is further configured to send an image acquisition instruction to the server again if the image set is not received within a preset time period.

8. A device binding method, comprising: The server determines the association between the target location and at least one associated acquisition device, and sends a movement command to the task execution device, wherein the movement command carries the location information of the target location; The task execution device responds to the travel command by moving to the target location and sending an image acquisition command to the server. The step of responding to the travel command by moving to the target location and sending the image acquisition command to the server includes: the task execution device carrying a marker item moving to the target location; the task execution device scanning a location code to obtain the location information corresponding to the target location, performing a specified action and sending the image acquisition command to the server, or staying at the target location for a preset time length and sending the image acquisition command to the server. In response to the image acquisition instruction, the server acquires an initial image of the target location through the at least one associated acquisition device, generates an image set, and sends the image set to the task execution device; The task execution device determines the target image from the image set and sends it back to the server; The server determines the target acquisition device corresponding to the target image from the at least one associated acquisition device, and establishes a binding relationship between the target point and the target acquisition device.

9. A computing device, comprising: Memory and processor; The memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions, which, when executed by the processor, implement the steps of the device binding method of claim 8.

10. A computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the steps of the device bonding method of claim 8.

Images