A method and device for determining the quantity of items loaded and unloaded

Abstract

The present invention discloses a method and device for determining the number of articles loaded and unloaded, and relates to the field of warehousing and logistics technology. A specific implementation of the method includes: determining the article loading and unloading instructions corresponding to a plurality of articles to be loaded and unloaded; the loading and unloading instructions indicate the operation of loading or unloading the articles; obtaining a plurality of preset action characteristic values ​​and the arrangement order of the plurality of action characteristic values ​​according to the loading and unloading instructions; the action characteristic values ​​correspond to the operation of loading or unloading; obtaining a plurality of real-time characteristic values ​​of the operations respectively performed by one or more operators; comparing the real-time characteristic values ​​with the action characteristic values, and determining a plurality of target characteristic values ​​corresponding to the action characteristic values ​​from the real-time characteristic values; and determining the number of articles loaded and unloaded by the operator according to the arrangement order of the plurality of target characteristic values ​​and the plurality of action characteristic values. This implementation can automatically determine the number of articles loaded and unloaded by the operator, and has strong timeliness and high accuracy.

Description

Technical Field

[0001] The present invention relates to the technical field of warehousing logistics, and in particular to a method and device for determining the loading and unloading quantity of articles. Background Art

[0002] In all the transport links of logistics, loading and unloading are an indispensable link. In the prior art, since the operators' hands are occupied during loading and unloading, it is impossible to use a scanner to scan one by one. Therefore, the calculation of the workload of each operator is usually obtained by averaging the total number of items loaded and unloaded. However, since the actual work efficiency of each operator is different, calculating the workload of the operator by the average value is not accurate enough. Summary of the invention

[0003] In view of this, an embodiment of the present invention provides a method and device for determining the number of items loaded and unloaded, by comparing the real-time feature value of the operator obtained in real time with multiple preset action feature values, and determining the target feature value corresponding to the action feature value from the real-time feature value, and finally according to the target feature value and the arrangement order of multiple action feature values, the number of items loaded and unloaded by the operator can be automatically determined, with strong timeliness and high accuracy.

[0004] To achieve the above objective, according to one aspect of an embodiment of the present invention, a method for determining the loading and unloading quantity of articles is provided.

[0005] A method for determining the number of items loaded and unloaded in an embodiment of the present invention includes: determining item loading and unloading instructions corresponding to multiple items to be loaded and unloaded; the loading and unloading instructions indicate the operation of loading or unloading the items; obtaining multiple preset action feature values ​​and the arrangement order of multiple action feature values ​​according to the loading and unloading instructions; the action feature values ​​correspond to the loading or unloading operations; obtaining multiple real-time feature values ​​of one or more operators performing the operations respectively; comparing the real-time feature values ​​with the action feature values, and determining multiple target feature values ​​corresponding to the action feature values ​​from the real-time feature values; and determining the number of items loaded and unloaded by the operator according to the multiple target feature values ​​and the arrangement order of multiple action feature values.

[0006] Optionally, the obtaining of multiple real-time feature values ​​of one or more operators performing the operations respectively includes: determining the first vehicle information corresponding to the logistics waybill, and obtaining the second vehicle information in the collection area by using a smart device; when the second vehicle information matches the first vehicle information, obtaining user information corresponding to one or more operators in the collection area by using face recognition technology; and obtaining multiple real-time feature values ​​of one or more user information performing the operations respectively.

[0007] Optionally, determining the number of objects loaded and unloaded by the operator based on the arrangement order of the multiple target feature values ​​and the multiple action feature values ​​includes: arranging the multiple target feature values ​​in chronological order to generate a target feature value set; arranging the multiple action feature values ​​in chronological order, taking the arranged multiple action feature values ​​as a group of action feature value sets, and determining the number of groups in the target feature value set that include the action feature value sets; each time there is a group of action feature value sets, it is recorded as one loading and unloading number, and determining the number of objects loaded and unloaded by the operator based on the loading and unloading numbers.

[0008] Optionally, determining the number of groups in the target feature value set that include the action feature value set includes: judging whether there are multiple target feature values ​​in the target feature value set that are arranged consecutively in sequence according to the arrangement order; if so, taking the multiple target feature values ​​arranged consecutively in sequence according to the arrangement order as a group of action feature value sets, and determining the number of groups in the target feature value set that includes the action feature value set.

[0009] Optionally, obtaining multiple real-time feature values ​​of one or more operators performing the operations respectively includes: using the smart device to obtain an image within the acquisition area in real time; performing feature value analysis on the image to obtain multiple real-time feature values ​​of one or more operators performing the operations respectively.

[0010] Optionally, the multiple actions include: lifting action, moving action, and putting down action; the feature value analysis of the image is performed to obtain multiple real-time feature values ​​of the one or more operators performing the operations respectively, including: determining the lifting action feature value or putting down action feature value corresponding to the operator according to the operator's arm movements, the position relationship between the object and the arm, the leg movements, and the torso movements in the image, and the position of the object before loading and unloading or the position of the object after loading and unloading; determining the moving action feature value of the operator according to the position of the object before loading and unloading and the position of the object after loading and unloading.

[0011] Optionally, the method also includes: determining the loading and unloading quantity corresponding to the logistics waybill; when the loading and unloading quantity is greater than the loading and unloading quantity and / or the loading and unloading quantity is less than a preset ratio threshold of the loading and unloading quantity, determining the loading and unloading quantity of one or more operators corresponding to the user information based on the loading and unloading quantity.

[0012] To achieve the above objective, according to another aspect of an embodiment of the present invention, a device for determining the loading and unloading quantity of articles is provided.

[0013] A device for determining the number of items loaded and unloaded according to an embodiment of the present invention includes: a determination module, which is used to determine the item loading and unloading instructions corresponding to multiple items to be loaded and unloaded; the loading and unloading instructions indicate the operation of loading or unloading the items; an acquisition module, which is used to acquire multiple preset action feature values ​​and the arrangement order of multiple action feature values ​​according to the loading and unloading instructions; the action feature values ​​correspond to the loading or unloading operations; and multiple real-time feature values ​​of one or more operators performing the operations respectively are acquired; a comparison module, which is used to compare the real-time feature values ​​with the action feature values, and determine multiple target feature values ​​corresponding to the action feature values ​​from the real-time feature values; and a quantity module, which is used to determine the number of items loaded and unloaded by the operator according to the multiple target feature values ​​and the arrangement order of multiple action feature values.

[0014] To achieve the above objective, according to another aspect of an embodiment of the present invention, an electronic device for determining the number of items loaded and unloaded is provided.

[0015] An electronic device for determining the number of items loaded and unloaded according to an embodiment of the present invention comprises: one or more processors; a storage device for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement a method for determining the number of items loaded and unloaded according to an embodiment of the present invention.

[0016] To achieve the above objective, according to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided.

[0017] A computer-readable storage medium according to an embodiment of the present invention stores a computer program, which, when executed by a processor, implements a method for determining the loading and unloading quantity of articles according to an embodiment of the present invention.

[0018] One embodiment of the above invention has the following advantages or beneficial effects: by comparing the real-time feature value of the operator obtained in real time with multiple preset action feature values, the target feature value corresponding to the action feature value is determined from the real-time feature value, and finally the number of items loaded and unloaded by the operator is automatically determined based on the target feature value and the arrangement order of multiple action feature values.

[0019] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with specific implementation examples. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention.

[0021] Figure 1 is a schematic diagram of main steps of a method for determining the loading and unloading quantity of articles according to an embodiment of the present invention;

[0022] Figure 2 is a schematic diagram of main steps of obtaining real-time feature values ​​according to an embodiment of the present invention;

[0023] Figure 3 is a schematic diagram of another main step of obtaining real-time feature values ​​according to an embodiment of the present invention;

[0024] Figure 4 is a schematic diagram of the main steps of determining the loading and unloading quantity of the article by the operator according to an embodiment of the present invention;

[0025] Figure 5 is a schematic diagram of the main steps of determining the number of groups including action feature value sets in a target feature value set according to an embodiment of the present invention;

[0026] Figure 6 is a schematic diagram of another main step of obtaining a real-time feature value according to an embodiment of the present invention;

[0027] Figure 7 is a schematic diagram of the main steps of determining the loading and unloading quantity of articles according to an embodiment of the present invention;

[0028] Figure 8 is a schematic diagram of main modules of an apparatus for determining the number of items loaded and unloaded according to an embodiment of the present invention;

[0029] Fig. 9 is an exemplary system architecture diagram to which embodiments of the present invention may be applied;

[0030] Fig.10 It is a schematic diagram of the structure of a computer system of a terminal device or a server suitable for implementing an embodiment of the present invention. DETAILED DESCRIPTION

[0031] The following is a description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, including various details of the embodiments of the present invention to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0032] It should be pointed out that the embodiments of the present invention and the technical features therein may be combined with each other without conflict.

[0033] Figure 1 4 is a schematic diagram of main steps of a method for determining the loading and unloading quantity of articles according to an embodiment of the present invention.

[0034] like Figure 1As shown, the method for determining the loading and unloading quantity of articles in the embodiment of the present invention mainly includes the following steps:

[0035] Step S101: determining an article loading and unloading instruction corresponding to a plurality of articles to be loaded and unloaded; the loading and unloading instruction indicates the operation of loading or unloading the articles;

[0036] Step S102: acquiring a plurality of preset action characteristic values ​​and an arrangement order of the plurality of action characteristic values ​​according to the loading and unloading instruction; the action characteristic values ​​correspond to the loading or unloading operation;

[0037] Step S103: obtaining a plurality of real-time characteristic values ​​of operations respectively performed by one or more operators;

[0038] Step S104: comparing the real-time feature value with the action feature value, and determining a plurality of target feature values ​​corresponding to the action feature value from the real-time feature value;

[0039] Step S105: Determine the number of objects loaded and unloaded by the operator according to the arrangement order of the multiple target feature values ​​and the multiple action feature values.

[0040] Among them, in each transportation link of logistics, there are only loading and unloading operations for the items to be loaded and unloaded. Therefore, the loading and unloading instructions indicate loading or unloading of the items. The present invention does not limit the specific operations of the loading and unloading instructions, and can also include other operations related to the items to be loaded and unloaded. For different loading and unloading instructions, there are corresponding different preset multiple action feature values. For example, under the loading instruction, there are three actions corresponding to the action A, action B and action C, respectively, and the action feature values ​​corresponding to each action are m1, m2 and m3, respectively. Then the arrangement order of the multiple action feature values ​​is m1→m2→m3; under the unloading instruction, there may also be three actions corresponding to the action A, action B and action C, but because the corresponding moving positions when executing each action are different, the corresponding action feature values ​​are different from the feature values ​​when the loading instruction is executed, which are m4, m5 and m6 respectively, and the arrangement order of the multiple action feature values ​​is m4→m5→m6.

[0041] In an optional embodiment, the target feature value in step S104 may be a real-time feature value that is the same as the action feature value, or a real-time feature value whose difference with the action feature value is within a preset range.

[0042] In an optional embodiment, in order to quickly and accurately count the loading and unloading quantities, it is necessary to ensure that the operators are employees of the enterprise to avoid unnecessary quantity statistics caused by irrelevant personnel. Therefore, in step S103, the step of obtaining multiple real-time feature values ​​of one or more operators performing the operations respectively is as follows: Figure 2 As shown, it may further include:

[0043] Step S201: Determine the first vehicle information corresponding to the logistics waybill, and use the smart device to obtain the second vehicle information in the collection area;

[0044] Step S202: when the second vehicle information matches the first vehicle information, user information corresponding to one or more operators in the collection area is obtained by using face recognition technology;

[0045] Step S203: Acquire multiple real-time feature values ​​of operations performed by one or more user information.

[0046] Among them, the first vehicle information is the vehicle information corresponding to the logistics waybill in the system, and the second vehicle information is the vehicle information of real-time loading and unloading. In the actual application process, multiple loading and unloading sites are usually set up, and different sites are used to load and unload the first vehicles corresponding to different logistics waybills. When multiple vehicles need to load and unload goods at the same time, the goods should be loaded and unloaded according to the sites allocated in the system to ensure accurate statistics of the loading and unloading quantity. Therefore, it is necessary to determine whether the first vehicle information matches the second vehicle information, and only when they match, the loading and unloading quantity is counted. In the case of mismatch, in an optional embodiment, an alarm can be issued to prompt the operator that the vehicle information does not match and the site is changed. Further, in order to improve the calculation efficiency of the characteristic value, in an optional embodiment, the user information corresponding to one or more operators in the collection area is obtained in step S202 first, and in step S203, only the loading and unloading quantity of the operator with user information is counted. In the actual loading and unloading process, there may be outsiders to help with loading and unloading to improve loading and unloading efficiency, but there is no need to count the number of outsiders loading and unloading. Therefore, only the real-time feature value is calculated for the operator who obtains the user information through face recognition technology, which can reduce resource waste and improve the calculation efficiency of the real-time feature value. In the case of mismatch, the number of loading and unloading is not counted.

[0047] In a further optional embodiment, the characteristic value can be obtained by analyzing the image, as shown in the following example: Figure 3 As shown, including:

[0048] Step S301: using a smart device to acquire images within a collection area in real time;

[0049] Step S302: Perform feature value analysis on the image to obtain a plurality of real-time feature values ​​of operations respectively performed by one or more operators.

[0050] After confirming the vehicle information and user information, the operator can determine the loading and unloading quantity of the items. The determination process is as follows: Figure 4 As shown, including:

[0051] Step S401: Arrange multiple target feature values ​​in chronological order to generate a target feature value set;

[0052] Step S402: arranging the plurality of action feature values ​​in sequence according to an arrangement order, taking the arranged plurality of action feature values ​​as a set of action feature value sets, and determining the number of sets of action feature value sets included in the target feature value set;

[0053] Step S403: Every time there is a set of action feature values, it is recorded as a loading and unloading number, and the number of objects loaded and unloaded by the operator is determined according to the loading and unloading number.

[0054] Since the real-time feature values ​​are obtained in real time, that is, in chronological order, and the target feature values ​​are obtained by filtering the real-time feature values ​​according to the action feature values, multiple target feature values ​​can be arranged in chronological order to obtain a target feature value set. For example, the action feature values ​​are m1, m2, and m3, and the real-time feature value that is the same as the action feature value is taken as the target feature value. Then, according to the three action feature values, a target feature value set [n3, n5, n9, n5, n9, n3, n5, n9] composed of multiple target feature values ​​arranged in chronological order is obtained by filtering the real-time feature values ​​according to the three action feature values, wherein the target feature value n3 has the same value as the action feature value m1, the target feature value n5 has the same value as the action feature value m2, and the target feature value n9 has the same value as the action feature value m3. Therefore, the target feature value set can also be expressed as [m1, m2, m3, m2, m3, m1, m2, m3]. Further, the three action feature values ​​are arranged in chronological order, and the obtained action feature value set is [m1, m2, m3]. According to the target feature value set, it can be determined that the number of groups containing the action feature value set is 3. Every time there is a group of action feature value sets, it is recorded as one loading and unloading number, so the loading and unloading number is 3 times, and further, the number of items loaded and unloaded by the operator is 3.

[0055] In a further optional embodiment, the process of determining the number of groups of action feature value sets in the target feature value set in step S402 is as follows: Figure 5 As shown, including:

[0056] Step S501: determining whether there are multiple target feature values ​​arranged consecutively in the target feature value set in the order of arrangement;

[0057] If yes, then executing step S502: taking the multiple target feature values ​​arranged successively in the arrangement order as a set of action feature value sets, determining the number of groups in the target feature value set that include the action feature value set;

[0058] If not, step S503 is executed: determining that the number of groups including the action feature value set in the target feature value set is 0.

[0059] Taking the above-mentioned target feature value set [n3, n5, n9, n5, n9, n3, n5, n9] as an example, the preset arrangement order is n3→n5→n9. Therefore, there are multiple target feature values ​​in the target feature value set that are arranged consecutively in the arrangement order, that is, the first three target feature values ​​and the last three target feature values ​​are n3, n5, n9 that are arranged consecutively in the arrangement order. In other words, the number of groups of action feature value sets determined in the target feature value set is 2.

[0060] By determining the number of groups of action feature value sets in the target feature value set through the above process, a coherent complete action can be obtained, and a whole complete action can be used as the number of loading and unloading times in sequence with high accuracy.

[0061] In an optional embodiment, the multiple actions during the loading and unloading process include: lifting action, moving action, and putting down action. In step S502, the process of obtaining the real-time feature value is as follows: Figure 6 As shown, further comprising:

[0062] Step S601: determining the lifting action feature value or the putting down action feature value corresponding to the operator according to the operator's arm action, the position relationship between the object and the arm, the leg action, the torso action, and the position of the object before loading or unloading or the position of the object after loading or unloading in the image;

[0063] Step S602: Determine the operator's moving action feature value according to the position of the object before loading and unloading and the position of the object after loading and unloading.

[0064] Regarding the setting of actions and action characteristic values, they can be customized according to the actual operator's behavioral conditions. The present invention relates to actions that may occur during loading and unloading, and therefore only includes lifting actions, moving actions, and putting down actions. In other application scenarios, running actions, squatting actions, jumping actions, etc. may also be included according to actual conditions.

[0065] In an optional embodiment, the method for determining the number of items to be loaded and unloaded provided by the embodiment of the present invention is as follows: Figure 7 As shown, it may also include:

[0066] Step S701: Determine the target loading and unloading quantity corresponding to the logistics waybill;

[0067] Step S702: when the loading and unloading quantity is greater than the target loading and unloading quantity and / or the loading and unloading quantity is less than a preset ratio threshold of the target loading and unloading quantity, the loading and unloading quantity of one or more operators corresponding to the user information is determined according to the loading and unloading quantity.

[0068] Since errors may occur in the automated loading and unloading quantity counting process, it is necessary to obtain the target loading and unloading quantity corresponding to the logistics waybill, that is, the total number of loading and unloading quantities that the logistics waybill should correspond to. When the loading and unloading quantity obtained by automatic statistics is greater than the total number of loading and unloading quantities, it means that the loading and unloading quantity obtained by automatic statistics has been counted too many times, and the loading and unloading quantity obtained by statistics cannot be used as the actual loading and unloading quantity of the operator. Similarly, when the loading and unloading quantity obtained by automatic statistics is less than the preset ratio threshold of the target loading and unloading quantity, that is, when the counted loading and unloading quantity is too small, the loading and unloading quantity obtained by statistics cannot be used as the actual loading and unloading quantity of the operator. Therefore, in response to the above two situations with large errors, in an optional embodiment, the target loading and unloading quantity can be divided by the total number of user information according to the principle of average distribution to obtain the loading and unloading quantity of the operator corresponding to each user information.

[0069] After the loading and unloading quantities are automatically counted, in an optional embodiment, a verification request can be sent to one or more operators corresponding to the user information so that the operators can verify their own workload and make manual adjustments to the loading and unloading quantities that are in doubt during the verification process.

[0070] It can be seen from the method for determining the number of items loaded and unloaded according to an embodiment of the present invention that by comparing the real-time feature value of the operator obtained in real time with a plurality of preset action feature values, the target feature value corresponding to the action feature value is determined from the real-time feature value, and finally according to the target feature value and the arrangement order of the plurality of action feature values, the number of items loaded and unloaded by the operator can be automatically determined, with strong timeliness and high accuracy.

[0071] Figure 8 4 is a schematic diagram of main modules of an apparatus for determining the loading and unloading quantity of articles according to an embodiment of the present invention.

[0072] like Figure 8 As shown, the device 800 for determining the number of items to be loaded and unloaded according to the embodiment of the present invention includes:

[0073] A determination module 801 is used to determine an article loading and unloading instruction corresponding to a plurality of articles to be loaded and unloaded; the loading and unloading instruction indicates an operation of loading or unloading the articles;

[0074] The acquisition module 802 is used to acquire a plurality of preset action characteristic values ​​and an arrangement order of the plurality of action characteristic values ​​according to the loading and unloading instruction; the action characteristic value corresponds to the loading or unloading operation; and acquire a plurality of real-time characteristic values ​​of one or more operators performing the operation respectively;

[0075] A comparison module 803 is used to compare the real-time feature value with the action feature value, and determine a plurality of target feature values ​​corresponding to the action feature value from the real-time feature value;

[0076] The quantity module 804 is used to determine the loading and unloading quantity of the objects by the operator according to the arrangement order of the multiple target feature values ​​and the multiple action feature values.

[0077] In an optional embodiment of the present invention, the acquisition module 802 is also used to determine the first vehicle information corresponding to the logistics waybill, and use a smart device to acquire the second vehicle information in the collection area; when the second vehicle information matches the first vehicle information, acquire the user information corresponding to one or more operators in the collection area through face recognition technology; and acquire multiple real-time feature values ​​of one or more user information to respectively execute the operations.

[0078] In an optional embodiment of the present invention, the quantity module 804 is also used to arrange the multiple target feature values ​​in chronological order to generate a target feature value set; arrange the multiple action feature values ​​in chronological order, use the arranged multiple action feature values ​​as a group of action feature value sets, and determine the number of groups in the target feature value set that include the action feature value sets; each time there is a group of action feature value sets, it is recorded as a loading and unloading number, and the loading and unloading quantity of the items by the operator is determined according to the loading and unloading number.

[0079] In an optional embodiment of the present invention, the quantity module 804 is also used to determine whether there are multiple target feature values ​​arranged consecutively in the target feature value set according to the arrangement order; if so, taking the multiple target feature values ​​arranged consecutively in the arrangement order as a group of action feature value sets, determining the number of groups in the target feature value set that include the action feature value set.

[0080] In an optional embodiment of the present invention, the acquisition module 802 is also used to use the smart device to acquire the image in the acquisition area in real time; perform feature value analysis on the image to obtain multiple real-time feature values ​​of the one or more operators performing the operations respectively.

[0081] In an optional embodiment of the present invention, the multiple actions include: lifting action, moving action, and putting down action; the acquisition module 802 is also used to determine the lifting action characteristic value or the putting down action characteristic value corresponding to the operator according to the operator's arm movements, the positional relationship between the object and the arm, the leg movements, and the torso movements in the image, and the position of the object before loading and unloading or the position of the object after loading and unloading; determine the operator's moving action characteristic value according to the position of the object before loading and unloading and the position of the object after loading and unloading.

[0082] In an optional embodiment of the present invention, the device also includes a judgment module for determining the target loading and unloading quantity corresponding to the logistics waybill; when the loading and unloading quantity is greater than the target loading and unloading quantity and / or the loading and unloading quantity is less than a preset ratio threshold of the target loading and unloading quantity, the loading and unloading quantity of one or more operators corresponding to the user information is determined according to the target loading and unloading quantity.

[0083] It can be seen from the device for determining the number of objects loaded and unloaded according to an embodiment of the present invention that by comparing the real-time feature value of the operator obtained in real time with a plurality of preset action feature values, the target feature value corresponding to the action feature value is determined from the real-time feature value, and finally, according to the target feature value and the arrangement order of the plurality of action feature values, the number of objects loaded and unloaded by the operator can be automatically determined, with strong timeliness and high accuracy.

[0084] Fig. 9 An exemplary system architecture 900 is shown to which the method for determining the number of items loaded and unloaded or the apparatus for determining the number of items loaded and unloaded according to the embodiments of the present invention can be applied.

[0085] like Fig. 9 As shown, system architecture 900 may include terminal devices 901, 902, 903, network 904 and server 905. Network 904 is used to provide a medium for communication links between terminal devices 901, 902, 903 and server 905. Network 904 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0086] The user can use the terminal devices 901, 902, 903 to interact with the server 905 through the network 904 to receive or send data, etc. Various communication client applications can be installed on the terminal devices 901, 902, 903, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc.

[0087] The terminal devices 901 , 902 , and 903 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, and desktop computers, etc.

[0088] The server 905 may be a server that provides various services, such as a background management server that provides support for the loading and unloading instructions sent by the user using the terminal devices 901, 902, and 903. The background management server may analyze and process the received loading and unloading instructions and other data, and feed back the processing results (such as the number of items loaded and unloaded by the operator) to the terminal device.

[0089] It should be noted that the method for determining the number of items loaded and unloaded provided in the embodiment of the present invention is generally executed by the server 905 , and accordingly, the device for determining the number of items loaded and unloaded is generally arranged in the server 905 .

[0090] It should be understood that Fig. 9 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0091] Reference below Fig.10 , which shows a schematic diagram of the structure of a computer system 1000 of a terminal device suitable for implementing an embodiment of the present invention. Fig.10 The terminal device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0092] like Fig.10 As shown, the computer system 1000 includes a central processing unit (CPU) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage part 1008 into a random access memory (RAM) 1003. In the RAM 1003, various programs and data required for the operation of the system 1000 are also stored. The CPU 1001, the ROM 1002, and the RAM 1003 are connected to each other through a bus 1004. An input / output (I / O) first interface 1005 is also connected to the bus 1004.

[0093] The following components are connected to the I / O first interface 1005: an input section 1006 including a keyboard, a mouse, etc.; an output section 1007 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1008 including a hard disk, etc.; and a communication section 1009 including a network first interface card such as a LAN card, a modem, etc. The communication section 1009 performs communication processing via a network such as the Internet. A drive 1010 is also connected to the I / O first interface 1005 as needed. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1010 as needed, so that a computer program read therefrom is installed into the storage section 1008 as needed.

[0094] In particular, according to the embodiments disclosed in the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 1009, and / or installed from the removable medium 1011. When the computer program is executed by the central processing unit (CPU) 1001, the above-mentioned functions defined in the system of the present invention are executed.

[0095] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0096] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0097] The modules involved in the embodiments of the present invention may be implemented by software or hardware. The modules described may also be set in a processor, for example, it may be described as: a processor includes a determination module, an acquisition module, a comparison module and a quantity module. The names of these modules do not constitute a limitation on the modules themselves in some cases, for example, the determination module may also be described as "a module for determining an item loading and unloading instruction corresponding to a plurality of items to be loaded and unloaded".

[0098] As another aspect, the present invention also provides a computer-readable medium, which may be included in the device described in the above embodiment; or it may exist independently and not be assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by a device, the device includes: determining the article loading and unloading instructions corresponding to multiple articles to be loaded and unloaded; the loading and unloading instructions indicate the operation of loading or unloading the articles; obtaining multiple preset action feature values ​​and the arrangement order of multiple action feature values ​​according to the loading and unloading instructions; the action feature values ​​correspond to the operation of loading or unloading; obtaining multiple real-time feature values ​​of one or more operators performing the operations respectively; comparing the real-time feature values ​​with the action feature values, and determining multiple target feature values ​​corresponding to the action feature values ​​from the real-time feature values; determining the loading and unloading quantity of the articles by the operator according to the arrangement order of the multiple target feature values ​​and the multiple action feature values.

[0099] According to the technical solution of the embodiment of the present invention, the real-time feature value of the operator obtained in real time is compared with multiple preset action feature values, and the target feature value corresponding to the action feature value is determined from the real-time feature value. Finally, according to the target feature value and the arrangement order of multiple action feature values, the number of items loaded and unloaded by the operator can be automatically determined, which has strong timeliness and high accuracy.

[0100] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for determining the number of items to be loaded and unloaded, characterized in that: include: Determining an item loading and unloading instruction corresponding to a plurality of items to be loaded and unloaded; the loading and unloading instruction indicates an operation of loading or unloading the items; Acquire a plurality of preset action characteristic values ​​and an arrangement order of the plurality of action characteristic values ​​according to the loading and unloading instruction; the action characteristic values ​​correspond to the loading or unloading operation; Acquire multiple real-time feature values ​​of one or more operators performing the operations respectively based on image analysis; Comparing the real-time feature value with the action feature value, and determining a plurality of target feature values ​​corresponding to the action feature value from the real-time feature value; According to the arrangement order of the multiple target feature values ​​and the multiple action feature values, the number of groups in the target feature value set that include the action feature value set is determined, and the number of objects loaded and unloaded by the operator is determined according to the number of groups.

2. The method according to claim 1, characterized in that The obtaining of a plurality of real-time characteristic values ​​of the operations respectively performed by one or more operators comprises: Determine the first vehicle information corresponding to the logistics waybill, and use the smart device to obtain the second vehicle information in the collection area; When the second vehicle information matches the first vehicle information, user information corresponding to one or more operators in the collection area is obtained by using face recognition technology; A plurality of real-time characteristic values ​​of one or more operators performing the operations respectively are obtained.

3. The method according to claim 1, characterized in that The step of determining the number of groups of the target feature value set that include the action feature value set according to the arrangement order of the multiple target feature values ​​and the multiple action feature values, and determining the number of items loaded and unloaded by the operator according to the number of groups, includes: Arrange the multiple target feature values ​​in chronological order to generate a target feature value set; Arrange the plurality of action feature values ​​in sequence according to the arrangement order, use the arranged plurality of action feature values ​​as a set of action feature value sets, and determine the number of sets in the target feature value set that include the action feature value set; Each time there is a set of action feature values, it is recorded as a loading and unloading number, and the loading and unloading quantity of the objects by the operator is determined according to the loading and unloading number.

4. The method according to claim 3, characterized in that The determining the number of groups of the target feature value set that include the action feature value set includes: Determine whether there are multiple target feature values ​​in the target feature value set that are arranged consecutively in the arrangement order; If yes, then a plurality of target feature values ​​sequentially arranged in the arrangement order are taken as a group of action feature value sets, and the number of groups in the target feature value sets that include the action feature value sets is determined.

5. The method according to claim 2, characterized in that: The acquiring of a plurality of real-time feature values ​​of one or more operators performing the operations respectively based on image analysis comprises: Using the smart device to acquire images in the acquisition area in real time; Performing feature value analysis on the image to obtain a plurality of real-time feature values ​​of the operations respectively performed by the one or more operators.

6. The method according to claim 5, characterized in that The multiple actions include: a lifting action, a moving action, and a putting down action; the performing feature value analysis on the image to obtain multiple real-time feature values ​​of the one or more operators performing the operations respectively includes: Determine the lifting action feature value or the putting down action feature value corresponding to the operator according to the operator's arm action, the positional relationship between the object and the arm, the leg action, the torso action, and the position of the object before loading or unloading or the position of the object after loading or unloading in the image; The moving action characteristic value of the operator is determined according to the position of the object before loading and unloading and the position of the object after loading and unloading.

7. The method according to claim 2, characterized in that Also includes: Determine the target loading and unloading quantity corresponding to the logistics waybill; When the loading and unloading quantity is greater than the target loading and unloading quantity and / or the loading and unloading quantity is less than a preset ratio threshold of the target loading and unloading quantity, the loading and unloading quantity of one or more operators corresponding to the user information is determined according to the target loading and unloading quantity.

8. A device for determining the number of items loaded and unloaded, characterized in that: include: A determination module, used to determine the item loading and unloading instructions corresponding to a plurality of items to be loaded and unloaded; The loading and unloading instructions indicate the operation of loading or unloading the articles; An acquisition module, used for acquiring a plurality of preset action characteristic values ​​and an arrangement order of the plurality of action characteristic values ​​according to the loading and unloading instruction; The action characteristic value corresponds to the loading or unloading operation; Acquire multiple real-time feature values ​​of one or more operators performing the operations respectively based on image analysis; A comparison module, used for comparing the real-time feature value with the action feature value, and determining a plurality of target feature values ​​corresponding to the action feature value from the real-time feature value; The quantity module is used to determine the number of groups of the target feature value set that include the action feature value set according to the arrangement order of the multiple target feature values ​​and the multiple action feature values, and determine the loading and unloading quantity of the objects by the operator according to the number of groups.

9. An electronic device for determining the number of items loaded and unloaded, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

10. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images