Vehicle part sorting method and device, electronic equipment and medium

Abstract

The invention provides a vehicle part sorting method and device, electronic equipment and a medium. The method is applied to a visual sorting system, the visual sorting system comprises a wearable sorting device provided with a visual recognition assembly, and the method comprises the steps that vehicle configuration information is obtained, then a part sorting task comprising a plurality of target parts is determined, and the target positions of the target parts in a virtual reality map are determined; the device position of the wearable sorting device in the virtual reality map is determined by adopting a visual identification assembly, a sorting guide path is generated in the virtual reality map according to the device position and the target position so as to obtain a target part, and the target part is detected by adopting the visual identification assembly to obtain a part detection result. And determining a part sorting result of the part sorting task according to the part detection results corresponding to the plurality of target parts. According to the method, the part sorting task and the sorting guide path can be generated, the target part can be automatically detected, and the part sorting efficiency and the part sorting quality can be integrally improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of part picking, in particular to a vehicle part picking method and device, electronic equipment and medium. BACKGROUND

[0002] At present, with the development of manufacturing industry, the demand for part picking in manufacturing process is increasing, and part picking can be divided into logistics picking and logistics planning. In the process of logistics picking, real-time logistics dynamics is mainly input by manual terminal devices such as PAD (portable terminal device), scanning gun, mobile phone and other terminal devices, and the goods are picked by comparing the display screen, paper picking list and sorting picking list by manual. In the process of logistics planning, the logistics planning or path generation is usually carried out according to manual experience by referring to drawings.

[0003] In the prior art, the operator needs to scan SPS (Set Parts Supply) allocation list and sorting list one by one by hand-held scanning gun, PAD and the like, resulting in low operation efficiency. In the picking link, the goods cannot be quickly located by means of lighting or checking the allocation list, and the efficiency of finding goods cannot be improved by means of logistics planning. After picking, the picked parts are checked by manual visual inspection and comparison of SPS allocation list or sorting list, which is low in checking efficiency and poor in effect, and is not conducive to the quality improvement of part picking. SUMMARY

[0004] In view of the above problems, the embodiments of the present application provide a vehicle part picking method, device, electronic equipment and medium.

[0005] In the first aspect of the present application, a vehicle part picking method is first provided, which is applied to a visual picking system, the visual picking system includes a wearable picking device, the wearable picking device includes a visual recognition component, and the method includes: obtaining vehicle configuration information, and determining a part picking task according to the vehicle configuration information; the part picking task includes a plurality of target parts; determining a target position of the target part in a virtual reality map according to the virtual reality map obtained in advance; determining a device position of the wearable picking device in the virtual reality map by using the visual recognition component, and generating a picking guide path in the virtual reality map according to the device position and the target position; obtaining the target part according to the picking guide path, and detecting the target part by using the visual recognition component to obtain a part detection result corresponding to the target part; determining a part picking result of the part picking task according to the part detection result corresponding to each of the plurality of target parts.

[0006] Optionally, the obtaining the vehicle configuration information, and determining the part picking task according to the vehicle configuration information, comprises: obtaining an identity tag of the vehicle, and identifying the identity tag to obtain the vehicle configuration information; searching for a plurality of target parts corresponding to the vehicle configuration information in a preset real-time part database; constructing a part picking task according to the plurality of target parts.

[0007] Optionally, the wearable picking device further comprises a display component and a voice interaction component, and the part picking task further comprises picking order information, and before the determining the target position of the target part in the virtual reality map according to the pre-obtained virtual reality map, the method further comprises: displaying the plurality of target parts to the user in sequence through the display component according to the picking order information; wherein the user is a user wearing the wearable picking device; receiving a voice confirmation instruction issued by the user for the target part through the voice interaction component.

[0008] Optionally, the obtaining the target part according to the picking guide path comprises detecting the target part by using the visual recognition component to obtain a part detection result corresponding to the target part, comprising: displaying the target part and the picking guide path to the user through the display component; guiding the user to obtain the target part through the picking guide path; identifying the target part by using the visual recognition component to obtain measured parameter information; obtaining standard parameter information of the target part from a preset real-time part database; comparing the measured parameter information and the standard parameter information to obtain the part detection result corresponding to the target part.

[0009] Optionally, the wearable picking device further comprises a display component, and the virtual reality map is obtained by using the following steps: obtaining a plurality of warehouse design data, and generating a plurality of warehouse three-dimensional maps according to the plurality of warehouse design data; obtaining warehouse environment data, and scanning the warehouse environment data by using the visual recognition component to obtain an environment simulation map; for any one of the warehouse three-dimensional maps, superimposing the environment simulation map on the warehouse three-dimensional map to obtain a virtual layout map; The visual recognition component is used to generate warehouse working condition simulation information in the virtual layout map and display the information to the user through the display component. The virtual reality map is selected from the virtual layout maps in response to a map confirmation instruction issued by the user for the warehouse working condition simulation information.

[0010] Optionally, the virtual layout map includes at least one of part stacking information, part position information and warehouse passage information, the warehouse working condition simulation information includes stacking process simulation information and distribution process simulation information, the picking device includes a display component, and the use of the visual recognition component to generate warehouse working condition simulation information in the virtual layout map and display the information to the user through the display component includes: The target stacking information of the target part is determined according to the part stacking information; The visual recognition component is used to generate stacking process simulation information in the virtual layout map according to the target stacking information; The target position of the target part and the use position of the target part are determined according to the part position information, wherein the target position is the storage position of the target part; The distribution path of the target part is determined according to the target position, the use position and the warehouse passage information; The visual recognition component is used to generate distribution process simulation information in the virtual layout map according to the distribution path; The stacking process simulation information and / or distribution process simulation information are displayed to the user through the display component.

[0011] Optionally, the use of the visual recognition component to determine the device position of the wearable picking device in the virtual reality map and generate a picking guide path in the virtual reality map according to the device position and the target position includes: The visual recognition component is used to determine the device position of the wearable picking device in the virtual reality map; The picking guide path is generated in the virtual reality map according to the device position, the target position and the warehouse passage information.

[0012] In the second aspect of the embodiment of the present application, a vehicle part picking device is also provided, which is applied to a visual picking system including a wearable picking device including a visual recognition component, and the device includes: A task construction module is used to acquire vehicle configuration information and determine part picking tasks according to the vehicle configuration information; the part picking tasks include a plurality of target parts. A position determining module is configured to determine a target position of the target part in a virtual reality map according to the virtual reality map obtained in advance; A path generating module is configured to determine a device position of the wearable picking device in the virtual reality map by using the visual recognition component, and generate a picking guide path in the virtual reality map according to the device position and the target position. A part detecting module is configured to obtain the target part according to the picking guide path, and detect the target part by using the visual recognition component to obtain a part detection result corresponding to the target part. A result obtaining module is configured to determine a part picking result of the part picking task according to the part detection results corresponding to the target parts respectively.

[0013] In a third aspect, the present application also provides an electronic device, including a processor, a memory, and a computer program stored in the memory and capable of running on the processor, and when the computer program is executed by the processor, the method described above is implemented.

[0014] In a fourth aspect, the present application also provides a computer readable storage medium, and the computer readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described above is implemented.

[0015] The present application has the following advantages: by obtaining vehicle configuration information, determining a part picking task according to the vehicle configuration information, the part picking task including a plurality of target parts, the present application can automatically generate a part picking task by obtaining vehicle configuration information, without manually scanning SPS loading lists and sorting lists one by one, and can improve the efficiency of obtaining a part picking task by a user. According to a virtual reality map obtained in advance, a target position of a target part in the virtual reality map is determined, a device position of a wearable picking device in the virtual reality map is determined by using a visual recognition component, and a picking guide path in the virtual reality map is generated according to the device position and the target position, the present application can quickly locate a target part, and can obtain a picking guide path by means of logistics planning, to improve the efficiency of finding a target part. According to a picking guide path, a target part is obtained, the target part is detected by using a visual recognition component, a part detection result corresponding to the target part is obtained, and a part picking result of a part picking task is determined according to part detection results corresponding to the target parts respectively, the present application can automatically detect a picked target part by using a visual recognition component, without checking the picked part by comparing with SPS loading lists or sorting lists manually, and can improve the part detection efficiency and part picking quality. BRIEF DESCRIPTION OF DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description.

[0017] Figure 1 is a step flow chart of a vehicle part picking method provided by an embodiment of the present application; Figure 2 is a step flow chart of a picking process provided by an embodiment of the present application; Figure 3 is a step flow chart of a logistics planning provided by an embodiment of the present application; Figure 4 is a structural schematic diagram of a vehicle part picking device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0018] In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the following will describe the embodiments of the present application in detail with reference to the drawings. However, those skilled in the art can understand that in the embodiments of the present application, many technical details are proposed in order to make the readers better understand the present application. However, the technical solutions claimed by the present application can be realized even without these technical details and based on various changes and updates of the following embodiments. The following embodiments are classified for the convenience of description, and should not constitute any limitation on the specific implementation of the present application, and the embodiments can be combined and referenced with each other without contradiction.

[0019] In the related art, the business links in the field of manual picking of manufacturing logistics can include SPS loading display, SPS picking parts, SPS picking path, SPS picking quality confirmation, sorting display, sorting picking parts, sorting picking path, sorting picking quality detection. The business links in the field of manufacturing logistics planning can include part layout planning, warehouse entry and online path planning.

[0020] In the above business links, in order to reflect the real-time logistics dynamics in the system, it is usually necessary to manually hold various devices such as PAD, scanning gun, mobile phone and other terminal devices for information input, which is low in operation efficiency. It is also necessary for the staff to compare and check through the display screen, paper picking list, sorting picking list and other means to pick the materials, and through the light-on or checking method of the loading list, it is difficult to quickly find the goods, to immediately check and to effectively train new employees. After the picking is completed, the checking is performed through the manual visual inspection and comparison with the SPS loading list or the sorting list, which is low in efficiency and poor in effect, and is not conducive to quality improvement.

[0021] In addition, the simulation planning of the drawings is usually manually planned according to the site environment or actual work experience to obtain a planning scheme and a guiding path. The planning needs to rely on the experience and ability of the planner, and there is no effective planning tool and intuitive evaluation system.

[0022] Therefore, the present application provides a vehicle part picking method, device, electronic equipment and medium. The vehicle part picking task is automatically generated by obtaining vehicle configuration information, without manually scanning SPS loading list and sorting list one by one, which can improve the efficiency of users obtaining part picking tasks. And can quickly locate the target part, can get the picking guide path with the help of logistics planning, to improve the efficiency of finding goods. The visual recognition component is used to automatically detect the picked target part, without manually comparing the SPS loading list or sorting list to check the picked part, which can improve the part detection efficiency and part picking quality.

[0023] Reference Figure 1 Fig. 1 shows a step flow chart of a vehicle part picking method according to an embodiment of the present application.

[0024] In the embodiment of the present application, the vehicle part picking method can be applied to a visual picking system, and the visual picking system can include a wearable picking device, and the wearable picking device can include a visual recognition component.

[0025] It should be noted that the visual picking system can be a system that uses computer vision technology to assist or automate part picking. In the embodiment of the present application, the visual picking system can realize the positioning, identification and picking of target parts through image recognition and analysis. In a specific implementation, the visual picking system can be an AR interactive management system, which can realize AR (Augmented Reality) interaction and MR (Mixed Reality) interaction.

[0026] The wearable picking device can be a wearable device used to assist operators in positioning, identifying and path guiding during the picking process. In the embodiment of the present application, the wearable picking device can include a visual recognition component, a display component, a voice interaction component, an outbound scanning component, a signal processor and other devices capable of realizing AR interaction or MR interaction.

[0027] The visual recognition component can be a device for capturing and processing image information, usually including a camera and an image processing module, capable of recognizing target objects, scenes or gestures, providing visual input for the AR / MR system. In the embodiments of the present application, position determination and target part detection can be performed through the visual recognition component, and in addition, AR simulation can be performed through the visual recognition component. In specific implementation, the visual recognition component can be an AR head-mounted display or an MR head-mounted display.

[0028] The display component can be a device for superimposing virtual information (such as images, videos, 3D models, etc.) onto the real world and displaying it to the user. In the embodiments of the present application, the target part and the picking guide path can be displayed to the user through the display component.

[0029] The voice interaction component can be a device for human-computer interaction through voice, including a microphone and a voice recognition module, which can support users to communicate with the AR / MR system through voice instructions. In the embodiments of the present application, user confirmation of the target part can be realized through the voice interaction component. In specific implementation, the voice interaction component can be a hardware with voice interaction function.

[0030] The outbound scanning component can be a device for scanning and identifying articles, usually including a bar code scanner or a two-dimensional code scanner, used to quickly identify and record article information during the outbound process. In the embodiments of the present application, after the user obtains the target part, outbound scanning can be realized through the outbound scanning component. In specific implementation, the outbound scanning component can be a smart glove or a smart bracelet.

[0031] The signal processor can refer to a device for processing data collected by various sensors (such as cameras, microphones, gyroscopes, etc.), which can convert raw signals into usable information, supporting real-time calculation and feedback of the AR / MR system. In the embodiments of the present application, the information obtained by the above components can be processed through the signal processor.

[0032] The method can specifically include the following steps: S101, obtaining vehicle configuration information, and determining a part picking task according to the vehicle configuration information; the part picking task includes a plurality of target parts.

[0033] It should be noted that the vehicle configuration information can be detailed data describing the specific model, specifications, functions and components of the vehicle, usually including the brand, model, engine type, interior configuration, optional accessories and other information of the vehicle. In the embodiments of the present application, the target parts to be picked can be determined through the vehicle configuration information.

[0034] The parts picking task can be a task generated according to vehicle configuration information, and the purpose is to pick the required parts from the inventory to meet the assembly or maintenance needs of the vehicle. In the embodiment of the application, the parts picking task can be constructed in units of vehicles, that is, the target parts required for an entire vehicle can be included in each parts picking task.

[0035] The target part can be a specific part that needs to be picked in the parts picking task, which is usually determined according to the vehicle configuration information, such as engine parts, tires, seats, and vehicle lights. In the embodiment of the application, the parts picking task can be performed by picking the target part.

[0036] In the embodiment of the application, vehicle configuration information can be obtained, and the parts picking task including a plurality of target parts can be determined according to the vehicle configuration information. The parts picking task can be an SPS batching task or an order picking task.

[0037] In a specific implementation, the AR interaction management system can capture vehicle configuration information and corresponding part information that needs to be picked, generate an SPS batching task or an order picking task, and issue instructions to the corresponding wearable picking device through an AR head-mounted display and voice.

[0038] S102, determining a target position of the target part in the virtual reality map according to the pre-obtained virtual reality map.

[0039] It should be noted that the virtual reality map can be a digital map, which is usually used in AR / MR scenarios and can display virtual information (such as target position and path guidance) in a real environment in real time, helping users to navigate or operate in a virtual and real combined environment. In the embodiment of the application, the target position of the part and the picking guidance path can be obtained through the virtual reality map.

[0040] The target position can be a specific position of the target part in the virtual reality map, which is usually presented in the form of coordinates or markers. In the embodiment of the application, the target position can be the storage position of the target part.

[0041] In the embodiment of the application, the target position of the target part in the virtual reality map can be determined according to the pre-obtained virtual reality map.

[0042] S103, determining a device position of the wearable picking device in the virtual reality map by using the visual recognition component, and generating a picking guidance path in the virtual reality map according to the device position and the target position.

[0043] It should be noted that the device position can be a current position of the wearable picking device in the virtual reality map, which is usually determined by a visual recognition component or other positioning technology. In embodiments of the present application, the device position can also represent a current position of a user wearing the wearable picking device.

[0044] The picking guide path can be a path guide generated according to the device position and the target position, which can be used to guide the user to reach the position of the target part in embodiments of the present application.

[0045] In embodiments of the present application, a visual recognition component can be used to determine the device position of the wearable picking device in the virtual reality map, and a picking guide path can be generated in the virtual reality map according to the device position and the target position.

[0046] In specific implementations, the picking personnel can be prompted on the AR head-mounted display for the part information, position, and optimal walking path of each part to be picked one by one based on the current standing position of the picking personnel and the picking part pool.

[0047] S104, obtaining the target part according to the picking guide path, and detecting the target part by using the visual recognition component to obtain a part detection result corresponding to the target part.

[0048] It should be noted that the part detection result can be a result obtained by detecting the target part by using the visual recognition component, and can include identification information, state information, and position information of the part, etc. In embodiments of the present application, the part detection result can be used to indicate whether the picked part is the target part.

[0049] In embodiments of the present application, the target part can be obtained according to the picking guide path, and the visual recognition component can be used to detect the target part to obtain a part detection result corresponding to the target part.

[0050] In specific implementations, the warehouse-out scanning component, i.e., the smart glove or smart bracelet, can automatically perform warehouse-out scanning each time the user picks a target part.

[0051] S105, determining a part picking result of the part picking task according to the part detection results corresponding to the target parts respectively.

[0052] It should be noted that the part picking result can be a final determination of the completion of the part picking task according to the detection results of all target parts, such as whether all target parts are successfully picked. In embodiments of the present application, the part picking result can be a result of the part picking task.

[0053] In the embodiment of the present application, the part picking result of the part picking task can be determined according to the part detection results of the target parts respectively corresponding to the target parts.

[0054] In a specific implementation, if all the target parts in the current part picking task are picked, the operator can inform the AR interactive management system of the completion of the task through the voice interaction component. The AR interactive management system can consider that the current part picking task is completed after confirming that the quantity and quality of the picked target parts meet the requirements based on the part picking results of all the target parts in the current part picking task.

[0055] The present application can automatically generate a part picking task by obtaining vehicle configuration information, without manually scanning SPS loading and sequencing sheets one by one, thereby improving the efficiency of obtaining a part picking task by a user. The target position of the target part in the virtual reality map is determined according to the pre-obtained virtual reality map, the device position of the wearable picking device in the virtual reality map is determined by using the visual recognition component, and the picking guide path is generated in the virtual reality map according to the device position and the target position. The present application can quickly locate the goods and obtain the picking guide path with the help of logistics planning, thereby improving the efficiency of finding the goods. The target part is obtained according to the picking guide path, the visual recognition component is used to detect the target part to obtain the part detection result corresponding to the target part, and the part picking result of the part picking task is determined according to the part detection results of the target parts respectively corresponding to the target parts. The present application can automatically detect the picked target part by using the visual recognition component, without manually checking the picked part by comparing with the SPS loading and sequencing sheets, thereby improving the part detection efficiency and part picking quality.

[0056] In an optional embodiment of the present application, step 101 further comprises the following steps: S11, obtaining the identity tag of the vehicle, and identifying the identity tag to obtain the vehicle configuration information; S12, searching for a plurality of target parts corresponding to the vehicle configuration information in a preset real-time part database; S13, constructing a part picking task according to the plurality of target parts.

[0057] It should be noted that the identity tag can refer to a label or mark used to identify and distinguish individuals or objects. It can be a physical label, a digital identifier or a code for uniquely identifying a certain entity (such as a person, a device, an article, etc.). Identity tags have different forms and uses in different scenarios, and in the embodiments of the present application, the identity tag can be an RFID tag, a barcode, a two-dimensional code, etc. of the vehicle, which can identify the identity information of the vehicle or parts in logistics, warehousing, retail, etc. scenarios.

[0058] In the embodiments of the present application, the identity tag of the vehicle can be obtained, the vehicle configuration information is identified by recognizing the identity tag, a plurality of target parts corresponding to the vehicle configuration information are searched in a preset real-time part database, and a part picking task is constructed according to the plurality of target parts. The real-time part database can be a PFEP (Plan for Every Part) database.

[0059] In a specific implementation, after the vehicle to be assembled completes spraying in the painting workshop, it will be sent to the PBS (Pick-by-System) painted body storage area for waiting. Then, the control room releases the vehicle from the PBS stereoscopic warehouse through the scheduling system, the vehicle enters the assembly workshop through the conveying line, and when passing through the accurate sorting point, the configuration information of the vehicle is identified by scanning the RFID tag of the vehicle, and these information is uploaded to the production management system, such as LES (Logistics Execution System) or LMS (Logistics Management System). This process ensures the accuracy of vehicle configuration and smooth connection of production process.

[0060] The production management system downloads the vehicle configuration information and the real-time PFEP database to the AR interactive management system, the AR interactive management system grabs the vehicle configuration information and the part information that needs to be picked, generates an SPS ingredient task or a sorting picking task, and publishes instructions to the corresponding account of the wearable picking device through the AR head-mounted display screen and the voice interaction component.

[0061] Among them, the SPS ingredient task refers to selecting the required parts from the warehouse or material storage area according to the production plan and vehicle configuration information, and preparing them in a complete manner so as to be supplied to the production line subsequently. The sorting picking task refers to sorting and picking materials according to the needs of the production line to ensure that the materials can be supplied to the production line in the correct order. In the embodiments of the present application, the wearable picking device can be a device with corresponding account information, and the entire process from the allocation of the part picking task to the acquisition of the part picking result can be published to the wearable picking device through the corresponding account information.

[0062] The application realizes automatic and accurate part picking and supply by acquiring the identity tag of the vehicle and identifying the vehicle configuration information, and combining a real-time part database to generate a part picking task, and improves production efficiency and accuracy.

[0063] In an optional embodiment of the application, the wearable picking device further comprises a display component and a voice interaction component, and the part picking task further comprises picking order information.

[0064] Before step 102, the method further comprises: S21, sequentially displaying a plurality of target parts to a user through the display component according to the picking order information; wherein the user is a user wearing the wearable picking device; S22, receiving a voice confirmation instruction issued by the user for the target part through the voice interaction component.

[0065] It should be noted that in the SPS (Set Parts Supply) system, the picking order information can refer to detailed data and rules for guiding material picking and sorting. It can be used to ensure that materials are accurately and efficiently supplied to the designated workstations according to the needs of the production line. In the embodiment of the application, the picking order information can represent the picking order of the target part.

[0066] In the embodiment of the application, a plurality of target parts can be sequentially displayed to a user through the display component according to the picking order information, and a voice confirmation instruction issued by the user for the target part can be received through the voice interaction component. Wherein the user is a user wearing the wearable picking device.

[0067] In a specific implementation, the operator of the wearable picking device corresponding to the account can receive a digital image and a voice task through an AR head-mounted display screen or an MR head-mounted display screen to replace the original paper picking list. The digital image can be an image of the target part, and the voice task can be a picking task for the target part displayed in the current AR head-mounted display screen or MR head-mounted display screen.

[0068] The operator of the wearable picking device corresponding to the account can perform task confirmation through the voice interaction component, that is, issue a voice confirmation instruction for the target part displayed in the current AR head-mounted display screen or MR head-mounted display screen, which can replace the original confirmation mode such as mobile phone, PAD, handheld scanning gun, etc.

[0069] Through the display component and the voice interaction component of the wearable picking device, and in combination with the picking order information, the application realizes the sequential display and voice confirmation of the target part, improves the operation convenience and efficiency, reduces the use of paper picking lists and traditional confirmation modes, and enhances the user experience and operation accuracy.

[0070] In an optional embodiment of the present application, step 104 further comprises the following steps: S31, displaying the target part and the picking guide path to the user through the display component; S32, guiding the user to obtain the target part through the picking guide path; S33, identifying the target part by using the visual recognition component to obtain measured parameter information; S34, obtaining standard parameter information of the target part from a preset real-time part database; S35, comparing the measured parameter information and the standard parameter information to obtain a part detection result corresponding to the target part.

[0071] It should be noted that the measured parameter information can refer to part-related data obtained by actual measurement or scanning in the material picking or supply process. In the embodiment of the present application, the measured parameter information can be obtained by identifying the target part by using the visual recognition component.

[0072] The standard parameter information refers to part specification and requirement data obtained from the preset real-time part database. These data are the basis for picking and supply, and are used for comparison with the measured parameters. In the embodiment of the present application, the standard parameter information is stored in the real-time part database.

[0073] In the embodiment of the present application, the target part and the picking guide path can be displayed to the user through the display component, the user can be guided to obtain the target part through the picking guide path, the target part can be identified by using the visual recognition component to obtain the measured parameter information, the standard parameter information of the target part can be obtained from the preset real-time part database, the measured parameter information and the standard parameter information can be compared, and the part detection result corresponding to the target part can be obtained.

[0074] In a specific implementation, a virtual reality map can be preset in the AR interaction management system, wherein the virtual reality map can be a digital twin layout map (part level) of the on-site layout. Once the task is confirmed, the visual recognition component can generate a picking guide path by scanning the device position of the wearable picking device, that is, the position of the operator, and display the picking guide path and the target part on the display component, that is, the AR head-mounted display screen.

[0075] The operator selects the target parts one by one according to the picking guide path and the target parts displayed by the display component. In the process of picking each target part, the visual recognition component compares the 3D shape, color and barcode information of the actual acquired part with the part corresponding to the target part code in the preset database, and confirms that the actual acquired part is consistent with the part corresponding to the target part code in the preset database. After that, it is considered that the user has completed the picking of the target part, and the next target part in the part picking task can be prompted, that is, the next target part and the picking guide path required to acquire the next target part are displayed.

[0076] The present application realizes accurate picking and path guidance of target parts through virtual reality maps and visual recognition components, ensures the comparison between actual parameters and standard parameters, improves the accuracy and efficiency of picking, reduces human errors, and optimizes the operation process.

[0077] In related technologies, in the logistics planning business, virtual reality maps cannot be obtained, and thus the existing planning situation cannot be verified, new planning schemes cannot be demonstrated, and the optimal online path cannot be identified. Therefore, the present application proposes the following way to obtain a virtual reality map.

[0078] In an optional embodiment of the present application, the wearable picking device further comprises a display component, and the virtual reality map is obtained by the following steps: S41, obtain a plurality of warehouse design data, and generate a plurality of warehouse three-dimensional maps according to the plurality of warehouse design data; S42, obtain warehouse environment data, and obtain an environment simulation map by scanning the warehouse environment data using the visual recognition component; S43, for any warehouse three-dimensional map, superimpose the environment simulation map on the warehouse three-dimensional map to obtain a virtual layout map; S44, generate warehouse working condition simulation information in the virtual layout map using the visual recognition component and display the information to the user through the display component; S45, in response to a map confirmation instruction issued by the user for the warehouse working condition simulation information, select the virtual reality map from the plurality of virtual layout maps.

[0079] It should be noted that the warehouse design data can refer to the data generated during the planning and design stage of the warehouse, including the layout of the warehouse, the position of the shelf, the width of the channel, the division of the storage area, etc. It can be used to generate a three-dimensional map of the warehouse, helping to simulate and optimize the actual operating environment of the warehouse. In the embodiment of the present application, the warehouse three-dimensional map can be obtained according to the warehouse design data.

[0080] The warehouse three-dimensional map can be a three-dimensional model generated based on warehouse design data, showing the three-dimensional structure and layout of the warehouse. An intuitive visual effect of the warehouse can be provided to facilitate the user to understand the spatial distribution and equipment position of the warehouse. In the embodiment of the present application, the warehouse three-dimensional map can include the storage position of the target part.

[0081] The warehouse environment data can refer to the environment information in the actual operation of the warehouse, such as shelf state, material placement position, channel occupation, etc. It can be used to generate an environment simulation map to reflect the real-time state of the warehouse. In the embodiment of the present application, the warehouse environment data can be obtained by scanning through the visual recognition component.

[0082] The environment simulation map can refer to a map generated by scanning the warehouse environment data through the visual recognition component, reflecting the real-time state and environment characteristics of the warehouse. It can be superimposed on the warehouse three-dimensional map to form a more realistic virtual layout map. In the embodiment of the present application, the environment simulation map can be a map generated according to the warehouse environment data.

[0083] The virtual layout map can refer to a map generated by superimposing the environment simulation map on the warehouse three-dimensional map, combining the static design and dynamic environment of the warehouse. It can provide a virtual reality display of the warehouse to help the user simulate and optimize the operation of the warehouse. In the embodiment of the present application, the virtual layout map can be a candidate virtual reality map, and the user can select a virtual reality map from a plurality of virtual layout maps.

[0084] The warehouse working condition simulation information can refer to warehouse operation simulation data generated in the virtual layout map, such as material flow path, picking task allocation, equipment running state, etc. In the embodiment of the present application, the warehouse working condition simulation information can be displayed to the user through the display component to help the user evaluate and optimize the operation efficiency of the warehouse.

[0085] The map confirmation instruction can refer to a confirmation instruction issued by the user for the warehouse working condition simulation information, indicating the user's approval of the current virtual layout map. In the embodiment of the present application, the map confirmation instruction can be used to select the final virtual reality map from a plurality of virtual layout maps.

[0086] The virtual reality map can refer to the virtual layout map confirmed by the user, combining the three-dimensional design and real-time environment data of the warehouse. In the embodiment of the present application, the virtual reality map can be used as a reference for warehouse operation and optimization to help achieve efficient material picking and supply.

[0087] In the embodiment of the present application, a plurality of warehouse design data can be acquired, a plurality of warehouse three-dimensional maps are generated according to the plurality of warehouse design data, warehouse environment data is acquired, an environment simulation map is obtained by scanning the warehouse environment data using a visual recognition component, for any warehouse three-dimensional map, the environment simulation map is superimposed on the warehouse three-dimensional map to obtain a virtual layout map. Among them, the virtual layout map of different versions corresponds to different warehouse three-dimensional maps.

[0088] In the embodiment of the present application, the warehouse working condition simulation information can be generated in the virtual layout map by using the visual recognition component and displayed to the user through the display component, and in response to the map confirmation instruction issued by the user for the warehouse working condition simulation information, the virtual reality map is selected from the plurality of virtual layout maps.

[0089] In specific implementation, the user can use CAD or other drawing software to plan the layout arrangement of more than one version of parts, and mark the use station of the parts in the assembly line. The layout arrangement of parts and the use station of parts in the assembly line are used as warehouse design data.

[0090] The user can generate a digital twin warehouse three-dimensional map based on the warehouse design data, which can also be a 3D model. The warehouse three-dimensional map includes the positioning, stacking height, quantity, channel, and assembly line use station of each target part in the map. The positioning can refer to the specific placement position of materials or equipment in the warehouse, the stacking height can refer to the maximum stacking height allowed when storing materials, the quantity can refer to the specific quantity of materials or goods, the channel can refer to the passageway in the warehouse for transportation and walking, and the assembly line use station can refer to the working position on the assembly line for completing a specific process.

[0091] Then the warehouse three-dimensional map, that is, the 3D model, can be imported into the AR interactive management system. The user uses the visual recognition component, that is, the AR visual recognition sensor, to scan the entire scene. After scanning, the warehouse environment data is obtained. The AR interactive management system and the actual environment are matched with the model, that is, the environment simulation map is superimposed on the warehouse three-dimensional map to generate a virtual layout map, that is, an AR virtual layout.

[0092] The user wears the above-mentioned wearable picking equipment. In the actual scene corresponding to the virtual layout map, the visual recognition component, that is, the AR visual recognition sensor, senses the environment in real time, and the virtual layout after the parts are positioned, the online path and the flow rate on the display component, that is, the AR head-mounted display screen. Among them, the online path can refer to the transportation path of materials from the warehouse to the production line. The flow rate can refer to the flow rate or quantity of materials in the warehouse or on the production line.

[0093] The user can observe the positioning, stacking, channel, vehicle operation and driving track, traffic flow and congestion of each part in the field, intuitively and quantitatively plan the field survey, and compare the virtual layout map of each version with the actual object. The vehicle operation refers to the specific operation behavior of the vehicle in the warehouse or during transportation, such as loading and unloading, moving, etc. The driving track refers to the driving route of the vehicle in the warehouse or on the road. The road traffic refers to the number of vehicles passing on the road. The congestion refers to the congestion caused by the dense vehicles in the warehouse or on the road.

[0094] In a specific implementation, when performing the logistics planning service, the user can import the 3D area model, part data (including part number, part name, outer size, size of part packaging, SNP standard packaging quantity, stacking height), channel rule, warehouse three-dimensional map and online station, that is, the use position of the target part, into the AR interaction management system. The system converts these information into an AR reality virtual environment and displays the layout and path on the AR head-mounted display screen. The planner can perform virtual verification and experience through the display screen, evaluate the feasibility and rationality of the planning scheme, and quantify the area utilization rate, channel traffic and operation efficiency of the planning.

[0095] The present application generates a virtual reality map by acquiring warehouse design data and environment data, and realizes virtual simulation and working condition simulation of warehouse layout by combining a visual recognition component and a display component. The user can intuitively evaluate the feasibility and optimization effect of different planning schemes, improve the efficiency and accuracy of logistics planning, reduce the cost and time of field survey, and provide a scientific basis and decision support for logistics planning.

[0096] In an optional embodiment of the present application, the virtual layout map includes at least one of part stacking information, part position information and warehouse channel information, the warehouse working condition simulation information includes stacking process simulation information and distribution process simulation information, and the picking equipment includes a display component.

[0097] Step S44 further includes the following steps: S51, determining target stacking information of the target part according to the part stacking information; S52, generating stacking process simulation information in the virtual layout map according to the target stacking information by using the visual recognition component; S53, determining the target position of the target part and the use position of the target part according to the part position information, wherein the target position is the storage position of the target part; S54, determining the distribution path of the target part according to the target position, the use position and the warehouse channel information; S55, generating, by the visual recognition component, delivery process simulation information in the virtual layout map according to the delivery path; S56, displaying, by the display component, the stacking process simulation information and / or the delivery process simulation information to the user.

[0098] In the embodiment of the present application, the target stacking information of the target part can be determined according to the part stacking information, and the visual recognition component can be used to generate stacking process simulation information in the virtual layout map according to the target stacking information. The target stacking information includes the landing position and / or the stacking height of the target part. The stacking process simulation information is a simulation process of stacking the target part.

[0099] In the embodiment of the present application, the target position of the target part and the use position of the target part can be determined according to the part position information. The target position is the storage position of the target part. The use position is the position of the use station of the target part. The delivery path of the target part is determined according to the target position, the use position and the warehouse channel information. The visual recognition component is used to generate delivery process simulation information in the virtual layout map according to the delivery path. The warehouse channel information can include at least one of the channel, vehicle operation and driving track, traffic and congestion. The delivery process simulation information is a simulation process of delivering the target part.

[0100] In the embodiment of the present application, the stacking process simulation information and / or the delivery process simulation information can be displayed to the user through the display component.

[0101] The present application combines part stacking information and position information to generate stacking and delivery process simulation information, and displays the information to the user through the display component, realizes virtual simulation and path planning of parts in the warehouse, improves the intuitiveness and scientificity of logistics planning, optimizes the warehouse operation efficiency and material delivery path, and reduces errors and resource waste in actual operation.

[0102] In an optional embodiment of the present application, step 103 includes the following steps: S61, determining, by the visual recognition component, the device position of the wearable picking device in the virtual reality map; S62, generating, in the virtual reality map, a picking guide path according to the device position, the target position and the warehouse channel information.

[0103] In the embodiment of the present application, the visual recognition component can be used to determine the device position of the wearable picking device in the virtual reality map, and then generate a picking guide path in the virtual reality map according to the device position, the target position and the warehouse channel information.

[0104] The application realizes accurate picking path planning and real-time navigation by real-time positioning of the wearable picking device in the virtual reality map through the visual recognition component, generating a picking guide path combining the target position and warehouse channel information, improving picking efficiency and accuracy, and reducing misoperation and time waste in the picking process.

[0105] Referring to Figure 2 , a step flowchart of a picking process provided by an embodiment of the application is shown. In specific implementation, the picking process can be implemented with reference to Figure 2 .

[0106] Start parking 201, after the vehicle to be assembled completes spraying in the painting workshop, it will be sent to the PBS painted body storage area for waiting. Then, the control room releases the vehicle from the PBS stereoscopic warehouse through the scheduling system, and the vehicle enters the general assembly workshop through the conveying line.

[0107] Precise sorting point scanning 202, when the vehicle passes through the precise sorting point, the configuration information of the vehicle is identified by scanning the RFID tag of the vehicle, and the information is uploaded to the production management system.

[0108] Vehicle configuration information comparison 203, the production management system downloads the vehicle configuration information and the real-time PFEP database to the AR interactive management system. The vehicle configuration information can be compared with the part information in the real-time PFEP database.

[0109] Confirm target parts 204, confirm the target parts that need to be picked from the real-time PFEP database through the vehicle configuration information.

[0110] Constructing part picking task 205, constructing the part picking task according to the target parts.

[0111] Determine whether the task matches the configuration information 206, determine whether the part picking task matches the vehicle configuration information, if the part picking task does not match the vehicle configuration information, re-perform the vehicle configuration information comparison 203 step. If the part picking task matches the vehicle configuration information, proceed to the next step.

[0112] Target part display 207, the user can receive digital images and voice tasks through the AR head-mounted display screen or the MR head-mounted display screen to replace the original paper picking list. The digital image can be an image of the target part, and the voice task can be a picking task for the target part displayed in the current AR head-mounted display screen or MR head-mounted display screen.

[0113] Voice confirmation 208, the user can confirm the task through the voice interaction component, that is, issue a voice confirmation instruction to the target part displayed in the current AR head-mounted display or MR head-mounted display, which can replace the original mobile phone, PAD, handheld scanner and other confirmation methods.

[0114] Virtual reality map acquisition 209, the target position of the target part in the virtual reality map can be determined according to the pre-acquired virtual reality map.

[0115] Generate picking guide path 210, determine the device position of the wearable picking device in the virtual reality map by using the visual recognition component, and then generate the picking guide path in the virtual reality map according to the device position, the target position and the warehouse channel information.

[0116] Part picking 211, the user picks the parts, and the warehouse scanning component, that is, the smart glove or smart bracelet can automatically scan the warehouse for each target part picked by the user.

[0117] Part detection 212, in the process of picking each target part, the visual recognition component compares the actual acquired part with the 3D shape of the part corresponding to the target part code in the preset database, the color of the part, and the barcode information of the part, and confirms that the actual acquired part is consistent with the part corresponding to the target part code in the preset database. After the target part code, it is considered that the user has completed the picking of the target part.

[0118] Picking the next part 213, the next target part in the part picking task is prompted, that is, the next target part and the picking guide path required to obtain the next target part are displayed.

[0119] Part picking result confirmation 214, if all the target parts in the current part picking task are picked, the operator can notify the AR interactive management system that the task is completed through the voice interaction component, and the AR interactive management system acquires the part picking result corresponding to all the target parts in the current part picking task.

[0120] Picking task end 215, if the quantity and quality of the picked parts in the part picking result meet the requirements, the current part picking task can be considered to be completed. At this time, the current part picking task can be ended, and the next part picking task can be acquired.

[0121] Reference Figure 3 , a step flowchart of logistics planning provided by an embodiment of the present application is shown. In specific implementation, logistics planning can be performed with reference to Figure 3 .

[0122] Planning start 301, logistics planning can be started.

[0123] Obtaining warehouse design data 302, warehouse design data 303, warehouse design data 304, users can use drawing software such as CAD to plan different versions of warehouse layouts, and warehouse design data 302, warehouse design data 303, and warehouse design data 304 are different versions of warehouse design data.

[0124] Obtaining positioning channel drawings 305, positioning channel drawings 306, and positioning channel drawings 307, positioning channel drawings 305 can be obtained based on warehouse design data 302, positioning channel drawings 306 can be obtained based on warehouse design data 303, and positioning channel drawings 307 can be obtained based on warehouse design data 304. The positioning channel drawings include the positioning and channel information in the corresponding warehouse design data. Among them, the positioning can refer to the specific placement position of materials or equipment in the warehouse, and the channel can refer to the passageway in the warehouse for transportation and walking.

[0125] Generating warehouse three-dimensional maps 308, warehouse three-dimensional maps 309, and warehouse three-dimensional maps 310, the warehouse three-dimensional map 308 can be generated based on the positioning channel drawing 305, the warehouse three-dimensional map 309 can be generated based on the positioning channel drawing 306, and the warehouse three-dimensional map 310 can be generated based on the positioning channel drawing 307. The warehouse three-dimensional map can be a three-dimensional model generated based on the warehouse design data, which can show the three-dimensional structure and layout of the warehouse. The warehouse three-dimensional map, that is, the 3D digital model, is imported into the AR interactive management system.

[0126] Obtaining environment simulation map 311, the environment simulation map can refer to a map generated by scanning the warehouse environment data through a visual recognition component, which can reflect the real-time state and environmental characteristics of the warehouse.

[0127] Generating virtual layout maps 312, virtual layout maps 313, and virtual layout maps 314, the virtual layout map 312 is obtained by superimposing the environment simulation map 311 on the warehouse three-dimensional map 308, the virtual layout map 313 is obtained by superimposing the environment simulation map 311 on the warehouse three-dimensional map 309, and the virtual layout map 314 is obtained by superimposing the environment simulation map 311 on the warehouse three-dimensional map 310. The virtual layout map can provide a virtual reality display of the warehouse, helping users to simulate and optimize the operation of the warehouse.

[0128] The warehouse working condition information 315, the warehouse working condition information 316 and the warehouse working condition information 317 are generated, the corresponding warehouse working condition information 315 is generated according to the virtual layout map 312, the corresponding warehouse working condition information 316 is generated according to the virtual layout map 313, and the corresponding warehouse working condition information 317 is generated according to the virtual layout map 314. The warehouse working condition simulation information can refer to warehouse operation simulation data generated in the virtual layout map, and includes stacking process simulation information and distribution process simulation information. The user wears the above-mentioned wearable picking device, in the actual scene corresponding to the virtual layout map, the environment is perceived in real time through the visual recognition component, that is, the AR visual recognition sensor, and the warehouse working condition simulation information is presented on the display component, that is, the AR head-mounted display screen, that is, the virtual layout after the parts are positioned, and the online path or flow information and the like.

[0129] It is judged whether the warehouse working condition information meets the requirements 318. If the warehouse working condition information meets the preset conditions, for example, the warehouse working condition information meets the preset standards of one or more of the positioning, stacking height, channel, vehicle operation and driving track, flow and congestion, the virtual layout map corresponding to the warehouse working condition information can be used as a virtual reality map. If the warehouse working condition information does not meet the preset conditions, the logistics planning can be re-performed. The user can also observe the positioning, stacking height, channel, vehicle operation and driving track, flow and congestion of each part in the field, intuitively and quantitatively plan the on-site investigation, and compare the virtual layout map with the actual object.

[0130] The virtual reality map 319 can generate the warehouse working condition simulation information in the virtual layout map by using the visual recognition component and display the information to the user through the display component, and select the virtual reality map from a plurality of virtual layout maps in response to the map confirmation instruction issued by the user for the warehouse working condition simulation information.

[0131] Referring to Figure 4 , a structure schematic diagram of a vehicle part picking device provided by an embodiment of the application is shown, the device comprises: The task construction module 401 is used for acquiring vehicle configuration information, determining a part picking task according to the vehicle configuration information, and the part picking task includes a plurality of target parts. The position determination module 402 is used for determining a target position of the target part in the virtual reality map according to a pre-acquired virtual reality map. The path generation module 403 is used for determining a device position of the wearable picking device in the virtual reality map by using the visual recognition component, and generating a picking guide path in the virtual reality map according to the device position and the target position. The part detection module 404 is configured to acquire the target part according to the picking guide path, and detect the target part by using the visual recognition component to obtain a part detection result corresponding to the target part. The result acquisition module 405 is configured to determine a part picking result of the part picking task according to the part detection results corresponding to the target parts respectively.

[0132] In an optional embodiment of the present application, the task construction module 401 comprises: The label acquisition sub-module is configured to acquire an identity label of the vehicle, and identify the identity label to obtain the vehicle configuration information. The part searching sub-module is configured to search for the target parts corresponding to the vehicle configuration information in a preset real-time part database. The task construction sub-module is configured to construct the part picking task according to the target parts.

[0133] In an optional embodiment of the present application, the wearable picking device further comprises a display component and a voice interaction component, and the part picking task further comprises picking order information. Before the target position of the target part in the virtual reality map is determined according to the virtual reality map acquired in advance, the device further comprises: The part display module is configured to display the target parts to the user in sequence through the display component according to the picking order information, wherein the user is a user wearing the wearable picking device. The part confirmation module is configured to receive a voice confirmation instruction issued by the user for the target part through the voice interaction component.

[0134] In an optional embodiment of the present application, the part detection module 404 comprises: The path display sub-module is configured to display the target part and the picking guide path to the user through the display component. The path guiding sub-module is configured to guide the user to acquire the target part through the picking guide path. The measured parameter acquisition sub-module is configured to identify the target part by using the visual recognition component to obtain measured parameter information. The standard parameter acquisition sub-module is configured to acquire standard parameter information of the target part from a preset real-time part database. The detection result acquisition sub-module is configured to compare the measured parameter information and the standard parameter information to obtain a part detection result corresponding to the target part.

[0135] In an optional embodiment of the present application, the wearable picking device further comprises a display component, and the virtual reality map is obtained by the following means: The design data acquisition module is configured to acquire a plurality of warehouse design data, and generate a plurality of warehouse three-dimensional maps based on the plurality of warehouse design data; The environment data acquisition module is configured to acquire warehouse environment data, and obtain an environment simulation map by scanning the warehouse environment data using the visual recognition component; The map superimposition module is configured to superimpose the environment simulation map on any of the warehouse three-dimensional maps to obtain a virtual layout map; The working condition simulation display module is configured to generate warehouse working condition simulation information in the virtual layout map using the visual recognition component and display the information to the user through the display component; The map confirmation module is configured to select the virtual reality map from the plurality of virtual layout maps in response to a map confirmation instruction issued by the user for the warehouse working condition simulation information.

[0136] In an optional embodiment of the present application, the virtual layout map comprises at least one of part stacking information, part position information, and warehouse passage information, the warehouse working condition simulation information comprises stacking process simulation information and distribution process simulation information, the picking device comprises a display component, and the working condition simulation display module comprises: The stacking information acquisition submodule is configured to determine target stacking information of the target part based on the part stacking information; The stacking process simulation submodule is configured to generate stacking process simulation information in the virtual layout map based on the target stacking information using the visual recognition component; The position information acquisition submodule is configured to determine the target position of the target part and the use position of the target part based on the part position information, wherein the target position is the storage position of the target part; The distribution path acquisition submodule is configured to determine the distribution path of the target part based on the target position, the use position, and the warehouse passage information; The distribution process simulation submodule is configured to generate distribution process simulation information in the virtual layout map based on the distribution path using the visual recognition component; The stacking and distribution display submodule is configured to display the stacking process simulation information and / or the distribution process simulation information to the user through the display component.

[0137] In an optional embodiment of the present application, the path generation module 403 comprises: An equipment position acquisition submodule is configured to determine an equipment position of the wearable picking equipment in the virtual reality map by using the visual recognition component. A guide path generation submodule is configured to generate a picking guide path in the virtual reality map according to the equipment position, the target position, and the warehouse passage information.

[0138] For the device embodiments, they are basically similar to the method embodiments, and thus are described more simply, and the related parts can be referred to the part of the description of the method embodiments.

[0139] An embodiment of the present application further provides an electronic device, which can comprise a processor, a memory and a computer program stored on the memory and capable of running on the processor, and the computer program is executed by the processor to realize the method as described above.

[0140] An embodiment of the present application further provides a computer readable storage medium, and the computer readable storage medium stores a computer program, and the computer program is executed by a processor to realize the method as described above.

[0141] It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of the related data need to comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for the user to choose authorization or refusal.

[0142] Each embodiment in the present specification is described in a progressive manner, and each embodiment focuses on the different parts from other embodiments, and the same and similar parts between each embodiment can be referred to each other.

[0143] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, device or computer program product. Therefore, the embodiments of the present application can be in the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware aspects. Moreover, the embodiments of the present application can be in the form of a computer program product implemented on one or more computer usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer usable program codes.

[0144] The embodiments of the present application are described with reference to the flowchart illustrations and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal devices to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal devices, create means for implementing the functions specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams.

[0145] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal devices to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams.

[0146] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal devices, such that a series of operational steps are performed on the computer or other programmable terminal devices to produce a computer implemented process so that the instructions which execute on the computer or other programmable terminal devices provide steps for implementing the functions specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams. Figure 1 one or more functions specified in the flowchart illustrations and / or block diagrams.

[0147] Although preferred embodiments of the present application have been described, those skilled in the art will be able to make additional modifications and variations to these embodiments without departing from the scope of the present application. Accordingly, the appended claims are intended to encompass all such modifications and variations as falling within the scope of the present application.

[0148] Finally, it is to be understood that the phraseology or terminology such as "first" and "second" etc. used herein is merely intended to differentiate one entity or operation from another entity or operation, without necessarily requiring or implying any actual such relationship or order between such entities or operations. Moreover, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises... a" does not, without more constraints, exclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the aforesaid element.

[0149] The above provides a vehicle part picking method, device, electronic equipment and medium, and the principles and implementation manners of the present application are described by applying specific examples in the present article. The above example is only used to help understand the method of the present application and its core idea. Meanwhile, for those skilled in the art, according to the idea of the present application, the specific implementation manner and application range can be changed, and the content of the present article should not be understood as a limitation of the present application.

Claims

1. A vehicle parts picking method, characterized by, The application is applied to a visual sorting system, the visual sorting system comprises a wearable sorting device, the wearable sorting device comprises a visual recognition component, and the method comprises the following steps: Obtain vehicle configuration information, and determine a part sorting task according to the vehicle configuration information; the part sorting task comprises a plurality of target parts; Determine a target position of the target part in a virtual reality map according to the virtual reality map obtained in advance; Determine a device position of the wearable sorting device in the virtual reality map by using the visual recognition component, and generate a sorting guide path in the virtual reality map according to the device position and the target position; Obtain the target part according to the sorting guide path, detect the target part by using the visual recognition component, and obtain a part detection result corresponding to the target part; Determine a part sorting result of the part sorting task according to a plurality of part detection results corresponding to the target parts.

2. The method of claim 1, wherein, The method for obtaining vehicle configuration information and determining a part sorting task according to the vehicle configuration information comprises the following steps: Obtain an identity tag of a vehicle, and identify the identity tag to obtain the vehicle configuration information; Find a plurality of target parts corresponding to the vehicle configuration information in a preset real-time part database; Construct a part sorting task according to the plurality of target parts.

3. The method of claim 1, wherein, The wearable sorting device further comprises a display component and a voice interaction component, the part sorting task further comprises sorting order information, and before the target position of the target part in the virtual reality map is determined according to the virtual reality map obtained in advance, the method further comprises the following steps: Display the plurality of target parts to a user in sequence through the display component according to the sorting order information; wherein the user is a user wearing the wearable sorting device; Receive a voice confirmation instruction issued by the user for the target part through the voice interaction component.

4. The method of claim 3, wherein, The method for obtaining the target part according to the sorting guide path, detecting the target part by using the visual recognition component, and obtaining a part detection result corresponding to the target part comprises the following steps: Display the target part and the sorting guide path to the user through the display component; Guide the user to obtain the target part through the sorting guide path; Identify the target part by using the visual recognition component to obtain measured parameter information; Obtain standard parameter information of the target part from a preset real-time part database; Compare the measured parameter information and the standard parameter information to obtain the part detection result corresponding to the target part.

5. The method of claim 1, wherein, The wearable sorting device further comprises a display component, and the virtual reality map is obtained by the following steps: Obtain a plurality of warehouse design data, and generate a plurality of warehouse three-dimensional maps according to the plurality of warehouse design data; Obtain warehouse environment data, and scan the warehouse environment data to obtain an environment simulation map by using the visual recognition component; For any one of the warehouse three-dimensional maps, superimpose the environment simulation map on the warehouse three-dimensional map to obtain a virtual layout map; The visual recognition component is used to generate warehouse working condition simulation information in the virtual layout map and display the information to the user through the display component; The virtual reality map is selected from the virtual layout maps in response to a map confirmation instruction issued by the user for the warehouse working condition simulation information.

6. The method of claim 5, wherein, The virtual layout map includes at least one of part stacking information, part position information and warehouse passage information, the warehouse working condition simulation information includes stacking process simulation information and distribution process simulation information, the picking device includes a display component, and the visual recognition component is used to generate warehouse working condition simulation information in the virtual layout map and display the information to the user through the display component, including: The target stacking information of the target part is determined according to the part stacking information; The visual recognition component is used to generate stacking process simulation information in the virtual layout map according to the target stacking information; The target position of the target part and the use position of the target part are determined according to the part position information, wherein the target position is the storage position of the target part; The distribution path of the target part is determined according to the target position, the use position and the warehouse passage information; The visual recognition component is used to generate distribution process simulation information in the virtual layout map according to the distribution path; The stacking process simulation information and / or distribution process simulation information are displayed to the user through the display component.

7. The method of claim 6, wherein, The visual recognition component is used to determine the device position of the wearable picking device in the virtual reality map, and a picking guide path is generated in the virtual reality map according to the device position and the target position, including: The visual recognition component is used to determine the device position of the wearable picking device in the virtual reality map; A picking guide path is generated in the virtual reality map according to the device position, the target position and the warehouse passage information.

8. A vehicle part picking device, characterized in that The device is applied to a visual picking system, the visual picking system includes a wearable picking device, the wearable picking device includes a visual recognition component, and the device includes: A task construction module is used to acquire vehicle configuration information, determine part picking tasks according to the vehicle configuration information, and the part picking tasks include target parts; A position determination module is used to determine target positions of the target parts in a virtual reality map according to the virtual reality map; A path generation module is used to determine a device position of the wearable picking device in the virtual reality map by using the visual recognition component, and generate a picking guide path in the virtual reality map according to the device position and the target position; A part detection module is used to acquire the target parts according to the picking guide path, detect the target parts by using the visual recognition component, and obtain part detection results corresponding to the target parts; A result acquisition module is used to determine part picking results of the part picking tasks according to the part detection results corresponding to the target parts respectively.

9. An electronic device, comprising: A computer program product comprising a computer readable storage medium having stored thereon computer program means, the computer program means comprising computer readable program code configured to, when executed on a processor, cause the processor to carry out the method according to any of claims 1-7.

10. A computer-readable storage medium, characterized in that, A computer program product comprising a computer readable storage medium having stored thereon computer program means, the computer program means comprising computer readable program code configured to, when executed on a processor, cause the processor to carry out the method according to any of claims 1-7.

Images