Wire harness installation method and device, equipment and storage medium

Abstract

The invention discloses a wire harness installation method and device, equipment and a storage medium. Comprising the steps of obtaining a current user installation image in a cabin, and determining a target installation step according to the user installation image; a target installation tool is determined based on the target installation step, and the target installation tool is provided for a user for wire harness installation through a wire harness installation robot; and acquiring a wire harness installation image, and generating a wire harness installation result according to the wire harness installation image. A target installation step is determined through an acquired current user installation image, then a target installation tool is matched through the target installation step, the determined corresponding target installation tool is further provided for a user for wire harness installation through a wire harness installation robot, and finally quality inspection is performed on the wire harness installation image. According to the invention, a man-machine cooperation mode is adopted, the manual workload is reduced, the conditions of installation errors and improper inspection are effectively avoided, and the working efficiency and quality of civil aircraft wire harness installation are further improved.

Description

Technical Field

[0001] The present invention relates to the technical field of aviation final assembly, and in particular to a wire harness installation method, device, equipment and storage medium. Background Art

[0002] With the continuous development of science and technology, human-machine collaboration is an inevitable trend to achieve high-efficiency and high-quality aircraft manufacturing. In terms of flexibility and complexity, aviation wiring harness installation is the most typical. The wiring harness installation process is complex and has many requirements, such as bracket installation, clamp installation, wiring harness lifting and pre-installation, wiring harness fixing, connector plug seat matching and tightening, etc. Each installation process has strict process control process and acceptance requirements. In the quality acceptance link, it is also necessary to achieve rapid inspection, problem traceability and process optimization.

[0003] In the prior art, the installation and acceptance process of the wiring harness is mainly manual and serial work flow. However, the prior art is prone to installation errors and inadequate inspection through manual installation and inspection, which reduces the work efficiency and quality of civil aircraft wiring harness installation. Summary of the invention

[0004] The present invention provides a wire harness installation method, device, equipment and storage medium, so as to realize high-efficiency and high-quality installation of aircraft wire harnesses through human-machine collaboration technology.

[0005] According to one aspect of the present invention, there is provided a wiring harness installation method, the method comprising:

[0006] Acquire a current user installation image in the cabin, and determine a target installation step according to the user installation image;

[0007] Determine a target installation tool based on the target installation steps, and provide the target installation tool to the user for wire harness installation through a wire harness installation robot;

[0008] A wire harness installation image is acquired, and a wire harness installation result is generated according to the wire harness installation image.

[0009] Optionally, obtaining the current user installation image in the cabin includes: taking a designated area set by the user as a target area; when it is recognized that the target area includes the target user, capturing an image in the target area as the current user installation image.

[0010] Optionally, determining the target installation step based on the user installation image includes: extracting the corresponding target installation action in the user installation image; obtaining an installation step identification model, wherein the installation step identification model contains the correspondence between each installation action and the installation step; and inputting the target installation action into the installation step identification model to obtain the target installation step output by the installation step identification model.

[0011] Optionally, obtaining an installation step recognition model includes: obtaining historical user installation images of a target area within a specified time range; obtaining user-labeled sample data based on the historical user installation images, wherein the sample data includes installation actions and installation steps; building a multimodal perception model network structure, and performing deep learning on the sample data through the multimodal perception model network structure to generate an installation step recognition model.

[0012] Optionally, determining a target installation tool based on a target installation step includes: obtaining a preset installation tool list, wherein the installation tool list includes a correspondence between installation steps and installation tools; and matching the target installation step through the installation tool list to obtain a target installation tool corresponding to the target installation step.

[0013] Optionally, generating a wire harness installation result based on the wire harness installation image includes: extracting quality inspection indicators from the wire harness installation image, wherein the quality inspection indicators include wire harness spacing, bending radius and slack; judging whether the quality inspection indicators meet preset conditions, and if so, determining that the wire harness installation result is qualified in installation quality; otherwise, determining that the wire harness installation result is unqualified in installation quality.

[0014] Optionally, after determining that the wiring harness installation result is unqualified in installation quality, it also includes: obtaining an inspection report template, combining each quality inspection indicator with the inspection report template to generate an inspection report; using quality inspection indicators that do not meet preset conditions as target inspection indicators; generating inspection prompt information based on the target inspection indicators; and sending the inspection report and inspection prompt information to the user terminal for display.

[0015] According to another aspect of the present invention, there is provided a wiring harness installation device, the device comprising:

[0016] A target installation step determination module is used to obtain a current user installation image in the cabin and determine a target installation step according to the user installation image;

[0017] A target installation tool determination module is used to determine a target installation tool based on a target installation step, and provide the target installation tool to a user for wire harness installation through a wire harness installation robot;

[0018] The wiring harness installation result generation module is used to obtain the wiring harness installation image and generate the wiring harness installation result according to the wiring harness installation image.

[0019] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0020] at least one processor; and

[0021] a memory communicatively connected to the at least one processor; wherein,

[0022] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute a wire harness installation method described in any embodiment of the present invention.

[0023] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement a wiring harness installation method described in any embodiment of the present invention when executed.

[0024] The technical solution of the embodiment of the present invention determines the target installation steps by acquiring the current user installation image, then matches the target installation tool through the target installation steps, and further provides the corresponding target installation tool to the user for wire harness installation through a wire harness installation robot, and finally performs a quality inspection on the wire harness installation image to generate a wire harness installation result. The human-machine collaboration method is adopted to reduce the manual workload, and effectively avoid installation errors and inadequate inspections, thereby improving the work efficiency and quality of civil aircraft wire harness installation.

[0025] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0027] Figure 1 is a flow chart of a wiring harness installation method provided according to Embodiment 1 of the present invention;

[0028] Figure 2 is a flow chart of another wiring harness installation method provided according to Embodiment 1 of the present invention;

[0029] Figure 3 is a flow chart of another wiring harness installation method provided according to Embodiment 2 of the present invention;

[0030] Figure 4 is a structural schematic diagram of a wiring harness installation device provided according to Embodiment 3 of the present invention;

[0031] Figure 5It is a structural schematic diagram of an electronic device for implementing a wiring harness installation method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0032] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0033] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0034] Embodiment 1

[0035] Figure 1 A flowchart of a wire harness installation method is provided for the first embodiment of the present invention. This embodiment is applicable to the installation of wire harnesses at an aircraft assembly site. The method can be performed by a wire harness installation device, which can be implemented in the form of hardware and / or software, and can be configured in a computer. Figure 1 As shown, the method includes:

[0036] S110: Acquire a current user installation image in the cabin, and determine a target installation step according to the user installation image.

[0037] Among them, the current user installation image refers to an image of the user who is currently installing the wire harness in the cabin. The user installation image contains the installation steps that the user is performing, that is, the target installation steps. The user refers to the staff or technician who performs the wire harness installation. The wire harness is a component in the cabin of a civil passenger aircraft. The aircraft wire harness is related to the aircraft electrical, avionics, fire control and control systems. It is a neural network that provides power sources, control signals and data information for various components of the aircraft. Therefore, the correctness and reliability of the wire harness installation plays a vital role in ensuring the reliable operation of the entire aircraft. The wire harness installation specifically includes the installation steps of bracket installation, clamp installation, wire harness lifting and pre-installation, wire harness fixing, and connector plug and socket tightening.

[0038] Figure 2 A flowchart of a wiring harness installation method is provided for the first embodiment of the present invention, wherein step S110 mainly includes the following steps S111 to S114:

[0039] S111. Acquire the current user installation image in the cabin.

[0040] Optionally, obtaining the current user installation image in the cabin includes: taking a designated area set by the user as a target area; when it is recognized that the target area includes the target user, capturing an image in the target area as the current user installation image.

[0041] Specifically, the user can set a designated area in the cabin as the target area according to the installation situation, and the image acquisition device connected to the controller will continuously detect the target area, wherein the controller refers to a computer controller that controls the operation of the wire harness installation robot, the image acquisition device can be a camera, and the target user refers to a user who is performing wire harness installation. When the camera recognizes that the target area includes the wire harness installer, it will immediately capture the image in the target area as the current user's installation image.

[0042] S112: Extract the corresponding target installation action in the user installation image.

[0043] Specifically, action recognition technology can be used to extract the installation action being performed by the user in the user installation image, and use it as the target installation action corresponding to the user installation image. The target installation action can then be used to further determine the installation steps being performed by the current user, so that the wire harness installation robot can perform auxiliary work.

[0044] S113: Acquire an installation step identification model, wherein the installation step identification model includes a correspondence between each installation action and the installation step.

[0045] Optionally, obtaining an installation step recognition model includes: obtaining historical user installation images of a target area within a specified time range; obtaining user-labeled sample data based on the historical user installation images, wherein the sample data includes installation actions and installation steps; building a multimodal perception model network structure, and performing deep learning on the sample data through the multimodal perception model network structure to generate an installation step recognition model.

[0046] Specifically, the installation step recognition model refers to a model based on action recognition, multimodal signal fusion and intention recognition that is pre-trained by the user. The installation step recognition model contains the correspondence between each installation action and the installation step. The target installation step corresponding to the target installation action can be determined through the installation step recognition model. When establishing the installation step recognition model, the controller will obtain the historical user installation images of the target area within the specified time range. The historical user installation image refers to the image corresponding to each installation step when the user installs the wiring harness within the specified time range. The user can mark the historical user installation image to generate sample data. In addition, the user can also input the installation action to the controller by wearing a motion capture device, and mark the installation steps to generate sample data. The user can build the network structure of the initial model according to the training needs. Finally, the controller can perform deep learning on the sample data through the built multimodal perception model network structure to generate an installation step recognition model for identifying the installation action.

[0047] S114. Input the target installation action into the installation step recognition model to obtain the target installation step output by the installation step recognition model.

[0048] Specifically, since the correspondence between each installation action and the installation step has been pre-learned in the installation step recognition model, after the target installation action is input into the installation step recognition model, the installation step recognition model performs recognition and feature comparison, and can output the target installation step corresponding to the target installation action.

[0049] S120: Determine a target installation tool based on the target installation step, and provide the target installation tool to the user for wire harness installation via a wire harness installation robot.

[0050] Specifically, different installation steps require users to use different installation tools to operate. There are many types of installation tools, such as wire stripping tools, crimping pliers, pick-up and delivery tools, cable tie guns, and hot air guns. If the user manually selects the tool before each installation step, it will take a lot of time and reduce the efficiency of the wire harness installation. Therefore, the human-machine collaboration method is adopted in this embodiment. After the controller determines the target installation tool corresponding to the target installation step, it will provide the target installation tool to the user through the wire harness installation robot for wire harness installation, which can reduce the time for users to find and take the installation tools by themselves, and effectively improve the efficiency of wire harness installation. It should be noted that the robot arm of the wire harness installation robot is fully compatible with different wire harness installation tools, and can correspond one to one. In addition, when humans and machines work together, the robot can sense the actions of the operator, identify his intentions, and can cooperate seamlessly to give full play to their respective strengths.

[0051] Optionally, determining a target installation tool based on a target installation step includes: obtaining a preset installation tool list, wherein the installation tool list includes a correspondence between installation steps and installation tools; and matching the target installation step through the installation tool list to obtain a target installation tool corresponding to the target installation step.

[0052] Specifically, the installation tool list refers to a list of installation tools corresponding to the installation steps. The user can set the installation tool list according to the installation needs. For example, the installation tool list includes installation tool 01 corresponding to installation step A and installation tool 03 corresponding to installation step B. By matching the target installation step with the installation tool list, the target installation tool corresponding to the target installation step can be determined. For example, when the target installation step is B, the corresponding target installation tool 03 can be determined.

[0053] S130: Acquire a wire harness installation image, and generate a wire harness installation result according to the wire harness installation image.

[0054] Furthermore, the controller can also check the quality of the wire harness installation based on machine vision. For example, the wire harness installation quality can be detected in real time through machine vision, that is, the wire harness installation image is obtained. The wire harness installation result is generated based on the wire harness installation image. For example, it can be determined whether the wire harness spacing, bending radius, and slackness meet the standards to generate the wire harness installation result. During the installation process of each installation step, rapid inspection, problem traceability, and process re-optimization can be achieved. This embodiment achieves fast and accurate wire harness installation and result inspection by completing the bracket installation, clamp installation, and wire harness fixing under human-machine collaborative operation.

[0055] The technical solution of the embodiment of the present invention determines the target installation steps by acquiring the current user installation image, then matches the target installation tool through the target installation steps, and further provides the corresponding target installation tool to the user for wire harness installation through a wire harness installation robot, and finally performs a quality inspection on the wire harness installation image to generate a wire harness installation result. The human-machine collaboration method is adopted to reduce the manual workload, and effectively avoid installation errors and inadequate inspections, thereby improving the work efficiency and quality of civil aircraft wire harness installation.

[0056] Embodiment 2

[0057] Figure 3 This is a flowchart of a wiring harness installation method provided in the second embodiment of the present invention. This embodiment adds a specific description of the process of generating a wiring harness installation result according to the wiring harness installation image on the basis of the above-mentioned first embodiment. Among them, the specific contents of steps S210-S220 are roughly the same as steps S110-S120 in the first embodiment, so they will not be repeated in this embodiment. Figure 3 As shown, the method includes:

[0058] S210: Acquire a current user installation image in the cabin, and determine a target installation step according to the user installation image.

[0059] Optionally, obtaining the current user installation image in the cabin includes: taking a designated area set by the user as a target area; when it is recognized that the target area includes the target user, capturing an image in the target area as the current user installation image.

[0060] Optionally, determining the target installation step based on the user installation image includes: extracting the corresponding target installation action in the user installation image; obtaining an installation step identification model, wherein the installation step identification model contains the correspondence between each installation action and the installation step; and inputting the target installation action into the installation step identification model to obtain the target installation step output by the installation step identification model.

[0061] Optionally, obtaining an installation step recognition model includes: obtaining historical user installation images of a target area within a specified time range; obtaining user-labeled sample data based on the historical user installation images, wherein the sample data includes installation actions and installation steps; building a multimodal perception model network structure, and performing deep learning on the sample data through the multimodal perception model network structure to generate an installation step recognition model.

[0062] S220: Determine a target installation tool based on the target installation step, and provide the target installation tool to the user for wire harness installation through a wire harness installation robot.

[0063] Optionally, determining a target installation tool based on a target installation step includes: obtaining a preset installation tool list, wherein the installation tool list includes a correspondence between installation steps and installation tools; and matching the target installation step through the installation tool list to obtain a target installation tool corresponding to the target installation step.

[0064] S230, acquiring a wire harness installation image, and extracting quality inspection indicators from the wire harness installation image, wherein the quality inspection indicators include a wire harness spacing, a bending radius, and a slack.

[0065] S240, determine whether the quality inspection index meets the preset conditions, if so, execute S250, otherwise, execute S260.

[0066] S250: Determine that the wiring harness installation result is of qualified installation quality.

[0067] S260: Determine that the wiring harness installation result is unqualified in installation quality.

[0068] Specifically, the controller can extract corresponding quality inspection indicators from the harness installation image. For example, harness spacing, bending radius, and slack. The controller can use machine vision to quickly check the quality of harness installation, and determine whether the harness spacing, bending radius, slack, etc. meet the standards to generate the harness installation result. When the quality inspection indicator meets the preset conditions, it can be determined that the harness installation result is qualified. When the quality inspection indicator does not meet the preset conditions, the harness installation result is determined to be unqualified.

[0069] Optionally, after determining that the wiring harness installation result is unqualified in installation quality, it also includes: obtaining an inspection report template, combining each quality inspection indicator with the inspection report template to generate an inspection report; using quality inspection indicators that do not meet preset conditions as target inspection indicators; generating inspection prompt information based on the target inspection indicators; and sending the inspection report and inspection prompt information to the user terminal for display.

[0070] Specifically, the controller will also obtain the inspection report template, and then determine the target position corresponding to each quality inspection indicator according to the inspection report template, and generate an inspection report by combining each quality inspection indicator with the inspection report template according to the target position. By sending the inspection report to the user terminal for display, the user can clearly understand the results of the wiring harness installation. The user terminal refers to a mobile terminal connected to the controller, and the user terminal includes but is not limited to mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers) and PMPs (portable multimedia players) and other mobile terminal devices.

[0071] Furthermore, the controller will use the quality inspection indicators that do not meet the preset conditions as target inspection indicators, and then generate inspection prompt information based on the target inspection indicators. The prompt information is generated to facilitate users to promptly understand the situation where the quality of the wiring harness installation results is unqualified, so that users can check and adjust the installation steps to ensure the stability and reliability of the aircraft.

[0072] The technical solution of the embodiment of the present invention determines the target installation steps by acquiring the current user installation image, then matches the target installation tool through the target installation steps, and further provides the corresponding target installation tool to the user for wire harness installation through a wire harness installation robot, and finally performs a quality inspection on the wire harness installation image to generate a wire harness installation result. The human-machine collaboration method is adopted to reduce the manual workload, and effectively avoid installation errors and inadequate inspections, thereby improving the work efficiency and quality of civil aircraft wire harness installation.

[0073] Embodiment 3

[0074] Figure 4 This is a schematic diagram of the structure of a wiring harness installation device provided in Embodiment 3 of the present invention. Figure 4 As shown, the device includes: a target installation step determination module 310, which is used to obtain the current user installation image in the cabin and determine the target installation step according to the user installation image;

[0075] A target installation tool determination module 320, for determining a target installation tool based on a target installation step, and providing the target installation tool to a user for wire harness installation via a wire harness installation robot;

[0076] The wire harness installation result generating module 330 is used to obtain a wire harness installation image and generate a wire harness installation result according to the wire harness installation image.

[0077] Optionally, the target installation step determination module 310 specifically includes: a current user installation image acquisition unit, which is used to: use a designated area set by the user as a target area; when it is recognized that the target area includes a target user, capture an image in the target area as a current user installation image.

[0078] Optionally, the target installation step determination module 310 specifically includes: a target installation action extraction unit, used to extract the corresponding target installation action in the user installation image; an installation step identification model acquisition unit, used to obtain an installation step identification model, wherein the installation step identification model contains the correspondence between each installation action and the installation step; the target installation step determination unit is used to input the target installation action into the installation step identification model to obtain the target installation step output by the installation step identification model.

[0079] Optionally, an installation step recognition model acquisition unit is specifically used to: obtain historical user installation images of the target area within a specified time range; obtain user-labeled sample data based on the historical user installation images, wherein the sample data includes installation actions and installation steps; build a multimodal perception model network structure, and perform deep learning on the sample data through the multimodal perception model network structure to generate an installation step recognition model.

[0080] Optionally, the target installation tool determination module 320 is specifically used to: obtain a preset installation tool list, wherein the installation tool list includes the correspondence between installation steps and installation tools; match the target installation step through the installation tool list to obtain the target installation tool corresponding to the target installation step.

[0081] Optionally, the wiring harness installation result generation module 330 is specifically used to: extract quality inspection indicators from the wiring harness installation image, wherein the quality inspection indicators include wiring harness spacing, bending radius and slack; determine whether the quality inspection indicators meet preset conditions, and if so, determine that the wiring harness installation result is qualified in installation quality; otherwise, determine that the wiring harness installation result is unqualified in installation quality.

[0082] Optionally, the device also includes: an inspection prompt display module, which is used to: after determining that the wiring harness installation result is unqualified in installation quality, obtain an inspection report template, combine each quality inspection indicator with the inspection report template to generate an inspection report; use the quality inspection indicators that do not meet the preset conditions as target inspection indicators; generate inspection prompt information based on the target inspection indicators; and send the inspection report and inspection prompt information to the user terminal for display.

[0083] The technical solution of the embodiment of the present invention determines the target installation steps by acquiring the current user installation image, then matches the target installation tool through the target installation steps, and further provides the corresponding target installation tool to the user for wire harness installation through a wire harness installation robot, and finally performs a quality inspection on the wire harness installation image to generate a wire harness installation result. The human-machine collaboration method is adopted to reduce the manual workload, and effectively avoid installation errors and inadequate inspections, thereby improving the work efficiency and quality of civil aircraft wire harness installation.

[0084] A wiring harness installation device provided in an embodiment of the present invention can execute a wiring harness installation method provided in any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method.

[0085] Embodiment 4

[0086] Figure 5A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0087] like Figure 5 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0088] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0089] The processor 11 can be various general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The processor 11 executes the various methods and processes described above, such as a wire harness installation method. That is: obtain the current user installation image in the cabin, determine the target installation steps according to the user installation image; determine the target installation tool based on the target installation step, and provide the target installation tool to the user through the wire harness installation robot for wire harness installation; obtain the wire harness installation image, and generate the wire harness installation result according to the wire harness installation image.

[0090] In some embodiments, a wiring harness installation method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of a wiring harness installation method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform a wiring harness installation method in any other appropriate manner (e.g., by means of firmware).

[0091] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0092] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0093] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0094] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0095] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0096] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0097] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0098] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A wiring harness installation method, characterized in that: include: Acquire a current user installation image in the cabin, and determine a target installation step according to the user installation image; Determining a target installation tool based on the target installation step, and providing the target installation tool to a user for wire harness installation by a wire harness installation robot; A wire harness installation image is acquired, and a wire harness installation result is generated according to the wire harness installation image.

2. The method according to claim 1, characterized in that The obtaining of the current user installation image in the cabin includes: The designated area set by the user is used as the target area; When it is recognized that the target area includes the target user, an image of the target area is captured as the current user installation image.

3. The method according to claim 2, characterized in that The step of determining the target installation according to the user installation image comprises: Extracting the target installation action corresponding to the user installation image; Acquire an installation step identification model, wherein the installation step identification model includes a correspondence between each installation action and the installation step; The target installation action is input into the installation step recognition model to obtain the target installation step output by the installation step recognition model.

4. The method according to claim 3, characterized in that The step of obtaining the installation step identification model includes: Get the historical user installation image of the target area within the specified time range; Acquiring user-marked sample data based on the historical user installation image, wherein the sample data includes installation actions and installation steps; A multimodal perception model network structure is constructed, and deep learning is performed on the sample data through the multimodal perception model network structure to generate the installation step recognition model.

5. The method according to claim 1, characterized in that The step of determining a target installation tool based on the target installation step includes: Obtaining a preset installation tool list, wherein the installation tool list includes a correspondence between installation steps and installation tools; The target installation step is matched with the installation tool list to obtain a target installation tool corresponding to the target installation step.

6. The method according to claim 1, characterized in that Generating a wiring harness installation result according to the wiring harness installation image includes: Extracting quality inspection indicators from the harness installation image, wherein the quality inspection indicators include harness spacing, bend radius, and slack; Determining whether the quality inspection index meets the preset conditions, and if so, determining that the wiring harness installation result is qualified in installation quality; Otherwise, it is determined that the wiring harness installation result is unqualified in installation quality.

7. The method according to claim 6, characterized in that After determining that the wiring harness installation result is unqualified in installation quality, the method further includes: Obtaining an inspection report template, and combining each of the quality inspection indicators with the inspection report template to generate an inspection report; Use quality inspection indicators that do not meet preset conditions as target inspection indicators; Generate inspection prompt information according to the target inspection indicator; The inspection report and the inspection prompt information are sent to the user terminal for display.

8. A wiring harness installation device, characterized in that: include: a target installation step determination module, configured to obtain a current user installation image in the cabin and determine a target installation step according to the user installation image; A target installation tool determination module, used to determine a target installation tool based on the target installation step, and provide the target installation tool to a user for wire harness installation through a wire harness installation robot; The wire harness installation result generating module is used to obtain the wire harness installation image and generate the wire harness installation result according to the wire harness installation image.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the method according to any one of claims 1 to 7.

10. A computer storage medium, characterized in that: The computer storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the method according to any one of claims 1 to 7 when executed.

Images