Device inspection method, apparatus and system
By automatically activating the inspection module after the vehicle is powered on, performing electrical inspection, operation guidance, and photo taking tasks, the problem of low efficiency and poor accuracy caused by manual intervention in existing technologies is solved, achieving efficient and accurate equipment inspection.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- YINWANG INTELLIGENT TECHNOLOGIES CO LTD
- Filing Date
- 2026-01-27
- Publication Date
- 2026-05-26
AI Technical Summary
In the existing technology, the electrical testing, assembly and quality inspection of vehicles in the final assembly line require a large amount of manual labor and external mechanical equipment, which is inefficient, costly and prone to omissions and missed inspections.
The inspection module automatically starts after the equipment is powered on, performing electrical inspection tasks, operation guidance tasks, and photo taking tasks, reducing manual operation and improving inspection efficiency and accuracy.
It reduced labor costs, decreased the risk of scratches on the vehicle's infotainment screen, improved inspection efficiency and accuracy, and reduced instances of missing parts and incorrect configurations.
Smart Images

Figure CN122085012A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of inspection technology, and in particular to a method, apparatus and system for inspecting equipment. Background Technology
[0002] Before equipment rolls off the final assembly line, it needs to complete processes such as assembly, electrical testing, and quality inspection. For example, before a vehicle rolls off the final assembly line, it needs to complete processes such as plugging in wiring harnesses, tightening bolts, assembling components such as seats and trim panels, and electrical testing to ensure that the controller versions in the vehicle are consistent and the functional parameters are normal. After passing off-line quality inspection and other matters, the vehicle is delivered only after confirming that its condition meets the requirements.
[0003] With the development of intelligent vehicles, the hardware and software configurations of vehicles are becoming increasingly diverse. However, in the related technologies, the electrical testing, assembly, and quality inspection processes of vehicles require a large amount of manual labor and external mechanical equipment, resulting in low inspection efficiency, high costs, and a high risk of missed inspections. Summary of the Invention
[0004] This application provides a method, apparatus, and system for equipment inspection, which improves the efficiency and accuracy of equipment inspection on the production line.
[0005] In a first aspect, this application provides a device inspection method applied to an inspection module of a first device, comprising: upon powering on the first device, executing a startup process of the inspection module, wherein the inspection module is used to inspect the first device; and after the startup process is completed, executing an inspection task corresponding to the inspection station where the first device is located.
[0006] In this way, users do not need to operate the vehicle's large screen. The inspection module can automatically start based on the power-on of the first device. After the vehicle arrives at the corresponding position, the inspection module can automatically execute the vehicle's inspection process, avoiding human error (such as incorrect selection of inspection process or inspection steps), reducing labor costs, reducing the risk of the vehicle's large screen being scratched, and improving the inspection efficiency and accuracy of vehicles on the inspection production line.
[0007] In one possible implementation, the inspection station includes one or more of the following inspection tasks: electrical inspection, operation instruction, and / or photography.
[0008] The inspection module can perform electrical inspection tasks, operation guidance tasks, and / or photography tasks at the inspection station where the first device is located. The operation guidance tasks may include quality inspection operation guidance tasks and / or assembly operation guidance tasks, etc. Users can complete operations based on the operation guidance tasks.
[0009] In this way, the inspection module can automatically perform electrical inspection tasks at the electrical inspection station; perform assembly operation guidance tasks at the assembly station to guide users in assembly; and perform quality inspection operation guidance tasks and photo taking tasks at the quality inspection station to guide users in assembly and conduct quality inspection via camera. This improves inspection efficiency and accuracy.
[0010] In one possible implementation, after the startup process is completed, the method further includes: obtaining the inspection station and the inspection task corresponding to the inspection station from the second device, wherein the second device is used to determine the inspection station of the first device on the inspection production line.
[0011] In this way, the inspection module can determine the workstation where the first device is located, so as to automatically execute the inspection task corresponding to the inspection workstation and reduce labor costs.
[0012] In one possible implementation, the inspection task includes an electrical inspection task, which includes performing one or more of the following operations on the first device: controller software upgrade, configuration parameter writing, software and hardware version verification, routine learning, third-party calibration, security certificate injection or key injection.
[0013] In this way, the inspection module can automatically perform electrical inspection tasks such as controller software upgrade, configuration parameter writing, software and hardware version verification, routine learning, third-party calibration, security certificate filling or key filling without manual operation when the first device is located at the electrical inspection station. This reduces labor costs, reduces the risk of scratching the vehicle's large screen, and improves the efficiency of electrical inspection of the first device.
[0014] In one possible implementation, the inspection task includes an operation guidance task, which includes: outputting a first prompt; the first prompt is used to guide the user on the operation process at the inspection station.
[0015] For example, an assembly operation guidance task may include outputting a first prompt. This first prompt is used to guide the user through the assembly operation process at the assembly station. For example, the first prompt may include: assembling component A, and specific assembly operation steps. The user can complete the assembly task based on the first prompt.
[0016] For another example, the quality inspection operation guidance task may include outputting a first prompt. This first prompt is used to guide the user through the quality inspection operation process at the quality inspection station. For example, the first prompt may include: quality inspection component A, and specific quality inspection operation steps. The user can complete the quality inspection task based on the first prompt.
[0017] In this way, by interacting with the user in real time through the screen of the first device, the user can refer to the first prompts to complete the operation task, reduce the situation of missing parts or incorrect configuration, improve the user's assembly qualification rate and quality inspection qualification rate of the first device, and improve the delivery efficiency of the first device.
[0018] In one possible implementation, outputting the first prompt includes: outputting the first prompt via a display module, and / or outputting the first prompt via an audio module.
[0019] In one possible implementation, the method further includes: receiving a first confirmation message from the user, the first confirmation message being used to instruct the user to complete the operation process.
[0020] In this way, when the user completes the assembly task or the quality inspection task, the first confirmation message indicates that the first equipment has completed the operable process, thereby improving the user interaction experience and operational reliability.
[0021] In one possible implementation, the inspection task includes a photo-taking task, which includes: controlling a camera in a first device to acquire image data, and acquiring the image data acquired by the camera in the first device; the image data is used to indicate the assembly result in the first device.
[0022] In this way, by calling the camera of the first device to collect image data, there is no need to add other camera devices, which reduces costs. The inspection module can intercept vehicles with faults and report the faults to the manufacturing execution system (MES) for processing, so that users can repair the faults and improve the delivery efficiency of the first device.
[0023] In one possible implementation, the photo-taking task also includes controlling the camera to adjust the shooting range.
[0024] For example, the inspection module can control the camera's movement and / or rotation to capture images from different directions within the vehicle. Alternatively, the inspection module can control the camera's zoom to capture images with different framing ranges. The inspection module can also switch between multiple cameras to capture image data from multiple cameras.
[0025] In this way, image data from various scenarios can be acquired, improving the quality and effectiveness of the image data.
[0026] In one possible implementation, the method further includes: sending image data; using the image data for image analysis on an electrical inspection server and / or terminal device; receiving the image analysis results and outputting a second prompt; the second prompt being used to indicate the assembly result.
[0027] Assembly results can include whether the assembly quality is up to standard and whether the assembly is accurate. For example, this could include whether the wiring harness connections are in place, whether the seat colors are accurate, and whether the door panel colors are accurate. Users can determine whether the assembly is up to standard based on the assembly results.
[0028] In one possible implementation, the inspection task includes an electrical inspection task and an operation guidance task. Based on the first inspection station where the first equipment is located, the inspection task corresponding to the first inspection station is executed, including: based on the first inspection station where the first equipment is located, executing the electrical inspection task corresponding to the first inspection station; if the electrical inspection task is completed, executing the operation guidance task corresponding to the second inspection station based on the first equipment; or, if the electrical inspection task is not completed, executing the electrical inspection task corresponding to the first inspection station and the operation guidance task corresponding to the second inspection station based on the second inspection station of the first equipment.
[0029] In this way, multiple different types of inspection tasks can be executed in parallel, improving inspection efficiency.
[0030] In one possible implementation, the inspection task includes a first electrical inspection task and a second electrical inspection task; the first electrical inspection task and the second electrical inspection task are executed sequentially.
[0031] In this way, multiple inspection tasks of the same type can be executed sequentially, reducing the impact between inspection tasks and lowering the inspection failure rate.
[0032] In one possible implementation, after the inspection module automatically starts upon power-up of the first device, the method further includes: sending a first request message to the electrical inspection server; the first request message is used to request one or more of the following: an electrical inspection task, an operation guidance task, and / or a photo-taking task; receiving a first response message from the electrical inspection server; the first response message carries one or more of the following: an electrical inspection task, an operation guidance task, and / or a photo-taking task.
[0033] In this way, the inspection module can obtain inspection tasks from the electrical inspection server.
[0034] In one possible implementation, after the verification module starts automatically when the first device is powered on, the method further includes: sending a second request message to the second device; the second request message is used to request one or more of the following: an operation guidance task and / or a photo-taking task; receiving a second response message from the second device; the second response message carries one or more of the following: an operation guidance task and / or a photo-taking task.
[0035] In this way, the inspection module can obtain inspection tasks from the second device, MES.
[0036] In one possible implementation, the method further includes: enabling the automatic inspection function based on the user's first operation; the automatic inspection function includes executing the inspection task corresponding to the inspection station where the first device is located; or, disabling the automatic inspection function based on the user's second operation.
[0037] In some scenarios, such as when vehicles are undergoing assembly testing and verification on the production line, there is no need to perform certain electrical inspection or photo-taking tasks. Users can enable or disable the automatic inspection function, improving the user experience and enhancing the applicability of the inspection module.
[0038] Secondly, this application provides a device inspection method applied to an electrical inspection server, comprising: receiving a first request message from a first device; the first request message being used to request one or more of the following: an electrical inspection task, an operation guidance task, and / or a photo-taking task; sending a first response message to the first device based on the first request message; the first response message carrying one or more of the following: an electrical inspection task, an operation guidance task, and / or a photo-taking task.
[0039] In one possible implementation, sending a first response message to a first device based on a first request message includes: sending a third request message to a second device; the third request message is used to request one or more of the following: an operation guidance task and / or a photo-taking task; receiving a third response message from the second device; the third response message carries one or more of the following: an operation guidance task and / or a photo-taking task; and sending a first response message to the first device based on the first request message and the third response message.
[0040] In one possible implementation, the method further includes: receiving image data from a first device and preset assembly information from a second device; generating image analysis results based on the image data and the preset assembly information; and sending the image analysis results.
[0041] Thirdly, this application provides a device inspection method applied to a second device, comprising: receiving a second request message from a first device; the second request message being used to request one or more of the following: an operation guidance task and / or a photo-taking task; sending a second response message to the first device based on the second request message; the second response message carrying one or more of the following: an operation guidance task and / or a photo-taking task.
[0042] Fourthly, this application provides an equipment inspection system, including a first device, a second device, and an electrical inspection server; the first device includes an inspection module; the second device is used to determine the inspection station of the first device on the inspection production line and the inspection task corresponding to the inspection station; the electrical inspection server is used to obtain the inspection task corresponding to the inspection station from the second device; the inspection module of the first device is used to obtain the inspection task corresponding to the inspection station from the electrical inspection server and obtain the inspection station of the first device on the inspection production line from the second device; the inspection module is also used to execute the inspection task corresponding to the inspection station based on the inspection station of the first device on the inspection production line; the inspection module is used to execute the startup process of the inspection module based on the power-on of the first device.
[0043] In one possible implementation, the inspection station includes one or more of the following inspection tasks: electrical inspection, operation instruction, and / or photography.
[0044] In one possible implementation, the inspection task includes an electrical inspection task, which includes performing one or more of the following operations on the first device: controller software upgrade, configuration parameter writing, software and hardware version verification, routine learning, third-party calibration, security certificate injection or key injection.
[0045] In one possible implementation, the inspection task includes an operation guidance task, which includes: the inspection module outputting a first prompt; the first prompt being used to guide the user on the operation process at the inspection station.
[0046] In one possible implementation, the verification module is used to output a first prompt via the display module, and / or via the audio module.
[0047] In one possible implementation, the verification module is used to receive a first confirmation message from the user, which instructs the user to complete the operation process.
[0048] In one possible implementation, the inspection task includes a photo-taking task, which includes: controlling a camera in a first device to acquire image data, and acquiring the image data acquired by the camera in the first device; the image data is used to indicate the assembly result in the first device.
[0049] In one possible implementation, the photo-taking task also includes controlling the camera to adjust the shooting range.
[0050] In one possible implementation, the inspection module is used to send image data to the electrical inspection server and / or terminal device; the image data is used for image analysis on the electrical inspection server and / or terminal device; the electrical inspection server and / or terminal device is used to perform image analysis on the image data, obtain image analysis results, and send the image analysis results to the inspection module; the inspection module is used to receive the image analysis results and output a second prompt; the second prompt is used to indicate the assembly result.
[0051] In one possible implementation, the inspection task includes an electrical inspection task and an operation guidance task. The inspection module is used to execute the electrical inspection task corresponding to the first inspection station where the first equipment is located; if the electrical inspection task is completed, it executes the operation guidance task corresponding to the second inspection station of the first equipment; or, if the electrical inspection task is not completed, it executes both the electrical inspection task corresponding to the first inspection station and the operation guidance task corresponding to the second inspection station of the first equipment.
[0052] In one possible implementation, the inspection task includes a first electrical inspection task and a second electrical inspection task; the first electrical inspection task and the second electrical inspection task are executed sequentially.
[0053] In one possible implementation, the inspection module is used to send a first request message to the electrical inspection server; the first request message is used to request one or more of the following: electrical inspection task, operation guidance task and / or photo taking task; the electrical inspection server is used to send a first response message to the inspection module based on the first request message; the first response message carries one or more of the following: electrical inspection task, operation guidance task and / or photo taking task; the inspection module is used to receive the first response message from the electrical inspection server.
[0054] In one possible implementation, the verification module sends a second request message to the second device; the second request message requests one or more of the following: an operation guidance task and / or a photo-taking task; the second device sends a second response message to the verification module based on the second request message; the second response message carries one or more of the following: an operation guidance task and / or a photo-taking task. The verification module receives the second response message from the second device.
[0055] In one possible implementation, the inspection module is used to enable the automatic inspection function based on the user's first operation; the automatic inspection function includes executing the inspection task corresponding to the inspection station where the first device is located; or, the inspection module is used to disable the automatic inspection function based on the user's second operation.
[0056] Fifthly, this application provides an equipment inspection apparatus, comprising: a processing module; the processing module being configured to execute a startup process of an inspection module upon powering on a first device, the inspection module being configured to perform inspection and testing on the first device; and the processing module being configured to execute an inspection task corresponding to the inspection station based on the inspection station where the first device is located after the startup process is completed.
[0057] In one possible implementation, the inspection station includes one or more of the following inspection tasks: electrical inspection, operation instruction, and / or photography.
[0058] In one possible implementation, the equipment inspection device further includes a communication module, which is used to obtain the inspection station and the inspection task corresponding to the inspection station from the second device, and the second device is used to determine the inspection station of the first device on the inspection production line.
[0059] In one possible implementation, the inspection task includes an electrical inspection task, which includes performing one or more of the following operations on the first device: controller software upgrade, configuration parameter writing, software and hardware version verification, routine learning, third-party calibration, security certificate injection or key injection.
[0060] In one possible implementation, the inspection task includes an operation guidance task, which includes: outputting a first prompt; the first prompt is used to guide the user on the operation process at the inspection station.
[0061] In one possible implementation, the equipment inspection device includes a display module that outputs a first prompt, including: outputting the first prompt through the display module; and / or, the equipment inspection device includes an audio module that outputs the first prompt, including: outputting the first prompt through the audio module.
[0062] In one possible implementation, the communication module is used to receive a first confirmation message from the user, which instructs the user to complete the operation process.
[0063] In one possible implementation, the inspection task includes a photo-taking task, which includes: controlling a camera in a first device to acquire image data, and acquiring the image data acquired by the camera in the first device; the image data is used to indicate the assembly result in the first device.
[0064] In one possible implementation, the photo-taking task also includes controlling the camera to adjust the shooting range.
[0065] In one possible implementation, the communication module is used to send image data; the image data is used for image analysis on the electrical inspection server and / or terminal equipment; the communication module is also used to receive the image analysis results and output a second prompt; the second prompt is used to indicate the assembly result.
[0066] In one possible implementation, the inspection task includes an electrical inspection task and an operation guidance task. The processing module is used to: execute the electrical inspection task corresponding to the first inspection station where the first equipment is located; if the electrical inspection task is completed, execute the operation guidance task corresponding to the second inspection station of the first equipment; or, if the electrical inspection task is not completed, execute the electrical inspection task corresponding to the first inspection station and the operation guidance task corresponding to the second inspection station of the first equipment.
[0067] In one possible implementation, the inspection task includes a first electrical inspection task and a second electrical inspection task; the first electrical inspection task and the second electrical inspection task are executed sequentially.
[0068] In one possible implementation, after the inspection module starts automatically when the first device is powered on, the communication module is further configured to send a first request message to the electrical inspection server; the first request message is configured to request one or more of the following: electrical inspection task, operation guidance task and / or photo taking task; and receive a first response message from the electrical inspection server; the first response message carries one or more of the following: electrical inspection task, operation guidance task and / or photo taking task.
[0069] In one possible implementation, after the verification module starts automatically when the first device is powered on, the communication module is further configured to send a second request message to the second device; the second request message is configured to request one or more of the following: an operation guidance task and / or a photo-taking task; and receive a second response message from the second device; the second response message carries one or more of the following: an operation guidance task and / or a photo-taking task.
[0070] In one possible implementation, the processing module is further configured to: enable the automatic inspection function based on the user's first operation; the automatic inspection function includes executing the inspection task corresponding to the inspection station where the first device is located; or, disable the automatic inspection function based on the user's second operation.
[0071] In a sixth aspect, this application provides a device testing apparatus, including at least one processor and a memory, wherein each of the at least one processor is configured to implement the method in the first aspect or any possible implementation of the first aspect, or to implement the method in the second aspect or any possible implementation of the second aspect, or to implement the method in the third aspect.
[0072] Optionally, the device may also include a communication interface (or transceiver), with the processor coupled to the communication interface.
[0073] In a seventh aspect, this application provides an intelligent driving device, including the device inspection apparatus of the fifth aspect or any possible implementation of the fifth aspect and / or the device inspection apparatus of the sixth aspect.
[0074] Eighthly, this application provides a chip system including at least one processor for supporting the implementation of the functions involved in the first aspect and any possible implementation of the first aspect.
[0075] In one possible design, the chip system also includes a memory for storing program instructions and data, which may be located inside or outside the processor.
[0076] The chip system can consist of chips or include chips and other discrete components.
[0077] Ninthly, this application provides a computer-readable storage medium storing a computer program (also referred to as code or instructions) that, when run by a processor, causes the methods described above, which can implement the first aspect and any possible implementation of the first aspect, to be executed.
[0078] In a tenth aspect, this application provides a computer program product comprising: a computer program (also referred to as code or instructions) that, when run, causes the methods described above, which can implement the first aspect and any possible implementation thereof, to be executed.
[0079] It should be understood that the second to tenth aspects of this application correspond to the technical solutions of the first aspect of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be repeated here. Attached Figure Description
[0080] Figure 1 This is a schematic diagram of an intelligent driving device provided in an embodiment of this application;
[0081] Figure 2 A schematic diagram of an intelligent driving system provided in an embodiment of this application;
[0082] Figure 3 This is a schematic diagram of a vehicle production line process.
[0083] Figure 4 This is a flowchart illustrating an electrical inspection method.
[0084] Figure 5 A schematic diagram of an equipment inspection system provided in an embodiment of this application;
[0085] Figure 6 A schematic diagram of a vehicle display screen provided in an embodiment of this application;
[0086] Figure 7 A schematic flowchart of a device inspection method provided in an embodiment of this application;
[0087] Figure 8 A schematic diagram of a vehicle production line process provided for an embodiment of this application;
[0088] Figure 9 A schematic diagram illustrating a data transmission process between devices, provided as an embodiment of this application;
[0089] Figure 10 A schematic diagram illustrating a method for executing a testing task, as provided in an embodiment of this application;
[0090] Figure 11A flowchart illustrating another equipment inspection method provided in this application embodiment;
[0091] Figure 12 This is a schematic diagram of another equipment inspection device provided in an embodiment of this application. Detailed Implementation
[0092] To facilitate understanding of the embodiments of this application, the following points will be explained first:
[0093] First, in the embodiments of this application, the indication includes explicit indication (also known as direct indication) and implicit indication (also known as indirect indication). Explicit indication information A refers to including information A; implicit indication information A refers to indicating information A through the correspondence between information A and information B and direct indication information B. The correspondence between information A and information B can be predefined, pre-stored, pre-burned, or pre-configured; or it can refer to indicating information A through information B and preset rules.
[0094] Second, in the embodiments of this application, information C is used to determine information D, which includes determining information D based solely on information C, as well as determining it based on information C and other information. Furthermore, information C can also be used to determine information D indirectly, for example, in the case where information D is determined based on information E, and information E is determined based on information C.
[0095] Third, in the embodiments of this application, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates an "or" relationship between the preceding and following related objects, but it does not exclude the possibility of indicating an "and" relationship. The specific meaning can be understood in conjunction with the context. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c; a and b; a and c; b and c; or a and b and c. Here, a, b, and c can be single or multiple.
[0096] Fourth, in the embodiments of this application, the use of prefixes such as "first" and "second" is merely for the purpose of distinguishing and describing different things belonging to the same name category, and does not constrain the order, size, or quantity of things. For example, "first threshold" and "second threshold" are simply different thresholds, and there is no temporal order, size, or priority relationship between them.
[0097] Fifth, the "sending" and "receiving" in the embodiments of this application can be performed between devices, such as between a second device and a first device; or they can be performed within a device, such as between components, modules, chips, software modules, or hardware modules within a device via a bus, wiring, or interface.
[0098] Sixth, in the embodiments of this application, "when," "if," and "if" all refer to the device making corresponding processing under certain objective circumstances, and are not limited to a time, nor do they require the device to make a judgment action when it is implemented, nor do they mean that there are other limitations.
[0099] Seventh, in the embodiments of this application, the words "example," "exemplarily," "for example," or "such as" are used to indicate that they are examples, illustrations, or explanations. Any embodiment or design that is described as "example," "exemplarily," "for example," or "such as" in this application should not be construed as being more preferred or advantageous than other embodiments or design options. Specifically, the use of the words "example," "exemplarily," "for example," or "such as" is intended to present the relevant concepts in a specific manner.
[0100] Eighth, the device verification method in this application embodiment can be applied to vehicle-to-everything (V2X), long-term evolution-vehicle (LTE-V), and vehicle-to-vehicle (V2V) communication. For example, it can be applied to vehicles or other devices within vehicles. These other devices can be hardware units, software modules, or a combination of both. These other devices include, but are not limited to, in-vehicle terminals, in-vehicle controllers, in-vehicle modules, in-vehicle components, in-vehicle chips, in-vehicle units, in-vehicle radar, or in-vehicle cameras, and other sensors. Vehicles can implement the device verification method provided in this application embodiment through these other devices.
[0101] Of course, the device inspection method in this application embodiment can also be used in other smart terminals besides vehicles, or installed in other smart terminals besides vehicles, or installed in components of such smart terminals. The smart terminal can be intelligent transportation equipment, robots, etc. For example, it includes, but is not limited to, the smart terminal itself or its controller, chip, radar, camera, and other sensors, as well as other components.
[0102] Ninth, the terminal device in the embodiments of this application may be referred to as user equipment (UE), electronic device, etc. For example, the terminal device may be a mobile phone, tablet, personal digital assistant (PDA), handheld device with wireless communication function, computing device, in-vehicle device or wearable device, virtual reality (VR) terminal device, augmented reality (AR) terminal device, wireless terminal in industrial control, wireless terminal in smart home, etc. The form of the terminal device is not specifically limited in the embodiments of this application.
[0103] The embodiments of this application can be applied to intelligent driving devices, or to devices within intelligent driving devices. To facilitate understanding of the solutions in this application, the following will first combine... Figure 1 and Figure 2 A detailed description of intelligent driving equipment is provided.
[0104] Figure 1 This is a functional block diagram of an intelligent driving device 100 to which this application embodiment applies. For example... Figure 1 As shown, the intelligent driving device 100 may include a perception system 120, a computing platform 150, and a communication device 140. Optionally, the intelligent driving device 100 may also include a display device 130.
[0105] The perception system 120 may include several sensors for sensing information about the environment surrounding the intelligent driving device 100. For example, the perception system 120 may include a positioning system, which may be a global navigation satellite system (GNSS), such as GPS or BeiDou. Alternatively, the perception system 120 may also include one or more of the following: an inertial measurement unit (IMU), a vibration sensor, a lidar, a millimeter-wave radar, an ultrasonic radar, and a camera device.
[0106] Optionally, the intelligent driving device 100 also includes a display device 130. The display device 130 within the cockpit of the intelligent driving device 100 is mainly divided into two categories: the first is an in-vehicle display screen; the second is a projection display screen, such as a head-up display (HUD). An in-vehicle display screen is a physical display screen and an important component of the in-vehicle infotainment system. Multiple displays can be installed in the cockpit, such as a digital instrument cluster display screen and a central control screen. In some possible implementations, one or more of the aforementioned in-vehicle displays can be human-machine interfaces (HMIs), for example, the central control screen can be an HMI. A head-up display, also known as a head-up display system, is mainly used to display driving information such as speed and navigation on a display device (e.g., the windshield) in front of the driver. This reduces the driver's eye-shifting time, avoids pupil changes caused by eye-shifting, and improves driving safety and comfort. HUDs include, for example, combiner-HUD (C-HUD) systems, windshield-HUD (W-HUD) systems, and augmented reality HUD (AR-HUD) systems.
[0107] The intelligent driving device 100 also includes a communication device 140. The communication device 140 can be used to communicate with other devices, such as devices in the cloud. The communication device 140 may include, for example, a vehicle-to-everything (V2X) communication unit.
[0108] It should be understood that V2X may include, but is not limited to, one or more of the following communication methods: vehicle-to-vehicle (V2V), vehicle-to-infrastructure (V2I), vehicle-to-pedestrian (V2P), vehicle-to-network (V2N), or vehicle-to-device (V2D). The network may include cellular networks; the device may include smartphones or other portable devices.
[0109] In this embodiment of the application, the intelligent driving device 100 can communicate with the manufacturing execution system (MES) through the V2X communication unit to obtain the inspection station where the intelligent driving device 100 is located and the inspection task corresponding to the inspection station from the MES.
[0110] The intelligent driving device 100 can also communicate with the electrical inspection server via a V2X communication unit. For example, the intelligent driving device 100 can obtain electrical inspection tasks, operation guidance tasks, and / or photo-taking tasks from the electrical inspection server via the V2X communication unit; or, it can send image data to the electrical inspection server via the V2X communication unit and receive image analysis results from the electrical inspection server, etc.
[0111] Alternatively, the intelligent driving device 100 can also communicate with other terminal devices through the V2X communication unit, sending image data to the terminal devices and receiving image analysis results from the terminal devices, etc.
[0112] Some or all of the functions of the intelligent driving device 100 can be controlled by the computing platform 150.
[0113] For example, the computing platform 150 may include processors 151 to 15n. In this embodiment, a processor is a circuit with signal processing capabilities. In one implementation, the processor may be a circuit with instruction read and execute capabilities, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a type of microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. These logical relationships of hardware circuits are fixed or reconfigurable. For example, the processor may be a hardware circuit implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field-programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. Furthermore, the processor can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), tensor processing unit (TPU), deep learning processing unit (DPU), etc. In addition, the computing platform 150 may also include memory for storing instructions, and some or all of the processors 151 to 15n can call the instructions in memory to implement the corresponding functions.
[0114] The computing platform 150 can also control the operation of intelligent driving systems, which may include advanced driving assistance systems (ADAS) and autonomous driving systems (ADS). Intelligent driving systems utilize various sensors on the vehicle (including but not limited to: lidar, millimeter-wave radar, cameras, ultrasonic sensors, GPS, and inertial measurement units) to acquire information from the vehicle's surroundings, and analyze and process this information to achieve functions such as obstacle perception, target recognition, vehicle localization, path planning, and driver monitoring / alerts, thereby improving the safety, automation, and comfort of vehicle driving.
[0115] At different levels of autonomous driving (or intelligent driving levels, ranging from L0 to L5, totaling six levels), intelligent driving systems can achieve different levels of automated driving assistance based on artificial intelligence algorithms and information acquired by multiple sensors. These levels of autonomous driving are based on the classification standards of the Society of Automotive Engineers (SAE). Level L0 is no automation; Level L1 is driver assistance; Level L2 is partial automation; Level L3 is conditional automation; Level L4 is high automation; and Level L5 is full automation. At levels L1 to L3, the task of monitoring road conditions and reacting is jointly completed by the driver and the system, requiring the driver to take over dynamic driving tasks. Levels L4 and L5 allow the driver to completely transform into a passenger. Currently, the functions that intelligent driving systems can achieve mainly include, but are not limited to: adaptive cruise control, automatic emergency braking, automatic parking, blind spot monitoring, forward cross-traffic alert / braking, rear cross-traffic alert / braking, forward collision warning, lane departure warning, lane keeping assist, rear collision warning, traffic sign recognition, traffic jam assist, and highway assist. It should be understood that the above-mentioned functions can have specific modes at different levels of autonomous driving (L0-L5). The higher the level of autonomous driving, the more intelligent the corresponding mode.
[0116] In this embodiment of the application, the computing platform 150 may, for example, execute the inspection task corresponding to the inspection station based on information from the communication device 140 (the inspection station where the vehicle is located and the inspection task corresponding to the inspection station).
[0117] Furthermore, the computing platform 150 is also able to determine the movement route and control the intelligent driving device 100 to travel to a safe area according to the movement route.
[0118] Figure 2 A schematic block diagram of an intelligent driving system 200 provided in an embodiment of this application is shown. Figure 2As shown, the system 200 includes a sensing module 210, a control module 240, and a communication module 250. Optionally, the system 200 may also include a human-computer interaction module 220 and / or a display module 230.
[0119] The sensing module 210 may include Figure 1 The perception system 120 shown includes one or more camera devices and / or one or more radar sensors for collecting environmental information about the area where the vehicle is located, such as parking line information, obstacle information, etc.; it may also include other sensors such as infrared thermal imaging sensors, water level sensors, and vibration sensors. See details for further information. Figure 1 Description of the location.
[0120] Furthermore, the perception module 210 can process the collected environmental information to create a world model consisting of roads, obstacles, etc., for downstream modules (such as the human-computer interaction module 220 and the control module 240). The perception module 210 can send the collected and / or determined information to the control module 240.
[0121] The human-computer interaction module 220 may include Figure 1 One or more of the display devices 130 shown may include, for example, an HMI; the human-computer interaction module 220 may also include a sound-generating device (such as a speaker, audio jack, etc.) and a sound-receiving device (such as a microphone). The display module 230 may include... Figure 1 One or more of the display devices 130 shown are configured to display the vehicle interface. The human-machine interaction module 220 can receive user commands (including voice commands, touch screen commands, etc.) and then control the changes of the interface displayed by the display module 230 according to the commands.
[0122] Communication module 250 and Figure 1 The communication device 140 is similar, and can be referred to the description above, so it will not be repeated here.
[0123] In this embodiment, the control module 240 can execute the inspection task corresponding to the inspection station based on the information from the communication module 250 (the inspection station where the vehicle is located and the inspection task corresponding to the inspection station).
[0124] Before a vehicle rolls off the final assembly line, it needs to complete assembly, electrical testing, and quality inspection processes. For example, before rolling off the final assembly line, the vehicle needs to complete wiring harness installation and connection, bolt tightening, assembly of chassis, seats, trim panels, and other body components, electrical testing, and upgrades to the in-vehicle controller software, write configuration parameters, and perform version verification and fault clearing. This ensures the vehicle functions correctly after production, guarantees consistent controller versions, and correct functional parameters. After quality inspection and calibration, the vehicle is delivered only after its condition is confirmed to meet requirements.
[0125] like Figure 3 The diagram shown is a schematic of a vehicle production line process. Figure 3 As shown, this production line can include processes such as assembly, electrical testing, and quality inspection. After the vehicle enters the production line, it moves along with the line. When the vehicle reaches the electrical testing station, the operator can press the brake pedal to power on the vehicle and manually select the electrical testing task to be performed at that station. Electrical testing tasks may include upgrading the in-vehicle controller software, writing configuration parameters, verifying versions, and clearing faults, thereby ensuring the vehicle functions correctly after leaving the production line. After the electrical testing is completed, the results can be displayed on the vehicle's large infotainment screen.
[0126] Once the vehicle is moved to the assembly station, the assembly station staff can refer to the issued paper operation manual to assemble the components. According to the operation manual, they should follow the procedures outlined in the manual and execute the corresponding steps; for example, assembling the corresponding colored seats, pillar trim panels, tires, and other components based on the specific vehicle configuration information shown on the vehicle's manifest.
[0127] Once the vehicle is moved to the quality inspection station, staff can perform manual quality inspections based on the requirements. For example, staff can check the wiring harness connection status and the tightness of the bolts.
[0128] Optionally, the production line can also include a visual error-proofing station. This station can be equipped with a mobile robotic arm (with a camera) or a fixed-position camera. The camera takes pictures of the vehicle, and the image data is processed to obtain the photographic results. These results can include assembly information, such as whether assembly is complete or if there are assembly defects like incorrect component colors. In the event of an assembly defect, the visual error-proofing device can instruct workers to intercept the vehicle with the defect so that they can repair it.
[0129] However, in the aforementioned production line, for the electrical inspection station, after the vehicle is powered on, a worker needs to manually connect a handheld electrical inspection device to the vehicle's on-board diagnostics (OBD) interface. The device can then scan the Vehicle Identification Number (VIN) on the vehicle's windshield or vehicle identification plate to input the vehicle information. The worker can then select the electrical inspection station from the menu on the device's touchscreen to trigger the electrical inspection procedure.
[0130] The vehicle infotainment system can also be equipped with built-in electrical testing software. After the vehicle is powered on, the electrical testing software built into the vehicle infotainment system can be started manually, and the corresponding electrical testing station can be selected from the menu on the vehicle's large screen to execute the electrical testing procedure.
[0131] However, both methods require manual selection of the electrical inspection station, resulting in low electrical inspection efficiency and the risk of misoperation due to incorrect manual selection.
[0132] Currently, the following methods exist for determining whether to perform an electrical inspection on a vehicle. For example... Figure 4 As shown, Figure 4 A flowchart of an electrical inspection method 400 is shown. Method 400 includes the following steps:
[0133] S401, In-vehicle electrical inspection application acquires external trigger signals at the electrical inspection station.
[0134] S402, the in-vehicle electrical testing application acquires signals inside the vehicle based on external trigger signals and calibration signal configuration information.
[0135] S403, the in-vehicle electrical inspection application obtains the target calibration script information based on the vehicle's internal signals and calibration signal script configuration information.
[0136] S404, the in-vehicle electrical inspection application determines the target calibration station information corresponding to the calibration script information based on the station configuration file.
[0137] S405, the in-vehicle electrical inspection application determines the script corresponding to the target calibration script information as the target execution script based on the target calibration station information.
[0138] In this method, the in-vehicle electrical inspection application requires an external signal to trigger the electrical inspection. In other words, the staff opens the in-vehicle electrical inspection application by operating the vehicle's large screen. This method is time-consuming and may also pose risks such as scratching the vehicle's large screen, resulting in low electrical inspection efficiency.
[0139] For assembly and quality inspection stations, the assembly operation manuals for the assembly station and the quality inspection operation manuals for the quality inspection station are generally distributed to the staff in paper form. For example, the quality inspection operation manuals for the entire production line are distributed to the staff in paper form, and the staff perform quality inspections on the vehicles at the quality inspection station based on the quality inspection operation manuals.
[0140] The assembly station is used to assemble body components such as the chassis, seats, and trim panels. The quality inspection station is used to perform quality checks on the vehicle, such as checking assembly precision, appearance fit quality, and functional integrity.
[0141] In this method, when assembling vehicle parts, there is no on-site operation guidance. The staff rely on memory and experience to assemble and inspect the parts. This method is unable to cope with scenarios where the assembly process and assembly stations need to be adjusted due to changes in vehicle configuration. As a result, some parts are missing or the configuration is incorrect, leading to unqualified vehicle assembly, requiring rework and affecting vehicle delivery.
[0142] For the visual error prevention workstation, a new robotic arm photography device has been added to the production line to photograph vehicles and determine if there are any assembly problems or other faults. If a fault is found, staff will intercept the vehicle with the fault and report the problem to the MES (Manufacturing Execution System) for further processing. However, the addition of the robotic arm photography device increases costs.
[0143] The aforementioned processes of vehicle electrical testing, assembly, and quality inspection require a large amount of manual labor and external mechanical equipment, resulting in low inspection efficiency, high costs, and a high risk of missed inspections.
[0144] To address the aforementioned issues, this application provides an equipment inspection method in which the inspection module automatically starts upon power-on of the first piece of equipment (such as a vehicle). After starting, the inspection module can acquire the vehicle's position on the inspection production line. When the vehicle moves to the inspection station along the production line, the inspection module automatically executes the corresponding inspection task.
[0145] In this way, users do not need to operate the vehicle's large screen. The inspection module can automatically start based on the power-on of the first device. After the vehicle arrives at the corresponding position, the inspection module can automatically execute the vehicle's inspection process, avoiding human error (such as incorrect selection of inspection process or inspection steps), reducing labor costs, reducing the risk of the vehicle's large screen being scratched, and improving the inspection efficiency and accuracy of vehicles on the inspection production line.
[0146] In this context, "user" can be understood as an operator or staff member on the production line. This application uses a user as an example for illustration.
[0147] In some examples, the first device can be a vehicle, such as a car, truck, motorcycle, bus, boat, airplane, helicopter, lawnmower, recreational vehicle, amusement park vehicle, construction equipment, tram, golf cart, train, etc., and this application embodiment does not impose any particular limitation. In one possible implementation, the first device 501 can be a new energy vehicle, including pure electric vehicle, hybrid electric vehicle, fuel cell electric vehicle, etc., and this application embodiment does not impose any limitation in this regard.
[0148] In some examples, such as Figure 5 The diagram shown is a schematic representation of an equipment inspection system 500 provided in an embodiment of this application. The system 500 includes a first device 501, a second device 502, and an electrical inspection server 503. The first device 501, the second device 502, and the electrical inspection server 503 can communicate with each other via a cellular network. The first device 501 may include an inspection module 504. Optionally, the first device 501 may further include a human-machine interaction module 505 and / or a controller 506.
[0149] In some examples, the verification module 504 can be a separate hardware device and / or software module within the vehicle. For example... Figure 6 As shown, an in-vehicle electrical inspection application can be installed and run on the vehicle's inspection module operating system. This in-vehicle electrical inspection application is used to perform inspection tasks.
[0150] In some examples, users can uninstall the in-vehicle electrical inspection application before the vehicle completes all inspection tasks and rolls off the production line.
[0151] Optionally, the first device also includes a communication module. The communication module can be a module in the inspection module 504, a module outside the inspection module 504, or it can be understood as a module deployed on the inspection module 504.
[0152] The inspection module 504 can communicate with the second device 502 through the communication module, and it can also communicate with the electrical inspection server 503 through the communication module.
[0153] Optionally, the inspection module may also include a display module. The display module may be a module within the inspection module 504, a module outside the inspection module 504, or it may be understood as a module deployed on the inspection module 504.
[0154] The inspection module 504 can display the icon of the installed in-vehicle electrical inspection application on the display screen via the display module. Additionally, during the operation of the in-vehicle electrical inspection application, the inspection module can also display the user interface of the application on the display screen via the display module. This display screen can be the display screen of the vehicle's infotainment system, or it can be another external display screen (such as a standalone display screen, or a computer display screen connected to a network); this embodiment does not impose specific limitations on this.
[0155] Alternatively, the inspection module 504 can also be configured in the cockpit domain controller (CDC) or the vehicle infotainment system, connecting to the network via the vehicle infotainment system's communication module to communicate with the second device 502 and the electrical inspection server 503. The inspection module 504 can display the icon of the installed in-vehicle electrical inspection application on a connected vehicle display screen (e.g., the central control screen). Furthermore, during the operation of the in-vehicle electrical inspection application, the inspection module can display the user interface of the in-vehicle electrical inspection application on the vehicle display screen.
[0156] The second device 502 can be a Manufacturing Execution System (MES). The MES can control the operation of the inspection production line according to the production line rhythm (such as the rhythm of vehicle production). The vehicles will move between multiple inspection stations on the inspection production line as it operates. Optionally, the inspection stations may include one or more of the following: one or more electrical inspection stations, one or more assembly stations, one or more quality inspection stations, or one or more photography stations, etc.
[0157] In other words, an inspection production line can include multiple types of inspection stations, and there can be multiple inspection stations of each type. When there are multiple inspection stations of the same type, the positions of these multiple inspection stations of the same type on the inspection production line can be arranged continuously, or other types of inspection stations can be interspersed among these multiple inspection stations of the same type.
[0158] Optionally, the inspection production line may include multiple types of inspection stations, and each type of inspection station may appear multiple times. For example, when a vehicle is on the inspection production line, after moving to assembly station 1, the user completes the operation guidance task based on the assembly requirements corresponding to assembly station 1; then, the vehicle moves to quality inspection station 1, and the user completes the quality inspection task based on the quality inspection requirements corresponding to quality inspection station 1. Afterwards, the vehicle may also move to assembly station 2, and the user completes the operation guidance task based on the assembly requirements corresponding to assembly station 2. That is, the inspection production line may include multiple assembly stations. Optionally, the inspection production line may include multiple quality inspection stations, or the inspection production line may include multiple electrical inspection stations; this embodiment does not impose specific limitations on this.
[0159] In some examples, the second device 502 can be used to determine the inspection station of the vehicle on the inspection production line and send the inspection station of the vehicle to the first device 501.
[0160] Optionally, after the first device 501 is powered on and the inspection module 504 in the first device 501 is started, the second device 502 can send an inspection task to the electrical inspection server 503, and the electrical inspection server 503 will send the inspection task to the inspection module 504.
[0161] Alternatively, the second device 502 can send an inspection task to the inspection module 504.
[0162] The device inspection method of this application embodiment can be implemented by an inspection module in a vehicle. This inspection module can be a standalone device, a chip or component in the vehicle, or a software module (e.g., an application program). The software module can be deployed on relevant in-vehicle equipment, such as the vehicle infotainment system (e.g., CDC) integrated into the aforementioned vehicle (intelligent driving device) computing platform 150, or deployed on the control unit of other components of the vehicle. This application embodiment does not limit the product form or deployment method of the inspection module.
[0163] In this embodiment of the application, the vehicle inspection module can also be referred to as an in-vehicle electrical inspection instrument, and the inspection module 504 can be the inspection function platform of the vehicle system.
[0164] The vehicle may include at least one display screen. The inspection module can implement the equipment inspection method of the embodiments of this application, and can also display the vehicle inspection process, inspection task and / or inspection results on any of the at least one display screen to notify the user of the vehicle inspection process.
[0165] The equipment testing method provided in this application will be described below with reference to specific embodiments. These embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.
[0166] Figure 7 This is a schematic flowchart of one embodiment of the equipment inspection method provided in this application. (Refer to...) Figure 7 The equipment inspection method provided in this application embodiment may include:
[0167] S701. Based on the power-on of the first device, the inspection module executes the inspection module startup process.
[0168] Optionally, the first device can be powered on based on user input.
[0169] In this embodiment, user input is used to trigger the power-on of the first device. User input may include, but is not limited to, actions such as pressing the brake pedal or pressing and holding the start button. This application does not impose specific limitations on the type of user input.
[0170] Optionally, the inspection module is used to inspect the first device. This may include performing electrical checks, providing operating instructions, and taking photographs of the first device; details can be found below and will not be elaborated upon here.
[0171] S702. After the startup process is completed, the inspection module executes the inspection task corresponding to the inspection station where the first device is located.
[0172] Optionally, the inspection station may include an electrical inspection station, a quality inspection station, and an assembly station. Inspection tasks may include electrical inspection tasks, operation guidance tasks, and / or photographic tasks. Operation guidance tasks may include assembly operation guidance tasks and quality inspection operation guidance tasks.
[0173] For example, if the first device is located at the electrical inspection station, the inspection module can perform the electrical inspection task corresponding to that electrical inspection station.
[0174] Optionally, the electrical inspection task may include performing one or more of the following operations on the first device: controller software upgrade, configuration parameter writing, software and hardware version verification, routine learning, third-party calibration, security certificate injection or key injection.
[0175] For example, the inspection module can interact with the ECU based on the electrical inspection program script corresponding to the electrical inspection station to realize ECU software upgrades, write functional parameters, version verification and other electrical inspection content.
[0176] For example, when the first device is located at the assembly station, the inspection module can execute the assembly operation guidance task corresponding to that assembly station.
[0177] Optionally, the assembly operation guidance task may include outputting a first prompt. This first prompt is used to guide the user through the assembly operation process at the assembly station. For example, the first prompt may include: assembling component A, and specific assembly operation steps. Component A may be one or more components.
[0178] For another example, the first prompt may include: assembling component A and component B, and specific assembly operation steps. Component A may be one or more components, and component B may be one or more components.
[0179] Alternatively, the first prompt may include more or fewer assembly operation guidance tasks, and this application embodiment does not impose specific limitations on this.
[0180] For example, when the first device is located at the quality inspection station, the inspection module can execute the quality inspection operation guidance task corresponding to that quality inspection station.
[0181] Optionally, the quality inspection operation guidance task may include outputting a first prompt. This first prompt is used to guide the user through the quality inspection operation process at the quality inspection station. For example, the first prompt may include: quality inspection component A, and specific quality inspection operation steps. Here, quality inspection component A may include its connection status, color, etc.
[0182] For another example, the first prompt may include: inspection component A, component B, and specific quality inspection operation procedures. Inspection component B may include checking the connection status, color, etc.
[0183] Alternatively, the first prompt may include more or fewer quality inspection operation guidance tasks, and this application embodiment does not impose specific limitations on this.
[0184] In some examples, when the first device is located at the quality inspection station, the inspection module can also perform the photo-taking task corresponding to that quality inspection station.
[0185] Optionally, the inspection module includes a camera, which performs a photo-taking task to capture image data.
[0186] Optionally, the photo-taking task may include controlling the camera in the first device to acquire image data, and obtaining the image data acquired by the camera in the first device. The image data may be used to indicate the assembly result in the first device.
[0187] In this way, the inspection module can automatically execute the inspection tasks corresponding to the inspection station where the first device is located. This reduces labor costs, lowers the risk of scratches on the vehicle's large screen, and improves the inspection efficiency of vehicles on the inspection line.
[0188] In some examples, embodiments of this application can be applied to vehicle final assembly lines, such as... Figure 8 The diagram shown is a flowchart illustrating the vehicle inspection method provided in this application embodiment.
[0189] Once the vehicle is fully assembled, meaning it enters the final assembly stage, components such as the dashboard, chassis, and battery are assembled. Afterward, the vehicle moves along the production line to electrical inspection station 1. At this point, the user can press the brake pedal, activating the vehicle's power. Upon power-up, the vehicle's infotainment screen is activated, and the inspection module automatically starts and executes the electrical inspection task. This task corresponds to electrical inspection station 1. After the inspection module completes the task, the results are displayed on the infotainment screen.
[0190] The vehicle moves along the production line to assembly station 1. At this point, the inspection module can display the assembly operation process corresponding to assembly station 1 on the vehicle's large infotainment screen. For example, the assembly operation process could be: 1. Assemble component A. Users can complete the assembly work based on the assembly operation process displayed on the vehicle's large infotainment screen and confirm the assembly is complete through the screen.
[0191] The vehicle moves along the production line to quality inspection station 1. At this point, the inspection module can display the quality inspection operation process corresponding to quality inspection station 1 on the vehicle's large screen. For example, the quality inspection operation process could be: Inspect component A. Users can complete the quality inspection work based on the quality inspection operation process displayed on the vehicle's large screen and confirm the completion of the quality inspection through the large screen.
[0192] Optionally, users can send the quality inspection results to the inspection module via the vehicle's large infotainment screen. For example, if no faults are found during the quality inspection, the inspection result can be "passed." If a fault is found during the quality inspection, the user can send the fault information to the inspection module via the vehicle's large infotainment screen.
[0193] Optionally, when the vehicle moves to quality inspection station 1 along the production line, the inspection module can also take pictures and identify the assembly results by calling the in-vehicle camera, and realize the automatic analysis and positioning of the assembly results through the electrical inspection server (or other terminal equipment).
[0194] Specifically, the inspection module can use the in-vehicle camera to take pictures and obtain image data of the vehicle's interior, then send this image data to the electrical inspection server (or other terminal devices) via the network. The electrical inspection server can also obtain preset assembly information, which represents the target assembly result of the vehicle. This includes details such as the vehicle's interior color and assembly details.
[0195] The electrical inspection server analyzes the image data based on preset assembly information and generates an assembly result. This result can include whether the assembly quality is up to standard and whether the assembly is accurate. For example, it can indicate whether the wiring harness is properly connected, whether the seat color is accurate, and whether the door panel color is accurate.
[0196] In some examples, the verification module can access the vehicle's infotainment system port via authentication and / or a whitelist to retrieve image data from the in-vehicle camera. For instance, the verification module may have a pre-set credential (such as a password, token, or certificate) between it and the vehicle's infotainment system. The vehicle's infotainment system port authenticates the verification module based on this credential. If the verification is successful, the vehicle's infotainment system port communicates with the verification module and sends the image data from the in-vehicle camera to the verification module. Alternatively, the vehicle's infotainment system port may pre-store the verification module's identifier (such as an Internet Protocol address or identifier). If the verification module's identifier matches the stored identifier, the vehicle's infotainment system port communicates with the verification module and sends the image data from the in-vehicle camera to the verification module.
[0197] The inspection module can display the quality inspection results on the vehicle's large screen. These results can include both manual inspection results and assembly results obtained through photo recognition.
[0198] If the quality inspection results indicate a fault, the inspection module can alert the user to the problem through the user interface of the in-vehicle electrical inspection application, instructing the user to intercept the vehicle with the fault. Alternatively, the inspection module can also alert the user to the fault through voice or other means, instructing the user to intercept the vehicle with the fault.
[0199] Optionally, the inspection module can also send fault information to the MES, which may include the fault problem and information about the vehicle where the fault problem occurred.
[0200] MES can intercept vehicles with faults based on fault information; for example, MES can control the production line to stop operating. MES can also prompt users to handle the fault.
[0201] In some examples, the inspection module can obtain inspection tasks from the electrical inspection server. Alternatively, the inspection module can also obtain inspection tasks from the MES (Manufacturing Execution System).
[0202] like Figure 9 The diagram shown is a schematic representation of a method for obtaining inspection tasks using an inspection module according to an embodiment of this application. Figure 9 (a) illustrates the method by which the inspection module obtains inspection tasks from the electrical inspection server; Figure 9 (b) illustrates the method by which the inspection module obtains inspection tasks from the MES.
[0203] Figure 9 (a) may include the following steps:
[0204] S901, the inspection module sends a first request message to the electrical inspection server. Correspondingly, the electrical inspection server receives the first request message from the inspection module.
[0205] The first request message can be used to request one or more of the following: electrical inspection task, operation instruction task, and / or photo taking task.
[0206] S902, the electrical inspection server sends a third request message to the MES. Correspondingly, the MES receives the third request message from the electrical inspection server.
[0207] The third request message is used to request one or more of the following: operation guidance task and / or photo taking task.
[0208] Optionally, the third request message can also be used to request vehicle electrical inspection data. The electrical inspection data may include inspection parameters, inspection standards, and an index of inspection procedures.
[0209] S903, MES sends a third response message to the electrical inspection server based on the third request message. Correspondingly, the electrical inspection server receives the third response message from MES.
[0210] Optionally, the third response message may include one or more of the following: operation guidance task, photo taking task, and / or vehicle electrical inspection data information.
[0211] Optionally, the electrical inspection server can generate electrical inspection tasks based on electrical inspection data.
[0212] S904. The electrical inspection server sends a first response message to the inspection module. Correspondingly, the inspection module receives the first response message from the electrical inspection server.
[0213] Optionally, the first response message may carry one or more of the following: electrical inspection task, operation instruction task, and / or photo taking task.
[0214] In this context, inspection stations are associated with inspection tasks. For example, if the first device is located at electrical inspection station 1, the corresponding electrical inspection task is Electrical Inspection Task 1. If the first device is located at assembly station 1, the corresponding assembly operation guidance task is Assembly Operation Guidance Task 1. If the first device is located at quality inspection station 1, the corresponding quality inspection operation guidance task is Quality Inspection Operation Guidance Task 1, and the photography task is Photography Task 1.
[0215] It should be understood that the above sequence of steps is only an example, and S902 and S903 can also be executed before S901. For example, S902 and S903 can be executed after the MES establishes a network connection with the electrical inspection server. This application embodiment does not impose specific limitations in this regard.
[0216] In other examples, such as Figure 9 As shown in (b), the inspection module can also obtain operation guidance tasks and / or photo-taking tasks from the MES.
[0217] Figure 9 (b) may include the following steps:
[0218] S911, the verification module sends a second request message to the MES. Correspondingly, the MES receives the first request message from the verification module.
[0219] The second request message can be used to request one or more of the following: operation guidance task and / or photo taking task.
[0220] S912, MES sends a second response message to the verification module. Correspondingly, the verification module receives the second response message from MES.
[0221] Optionally, the second response message may include one or more of the following: an operation guidance task and / or a photo-taking task.
[0222] In this way, once the inspection module establishes a network connection with the MES, it can directly obtain operation guidance tasks and / or photo-taking tasks from the MES, thereby improving efficiency.
[0223] In some examples, inspection tasks include multiple types, such as electrical inspection tasks, operation instruction tasks, and photography tasks. While the vehicle is operating on the production line, different types of inspection tasks can be executed in parallel, while inspection tasks of the same type need to be executed sequentially.
[0224] like Figure 10 The diagram shown is a schematic representation of a verification task execution method provided in an embodiment of this application.
[0225] Specifically, when a vehicle arrives at electrical inspection stations 1-n, the inspection module executes the corresponding electrical inspection task 1-n; when a vehicle arrives at assembly stations 1-m, the inspection module executes assembly operation guidance task 1-m; when a vehicle arrives at photography stations 1-p, the inspection module executes photography task 1-p. Here, n, m, and p are integers greater than 2.
[0226] The photo-taking station can also be understood as a quality inspection station. When a vehicle arrives at the quality inspection station, the inspection module can perform quality inspection operation guidance tasks and / or photo-taking tasks.
[0227] Alternatively, the photo-taking station can be different from the quality inspection station. When a vehicle arrives at the quality inspection station, the inspection module can perform quality inspection operation guidance tasks; when a vehicle arrives at the photo-taking station, the inspection module performs photo-taking tasks.
[0228] This application example illustrates the process of a vehicle arriving at the photo-taking station and the inspection module performing a photo-taking task.
[0229] Optionally, electrical inspection stations 1-n, assembly stations 1-m, and photography stations 1-p can be executed in parallel.
[0230] For example, when a vehicle arrives at electrical inspection station 1, the inspection module performs the corresponding electrical inspection task 1.
[0231] During the execution of the corresponding electrical inspection task 1 by the inspection module, the vehicle moves to assembly station 1 along the production line. If electrical inspection task 1 is completed, the inspection module executes assembly operation guidance task 1; if electrical inspection task 1 is not completed, the inspection module continues to execute electrical inspection task 1 and executes assembly operation guidance task 1.
[0232] During the execution of the corresponding electrical inspection task 1 and assembly operation guidance task 1 by the inspection module, the vehicle moves along the production line to the photography station 1. If the electrical inspection task 1 and assembly operation guidance task 1 are not completed, the inspection module continues to execute the electrical inspection task 1 and assembly operation guidance task 1, and executes the photography task 1.
[0233] For example, if a vehicle is simultaneously involved in both an electrical inspection software upgrade and the installation of pillar trim panels at a certain workstation, the inspection module will execute the two inspection tasks in parallel. That is, while the target ECU is being upgraded with software, the user interface of the in-vehicle electrical inspection application can display the assembly operation process for installing pillar trim panels, reminding the staff to perform the assembly operation.
[0234] Optionally, electrical inspection stations 1 through n can be executed serially. Similarly, assembly stations 1 through m and photography stations 1 through p can be executed serially.
[0235] For example, taking the inspection module's execution of an electrical inspection task as an example, when a vehicle arrives at electrical inspection station 1, the inspection module executes the corresponding electrical inspection task 1. During the execution of electrical inspection task 1, the vehicle moves along the production line to electrical inspection station 2. If electrical inspection task 1 is completed, the inspection module executes electrical inspection task 2; if electrical inspection task 1 is not completed, the inspection module continues to execute electrical inspection task 1 until it is completed, and then executes electrical inspection task 2.
[0236] In some examples, the inspection module performs the inspection tasks corresponding to the inspection station where the vehicle is located; that is, the automatic inspection function can be turned on or off. In some scenarios, such as when vehicles are undergoing production line assembly testing and verification, there is no need to perform certain electrical inspection or photo-taking tasks. Users can turn the automatic inspection function on or off, improving the applicability of the embodiments of this application.
[0237] Optionally, the inspection module can enable automatic inspection based on the user's first action.
[0238] This first operation is used to instruct the automatic inspection function to be activated.
[0239] For example, the first operation could be to enable the automatic inspection function control in the user interface of a touch-screen in-vehicle electrical inspection application.
[0240] Optionally, enabling the automatic inspection function can be understood as enabling all or part of the automatic inspection functions of the inspection module.
[0241] With all automatic inspection functions enabled, when a vehicle arrives at the inspection station, the inspection module executes the inspection task corresponding to that station.
[0242] When the automatic inspection function is partially enabled, the inspection module can determine whether the automatic inspection function of the inspection station is enabled when the vehicle arrives at the inspection station. If the automatic inspection function of the inspection station is enabled, the inspection task corresponding to the inspection station will be executed.
[0243] For example, the user interface of the in-vehicle electrical inspection application may include a function switch control corresponding to each inspection task. When the electrical inspection task does not need to be performed, the user can touch the function switch control of the electrical inspection task to turn off the automatic electrical inspection function of the inspection module, that is, turn off the function of the vehicle to perform electrical inspection tasks at the electrical inspection station.
[0244] Alternatively, the inspection module can disable the automatic inspection function based on a second user action.
[0245] This second operation is used to instruct the automatic inspection function to be turned off.
[0246] For example, the second operation could be to disable the automatic inspection function control in the user interface of a touch-screen in-vehicle electrical inspection application.
[0247] Optionally, disabling the automatic inspection function can be understood as disabling all or part of the automatic inspection functions of the inspection module.
[0248] When all automatic inspection functions are turned off, the inspection module does not perform inspection tasks when the vehicle arrives at the inspection station.
[0249] When the automatic inspection function is partially turned off, the inspection module can determine whether the automatic inspection function of the inspection station is turned off when the vehicle arrives at the inspection station. If the automatic inspection function of the inspection station is turned off, the inspection module will not perform the inspection task; if the automatic inspection function of the inspection station is not turned off, the inspection module will perform the inspection task.
[0250] For example, the user interface of the in-vehicle electrical inspection application may include a function switch control corresponding to each inspection task. When an assembly operation task needs to be performed, the user can touch the function switch control of the assembly operation task to enable the automatic assembly function of the inspection module, that is, to enable the vehicle to perform assembly operation tasks at the assembly station.
[0251] Alternatively, if the automatic inspection function is turned off, the inspection task can be performed manually.
[0252] In some examples, Figure 11 This is a flowchart illustrating a vehicle inspection method 1100 provided in an embodiment of this application. Method 1100 includes the following steps:
[0253] S1101, When the user presses the brake pedal, the vehicle is powered on.
[0254] S1102. The inspection module starts and connects to the network.
[0255] Optionally, the inspection module can automatically start upon vehicle power-on. Once started, the inspection module can search for and connect to the network, through which it can communicate with the electrical inspection server and the MES (Manufacturing Execution System).
[0256] S1103. The inspection module obtains the vehicle identification number (VIN).
[0257] The VIN is used to identify the vehicle. The VIN can be stored in the vehicle's ECU, and the verification module can read the vehicle's VIN from the ECU.
[0258] S1104. The inspection module sends a first request message to the electrical inspection server based on the VIN. Correspondingly, the electrical inspection server receives the first request message from the inspection module.
[0259] The first request message is used to request one or more of the following: electrical inspection task, operation instruction task, and / or photo taking task.
[0260] In some examples, the vehicle inspection server can store inspection tasks for multiple vehicles. The first request message can carry the vehicle's VIN, and the vehicle inspection server can assign the corresponding inspection task based on the vehicle's VIN.
[0261] S1105. The electrical inspection server sends a first response message to the inspection module. Correspondingly, the inspection module receives the first response message from the electrical inspection server.
[0262] Optionally, the first response message may carry one or more of the following: electrical inspection task, operation instruction task, and / or photo taking task.
[0263] S1106. The MES sends the vehicle's location information to the inspection module. Correspondingly, the inspection module receives the vehicle's location information from the MES.
[0264] Optionally, the MES can determine the vehicle's location information using radio frequency identification (RFID) technology and / or barcodes. The vehicle's location information may include the inspection station where the vehicle is located.
[0265] For example, vehicles on the production line can be equipped with RFID electronic tags (small readable and writable chips): the RFID electronic tags can be installed on the vehicle doors; or, the RFID electronic tags can be installed on the vehicle's windshield, and this application embodiment does not impose specific limitations on this. RFID readers are deployed at key workstations on the production line (such as each inspection station). When a vehicle moves along the production line to that station, the RFID reader can automatically read the RFID electronic tag on the vehicle and send a message to the MES (Manufacturing Execution System) instructing the vehicle to arrive at that inspection station.
[0266] Alternatively, a barcode (or QR code, etc.) can be affixed to the vehicle on the production line. At key workstations on the production line (such as each inspection station), barcode scanners are deployed. When a vehicle moves to that workstation, the barcode scanner can automatically read the barcode on the vehicle and send a message to the MES, instructing the vehicle to arrive at that inspection station.
[0267] Alternatively, MES can also determine the vehicle's location information through other technologies, such as ultra-wideband (UWB) technology. This application does not impose specific limitations on this.
[0268] After MES determines the vehicle's location information, it can send the vehicle's location information to the inspection module.
[0269] In some examples, the execution order of S1106 can also be at other locations, such as any location between S1103 and S1126. MES can determine the vehicle's location information in real time and send it to the inspection module.
[0270] Thus, through the above embodiments, the inspection module can obtain the inspection station where the vehicle is located and the corresponding inspection task. The following describes the process of executing the corresponding inspection task when the vehicle is located in different inspection stations:
[0271] When the vehicle is moved to the electrical inspection station, the equipment inspection system executes S1107-S1111.
[0272] S1107. The inspection module determines that the vehicle is located at the electrical inspection station based on the vehicle's location information.
[0273] For example, the vehicle's location information could be that the vehicle is located at the electrical inspection station.
[0274] S1108, The inspection module performs an electrical inspection task on the target controller.
[0275] The target controller can be a target ECU or other controller.
[0276] For example, the inspection module can execute the program script corresponding to the electrical inspection station, interact with the target ECU to perform diagnostic commands, upgrade the ECU software, write functional parameters, verify the version, and perform other electrical inspection tasks to ensure the accuracy of the vehicle's hardware and software versions before it leaves the production line and to write the correct configuration parameters.
[0277] S1109. The target controller sends the electrical test results to the inspection module. Correspondingly, the inspection module receives the electrical test results from the target controller.
[0278] The results of the electrical inspection may include faults (such as inconsistencies between controller software and hardware versions), data from various vehicle components, etc.
[0279] S1110, The inspection module sends the electrical inspection results to the display module. Correspondingly, the display module receives the electrical inspection results from the inspection module.
[0280] Optionally, the inspection module may also send the electrical inspection results to the electrical inspection server and / or MES, and this application embodiment does not impose specific limitations on this.
[0281] S1111, The display module displays the electrical test results.
[0282] Optionally, the display module can display the electrical test result on the vehicle's large screen.
[0283] When the vehicle is moved to the assembly station, execute S1112-S1115.
[0284] S1112. The inspection module determines that the vehicle is located at the assembly station based on the vehicle's location information.
[0285] For example, the vehicle's location information could be that the vehicle is located at an assembly station.
[0286] S1113. The inspection module sends a first prompt to the display module. Correspondingly, the display module receives the first prompt from the inspection module.
[0287] The first prompt can be the assembly operation process for the user at the assembly station.
[0288] S1114, The display module displays the first prompt.
[0289] Optionally, the display module can display the assembly operation process on the vehicle's large screen to prompt the user to assemble according to the assembly operation process.
[0290] The above S1113 and S1114 are examples of the inspection module outputting the first prompt through the display module. In other examples, the vehicle may also include an audio module, through which the inspection module can output the first prompt.
[0291] Specifically, the inspection module sends a first prompt to the audio module. Correspondingly, the audio module receives the first prompt from the inspection module. This first prompt can be the user's assembly operation procedure at the assembly station.
[0292] Then, the audio module can play the first prompt to guide the user through the assembly process.
[0293] S1115. The verification module receives the first confirmation message from the user.
[0294] After the user completes the assembly, they can select a confirmation control on the vehicle's infotainment screen. The infotainment system can then generate a first confirmation message based on the user's selection of the confirmation control and send the first confirmation message to the verification module to indicate that the user has completed the assembly.
[0295] When the vehicle is moved to the quality inspection station, execute S1116-S1126.
[0296] S1116. The inspection module determines the location of the vehicle at the quality inspection station based on the vehicle's location information.
[0297] For example, the vehicle's location information could be that the vehicle is located at the quality inspection station.
[0298] S1117. The inspection module sends a first prompt to the display module. Correspondingly, the display module receives the first prompt from the inspection module.
[0299] The first prompt can be the quality inspection operation process for users at the assembly station.
[0300] S1118, The display module displays the first prompt.
[0301] Optionally, the display module can display the quality inspection operation process on the vehicle's large screen to prompt users to perform quality inspections according to the process.
[0302] In other examples, the vehicle may also include an audio module, through which the verification module can output the first prompt.
[0303] Specifically, the inspection module sends an initial prompt to the audio module. Correspondingly, the audio module receives the initial prompt from the inspection module. This initial prompt can be the user's quality inspection procedure at the quality inspection station.
[0304] Afterwards, the audio module can play the first prompt to guide the user to perform the quality inspection according to the quality inspection procedure.
[0305] S1119. The verification module receives the first confirmation message from the user.
[0306] After the user completes the quality inspection, they can select a confirmation control on the vehicle's infotainment screen. The infotainment system can then generate a first confirmation message based on the user's selection of the confirmation control and send the first confirmation message to the inspection module to indicate that the user's quality inspection is complete.
[0307] S1120, The inspection module calls the camera in the vehicle to collect image data.
[0308] Optionally, the inspection module can acquire image data by calling the camera in the vehicle.
[0309] In some examples, the inspection module can also control the camera to adjust the shooting range and collect the required image data.
[0310] For example, the inspection module can also control the camera to move and / or rotate to capture images from different directions within the vehicle.
[0311] Alternatively, the inspection module can also control the camera zoom to capture images with different framing ranges.
[0312] For example, if the target component (such as a bolt on a vehicle) captured by the camera is smaller than a first preset threshold, and the distance between the camera and the target component is greater than a second preset threshold, the target component captured by the camera at its normal focal length will occupy too small a proportion in the image, which may lead to the inability to accurately identify and determine whether the target component is qualified. To address this, the inspection module can control the camera to adjust to a telephoto focal length to increase the proportion of the target component in the image, ensuring that its details are clearly visible, thereby supporting effective status analysis and identification.
[0313] For another example, if the target component (such as a vehicle seat) captured by the camera has a volume greater than or equal to a first preset threshold, and / or the distance between the camera and the target component is less than or equal to a second preset threshold, the target component captured by the camera at its normal focal length will occupy too large a proportion in the image, and it may not be possible to display the entire target component in the image. Therefore, the verification module can control the camera to adjust to a shorter focal length to reduce the proportion of the target component in the frame, ensuring that it is fully present in the image, thereby supporting effective state analysis and recognition.
[0314] The first preset threshold and the second preset threshold can be determined by the user based on experience, and this application embodiment does not impose specific restrictions on them.
[0315] Alternatively, if the vehicle includes multiple cameras, the inspection module can switch between multiple cameras to capture images and obtain image data from multiple cameras.
[0316] Optionally, if camera 1 is unable to capture the target component, the inspection module can switch to camera 2 inside the vehicle to capture the target component.
[0317] For example, if camera 1 is blocked by other parts inside the vehicle and cannot capture the target part, the inspection module can switch to camera 2 inside the vehicle to capture the target part.
[0318] Alternatively, if the distance between camera 1 and the target component is greater than a third preset threshold, the captured image data cannot identify the target component, while the distance between camera 2 and the target component is less than a fourth preset threshold, the captured image data shows a clear target image that can be identified. The verification module can switch to camera 2 inside the vehicle to capture images of the target component.
[0319] Optionally, the inspection module can also call on multiple cameras in the vehicle to capture image data of the same target component from different angles, so as to better identify the assembly status of the target component in the future.
[0320] S1121, The inspection module sends the image data to the electrical inspection server. Correspondingly, the electrical inspection server receives the image data from the inspection module.
[0321] S1122, MES sends the preset assembly information to the electrical inspection server. Correspondingly, the electrical inspection server receives the preset assembly information from MES.
[0322] Optionally, preset assembly information can represent the target assembly result of the vehicle. For example, the interior color of the vehicle, the assembly content, etc.
[0323] For example, the preset assembly information may include bolt connection status, wiring harness plug-in status, white steering wheel and seat, and black seat.
[0324] S1123, the electrical inspection server obtains image analysis results based on image data and preset assembly information.
[0325] The electrical inspection server performs image analysis on the image data to identify the assembly results in the image.
[0326] For example, an electrical inspection server can automatically process image data based on a big data model to identify the assembly results in the images.
[0327] The electrical inspection server determines the image analysis results based on the assembly results in the image and preset assembly information. These results can include whether the assembly is correct, whether the assembly quality is up to standard, and whether any assembly malfunctions have occurred.
[0328] For example, the assembly result in the image shows tight bolt connections, tight wiring harness connections, a white steering wheel, and a white seat. The image analysis result could then indicate whether the assembly quality is acceptable, that the steering wheel is correctly assembled, and that the seat color is incorrect; it should be black.
[0329] S1124. The electrical inspection server sends the image analysis results to the inspection module. Correspondingly, the inspection module receives the image analysis results from the electrical inspection server.
[0330] Optionally, in S1121-S1124 above, the image data is analyzed by the electrical inspection server to obtain image analysis results. In other examples, the inspection module can also send the image data to a terminal device (such as a computer). This terminal device can communicate with the inspection module and the MES via a network, and the MES sends preset assembly information to the terminal device. The terminal device obtains the image analysis results based on the image data and the preset assembly information, and sends them to the inspection module. This application embodiment does not specifically limit this aspect.
[0331] S1125, The inspection module sends a second prompt to the display module. Correspondingly, the display module receives the second prompt from the inspection module.
[0332] The electrical inspection server can send a second prompt to the display module based on the image analysis results. This second prompt can be used to indicate the assembly result.
[0333] For example, the second prompt could be "The steering wheel is assembled correctly, but the seat color is incorrect; it should be black."
[0334] S1126, The display module displays the second prompt.
[0335] Optionally, the display module can show a second prompt on the vehicle's large screen to inform the user of the assembly result. Alternatively, the second prompt can also show the quality inspection result.
[0336] In other examples, the vehicle may also include an audio module, through which the verification module can output a second prompt.
[0337] Specifically, the inspection module sends a second prompt to the audio module. Correspondingly, the audio module receives the second prompt from the inspection module. The first prompt can be the assembly result. Then, the audio module can play the second prompt to inform the user of the assembly result.
[0338] Thus, the present application embodiment can automatically carry out the vehicle inspection process through the above method, reduce labor costs, reduce the risk of the vehicle's large screen being scratched, and improve the inspection efficiency of vehicles on the inspection production line.
[0339] It should be noted that, in the embodiments of this application, all steps in the accompanying drawings are merely examples, and the order of the numbers of the methods described above does not imply the order of execution and should not constitute any limitation on the embodiments of this application. For example, in practical applications, the execution order of the steps shown in this application can be adjusted, and some steps can be added or removed; the embodiments of this application do not limit this.
[0340] The above text combined Figures 5 to 11 This application describes in detail the equipment inspection system and equipment inspection method according to embodiments of the present application. The following is in conjunction with... Figure 12 This application describes in detail the device inspection apparatus according to embodiments of the present application. The device inspection apparatus includes modules or units for performing each part of the above embodiments. Modules or units can be software or hardware, or hardware, or a combination of software and hardware. The following only provides a brief example of the data processing apparatus; for details of the implementation, please refer to the description of the foregoing method embodiments, which will not be repeated below.
[0341] Figure 12 This is a schematic block diagram of the equipment inspection apparatus 1200 provided in an embodiment of this application. Figure 12 As shown, the device 1200 may include a processing module 1201.
[0342] In one possible implementation, the device 1200 is used to perform the steps of the above-described method verification module.
[0343] The processing module 1201 is used to execute the startup process of the inspection module when the first device is powered on. The inspection module is used to inspect the first device. After the startup process is completed, the inspection task corresponding to the inspection station where the first device is located is executed.
[0344] It should be understood that the device 1200 here is embodied in the form of a functional module. The term "module" here can refer to application-specific integrated circuits (ASICs), electronic circuits, processors (e.g., shared processors, proprietary processors, or group processors, etc.) and memories for executing one or more software or firmware programs, integrated logic circuits, and / or other suitable components supporting the described functions. In an alternative example, those skilled in the art will understand that the device 1200 can specifically be the verification module in the above embodiments. The device 1200 can be used to execute the various processes and / or steps corresponding to the verification module in the above method embodiments; to avoid repetition, these will not be described again here.
[0345] For example, a processor may include an application processor (AP), a modem processor, a controller, and / or a digital signal processor (DSP). Different processing units can be independent devices or integrated into one or more processors.
[0346] It should be understood that the processor in the embodiments of this application can be an integrated circuit chip with signal processing capabilities. During implementation, the steps of the above method embodiments can be completed by integrated logic circuits in the processor's hardware or by instructions in software form. The processor described above may include, for example, an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU), etc. Different processing units can be independent devices or integrated into one or more processors. Alternatively, the processor described above can be a general-purpose processor, a DSP, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor, etc. The steps of the method disclosed in the embodiments of this application can be directly manifested as being executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules can reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method.
[0347] It should also be understood that the memory in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM). It should be noted that the memory used in the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0348] This application also provides an intelligent driving device, which includes a device inspection apparatus for implementing the method shown in the above method embodiments.
[0349] This application also provides another intelligent driving device, which is equipped with a verification module for implementing the method shown in the above method embodiments.
[0350] This application also provides a chip system, which includes at least one processor for implementing the methods shown in the above method embodiments.
[0351] This application also provides a computer program product, which includes a computer program (also known as code or instructions) that, when run, enables a computer to execute the methods shown in the above-described method embodiments.
[0352] This application also provides a computer-readable storage medium storing a computer program (also referred to as code or instructions). When the computer program is run, it enables the computer to perform the methods shown in the above-described method embodiments.
[0353] It should be understood that the module division in the embodiments of this application is illustrative and only represents a logical functional division. In actual implementation, there may be other division methods. Furthermore, the functional modules in the various embodiments of this application can be integrated into a single processor, exist as separate physical entities, or be integrated into a single module. The integrated modules described above can be implemented in hardware or as software functional modules.
[0354] The terms "unit," "module," etc., used in this specification can be used to refer to computer-related entities, hardware, firmware, combinations of hardware and software, software, or software in execution. In the embodiments of this application, "unit" and "module" have the same meaning and can be used interchangeably.
[0355] Those skilled in the art will recognize that the various illustrative logical blocks and steps described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application. In the several embodiments provided in this application, it should be understood that the disclosed apparatus, devices, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for example, the division of units is merely a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the shown or discussed mutual couplings or direct couplings or communication connections may be through some interfaces; indirect couplings or communication connections between devices or units may be electrical, mechanical, or other forms.
[0356] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0357] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.
[0358] In the above embodiments, the functions of each functional unit can be implemented entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. A computer program product includes one or more computer instructions (programs). When the computer program instructions (programs) are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. Computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., digital video discs, DVDs), or semiconductor media (e.g., solid-state disks, SSDs), etc.
[0359] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the technology, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.
[0360] The above are merely specific embodiments of this application, but the protection scope of the embodiments of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the embodiments of this application should be included within the protection scope of the embodiments of this application. Therefore, the protection scope of the embodiments of this application should be determined by the protection scope of the claims.
Claims
1. A method for inspecting equipment, characterized in that, The inspection module applied to the first device includes: Based on the power-on of the first device, the startup process of the inspection module is executed, and the inspection module is used to inspect the first device; After the startup process is completed, the inspection task corresponding to the inspection station where the first device is located is executed.
2. The method according to claim 1, characterized in that, The inspection station includes one or more of the following inspection tasks: electrical inspection, operation guidance, and / or photography.
3. The method according to claim 1 or 2, characterized in that, After the startup process is completed, the method further includes: The inspection station and the inspection task corresponding to the inspection station are obtained from the second device, and the second device is used to determine the inspection station of the first device on the inspection production line.
4. The method according to any one of claims 1-3, characterized in that, The inspection task includes an electrical inspection task, which includes performing one or more of the following operations on the first device: controller software upgrade, configuration parameter writing, software and hardware version verification, routine learning, third-party calibration, security certificate filling or key filling.
5. The method according to any one of claims 1-4, characterized in that, The inspection task includes an operation guidance task, which includes: outputting a first prompt; the first prompt is used to guide the user on the operation procedure at the inspection station.
6. The method according to claim 5, characterized in that, The first output prompt includes: The first prompt may be output via a display module and / or via an audio module.
7. The method according to claim 5 or 6, characterized in that, The method further includes: Receive a first confirmation message from the user, which instructs the user to complete the operation process.
8. The method according to any one of claims 1-7, characterized in that, The inspection task includes a photo-taking task, which includes: controlling the camera in the first device to collect image data and acquiring the image data collected by the camera in the first device; the image data is used to indicate the assembly result in the first device.
9. The method according to claim 8, characterized in that, The photo-taking task also includes: controlling the camera to adjust the shooting range.
10. The method according to claim 8 or 9, characterized in that, The method further includes: The image data is sent; the image data is used for image analysis on the electrical inspection server and / or terminal equipment. Receive the image analysis results and output a second prompt; the second prompt is used to indicate the assembly result.
11. The method according to any one of claims 1-10, characterized in that, The inspection tasks include electrical inspection tasks and operation guidance tasks. The step of executing the inspection task corresponding to the first inspection station where the first device is located includes: Based on the first inspection station where the first device is located, perform the electrical inspection task corresponding to the first inspection station. Upon completion of the electrical inspection task, the operation guidance task corresponding to the inspection station is executed based on the second inspection station of the first equipment. Alternatively, if the electrical inspection task is not completed, the electrical inspection task corresponding to the first inspection station and the operation guidance task corresponding to the second inspection station are executed based on the second inspection station of the first equipment.
12. The method according to any one of claims 2-11, characterized in that, The inspection task includes a first electrical inspection task and a second electrical inspection task; The first electrical inspection task and the second electrical inspection task are executed sequentially.
13. The method according to any one of claims 1-12, characterized in that, After the inspection module automatically starts when the first device is powered on, the method further includes: Send a first request message to the electrical inspection server; the first request message is used to request one or more of the following: electrical inspection task, operation guidance task and / or photo taking task; Receive a first response message from the electrical inspection server; the first response message carries one or more of the following: electrical inspection task, operation guidance task, and / or photo taking task.
14. The method according to any one of claims 1-13, characterized in that, After the inspection module automatically starts when the first device is powered on, the method further includes: Send a second request message to the second device; the second request message is used to request one or more of the following: operation guidance task and / or photo taking task; Receive a second response message from the second device; the second response message carries one or more of the following: an operation guidance task and / or a photo-taking task.
15. The method according to any one of claims 1-14, characterized in that, The method further includes: Based on the user's first operation, the automatic inspection function is activated; the automatic inspection function includes executing the inspection task corresponding to the inspection station where the first device is located. Alternatively, based on a second user action, the automatic verification function can be disabled.
16. A method for inspecting equipment, characterized in that, Applications in electrical inspection servers include: Receive a first request message from a first device; the first request message is used to request one or more of the following: electrical inspection task, operation guidance task and / or photo taking task; A first response message is sent to the first device based on the first request message; the first response message carries one or more of the following: electrical inspection task, operation guidance task and / or photo taking task.
17. The method according to claim 16, characterized in that, Sending a first response message to the first device based on the first request message includes: Send a third request message to the second device; the third request message is used to request one or more of the following: operation guidance task and / or photo taking task; Receive a third response message from the second device; the third response message carries one or more of the following: an operation guidance task and / or a photo-taking task; The first response message is sent to the first device based on the first request message and the third response message.
18. The method according to claim 16 or 17, characterized in that, The method further includes: Receive image data from the first device and preset assembly information from the second device; Image analysis results are generated based on the image data and the preset assembly information; Send the image analysis results.
19. A method for inspecting equipment, characterized in that, Applied to a second device, including: Receive a second request message from the first device; the second request message is used to request one or more of the following: an operation guidance task and / or a photo-taking task; A second response message is sent to the first device based on the second request message; the second response message carries one or more of the following: operation guidance task and / or photo taking task.
20. An equipment inspection system, characterized in that, It includes a first device, a second device, and an electrical inspection server; the first device includes an inspection module; The second device is used to determine the inspection station of the first device on the inspection production line and the inspection task corresponding to the inspection station; The electrical inspection server is used to obtain the inspection task corresponding to the inspection station from the second device; The inspection module of the first device is used to obtain the inspection task corresponding to the inspection station from the electrical inspection server, and to obtain the inspection station of the first device on the inspection production line from the second device; The inspection module is also used to execute the inspection task corresponding to the inspection station based on the inspection station of the first equipment on the inspection production line; the inspection module is used to execute the start-up process of the inspection module based on the power-on of the first equipment.
21. An equipment inspection device, characterized in that, include: Processing module; The processing module is used to execute the startup process of the inspection module based on the power-on of the first device, and the inspection module is used to perform inspection and testing on the first device; The processing module is further configured to, after the startup process is completed, execute the inspection task corresponding to the inspection station where the first device is located.
22. An equipment inspection device, characterized in that, The device includes at least one processor and a memory for storing computer-readable instructions, wherein when the at least one processor reads the computer-readable instructions from the memory, the device causes the device to perform the method as described in any one of claims 1 to 16.
23. An intelligent driving device, characterized in that, It includes the equipment inspection device as described in claim 21; or it includes the equipment inspection device as described in claim 22.
24. A computer-readable storage medium storing instructions, characterized in that, When the instructions are executed on a computer, the computer performs the method as described in any one of claims 1 to 16, or the method as described in any one of claims 17 to 19, or the method as described in claim 20.
25. A computer program product, characterized in that, The computer program product includes: a computer program or instructions that, when executed on a computer, cause the computer to perform the method as claimed in any one of claims 1 to 16, or the method as claimed in any one of claims 17 to 19, or the method as claimed in claim 20.