AR-based power battery training method and system

Abstract

The invention provides a power battery training method and system based on AR, and relates to the technical field of virtual reality simulation. The AR-based power battery training method comprises the steps of obtaining training data of PACK repair operation of a power battery; aR scene data are obtained according to the training data, AR equipment loads and generates an augmented reality three-dimensional coordinate scene through the AR scene data, and a selection interface of the augmented reality three-dimensional coordinate scene comprises at least one power battery training interface; acquiring student operation information sent by the AR equipment; and performing training evaluation according to the student operation information to generate a training evaluation result. According to the AR-based power battery training method, the technical effect of improving the training operation efficiency can be achieved.

Description

Technical Field

[0001] The present application relates to the technical field of virtual reality simulation technology, and specifically, to an AR-based power battery training method and system. Background Art

[0002] At present, the pre-job training process for power battery production site personnel is: learning theoretical knowledge (products and tools, etc.) through written materials, safety knowledge learning, familiarizing with the use of on-site products and tools, practical training, and practical assessment. Generally speaking, in the existing training process, such as in the process of learning theoretical knowledge, the learning is relatively abstract, the knowledge is difficult to digest, the experience is not high, the cost of products, tools and other materials is high, the number of trainees is limited, and the product structure is not clear enough, which affects the work efficiency. Summary of the invention

[0003] The purpose of this application is to provide an AR-based power battery training method, system, electronic device and computer-readable storage medium, which can achieve the technical effect of improving the efficiency of training operations.

[0004] In a first aspect, the present application provides an AR-based power battery training method, comprising:

[0005] Obtain training data for power battery PACK repair operations;

[0006] Obtaining AR scene data according to the training data, the AR device loading and generating an augmented reality three-dimensional coordinate scene through the AR scene data, wherein the selection interface of the augmented reality three-dimensional coordinate scene includes at least one power battery training interface;

[0007] Obtaining the student operation information sent by the AR device;

[0008] A training evaluation is performed based on the trainee operation information to generate a training evaluation result.

[0009] In the above implementation process, the AR-based power battery training method generates corresponding AR scene data through the training data of the power battery PACK rework operation, so that the AR device can load and generate an augmented reality three-dimensional coordinate scene based on the AR scene data; the augmented reality three-dimensional coordinate scene includes at least one power battery training interface, and the trainees perform corresponding training operations according to the power battery training interface, and obtain the trainee operation information sent by the AR device after the trainee's operation, evaluate the accuracy of the trainee's operation, and generate a training evaluation result; thus, the AR-based power battery training method realizes an immersive experience by providing an augmented reality application scenario, can quickly master the operation process and safety education knowledge of the power battery PACK rework, and achieve the technical effect of improving the efficiency of training operations.

[0010] Furthermore, the power battery training interface includes a product interface. Before the step of obtaining the trainee operation information sent by the AR device, the method further includes:

[0011] Acquire a first operation action for the product interface;

[0012] A 3D structural model of the power battery PACK is generated based on the first operation action, and the AR device performs a disassembly demonstration of the structure of the power battery PACK based on the 3D structural model. The 3D structural model includes one or more of the PACK upper cover bolts, internal sealant, wiring harness, and BMS position.

[0013] In the above implementation process, a 3D structural model of the power battery PACK is generated through the product interface, so as to demonstrate the disassembly of the structure of the power battery PACK, thereby enabling students to have an immersive training experience of the power battery PACK.

[0014] Furthermore, the power battery training interface further includes a tool interface. Before the step of obtaining the trainee operation information sent by the AR device, the method further includes:

[0015] Acquire a second operation action for the tool interface;

[0016] A tool selection interface is generated based on the second operation action, and the AR device demonstrates the purpose and usage of the preset tool based on the tool selection interface. The tool 3D model in the tool selection interface includes one or more of a tightening gun, a truss hanger, a detection tool, and a scanning gun.

[0017] In the above implementation process, tools for the power battery PACK and corresponding tool operation demonstrations are generated through the tool interface, so that trainees can have an immersive training experience on the power battery PACK tools.

[0018] Furthermore, the power battery training interface also includes an operation interface. Before the step of obtaining the trainee operation information sent by the AR device, the method also includes:

[0019] Acquire a third operation action for the operation interface;

[0020] Generate an operation process training interface based on the third operation action, and generate a human model based on the operation process training interface to demonstrate the operation by the AR device;

[0021] If the trainee's operation is different from the demonstration operation of the AR device, an operation error prompt message is generated, and the AR device returns to the step of generating a human body model based on the operation process training interface to perform the demonstration operation.

[0022] In the above implementation process, the operation process of the power battery PACK is demonstrated through the operation interface, and the demonstration operation is realized through a human body model; in the process of demonstrating the operation, the student's operation is standardized, that is, when the student's operation is different from the demonstration operation of the AR device, the demonstration operation is performed again.

[0023] Furthermore, the power battery training interface also includes a safety interface. Before the step of obtaining the trainee operation information sent by the AR device, the method also includes:

[0024] Acquire a fourth operation action for the security interface;

[0025] A safety training interface is generated based on the fourth operation action, and the AR device generates a safety education demonstration and an exception handling demonstration based on the safety training interface.

[0026] In the above implementation process, a safety education demonstration and an exception handling demonstration are generated for the safety training interface of the power battery PACK through the safety interface, so as to help trainees quickly master the safety education knowledge of the power battery PACK repair.

[0027] Furthermore, the power battery training interface includes an assessment interface, and the step of obtaining the trainee operation information sent by the AR device includes:

[0028] Acquire a fifth operation action for the assessment interface;

[0029] An assessment checklist interface is generated based on the fifth operation action, and the AR device generates at least one assessment content demonstration based on the assessment checklist interface, wherein the assessment content demonstration includes one or more of the following: pressure-holding tooling and PACK moving out of the AGV, PACK disassembly, PACK inspection and testing, PACK assembly, pressure-holding tooling and PACK moving back to the AGV, data synchronization, and tool inspection;

[0030] The student operation information sent by the AR device is obtained based on the assessment content demonstration.

[0031] In a second aspect, the present application provides an AR-based power battery training system, comprising:

[0032] Training data module, used to obtain training data for power battery PACK repair operations;

[0033] A training scene module, used to obtain AR scene data according to the training data, and the AR device loads and generates an augmented reality three-dimensional coordinate scene through the AR scene data, and the selection interface of the augmented reality three-dimensional coordinate scene includes at least one power battery training interface;

[0034] A student operation module, used to obtain student operation information sent by the AR device;

[0035] The training evaluation module is used to perform training evaluation based on the trainee operation information and generate training evaluation results.

[0036] Furthermore, the power battery training interface includes a product interface, and the trainee operation module is also used for:

[0037] Acquire a first operation action for the product interface;

[0038] A 3D structural model of the power battery PACK is generated based on the first operation action, and the AR device performs a disassembly demonstration of the structure of the power battery PACK based on the 3D structural model. The 3D structural model includes one or more of the PACK upper cover bolts, internal sealant, wiring harness, and BMS position.

[0039] Furthermore, the power battery training interface also includes a tool interface, and the trainee operation module is also used to:

[0040] Acquire a second operation action for the tool interface;

[0041] A tool selection interface is generated based on the second operation action, and the AR device demonstrates the purpose and usage of the preset tool based on the tool selection interface. The tool 3D model in the tool selection interface includes one or more of a tightening gun, a truss hanger, a detection tool, and a scanning gun.

[0042] Furthermore, the power battery training interface also includes an operation interface, and the trainee operation module is also used to:

[0043] Acquire a third operation action for the operation interface;

[0044] Generate an operation process training interface based on the third operation action, and generate a human model based on the operation process training interface to demonstrate the operation by the AR device;

[0045] If the trainee's operation is different from the demonstration operation of the AR device, an operation error prompt message is generated, and the AR device returns to the step of generating a human body model based on the operation process training interface to perform the demonstration operation.

[0046] Furthermore, the power battery training interface also includes a safety interface, and the trainee operation module is also used to:

[0047] Acquire a fourth operation action for the security interface;

[0048] A safety training interface is generated based on the fourth operation action, and the AR device generates a safety education demonstration and an exception handling demonstration based on the safety training interface.

[0049] Furthermore, the power battery training interface includes an assessment interface, and the trainee operation module is also used for:

[0050] Acquire a fifth operation action for the assessment interface;

[0051] An assessment checklist interface is generated based on the fifth operation action, and the AR device generates at least one assessment content demonstration based on the assessment checklist interface, wherein the assessment content demonstration includes one or more of the following: pressure-holding tooling and PACK moving out of the AGV, PACK disassembly, PACK inspection and testing, PACK assembly, pressure-holding tooling and PACK moving back to the AGV, data synchronization, and tool inspection;

[0052] The student operation information sent by the AR device is obtained based on the assessment content demonstration.

[0053] In a third aspect, the present application provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method described in any one of the first aspects when executing the computer program.

[0054] In a fourth aspect, the present application provides a computer-readable storage medium, on which instructions are stored. When the instructions are executed on a computer, the computer executes the method as described in any one of the first aspects.

[0055] In a fifth aspect, the present application provides a computer program product, which, when running on a computer, enables the computer to execute the method as described in any one of the first aspects.

[0056] Other features and advantages disclosed in the present application will be described in the following description, or some features and advantages can be inferred or determined without doubt from the description, or can be learned by implementing the above-mentioned technology disclosed in the present application.

[0057] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0059] Figure 1 A schematic diagram of a flow chart of a power battery training method based on AR provided in an embodiment of the present application;

[0060] Figure 2 A schematic diagram of the structure of a power battery PACK provided in an embodiment of the present application;

[0061] Figure 3 A schematic diagram of a flow chart of another AR-based power battery training method provided in an embodiment of the present application;

[0062] Figure 4 A structural block diagram of an AR-based power battery training system provided in an embodiment of the present application;

[0063] Figure 5 A structural block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0064] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0065] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0066] The embodiments of the present application provide an AR-based power battery training method, system, electronic device and computer-readable storage medium, which can be applied to the training process for power battery PACK rework operations; the AR-based power battery training method generates corresponding AR scene data through the training data of the power battery PACK rework operations, so that the AR device can load and generate an augmented reality three-dimensional coordinate scene based on the AR scene data; the augmented reality three-dimensional coordinate scene includes at least one power battery training interface, and the trainee performs corresponding training operations according to the power battery training interface, and obtains the trainee operation information sent by the AR device after the trainee's operation, evaluates the accuracy of the trainee's operation, and generates a training evaluation result; thus, the AR-based power battery training method realizes an immersive experience by providing an augmented reality application scenario, can quickly master the operation process and safety education knowledge of the power battery PACK rework, and achieves the technical effect of improving the efficiency of training operations.

[0067] See also Figure 1 and Figure 2 , Figure 1 A flowchart of a power battery training method based on AR provided in an embodiment of the present application is provided. Figure 2 A schematic diagram of the structure of a power battery PACK provided in an embodiment of the present application; the AR-based power battery training method comprises the following steps:

[0068] S100: Acquire training data for power battery PACK repair work;

[0069] Exemplarily, the training data for the power battery PACK rework operation includes data such as the 3D model of the power battery PACK, the 3D model of the tool, the standard operating procedure, the operating safety procedure, etc.;

[0070] S200: Obtaining AR scene data according to the training data, the AR device loading and generating an augmented reality three-dimensional coordinate scene through the AR scene data, wherein the selection interface of the augmented reality three-dimensional coordinate scene includes at least one power battery training interface;

[0071] For example, augmented reality (AR) technology is a technology that cleverly integrates virtual information with the real world. It widely uses a variety of technical means such as multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, and sensing. It simulates computer-generated virtual information such as text, images, three-dimensional models, music, and videos, and applies them to the real world. The two types of information complement each other, thereby achieving "enhancement" of the real world.

[0072] S300: Acquire the student operation information sent by the AR device;

[0073] S400: Perform training evaluation according to the trainee operation information and generate training evaluation results.

[0074] Exemplarily, the AR-based power battery training method generates corresponding AR scene data through the training data of the power battery PACK rework operation, so that the AR device can load and generate an augmented reality three-dimensional coordinate scene based on the AR scene data; the augmented reality three-dimensional coordinate scene includes at least one power battery training interface, and the trainee performs corresponding training operations according to the power battery training interface, and obtains the trainee operation information sent by the AR device after the trainee's operation, evaluates the accuracy of the trainee's operation, and generates a training evaluation result; thus, the AR-based power battery training method realizes an immersive experience by providing an augmented reality application scenario, can quickly master the operation process and safety education knowledge of the power battery PACK rework, and achieves the technical effect of improving the efficiency of training operations.

[0075] Exemplarily, the power battery training interface includes a product interface. Before the step of S300: acquiring the trainee operation information sent by the AR device, the method further includes:

[0076] Obtaining a first operation action on a product interface;

[0077] A 3D structural model of the power battery PACK is generated based on the first operation action, and the AR device demonstrates the disassembly of the structure of the power battery PACK based on the 3D structural model. The 3D structural model includes one or more of the PACK upper cover bolts, internal sealant, wiring harness, and BMS position.

[0078] For example, a 3D structural model of the power battery PACK is generated through the product interface, so that the structure of the power battery PACK can be disassembled and demonstrated, thereby providing trainees with an immersive training experience of the power battery PACK.

[0079] Exemplarily, the power battery training interface further includes a tool interface. Before the step of S300: obtaining the trainee operation information sent by the AR device, the method further includes:

[0080] Obtain a second operation action for the tool interface;

[0081] A tool selection interface is generated based on the second operation action, and the AR device demonstrates the purpose and usage of the preset tool based on the tool selection interface. The tool 3D model in the tool selection interface includes one or more of a tightening gun, a truss hanger, a detection tool, and a scanning gun.

[0082] Exemplarily, tools for the power battery PACK and corresponding tool operation demonstrations are generated through a tool interface, so that trainees can have an immersive training experience of the power battery PACK tools.

[0083] Exemplarily, the power battery training interface also includes an operation interface. Before the step of S300: obtaining the trainee operation information sent by the AR device, the method further includes:

[0084] Acquire a third operation action for the operation interface;

[0085] Based on the third operation action, an operation process training interface is generated, and the AR device generates a human model based on the operation process training interface to demonstrate the operation;

[0086] If the trainee's operation is different from the demonstration operation of the AR device, an operation error prompt message is generated, and the process returns to the step in which the AR device generates a human model based on the operation process training interface to perform the demonstration operation.

[0087] Exemplarily, the operation process of the power battery PACK is demonstrated through the operation interface, and the demonstration operation is implemented through a human body model; in the process of demonstrating the operation, the trainee's operation is standardized, that is, when the trainee's operation is different from the demonstration operation of the AR device, the demonstration operation is performed again.

[0088] Exemplarily, the power battery training interface also includes a safety interface. Before the step of S300: obtaining the trainee operation information sent by the AR device, the method further includes:

[0089] Obtaining a fourth operation action for the security interface;

[0090] A safety training interface is generated based on the fourth operation action, and the AR device generates a safety education demonstration and an exception handling demonstration based on the safety training interface.

[0091] Exemplarily, a safety training interface for a power battery PACK generates a safety education demonstration and an exception handling demonstration through a safety interface, thereby helping trainees to quickly master the safety education knowledge of power battery PACK repair.

[0092] Exemplarily, the power battery training interface includes an assessment interface, S300: the step of obtaining the trainee operation information sent by the AR device includes:

[0093] Get the fifth operation action for the assessment interface;

[0094] An assessment checklist interface is generated based on the fifth operation action, and the AR device generates at least one assessment content demonstration based on the assessment checklist interface, and the assessment content demonstration includes one or more of the following: pressure-holding tooling and PACK moving out of the AGV, PACK disassembly, PACK inspection and testing, PACK assembly, pressure-holding tooling and PACK moving back to the AGV, data synchronization, and tool inspection;

[0095] Based on the assessment content demonstration, obtain the student operation information sent by the AR device.

[0096] In some implementation scenarios, the AR-based power battery training method provided in the embodiments of the present application, the simulation scenarios included in the AR scenario data are summarized as shown in the following table:

[0097] Table 1-Simulation scenario summary

[0098]

[0099]

[0100] See also Figure 3 , Figure 3 A flow chart of another AR-based power battery training method provided in an embodiment of the present application; applied to an AR-based power battery training device, providing augmented reality application scenarios, power battery PACK 3D structure models, and tool usage, through an immersive experience, the operation process and safety education knowledge of power battery PACK repair can be quickly mastered; combined with Figure 3 ,The specific operation process example of this AR-based power battery training method is as follows:

[0101] (1) Start the system and wait for the AR device to connect to the system platform;

[0102] (2) Login account and password;

[0103] (3) Trainees wear AR devices, choose to import the power battery PACK repair operation training course, and load the augmented reality 3D coordinate scene;

[0104] (4) The system displays an augmented reality three-dimensional coordinate scene and generates a virtual teaching assistant to guide students to operate in the augmented reality scene by combining text, voice and animation;

[0105] (5) The main interface allows you to select menus: products, tools, operations, safety, and assessments;

[0106] (6) The trainee chooses to enter the product menu. First, the 3D structure model of the power battery PACK is presented. The virtual assistant introduces the PACK structure disassembly and indicates the location of the PACK cover bolts, internal sealant, wiring harness, and BMS. After completion, the trainee returns to the main interface.

[0107] (7) The trainee chooses to enter the tool menu, which presents 3D model tool options such as tightening guns, truss hangers, inspection tools, and scanners. After selecting one of the tools, the virtual assistant will introduce the purpose and usage of the tool, and then return to the main interface after completion;

[0108] (8) When the trainee chooses to enter the operation menu, the virtual assistant will generate a human model to demonstrate the operation, guide the trainee to complete each step, and explain some key operation actions in detail by the system while the trainee is operating; after completing the current step, the next step of operation demonstration will be automatically entered;

[0109] (9) If the trainee operates incorrectly, the system prompts the trainee that the operation is wrong, and re-demonstrates the correct virtual action corresponding to the non-standard behavior to the trainee, guides the trainee to complete the operation correctly, and proceeds to the next step of the operation demonstration;

[0110] (10) The operation process is as follows: ① The AGV sends the defective PACK products back to the repair area, and demonstrates the use of a scanner to scan the code; ② Use a hoist to lift the pressure-maintaining tooling to the temporary storage trolley, and lift the defective products to the workbench; ③ Use tools to disassemble the pack; ④ Use a hoist to remove the PACK cover; ⑤ Demonstrate and guide the inspection of whether the internal sealant is installed intact, whether the wiring harness pins are skewed and re-plugged, and whether the detection tool measures whether the BMS is damaged; ⑥ After the abnormal processing is qualified, the call button is activated, and the defective products are removed from the battery line batch port; ⑦ Reinstall the PACK cover, and use a hoist to lift the PACK and the pressure-maintaining tooling onto the AGV in turn; ⑧ Arrange and inspect tool parts; ⑨ Update the result data and release the AGV;

[0111] (11) After the trainees complete all steps of the operation training, they return to the main interface;

[0112] (12) The trainee chooses to enter the safety menu, and the virtual assistant will demonstrate safety education and abnormal handling methods. For example, if the PACK temperature is too high or sparks are generated, call the AGV to transport the PACK to the fire pool. After completion, return to the main interface;

[0113] (13) The trainee chooses to enter the assessment menu, and the virtual assistant will generate an assessment list. The assessment contents include: moving the pressure-holding tooling and PACK out of the AGV, PACK disassembly, PACK inspection and testing, PACK assembly, moving the pressure-holding tooling and PACK back to the AGV, data synchronization, and tool inspection;

[0114] (14) Trainees perform corresponding operations in the augmented reality power battery PACK repair operation scene according to the assessment requirements;

[0115] (15) The system determines whether each step is correct based on the trainee’s action information and scores each step;

[0116] (16) If the score is not satisfactory, students can review the playback record of the incorrect operation during the assessment process and demonstrate the correct operation in the animation. Students can choose to retake the assessment;

[0117] (17) After the assessment is completed, the system saves the student’s assessment record and learning record, and pushes the assessment results to the relevant departments.

[0118] For example, in combination Figures 1 to 3 The power battery training method based on AR provided in the embodiment of the present application has at least the following beneficial effects:

[0119] (1) Existing theoretical knowledge training is relatively abstract and difficult to remember. The present invention enables trainees to master theoretical knowledge faster and more deeply, and to understand it vividly;

[0120] (2) Existing learning, training and assessment generally only record the results. The present invention provides more systematic learning and assessment for trainees, and retains records of the learning and assessment process for review at any time;

[0121] (3) Existing practical training requires the provision of real tools, products and venues, which has high material costs, wastes energy and is restricted by the geographical environment. The present invention overcomes the constraints of space, equipment, environment and raw material supply, thus saving costs;

[0122] (4) Existing practical training may cause certain damage to tools, products and venues, requiring regular maintenance. Improper operation by trainees may also cause danger to themselves or others. The present invention provides a safe training environment and saves maintenance costs.

[0123] (5) The present invention provides an abnormality handling simulation scenario to train trainees to learn methods for handling emergencies, which is fresh in their memory and makes up for the practical knowledge of handling abnormal power battery temperature and other situations in reality.

[0124] See also Figure 4 , Figure 4 This is a structural block diagram of an AR-based power battery training system provided in an embodiment of the present application. The AR-based power battery training system includes:

[0125] The training data module 100 is used to obtain training data for the power battery PACK repair operation;

[0126] The training scene module 200 is used to obtain AR scene data according to the training data, and the AR device loads and generates an augmented reality three-dimensional coordinate scene through the AR scene data. The selection interface of the augmented reality three-dimensional coordinate scene includes at least one power battery training interface;

[0127] The student operation module 300 is used to obtain the student operation information sent by the AR device;

[0128] The training evaluation module 400 is used to perform training evaluation according to the trainee operation information and generate training evaluation results.

[0129] Exemplarily, the power battery training interface includes a product interface, and the trainee operation module 300 is also used to:

[0130] Obtaining a first operation action on a product interface;

[0131] A 3D structural model of the power battery PACK is generated based on the first operation action, and the AR device demonstrates the disassembly of the structure of the power battery PACK based on the 3D structural model. The 3D structural model includes one or more of the PACK upper cover bolts, internal sealant, wiring harness, and BMS position.

[0132] Exemplarily, the power battery training interface also includes a tool interface, and the trainee operation module 300 is also used to:

[0133] Obtain a second operation action for the tool interface;

[0134] A tool selection interface is generated based on the second operation action, and the AR device demonstrates the purpose and usage of the preset tool based on the tool selection interface. The tool 3D model in the tool selection interface includes one or more of a tightening gun, a truss hanger, a detection tool, and a scanning gun.

[0135] Exemplarily, the power battery training interface also includes an operation interface, and the trainee operation module 300 is also used to:

[0136] Acquire a third operation action for the operation interface;

[0137] Based on the third operation action, an operation process training interface is generated, and the AR device generates a human model based on the operation process training interface to demonstrate the operation;

[0138] If the trainee's operation is different from the demonstration operation of the AR device, an operation error prompt message is generated, and the process returns to the step in which the AR device generates a human model based on the operation process training interface to perform the demonstration operation.

[0139] Exemplarily, the power battery training interface also includes a safety interface, and the trainee operation module 300 is also used to:

[0140] Obtaining a fourth operation action for the security interface;

[0141] A safety training interface is generated based on the fourth operation action, and the AR device generates a safety education demonstration and an exception handling demonstration based on the safety training interface.

[0142] Exemplarily, the power battery training interface includes an assessment interface, and the trainee operation module 300 is also used to:

[0143] Get the fifth operation action for the assessment interface;

[0144] An assessment checklist interface is generated based on the fifth operation action, and the AR device generates at least one assessment content demonstration based on the assessment checklist interface, and the assessment content demonstration includes one or more of the following: pressure-holding tooling and PACK moving out of the AGV, PACK disassembly, PACK inspection and testing, PACK assembly, pressure-holding tooling and PACK moving back to the AGV, data synchronization, and tool inspection;

[0145] Based on the assessment content demonstration, obtain the student operation information sent by the AR device.

[0146] It should be noted that the AR-based power battery training system provided in the embodiment of the present application is Figures 1 to 3 The method embodiments shown correspond to each other and will not be described again here to avoid repetition.

[0147] This application also provides an electronic device, see Figure 5 , Figure 5 A block diagram of an electronic device provided in an embodiment of the present application. The electronic device may include a processor 510, a communication interface 520, a memory 530, and at least one communication bus 540. The communication bus 540 is used to realize direct connection and communication between these components. The communication interface 520 of the electronic device in the embodiment of the present application is used to communicate signaling or data with other node devices. The processor 510 may be an integrated circuit chip with signal processing capabilities.

[0148] The processor 510 mentioned above can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor 510 can also be any conventional processor, etc.

[0149] The memory 530 may be, but is not limited to, a random access memory (RAM), a read only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electric erasable programmable read-only memory (EEPROM), etc. The memory 530 stores computer-readable instructions. When the computer-readable instructions are executed by the processor 510, the electronic device can execute the above-mentioned Figures 1 to 3 The method embodiment involves various steps.

[0150] Optionally, the electronic device may further include a storage controller and an input / output unit.

[0151] The memory 530, storage controller, processor 510, peripheral interface, input and output unit components are directly or indirectly electrically connected to each other to achieve data transmission or interaction. For example, these components can be electrically connected to each other via one or more communication buses 540. The processor 510 is used to execute executable modules stored in the memory 530, such as software function modules or computer programs included in the electronic device.

[0152] The input and output unit is used to provide users with the task creation and to create a start optional time period or preset execution time for the task to realize the interaction between the user and the server. The input and output unit can be, but is not limited to, a mouse and a keyboard.

[0153] Understandably, Figure 5 The structure shown is for illustration only, and the electronic device may also include Figure 5 More or fewer components as shown, or with Figure 5 Different configurations shown. Figure 5 Each component shown in the figure can be implemented by hardware, software or a combination thereof.

[0154] An embodiment of the present application further provides a storage medium having instructions stored thereon. When the instructions are run on a computer, the computer program is executed by a processor to implement the method described in the method embodiment. To avoid repetition, the method will not be described here.

[0155] The present application also provides a computer program product, which, when executed on a computer, enables the computer to execute the method described in the method embodiment.

[0156] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0157] In addition, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

[0158] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0159] The above description is only an embodiment of the present application and is not intended to limit the scope of protection of the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application. It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in the subsequent drawings.

[0160] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0161] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

Claims

1. A power battery training method based on AR, characterized in that: include: Obtain training data for power battery PACK repair operations; Obtaining AR scene data according to the training data, the AR device loading and generating an augmented reality three-dimensional coordinate scene through the AR scene data, wherein the selection interface of the augmented reality three-dimensional coordinate scene includes at least one power battery training interface; Obtaining the student operation information sent by the AR device; A training evaluation is performed based on the trainee operation information to generate a training evaluation result.

2. The AR-based power battery training method according to claim 1, characterized in that: The power battery training interface includes a product interface. Before the step of obtaining the trainee operation information sent by the AR device, the method further includes: Acquire a first operation action for the product interface; A 3D structural model of the power battery PACK is generated based on the first operation action, and the AR device performs a disassembly demonstration of the structure of the power battery PACK based on the 3D structural model. The 3D structural model includes one or more of the PACK upper cover bolts, internal sealant, wiring harness, and BMS position.

3. The AR-based power battery training method according to claim 2, characterized in that: The power battery training interface also includes a tool interface. Before the step of obtaining the trainee operation information sent by the AR device, the method also includes: Acquire a second operation action for the tool interface; A tool selection interface is generated based on the second operation action, and the AR device demonstrates the purpose and usage of the preset tool based on the tool selection interface. The tool 3D model in the tool selection interface includes one or more of a tightening gun, a truss hanger, a detection tool, and a scanning gun.

4. The AR-based power battery training method according to claim 2 or 3, characterized in that: The power battery training interface also includes an operation interface. Before the step of obtaining the trainee operation information sent by the AR device, the method also includes: Acquire a third operation action for the operation interface; Generate an operation process training interface based on the third operation action, and generate a human model based on the operation process training interface to demonstrate the operation by the AR device; If the trainee's operation is different from the demonstration operation of the AR device, an operation error prompt message is generated, and the AR device returns to the step of generating a human body model based on the operation process training interface to perform the demonstration operation.

5. The AR-based power battery training method according to claim 2 or 3, characterized in that: The power battery training interface also includes a safety interface. Before the step of obtaining the trainee operation information sent by the AR device, the method also includes: Acquire a fourth operation action for the security interface; A safety training interface is generated based on the fourth operation action, and the AR device generates a safety education demonstration and an exception handling demonstration based on the safety training interface.

6. The AR-based power battery training method according to claim 1, characterized in that: The power battery training interface includes an assessment interface, and the step of obtaining the trainee operation information sent by the AR device includes: Acquire a fifth operation action for the assessment interface; An assessment checklist interface is generated based on the fifth operation action, and the AR device generates at least one assessment content demonstration based on the assessment checklist interface, wherein the assessment content demonstration includes one or more of the following: pressure-holding tooling and PACK moving out of the AGV, PACK disassembly, PACK inspection and testing, PACK assembly, pressure-holding tooling and PACK moving back to the AGV, data synchronization, and tool inspection; The student operation information sent by the AR device is obtained based on the assessment content demonstration.

7. An AR-based power battery training system, characterized in that: include: Training data module, used to obtain training data for power battery PACK repair operations; A training scene module, used to obtain AR scene data according to the training data, and the AR device loads and generates an augmented reality three-dimensional coordinate scene through the AR scene data, and the selection interface of the augmented reality three-dimensional coordinate scene includes at least one power battery training interface; A student operation module, used to obtain student operation information sent by the AR device; The training evaluation module is used to perform training evaluation based on the trainee operation information and generate training evaluation results.

8. The AR-based power battery training system according to claim 7, characterized in that: The power battery training interface includes a product interface, and the trainee operation module is also used for: Acquire a first operation action for the product interface; A 3D structural model of the power battery PACK is generated based on the first operation action, and the AR device performs a disassembly demonstration of the structure of the power battery PACK based on the 3D structural model. The 3D structural model includes one or more of the PACK upper cover bolts, internal sealant, wiring harness, and BMS position.

9. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps of the AR-based power battery training method as described in any one of claims 1 to 6 are implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, and when the instructions are executed on a computer, the computer executes the AR-based power battery training method according to any one of claims 1 to 6.

Images