Accessory replacement interaction method and device, electronic equipment and system
By marking fault points in the digital twin model and displaying replaceable accessories information, and combining extended reality technology to achieve accurate matching of accessories, the problem of accessories mismatch in large-scale HVAC equipment repairs is solved and maintenance efficiency is improved.
Patent Information
- Application Number
- CN202310662738.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-05
- Publication Date
- 2024-12-06
AI Technical Summary
During the failure maintenance process of large HVAC equipment such as central air conditioners, accessories purchased or obtained from repair shops often do not match the equipment, resulting in inefficient maintenance.
By creating a digital twin model of the device and marking the fault points in the model, displaying the replaceable accessories information corresponding to the fault points, allowing users to perform installation previews to determine the target accessories for size adaptation, combining extended reality technology to display the device scene and faults on the spot. to achieve accurate matching of accessories.
Improve maintenance efficiency, reduce re-repair and delays caused by mismatch of accessories, and ensure the accuracy and efficiency of the maintenance process.
Smart Images

Figure CN119090474A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of equipment maintenance, and more specifically, to an interactive method for accessory replacement, an interactive device for accessory replacement, an electronic device, an interactive system for accessory replacement, a non-volatile computer-readable storage medium, and a computer program product. Background Art
[0002] At present, when performing fault maintenance on large HVAC equipment such as central air conditioners, engineers are usually required to troubleshoot various parts of the HVAC equipment on site. The faulty parts found need to be purchased from other places or replaced with replacement parts from a repair shop. However, the replacement parts purchased from other places or taken from the repair shop may not match the on-site equipment, resulting in the maintenance personnel having to re-purchase or go to the repair shop to replace other parts before repairing the equipment, resulting in low maintenance efficiency. Summary of the invention
[0003] Embodiments of the present application provide an interactive method for accessory replacement, an interactive device for accessory replacement, an electronic device, an interactive system for accessory replacement, a non-volatile computer-readable storage medium, and a computer program product.
[0004] An interactive method for accessory replacement according to one embodiment of the present application includes displaying a digital twin model of a device and a fault point mark, wherein the fault point mark is used to indicate the location of the fault point in the digital twin model; in response to a fault locating operation on the fault point mark, displaying replaceable accessory information of the component corresponding to the located fault point mark, wherein the replaceable accessory information includes at least one or more models of replaceable accessories; and in response to an installation preview operation on the model of the replaceable accessory, replacing the component corresponding to the fault point mark in the digital twin model with the model of the replaceable accessory to determine a target replaceable accessory that matches the size of the device.
[0005] In some embodiments, the digital twin model and fault point mark of the display device include superimposing and displaying the scene where the device is located, the digital twin model and the fault point mark in each of the extended reality devices based on the location information of the device and the extended reality device.
[0006] In some embodiments, the interactive method for accessory replacement also includes identifying the device to obtain the digital twin model of the device and the fault point mark, the digital twin model is generated based on the three-dimensional model and operation information of the device, and the fault point mark is generated based on the operation information.
[0007] In some embodiments, the display of replaceable accessory information of the component corresponding to the located fault point mark includes displaying one or more models of the replaceable accessories that match the component corresponding to the located fault point mark based on the operating information of the device and the information of the component corresponding to the located fault point mark.
[0008] In some embodiments, the replaceable accessory information also includes pricing information and inventory information of each of the replaceable accessories. The interactive method for accessory replacement also includes responding to an order for the replaceable accessories, generating an order based on the order quantity and the pricing information, and updating the inventory information of the replaceable accessories after the order payment is completed.
[0009] In some embodiments, the replaceable parts information also includes displaying logistics information of the order in response to a query operation on the order.
[0010] In some embodiments, the replaceable accessories information also includes determining whether the fault is repaired based on the operating information of the device in response to the purchased replaceable accessories being installed on the device; and uploading on-site maintenance information to determine a maintenance score if the fault is repaired.
[0011] The interactive device for accessory replacement in the embodiment of the present application includes a first display module, a second display module and a preview module; the first display module is used to display a digital twin model and a fault point mark of the device, and the fault point mark is used to indicate the location of the fault point in the digital twin model; the second display module is used to respond to the fault location operation of the fault point mark, and display the replaceable accessory information of the component corresponding to the located fault point mark, and the replaceable accessory information includes at least the model of the replaceable accessory; and the preview module is used to respond to the installation preview operation of the model of the replaceable accessory, and replace the component corresponding to the fault point mark in the digital twin model with the model of the replaceable accessory to determine the target replaceable accessory that is adapted to the size of the device.
[0012] The electronic device of an embodiment of the present application includes a display, one or more processors, a memory and one or more computer programs, wherein one or more of the computer programs are stored in the memory and executed by one or more of the processors, and the computer program includes instructions for executing the interactive method of accessory replacement of any of the above embodiments.
[0013] The interactive system for accessory replacement of the embodiment of the present application comprises a device and an electronic device. The electronic device can be connected to the device for communication, and the electronic device is used to execute the interactive method for accessory replacement described in any one of the above embodiments.
[0014] The computer-readable storage medium of the embodiment of the present application includes a computer program. When the computer program is executed by a processor, the processor executes the interactive method for accessory replacement of any of the above-mentioned embodiments.
[0015] The computer program product of the embodiment of the present application includes a computer program, and when the computer program is executed by a processor, the interactive method for replacing accessories described in any of the above embodiments is implemented.
[0016] In the interactive method for accessory replacement, the interactive device for accessory replacement, the electronic device, the interactive system for accessory replacement, the non-volatile computer-readable storage medium and the computer program product of the embodiments of the present application, a digital twin model of the device is displayed, and a fault point mark for indicating the location of the fault point in the digital twin model is displayed in the digital twin model, so that maintenance personnel can obtain the replaceable accessory information of the component corresponding to the fault point mark, and the replaceable accessories can be previewed and installed in the digital twin model to determine the replaceable accessories that are compatible with the accessories corresponding to the fault point mark, which can help maintenance personnel or users select replaceable accessories with compatible sizes and avoid the problem of low maintenance efficiency caused by the incompatibility of replaceable accessories.
[0017] Additional aspects and advantages of the embodiments of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the embodiments of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:
[0019] Figure 1 is a flow chart of a device management method of certain embodiments of the present application;
[0020] Figure 2 is a schematic diagram of the structure of an electronic device according to some embodiments of the present application;
[0021] Figure 3 It is a schematic diagram of a scenario of a device management method in certain embodiments of the present application;
[0022] Figure 4 It is a schematic diagram of a scenario of a device management method in certain embodiments of the present application;
[0023] Figure 5 It is a schematic diagram of a scenario of a device management method in certain embodiments of the present application;
[0024] Figure 6 It is a schematic diagram of a scenario of a device management method in certain embodiments of the present application;
[0025] Figure 7 It is a schematic diagram of a scenario of a device management method in certain embodiments of the present application;
[0026] Figure 8 is a flow chart of a device management method of certain embodiments of the present application;
[0027] Fig. 9 is a flow chart of a device management method of certain embodiments of the present application;
[0028] Fig.10 is a flow chart of a device management method of certain embodiments of the present application;
[0029] Fig.11 It is a schematic diagram of a scenario of a device management method in certain embodiments of the present application;
[0030] Fig.12 It is a schematic diagram of a scenario of a device management method in certain embodiments of the present application;
[0031] Fig.13 is a flow chart of a device management method of certain embodiments of the present application;
[0032] Fig.14 It is a schematic diagram of a scenario of a device management method in certain embodiments of the present application;
[0033] Fig.15 is a flow chart of a device management method of certain embodiments of the present application;
[0034] Fig.16 is a flow chart of a device management method of certain embodiments of the present application;
[0035] Fig.17 is a module schematic diagram of a device management device in certain embodiments of the present application;
[0036] Fig.18 It is a schematic diagram of the connection status of a non-volatile computer-readable storage medium and a processor in certain embodiments of the present application. DETAILED DESCRIPTION
[0037] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions from beginning to end. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the embodiments of the present application, and cannot be understood as limiting the embodiments of the present application.
[0038] See also Figure 1 , Figure 2 , Figure 3The interactive method for replacing accessories in the embodiment of the present application includes:
[0039] Step 011: Displaying a digital twin model 201 of the device and a fault point mark 202, where the fault point mark 202 is used to indicate the location of the fault point in the digital twin model 201;
[0040] Among them, the digital twin makes full use of physical models, sensor updates, operation history and other data, integrates multi-disciplinary, multi-physical quantity, multi-scale, and multi-probability simulation processes, completes mapping in the virtual space, and thus reflects the entire life cycle of the corresponding physical equipment.
[0041] The device 200 may be a HVAC device, which includes heating, ventilation, and air conditioning. The HVAC device is a device 200 related to heating, ventilation, and air conditioning, such as an air conditioner, a boiler, a radiator, an electric heater, etc. The device 200 may also be a household appliance, such as a washing machine, a water heater, a refrigerator, etc.
[0042] The digital twin model 201 of the device 200 is the mapping of the device 200 in three-dimensional space. The digital twin model 201 can realize simulation operation. The size ratio of the digital twin model 201 to the device 200 is 1:1. The operating parameters of the digital twin model 201 during simulation operation are consistent with the operating parameters of the device 200 during actual operation, and the parameters of the sensors in the digital twin model 201 are consistent with the parameters of the corresponding sensors of the device 200. By checking the working conditions of the digital twin model 201, the actual working conditions of the device 200 can be obtained.
[0043] Specifically, when displaying, the digital twin model 201 can be displayed through the display interface T of the display 20 of the electronic device 100. The electronic device 100 can be an extended reality (Extended Reality, XR) device (such as XR glasses), so that maintenance personnel can use XR glasses to superimpose the digital twin model 201 on the device 200 in the real scene for display, thereby facilitating maintenance personnel. The electronic device 100 can also be an electronic device 100 with a display 20 (such as a mobile phone, a computer, a smart watch, etc.), and the digital twin model 201 and related information can be directly displayed through the display 20.
[0044] Among them, XR refers to the combination of reality and virtuality through computers to create a virtual environment for human-computer interaction. It is also a general term for multiple technologies such as augmented reality (AR), virtual reality (VR), and mixed reality (MR).
[0045] The digital twin model 201 of the device 200 can be established in advance, and then the simulation operation of the digital twin model 201 can be realized based on the real-time acquisition of the operation information of the device 200. After the device 200 fails, different faults will cause corresponding deviations in the operation information of the device 200. For example, after the motor is damaged, the motor of the device 200 cannot operate normally, and the operation information of the motor is stopped. Therefore, by obtaining the operation information of the device 200 (specifically, it can be information collected by one or more sensors in the device 200), combined with the big data information maintained by the device 200, a rapid judgment of the fault point can be realized, so that the fault point mark 202 is displayed in the digital twin model 201, and the fault point mark 202 can indicate the location of the fault point in the digital twin model 201. In this way, there is no need to locate the fault point through the personal experience of the maintenance personnel, which saves the time of locating the fault point.
[0046] Step 012: In response to the fault location operation on the fault point mark 202, display the replaceable parts information 203 of the component corresponding to the located fault point mark 202, and the replaceable parts information 203 at least includes one or more models of replaceable parts 204;
[0047] Specifically, the number of fault point marks 202 in the digital twin model 201 may be one or more. To obtain the position of one of the fault point marks 202 in the digital twin model 201, for example, Figures 3 to 5 , the multiple fault point marks 202 include fault point mark A, fault point mark B, fault point mark C, and fault point mark D. The maintenance personnel or the user can perform a fault location operation on any fault point mark 202 in the digital twin model 201. For example, by selecting the fault point mark 202, the replaceable accessory information 203 of the component corresponding to the fault point mark 202 can be obtained. The replaceable accessory information 203 includes an accessory model for replacing the faulty component, wherein at least the model of one or more replaceable accessories 204 of the component corresponding to the fault point mark 202 by the maintenance personnel or the user can be displayed. If the maintenance personnel selects fault point mark A, the model of one or more replaceable accessories 204 of the component corresponding to the fault point mark A will be displayed; if the maintenance personnel selects fault point mark B, the model of one or more replaceable accessories 204 of the component corresponding to the fault point mark B will be displayed; if the maintenance personnel selects fault point marks A and B, the model of one or more replaceable accessories 204 of the component corresponding to the fault point marks A and B will be displayed at the same time; if the maintenance personnel selects fault point marks A to D, the model of one or more replaceable accessories 204 of the component corresponding to the fault point marks A to D will be displayed at the same time.
[0048] Step 013: In response to the installation preview operation of the model of the replaceable accessory 204, the component corresponding to the fault point mark 202 in the digital twin model 201 is replaced with the model of the replaceable accessory 204 to determine the target replaceable accessory 204 that is adapted to the size of the device 200.
[0049] Specifically, the maintenance personnel or the user performs an installation preview operation on one or more replaceable accessories 204 of the component corresponding to any fault point mark 202 in the digital twin model 201. For example, Figure 6 and Figure 7 , for the selection and replacement operations of the replaceable accessories 204, there are multiple replaceable accessories 204 in the components of the fault point mark 202 in the digital twin model 201. Click any one of them, and a replacement button pop-up window will appear on the display interface T. Click the "Yes" button to implement the replacement operation, and the replaceable accessory 204 can be replaced with the component corresponding to the fault point mark 202 to realize the installation preview of the replaceable accessory 204.
[0050] For example, the replaceable parts 204 of the fault point mark A include replaceable parts a, replaceable parts b and replaceable parts c. The maintenance personnel or user selects replaceable parts a to replace the parts corresponding to the fault point mark A. After the replacement is completed, the three-dimensional model of the replaceable parts a and the part M that matches the replaceable parts a is displayed after installation; through the three-dimensional models of the replaceable parts a and the part M, it can be determined whether the sizes of the replaceable parts a and the part M are compatible. Figure 6 and Figure 7 After performing an installation preview on replaceable accessory a, it is determined that the size of replaceable accessory a does not match that of component M, while after performing an installation preview on replaceable accessory b, it is determined that the size of replaceable accessory b matches that of component M. Therefore, the installation preview operation can help maintenance personnel or users select replaceable accessory 204 of matching size, thereby avoiding the problem of low maintenance efficiency caused by the incompatible size of replaceable accessory 204.
[0051] In this way, by displaying the digital twin model 201 of the device 200, and displaying the fault point mark 202 for indicating the position of the fault point in the digital twin model 201 in the digital twin model 201, the maintenance personnel can obtain the replaceable accessory information 203 of the component corresponding to the fault point mark 202, and the replaceable accessory 204 can be determined by performing a preview installation operation in the digital twin model 201. The replaceable accessory 204 that is compatible with the accessory corresponding to the fault point mark 202 can help maintenance personnel or users select replaceable accessories 204 of suitable size, thereby avoiding the problem of low maintenance efficiency caused by the incompatible size of the replaceable accessories 204.
[0052] See also Figure 8In some embodiments, step 011: displaying the digital twin model 201 and the fault point mark 202 of the device includes:
[0053] Step 0111: Based on the location information of the device 200 and the extended reality device, the scene where the device is located, the digital twin model 201 and the fault point mark 202 are superimposed and displayed in each extended reality device.
[0054] Specifically, in order to realize the superimposed display of the digital twin model 201, the device 200, the scene where the device 200 is located, and the fault point mark 202 through the XR glasses, the XR glasses are required to obtain the position of the device 200 and the scene where the device 200 is located (such as the XR glasses obtain the scene image through the camera to achieve visual positioning), and then combined with the position of the XR glasses, the digital twin model 201, the device 200, the scene where the device 200 is located, and the fault point mark 202 can be superimposed and displayed from the perspective of the XR glasses. At this time, the position of the displayed digital twin model 201 is the actual position of the device 200.
[0055] In addition, the maintenance personnel may include on-site maintenance personnel and remote maintenance personnel. Both the on-site maintenance personnel and the remote maintenance personnel have electronic devices 100 (such as wearing XR glasses). After the on-site maintenance personnel obtain the digital twin model 201, they can synchronize the display content (such as the on-site scene, digital twin model 201, equipment 200, and the fault mark point superimposed display content) and interactive operations to the remote maintenance personnel's XR glasses, so that the scene where the device is located, the digital twin model 201 and the fault point mark 202 are superimposed in each extended reality device, so that the on-site maintenance personnel and the remote maintenance personnel can achieve multi-person collaboration and complete the maintenance together.
[0056] See also Fig. 9 In some embodiments, the accessory replacement interaction method further includes:
[0057] Step 014: Identify the device 200 to obtain the digital twin model 201 and the fault point mark 202 of the device 200. The digital twin model 201 is generated based on the three-dimensional model and operation information of the device 200, and the fault point mark 202 is generated based on the operation information.
[0058] Specifically, each digital twin model 201 can be pre-established based on the corresponding device 200. When establishing it, it is necessary to obtain the three-dimensional model and operation information of the corresponding device 200. Only after combining the three-dimensional model and the operation information and realizing the simulation operation of the three-dimensional model, can the digital twin model 201 be established.
[0059] In order to accurately obtain the digital twin model 201 corresponding to the device 200, the image of the device 200 can be captured by XR glasses, and then the model of the device 200 can be identified to obtain the digital twin model 201 corresponding to the device 200, thereby ensuring the accuracy of obtaining the digital twin model 201. After the device 200 is accurately identified, the digital twin model 201 and the fault point mark 202 corresponding to the device 200 can be obtained.
[0060] Alternatively, the digital twin model 201 is not pre-established but generated in real time by the XR glasses. The XR glasses can obtain an image of the device 200, and then identify the model of the device 200 based on the image, thereby obtaining a three-dimensional model that matches the model; after obtaining the three-dimensional model of the device 200, the XR glasses communicate with the device 200 to obtain the operating information of the device 200, thereby combining the three-dimensional model and operating information of the device 200 to generate the digital twin model 201 in real time.
[0061] See also Fig.10 In some embodiments, step 012: displaying replaceable parts information 203 of the component corresponding to the located fault point mark 202 includes:
[0062] Step 0121: Based on the operation information of the device 200 and the information of the component corresponding to the located fault point mark 202, display the models of one or more replaceable accessories 204 that match the component corresponding to the located fault point mark 202.
[0063] Specifically, in order to display the models of one or more replaceable accessories 204 corresponding to the components of the located fault point mark 202, the display interface T needs to be filtered according to the operation information of the current device 200 and the information of the components corresponding to the located fault point mark 202. For example, the operation information includes the historical operation duration of the current device 200, the historical operation environment, and the geographical location where the device 200 is installed; the historical operation duration can be how long the device 200 needs to run every day or at what time the device 200 runs every day, and different operation times will cause different losses to the device 200; the historical operation environment includes the temperature or humidity environment in which the device 200 runs. If the ambient temperature is high when the device 200 is running, the accessories of the device 200 need to be made of high temperature resistant materials; if the ambient humidity is high when the device 200 is running, the accessories of the device 200 need to be waterproof; the geographical locations where the device 200 is installed are different, and it is necessary to consider whether the accessories can be delivered to the installation location of the device 200 in time. The digital twin model 201 displays the accessories close to the installation location of the device 200; the information of the component corresponding to the located fault point mark 202 includes the model of the component, such as the model of the motor, and the power corresponding to different models will also be different.
[0064] In this way, by screening the replaceable parts 204 through the operation information of the device 200 and the information of the components corresponding to the located fault point mark 202, the time required for searching the replaceable parts 204 can be reduced, thereby improving maintenance efficiency.
[0065] See also Fig.11 , Fig.12 and Fig.13 In some embodiments, the replaceable accessory information 203 also includes price information and inventory information of each replaceable accessory 204, and the accessory replacement interaction method further includes:
[0066] Step 015: In response to the ordering operation for the replaceable accessory 204, an order is generated according to the quantity and selling price information of the order, and the inventory information of the replaceable accessory 204 is updated after the order payment is completed.
[0067] Specifically, the replaceable parts information 203 also includes the price information and inventory information of each replaceable part 204 corresponding to the fault point mark 202. The maintenance personnel or the user can place an order for each replaceable part 204. If the order operation is selected, an order button pop-up window will appear on the display interface T, and the pop-up window will display the name, unit price, quantity, inventory and total amount of the replaceable part 204. By adjusting the order quantity of the replaceable part 204, an order can be generated by clicking the "Order" button. The order may include the name, quantity, unit price, inventory and total amount of the replaceable part 204, and after the order payment is successful, the inventory information of the replaceable part 204 in the display interface T is updated. For example, the replaceable accessories 204 corresponding to component A of the fault point mark 202 are replaceable accessories a and replaceable accessories b respectively. By clicking replaceable accessories a and replaceable accessories b, you can obtain the price information and inventory information of replaceable accessories a and replaceable accessories b. For example, by clicking replaceable accessory a, it is displayed that the price of replaceable accessory a is ten thousand and the inventory is ten pieces; when the maintenance personnel places an order for two pieces, the generated order is for replaceable accessory a, with a unit price of ten thousand, an order quantity of two pieces, and a total amount of twenty thousand; after the order payment is successful, the inventory quantity of replaceable accessory a changes from ten pieces to eight pieces.
[0068] See also Fig.14 and Fig.15 In some embodiments, the accessory replacement interaction method further includes:
[0069] Step 016: In response to the query operation on the order, the logistics information of the order is displayed.
[0070] Specifically, maintenance personnel or users can query the order generated by the replaceable accessory 204. If the query operation is selected, the logistics information of the order generated by the replaceable accessory 204 can be displayed, wherein the logistics information may include the shipping place of the replaceable accessory 204, the current shipping status of the replaceable accessory 204 (the shipping status includes the shipped status and the preparation status), the current location of the replaceable accessory 204, the expected arrival time of the replaceable accessory 204 and the transportation method used by the replaceable accessory 204, etc. For example, after the replaceable accessory a is ordered and paid successfully to generate an order, click on the generated order, and the display interface T will display the shipping place of the replaceable accessory a, the current shipping status of the replaceable accessory a, the expected arrival time of the replaceable accessory a in three days, and the replaceable accessory a is transported by truck.
[0071] In this way, by querying the order generated by the replaceable accessory 204, the logistics information of the replaceable accessory 204 can be displayed, so that the transportation status of the replaceable accessory 204 can be monitored.
[0072] See also Fig.16 In some embodiments, the accessory replacement interaction method further includes:
[0073] Step 017: In response to the purchased replaceable accessory 204 being installed on the device 200, determining whether the fault is repaired according to the operation information of the device 200;
[0074] Step 018: In the case of fault repair, upload the on-site repair information to determine the repair score.
[0075] Specifically, maintenance personnel or customers can install the replaceable accessory 204 on the device 200. If they choose to perform the installation operation, they can determine whether the fault has been repaired based on the operating information of the device 200. For example, the component marked 202 at the fault point of the device 200 is the motor of the device 200, and the fault of the device 200 is the abnormal heating of the motor. Then the replaceable accessory 204 is the motor of the device 200. The motor is replaced into the device 200. There is no abnormal heating phenomenon in the motor operating information obtained by running the device 200, indicating that the fault point of the device 200 has been repaired.
[0076] When the fault point of the device 200 is repaired, it is necessary to upload maintenance information to determine the score of this maintenance. For example, the maintenance information includes the operation data of the device 200 after the replacement parts are installed, the photos taken by the on-site operation of the device 200, the feedback and task evaluation of the maintenance process by the maintenance personnel, the feedback and task evaluation of the maintenance process by the user, the feedback and task evaluation of the maintenance process by the remote maintenance expert, etc. By uploading the photos obtained by taking photos of the operation data of the device 200 and the photos obtained by taking photos by the on-site operation of the device 200 to the cloud server, the maintenance task is scored in combination with the feedback of the maintenance personnel, users and remote maintenance experts on the maintenance process, so that the maintenance personnel can learn from the experience of this maintenance and improve their maintenance capabilities through the scoring results.
[0077] See also Fig.17 In order to facilitate the implementation of the above-mentioned interactive method for accessory replacement, the embodiment of the present application also provides an interactive device 10 for accessory replacement. The interactive device 10 for accessory replacement may include a first display module 11, a second display module 12 and a preview module 13. The first display module 11 is used to display the digital twin model 201 and the fault point mark 202 of the device, and the fault point mark 202 is used to indicate the location of the fault point in the digital twin model 201; the second display module 12 is used to respond to the fault location operation of the fault point mark 202, and display the replaceable accessory information 203 of the component corresponding to the located fault point mark 202, and the replaceable accessory information 203 at least includes the model of the replaceable accessory 204; and the preview module 13 is used to respond to the installation preview operation of the model of the replaceable accessory 204, and replace the component corresponding to the fault point mark 202 in the digital twin model 201 with the model of the replaceable accessory 204, so as to determine the target replaceable accessory 204 that is adapted to the size of the device 200.
[0078] The first display module 11 is specifically used to overlay the scene where the display device is located, the digital twin model 201 and the fault point mark 202 in each extended reality device according to the location information of the device 200 and the extended reality device.
[0079] The interactive device 10 for accessory replacement also includes an acquisition module 14, which is used to identify the device 200 to obtain the digital twin model 201 and fault point mark 202 of the device 200. The digital twin model 201 is generated based on the three-dimensional model and operation information of the device 200, and the fault point mark 202 is generated based on the operation information.
[0080] The second display module 12 is specifically used to display models of one or more replaceable accessories 204 matching the component corresponding to the located fault point mark 202 according to the operation information of the device 200 and the information of the component corresponding to the located fault point mark 202.
[0081] The interactive device 10 for accessory replacement also includes a generation module 15, which is used to respond to an order operation for a replaceable accessory 204, generate an order according to the order quantity and price information, and update the inventory information of the replaceable accessory 204 after the order payment is completed.
[0082] The interactive device 10 for accessory replacement further includes a third display module 16, and the third display module 16 is used to display logistics information of an order in response to a query operation on the order.
[0083] The interactive device 10 for accessory replacement further includes a first determination module 17 , which is used to determine whether the fault is repaired according to the operation information of the device 200 in response to the purchased replaceable accessory 204 being installed on the device 200 .
[0084] The interactive device 10 for accessory replacement further comprises a second determination module 18, which is used to upload on-site maintenance information to determine a maintenance score when a fault is repaired.
[0085] Please refer again Figure 2 An electronic device 100 of one embodiment of the present application includes a display 20, one or more processors 30, a memory 40 and one or more computer programs 42, wherein the one or more computer programs 42 are stored in the memory 40 and executed by the one or more processors 30, and the computer program 42 includes instructions for executing the interactive method of accessory replacement of any of the above-mentioned embodiments.
[0086] Optionally, the electronic device 100 may be any device 200 with a display 20, such as XR glasses, a mobile phone, a tablet computer, a smart watch, a head-mounted display, etc. This application takes the electronic device 100 as an example of XR glasses, and it can be understood that the specific form of the electronic device 100 is not limited to XR glasses.
[0087] An interactive system for accessory replacement according to one embodiment of the present application includes a device 200 and an electronic device 100. The electronic device 100 can be communicatively connected with the device 200, and the electronic device 100 is used to execute the interactive method for accessory replacement according to any of the above embodiments.
[0088] See also Fig.18 The embodiment of the present application also provides a computer-readable storage medium 300 on which a computer program 310 is stored. When the computer program 310 is executed by a processor 320, the steps of the interactive method for accessory replacement of any of the above-mentioned embodiments are implemented. The processor 320 can be a processor of the electronic device 100. For the sake of brevity, it will not be repeated here.
[0089] An embodiment of the present application also provides a computer program product, including a computer program, which, when executed by a processor, implements the interactive method for accessory replacement of any of the above-mentioned embodiments, wherein the processor may be the processor 30 in the electronic device 100 in the above-mentioned embodiment, which will not be described in detail here for the sake of brevity.
[0090] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0091] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of each embodiment of the present application.
[0092] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. An interactive method for accessory replacement, It is characterized in that include: A digital twin model of a display device and a fault point mark, wherein the fault point mark is used to indicate the location of the fault point in the digital twin model; In response to a fault location operation on the fault point mark, displaying replaceable parts information of the component corresponding to the located fault point mark, the replaceable parts information at least including one or more models of replaceable parts; and In response to an installation preview operation on the model of the replaceable accessory, the component corresponding to the fault point mark in the digital twin model is replaced with the model of the replaceable accessory to determine a target replaceable accessory that matches the size of the device.
2. The interactive method according to claim 1, It is characterized in that The digital twin model and fault point marking of the display device include: According to the location information of the device and the extended reality device, the scene where the device is located, the digital twin model and the fault point mark are superimposed and displayed in each of the extended reality devices.
3. The interactive method according to claim 1, It is characterized in that Also includes: Identify the device to obtain the digital twin model of the device and the fault point mark, the digital twin model is generated according to the three-dimensional model and operation information of the device, and the fault point mark is generated according to the operation information.
4. The interactive method according to claim 1, It is characterized in that The display of replaceable accessory information of the component corresponding to the located fault point mark includes: According to the operation information of the device and the information of the component corresponding to the located fault point mark, one or more models of the replaceable accessories matching the component corresponding to the located fault point mark are displayed.
5. The interactive method according to claim 1, It is characterized in that The replaceable parts information also includes price information and inventory information of each replaceable part, and the method further includes: In response to an ordering operation for the replaceable accessory, an order is generated according to the order quantity and the selling price information, and the inventory information of the replaceable accessory is updated after the order payment is completed.
6. The interactive method according to claim 5, It is characterized in that The method further comprises: In response to a query operation on the order, logistics information of the order is displayed.
7. The interactive method according to claim 5, It is characterized in that Also includes; In response to the purchased replaceable part being installed on the device, determining whether the fault is repaired according to the operation information of the device; and In the event of said fault repair, on-site repair information is uploaded to determine the repair score.
8. An interactive device for accessory replacement, It is characterized in that include: A first display module, used to display a digital twin model of a device and a fault point mark, wherein the fault point mark is used to indicate a location of a fault point in the digital twin model; A second display module, in response to a fault location operation on the fault point mark, displays replaceable parts information of the component corresponding to the located fault point mark, wherein the replaceable parts information at least includes a model of the replaceable parts; and A preview module is used to replace the component corresponding to the fault point mark in the digital twin model with the model of the replaceable accessory in response to an installation preview operation on the model of the replaceable accessory, so as to determine a target replaceable accessory that is compatible with the size of the device.
9. An electronic device, It is characterized in that include: monitor; One or more processors, memory; and One or more computer programs, wherein one or more of the computer programs are stored in the memory and executed by one or more of the processors, and the computer programs include instructions for executing the interactive method for accessory replacement described in any one of claims 1-7.
10. An interactive system for accessory replacement, It is characterized in that include: equipment; and An electronic device capable of being communicatively connected with the device, and used to execute the interactive method for accessory replacement as described in any one of claims 1-7.
11. A non-volatile computer-readable storage medium containing a computer program, wherein when the computer program is executed by a processor, the processor executes the interactive method according to any one of claims 1 to 7.
12. A computer program product comprising a computer program, It is characterized in that When the computer program is executed by a processor, the interaction method according to any one of claims 1 to 7 is implemented.
Citation Information
Cited By
Pan-tilt failure inspection and position covering method based on neighbor machine cooperation and related equipment
CN120975509A
A gimbal failure inspection and replacement method based on neighboring machine cooperation and related equipment
CN120975509B
