Fault handling method, electronic device, wearable device, and storage medium

Abstract

The present invention provides a fault handling method, electronic device, wearable device, and storage medium, which can be applied to the field of fault detection technology. The fault handling method includes: performing fault detection on multiple real components in the electronic device based on their operating information and fault dependency relationships to obtain real faulty components; in response to receiving a contact signal indicating that a user has worn the wearable device, controlling an image acquisition device provided in the wearable device to acquire a faulty component image of the real faulty component; determining a capture posture of the image acquisition device relative to the real faulty component based on the faulty component image; and determining target position information of a virtual guide based on the capture posture and position information of the image acquisition device, so as to display the virtual guide on a visual interface of the wearable device using the target position information, wherein the target position information is used to indicate the position of the virtual faulty component relative to the virtual electronic device in the visual interface.

Description

Technical Field

[0001] The present invention relates to the field of fault detection, and more particularly to a fault handling method, electronic equipment, wearable device and storage medium. Background Art

[0002] Electronic devices may encounter various problems (such as hardware failures) when running for a long time. Timely detection and repair of faults can extend the service life of electronic devices and reduce the frequency and cost of equipment replacement.

[0003] During troubleshooting, command-line tools or static monitoring panels are used to obtain component status information and troubleshoot the fault. This approach is complex and inefficient. Furthermore, after a fault occurs, auxiliary repair capabilities are insufficient, making misoperation more likely and increasing repair costs. Summary of the Invention

[0004] In view of the above problems, the present invention provides a fault handling method, an electronic device, a wearable device and a storage medium.

[0005] According to a first aspect of the present invention, there is provided a fault handling method, which is applied to an electronic device, comprising: performing fault detection on multiple real components based on operating information of multiple real components in the electronic device and fault dependency relationships between the multiple real components to obtain real faulty components; in response to receiving a contact signal indicating that a user has worn a wearable device, controlling an image acquisition device provided in the wearable device to acquire a faulty component image of the real faulty component; determining, based on the faulty component image, an acquisition posture of the image acquisition device relative to the real faulty component; and determining target position information of a virtual guide based on the acquisition posture and position information of the image acquisition device, so as to display the virtual guide on a visual interface of the wearable device using the target position information, wherein the target position information is used to indicate the position of the virtual faulty component relative to the virtual electronic device in the visual interface.

[0006] The second aspect of the present invention provides a fault handling method, which is applied to a wearable device, comprising: when it is detected that the status information between the user and the wearable device meets a preset condition, sending a contact signal, the contact signal indicating that the user has worn the wearable device; in response to receiving a control signal, using an image acquisition device provided in the wearable device to acquire a faulty component image of a real faulty component, the real faulty component being obtained by performing fault detection on multiple real components based on the operating information of multiple real components in the electronic device and the fault dependency relationship between the multiple real components; sending the faulty component image so that the electronic device determines the acquisition posture of the image acquisition device relative to the real faulty component based on the faulty component image; determining the target position information of the virtual guidance based on the acquisition posture and the position information of the image acquisition device; using the target position information, displaying the virtual guidance on the visual interface of the wearable device, the target position information being used to indicate the position of the virtual faulty component displayed on the visual interface relative to the virtual electronic device.

[0007] The third aspect of the present invention provides an electronic device, comprising: one or more processors; a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the above-mentioned fault handling method applied to the electronic device.

[0008] The fourth aspect of the present invention provides a wearable device, comprising: one or more processors; a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the above-mentioned fault handling method applied to the wearable device.

[0009] The fifth aspect of the present invention provides a fault handling device, which is applied to an electronic device, comprising: a fault detection module for performing fault detection on multiple real components based on the operation information of multiple real components in the electronic device and the fault dependency relationship between the multiple real components to obtain the real faulty components. The control module is used to control the image acquisition device provided in the wearable device to acquire the faulty component image of the real faulty component in response to receiving a contact signal indicating that the user has worn the wearable device. The first determination module is used to determine the acquisition posture of the image acquisition device relative to the real faulty component based on the faulty component image. The second determination module is used to determine the target position information of the virtual guidance based on the acquisition posture and the position information of the image acquisition device, so as to display the virtual guidance on the visual interface of the wearable device using the target position information, and the target position information is used to indicate the position of the virtual faulty component in the visual interface relative to the virtual electronic device.

[0010] The sixth aspect of the present invention provides a fault handling device, which is applied to a wearable device and includes: a first sending module for sending a contact signal when detecting that the status information between the user and the wearable device meets a preset condition, the contact signal indicating that the user has worn the wearable device. The acquisition module is used to respond to receiving a control signal and use an image acquisition device provided in the wearable device to acquire a faulty component image of a real faulty component. The real faulty component is obtained by performing fault detection on multiple real components based on the operating information of multiple real components in the electronic device and the fault dependency relationship between the multiple real components. The second sending module is used to send the faulty component image so that the electronic device determines the acquisition posture of the image acquisition device relative to the real faulty component based on the faulty component image; and determines the target position information of the virtual guidance based on the acquisition posture and the position information of the image acquisition device. The first display module is used to display the virtual guidance on the visual interface of the wearable device using the target position information, and the target position information is used to indicate the position of the virtual faulty component displayed on the visual interface relative to the virtual electronic device.

[0011] The seventh aspect of the present invention further provides a computer-readable storage medium having a computer program or instructions stored thereon, which implements the steps of the above method when the computer program or instructions are executed by a processor.

[0012] The eighth aspect of the present invention further provides a computer program product, comprising a computer program or instructions, which implement the steps of the above method when executed by a processor.

[0013] According to an embodiment of the present invention, the operation information of multiple components in the server is combined with the fault dependency of multiple components to perform fault detection on multiple components. The real fault component can be accurately obtained from the local operation itself and the global fault dependency, thereby achieving accurate and rapid fault location. In response to receiving a contact signal indicating that the user has worn a wearable device, the image acquisition device set on the wearable device is controlled to acquire a faulty component image of the real faulty component; based on the faulty component image, the acquisition posture of the image acquisition device relative to the real faulty component is determined; based on the acquisition posture and the position information of the image acquisition device, the target position information of the virtual guidance is determined, so that the virtual guidance can be displayed on the visual interface of the wearable device using the target position information, thereby realizing the accurate display of the virtual guidance on the visual interface through the faulty component image. The user obtains virtual guidance of the maintenance process by wearing the wearable device, which greatly reduces the possibility of misoperation and reduces maintenance costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The above contents and other objects, features and advantages of the present invention will become more apparent through the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:

[0015] Figure 1 A diagram showing an application scenario of a fault handling method according to an embodiment of the present invention is shown;

[0016] Figure 2 A flowchart of a fault handling method applied to an electronic device according to an embodiment of the present invention is shown;

[0017] Figure 3 A schematic diagram showing a fault handling method according to an embodiment of the present invention is shown;

[0018] Figure 4A A schematic diagram showing an image matching algorithm for user repair of an electronic device according to an embodiment of the present invention is shown;

[0019] Figure 4B A schematic diagram showing a method for detecting an action during a user repairing an electronic device according to an embodiment of the present invention is shown;

[0020] Figure 5 A flowchart of a fault handling method applied to a wearable device according to an embodiment of the present invention is shown;

[0021] Figure 6 An interaction diagram of a fault handling method according to an embodiment of the present invention is shown;

[0022] Figure 7 A structural block diagram of a fault handling device applied to an electronic device according to an embodiment of the present invention is shown;

[0023] Figure 8 A structural block diagram of a fault handling apparatus applied to a wearable device according to an embodiment of the present invention is shown;

[0024] Figure 9 A block diagram of an electronic device suitable for implementing a fault handling method according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0025] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present invention. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of embodiments of the present invention. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concept of the present invention.

[0026] The terms used herein are only for describing specific embodiments and are not intended to limit the present invention. The terms "comprise", "include", etc. used herein indicate the presence of the features, steps, operations and / or components, but do not exclude the presence or addition of one or more other features, steps, operations or components.

[0027] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0028] When expressions such as "at least one of A, B, and C, etc." are used, they should generally be interpreted in accordance with the meaning commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0029] Electronic devices may encounter various problems (such as hardware failures) after long-term operation. Timely detection and repair of faults can extend the service life of electronic devices and reduce the frequency and cost of equipment replacement.

[0030] During troubleshooting, command-line tools or static monitoring panels are used to obtain component status information and troubleshoot the fault. This approach is complex and inefficient in troubleshooting. Furthermore, after a fault occurs, auxiliary maintenance capabilities are insufficient, making it prone to misoperation and increasing repair costs.

[0031] In view of this, an embodiment of the present invention provides a fault handling method, which is applied to an electronic device, including: performing fault detection on multiple real components based on operation information of multiple real components in the electronic device and fault dependency relationships between the multiple real components to obtain real faulty components; in response to receiving a contact signal indicating that a user has worn a wearable device, controlling an image acquisition device provided in the wearable device to acquire a faulty component image of the real faulty component; determining a capture posture of the image acquisition device relative to the real faulty component based on the faulty component image; determining target position information of the virtual guidance based on the capture posture and position information of the image acquisition device, so as to display the virtual guidance on the visual interface of the wearable device using the target position information, and the target position information is used to indicate the position of the virtual faulty component relative to the virtual electronic device in the visual interface.

[0032] Figure 1 The following diagram shows an application scenario of the fault handling method according to an embodiment of the present invention.

[0033] like Figure 1As shown, the application scenario 100 according to this embodiment may include an electronic device 101, a wearable device 102, and a network 103. The network 103 is used as a medium for providing a communication link between the electronic device 101 and the wearable device 102. The network 103 may include various connection types, such as wired or wireless communication links or fiber optic cables.

[0034] The user can use the wearable device 102 to interact with the electronic device 101 via the network 103 to receive or send messages, etc. Various communication client applications can be installed on the electronic device 101 and the wearable device 102, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (for example only).

[0035] The electronic device 101 may be any electronic device having a display screen and supporting web browsing, including but not limited to a tablet computer, a laptop computer, a desktop computer, and the like.

[0036] The wearable device 102 may be VR (Virtual Reality) glasses or AR (Augmented Reality) glasses.

[0037] Users can wear VR glasses and then interact with electronic device models in a simulated environment through handles, sensor gloves, etc. (such as grabbing component sub-models in electronic device models) to simulate the fault repair process and reduce the possibility of misoperation.

[0038] Users can wear AR glasses and accurately obtain the position of virtual information (such as virtual guidance) in the real space through image recognition of real environment characteristics and real-time positioning to avoid drift.

[0039] It should be noted that VR glasses and AR glasses can interact with virtual information in simulated environments and real environments through gestures, voice, eye tracking, etc.

[0040] It should be understood that Figure 1 The number of electronic devices, networks, and wearable devices in the embodiment is only 1. Depending on the implementation requirements, there can be any number of electronic devices, networks, and wearable devices.

[0041] Figure 2 A flow chart of a fault handling method applied to an electronic device according to an embodiment of the present invention is shown.

[0042] like Figure 2 As shown, the fault handling method applied to the electronic device of this embodiment includes operations S210 to S240.

[0043] In operation S210, fault detection is performed on the multiple real components according to operation information of the multiple real components in the electronic device and the fault dependency relationship between the multiple real components to obtain real faulty components.

[0044] According to an embodiment of the present invention, the electronic device may be a computer device, such as a laptop computer, a desktop computer, a server, etc.

[0045] According to an embodiment of the present invention, a real component may be a part of an electronic device, such as a display screen, a hard disk, a fan, a power supply, a motherboard, etc.

[0046] According to an embodiment of the present invention, the operating information may include component operating data, environmental data, and the like. For example, the component may be a fan, and the component operating data may be the fan speed, while the environmental data may be the temperature around the fan. For example, the component may be a hard disk, and the component operating data may be the read / write speed, the rotation speed of the hard disk platter, and the like, while the environmental data may be the temperature, humidity, and vibration frequency around the hard disk.

[0047] According to embodiments of the present invention, fault dependencies represent the logical relationships between the impacts and mutual triggering of faults occurring in different components. Fault dependencies can be categorized into various types, such as direct and indirect dependencies, causal dependencies, unidirectional and bidirectional dependencies, and cascading dependencies.

[0048] A direct dependency means that fault A directly causes fault B to occur. An indirect dependency means that fault A indirectly causes fault B to occur through one or more intermediate faults.

[0049] A unidirectional dependency means that fault A directly causes fault B, but the occurrence of fault B does not affect the occurrence of fault A. A bidirectional dependency means that the occurrence of fault A and fault B affect each other.

[0050] Cascading dependencies can be where failure A triggers a series of subsequent failures.

[0051] According to an embodiment of the present invention, the fault detection method may be to process the operation information and fault dependency through a machine learning algorithm, statistical-based data analysis, etc., so as to detect the real faulty component.

[0052] For example, information fusion is performed on the operation information and fault dependencies to obtain fused data; the fused data is input into the machine learning algorithm to identify the real faulty components from multiple real components.

[0053] For example, the operation information is compared with the mean of the historical operation information to determine multiple candidate faulty components whose differences are greater than a preset difference; and the actual faulty component is determined from the multiple candidate faulty components using the fault dependency relationship.

[0054] In operation S220, in response to receiving a contact signal indicating that the user has worn the wearable device, an image acquisition device provided in the wearable device is controlled to acquire an image of a faulty component of a real faulty component.

[0055] According to an embodiment of the present invention, a wearable device may include at least one of the following: VR glasses and AR glasses. The wearable device may be provided with an image acquisition device to capture images of a real faulty component. The image acquisition device may be a depth camera, an infrared camera, a visible light camera, or the like.

[0056] According to an embodiment of the present invention, a contact signal may be a signal sent by a wearable device when it detects that the state information between the user and the wearable device meets a preset condition. For example, the state information may be the distance between the user and the wearable device. The preset condition may be that the distance is less than a distance threshold.

[0057] In an embodiment of the present invention, the user's consent or authorization may be obtained before obtaining the user's behavior information. For example, before operation S220, a request to detect user behavior data may be issued to the user. If the user agrees or authorizes the acquisition of user information, operation S220 is performed.

[0058] In operation S230 , a capture position of the image capture device relative to the actual faulty component is determined based on the faulty component image.

[0059] According to an embodiment of the present invention, the position information of the actual faulty component relative to the electronic device can be obtained first. The position information of the actual faulty component in the faulty component image and the position information of the actual faulty component relative to the electronic device are then converted into coordinates to obtain the captured pose of the image acquisition device relative to the actual faulty component. For example, the captured pose includes the position information and orientation of the image acquisition device relative to the wearable device.

[0060] In operation S240, based on the acquired posture and position information of the image acquisition device, the target position information of the virtual guidance is determined, so that the virtual guidance can be displayed on the visual interface of the wearable device using the target position information. The target position information is used to indicate the position of the virtual fault component in the visual interface relative to the virtual electronic device.

[0061] According to an embodiment of the present invention, the position information of the image acquisition device may be position information in a world coordinate system.

[0062] According to an embodiment of the present invention, the target position information of the virtual guide may be position information of the virtual guide relative to the virtual electronic device.

[0063] For example, based on the position information of the image acquisition device, the position information of the virtual guide is converted to the world coordinate system, and then based on the acquired posture, the position information of the virtual guide in the world coordinate system is converted into the target position information in the virtual coordinate system.

[0064] According to an embodiment of the present invention, the virtual guidance may include at least one of the following: a path icon for fault repair, an animation icon for component disassembly, a voice interaction button, a pop-up window for operation step guidance, etc.

[0065] For example, a user wearing AR glasses can repair a real faulty component by following the fault repair path icon, reducing the possibility of misoperation. For example, the user can be a maintenance technician.

[0066] For example, users wearing VR glasses can follow the prompts in the pop-up window that guides them through the operating steps to simulate repairs on real faulty components, thereby reducing irreversible operational errors.

[0067] According to an embodiment of the present invention, the operation information of multiple components in the server is combined with the fault dependency of multiple components to perform fault detection on multiple components. The real fault component can be accurately obtained from the local operation itself and the global fault dependency, thereby achieving accurate and rapid fault location. In response to receiving a contact signal indicating that the user has worn a wearable device, the image acquisition device set on the wearable device is controlled to acquire a faulty component image of the real faulty component; based on the faulty component image, the acquisition posture of the image acquisition device relative to the real faulty component is determined; based on the acquisition posture and the position information of the image acquisition device, the target position information of the virtual guidance is determined, so that the virtual guidance can be displayed on the visual interface of the wearable device using the target position information, thereby realizing the accurate display of the virtual guidance on the visual interface through the faulty component image. The user obtains virtual guidance of the maintenance process by wearing the wearable device, which greatly reduces the possibility of misoperation and reduces maintenance costs.

[0068] According to an embodiment of the present invention, a visual interface is used to display a first virtual scene, which represents a simulated environment of an electronic device model; based on the faulty component image, determining the acquisition posture of the image acquisition device relative to the real faulty component, and also including: matching the faulty component image with multiple component sub-models in the electronic device model respectively to obtain a faulty component sub-model that matches the real faulty component, and the electronic device model is constructed based on component information of multiple real components; obtaining the acquisition posture of the image acquisition device based on the image position of the real faulty component in the faulty component image and the first virtual position of the faulty component sub-model in the first virtual scene.

[0069] According to an embodiment of the present invention, the first virtual scene may be a simulated environment in which a user performs maintenance using a model of an electronic device. For example, the first virtual scene may be a scene in VR glasses.

[0070] The update frequency of the electronic device model can be consistent with the acquisition frequency of the image acquisition device. If fault information of a real component appears in the electronic device log, the fault information of the real component can be sent to the wearable device to highlight the faulty component sub-model in the electronic device based on the unique identifier of the component in the fault information.

[0071] The fault component image may include not only multiple fault components but also components. Therefore, multiple component sub-models may be highlighted in the electronic device model, making it difficult to realize the fault component sub-models corresponding to multiple real fault components.

[0072] The overlap degree between the faulty component image and multiple highlighted component sub-models in the electronic device model is calculated. The component sub-image with the highest overlap degree in the faulty component image is identified as the actual faulty component. The overlap degree can be the ratio of the number of overlapping pixels in the component sub-image to the total number of pixels in the faulty component image. The component sub-image can be obtained by segmenting the faulty component image. The highlighted component sub-model that matches the actual faulty component is identified as the faulty component sub-model. This allows accurate matching to the actual faulty component even when the faulty component image contains multiple faulty components.

[0073] According to an embodiment of the present invention, the first virtual position can be bound to the position of the actual faulty component relative to the electronic device. Through the aforementioned image matching, the rotation matrix and translation vector of the image acquisition device can be accurately obtained based on the image position of the actual faulty component in the faulty component image and the position of the actual faulty component relative to the electronic device, thereby determining the acquisition pose of the image acquisition device.

[0074] According to an embodiment of the present invention, the faulty component image is matched against multiple component submodels in the electronic device model to obtain a faulty component submodel that matches the actual faulty component. Matching of the faulty component and the faulty component submodel is achieved through image matching. The image capture device's position is determined based on the actual faulty component's image position in the faulty component image and the first virtual position of the faulty component submodel in a first virtual scene, providing a basis for virtual-reality correspondence for the subsequent display of virtual guidance on a visual interface.

[0075] According to an embodiment of the present invention, an electronic device model is constructed based on the following method: an initial model is obtained based on component position information and structural information of multiple real components; the initial model is rendered based on the current temperature information of multiple real components to obtain an electronic device model with a thermal map.

[0076] According to an embodiment of the present invention, component position information may include the position of the component relative to the electronic device. Structural information may include the size, shape, and connection relationships of the component with other components. For example, dynamic arrow icons may be used on the initial model to indicate the signal direction of communication between multiple components.

[0077] According to an embodiment of the present invention, the electronic device model can display temperature information of multiple real components in real time.

[0078] According to an embodiment of the present invention, temperature sensors are installed on multiple real components in an electronic device to obtain current temperature information. Different data source information, such as current temperature information, signal direction of communication between multiple real components in a network link, data flow, and fault event data recorded in the log of the electronic device, are integrated and displayed in a visual interface in the most intuitive and easy-to-understand way. The temperature distribution is presented through a heat map, the signal direction of communication is indicated by dynamic arrows, and the order of fault occurrence is displayed on a timeline, so that users can simultaneously obtain multi-dimensional electronic device status information, which is more conducive to users' comprehensive understanding of the cause of the fault.

[0079] According to an embodiment of the present invention, the visual interface is also used to display a second virtual scene, which represents the real environment in which the electronic device is located; for the second virtual scene, based on the fault component image, the acquisition posture of the image acquisition device relative to the real fault component is determined, including: matching the fault component image with multiple reference fault component images to obtain a matching result, and the multiple reference fault component images are obtained by using the image acquisition device to acquire multiple real components in the electronic device in different postures; when the matching result indicates that there is a target reference fault component image that matches the fault component image among the multiple reference fault component images, the posture corresponding to the target reference fault component image is determined as the acquisition posture; when the matching result indicates that there is no target reference fault component image that matches the fault component image among the multiple reference fault component images, the acquisition posture is determined based on user behavior data obtained by an inertial measurement unit set in the wearable device.

[0080] According to an embodiment of the present invention, the second virtual scene can be used for the user to repair the electronic device according to the prompt of the virtual guide. For example, the second virtual scene can be a scene in AR glasses.

[0081] According to an embodiment of the present invention, the reference faulty component image may be stored in a database.

[0082] Quickly determining the image acquisition device's position relative to the actual faulty component reduces the time it takes to match virtual and real components, avoids lags in the virtual guide display within the visual interface, and improves the user experience. Therefore, by matching the faulty component image with multiple reference faulty component images, a target reference faulty component image that matches the faulty component image can be quickly determined.

[0083] However, the image of the faulty component may be blurred due to the vibration of the electronic device, making it difficult to match the target reference image of the faulty component with the faulty component image. The acquisition pose can be determined by combining the user behavior data obtained by the inertial unit to ensure that the display of the virtual guide in the visual interface is not affected.

[0084] According to embodiments of the present invention, user behavior data may include user speed, acceleration, and the like. For example, user behavior data may be input into a posture detection model to obtain a captured posture. The posture prediction model may be trained using historical user behavior data, and the labels may be historically captured postures corresponding to historical user behaviors.

[0085] According to an embodiment of the present invention, by matching a faulty component image with a plurality of reference faulty component images, a target reference faulty component image that matches the faulty component image can be obtained, and the posture corresponding to the target reference faulty component image is determined as the acquisition posture. At the same time, the faulty component image may be blurred due to jitter of the electronic device, making it difficult to match the target reference faulty component image that matches the faulty component image. The acquisition posture can be determined based on user behavior data obtained by an inertial measurement unit provided in the wearable device, thereby avoiding the problem of freezes in the virtual guide display within the visual interface and improving the user experience.

[0086] According to an embodiment of the present invention, the target position information of the virtual guide is determined based on the acquisition posture and the position information of the image acquisition device, including: converting the original position information of the virtual guide according to the position information of the image acquisition device to obtain the intermediate position information of the virtual guide relative to the image acquisition device, the virtual guide is an icon obtained from the database according to the fault type of the real faulty component, and the original position information is the position of multiple pixels in the icon; based on the acquisition posture, the intermediate position information is converted into the target position information of the virtual guide.

[0087] The original position information of the virtual guide is converted to the intermediate position information in the world coordinate system where the position information of the image acquisition device is located. The intermediate position information is then converted to the virtual coordinate system in the virtual environment using the rotation matrix and translation vector corresponding to the acquired posture.

[0088] For example, the vertices in the icon can be bound to the vertices of the real faulty component. According to the position information of the image acquisition device and the position information of the real faulty component, the vertices of the icon can be converted to the world coordinate system with the image acquisition device as the origin to obtain the intermediate position information.

[0089] According to an embodiment of the present invention, the original position information of the virtual guide is converted according to the position information of the image acquisition device to obtain the intermediate position information of the virtual guide relative to the image acquisition device, thereby realizing the coordinate conversion from the pixel position of the icon to the real environment; based on the acquisition posture, the intermediate position information is converted into the target position information of the virtual guide, thereby realizing the coordinate conversion from the real environment to the virtual environment, so that the virtual guide can accurately guide the user to perform maintenance on the electronic device.

[0090] According to an embodiment of the present invention, fault detection is performed on multiple real components based on the operating information of multiple real components in an electronic device and the fault dependency relationship between the multiple real components to obtain real fault components, including: extracting features from the operating information of the multiple real components according to time information to obtain a time series feature sequence; inputting the fault dependency relationship between the multiple real components into the attention network of the prediction model to obtain attention features; splicing the time series feature sequence and the attention features to obtain a target feature sequence; and using the target feature sequence to perform fault detection on the multiple real components.

[0091] According to an embodiment of the present invention, the prediction model may be a long short-term memory network (LSTM), a random forest, or the like.

[0092] According to an embodiment of the present invention, the operation information may include operation data and environment data of a real component within a period of time.

[0093] According to embodiments of the present invention, since operational information is specific to a single real component and lacks information about multiple real components, an attention network is used to extract global features from fault dependencies. The temporal feature sequence and attention features are then concatenated to generate a target feature sequence. Therefore, using the target feature sequence to perform fault detection on multiple real components can combine the operational status of the real components themselves with the fault dependencies between them, achieving accurate fault detection.

[0094] According to an embodiment of the present invention, the fault dependency relationship is obtained from a fault propagation graph, where nodes in the fault propagation graph represent real components, and edges between nodes represent fault association relationships between multiple real components.

[0095] According to embodiments of the present invention, multiple faults may occur simultaneously, and the environmental data in the operational information may also be affected by multiple faults. For example, a server's "power failure" and "heat dissipation failure" may occur simultaneously, both leading to "processor overtemperature." Therefore, a fault propagation graph is used to construct a correlation model, identify the fault dependencies between multiple components, and accurately locate the root cause.

[0096] For example, a fault propagation diagram can be combined with a Bayesian network algorithm to comprehensively consider multiple fault factors and their interrelationships, dynamically inferring the source of the fault. Historical maintenance data can be used to continuously train predictive models such as random forests and LSTMs. This allows the predictive model to match appropriate repair solutions from a knowledge base based on the fault characteristics of the electronic equipment. The model also annotates the confidence level of each repair solution, dynamically recommends targeted repair solutions, and provides decision support for maintenance personnel.

[0097] For example, a dynamic threshold adjustment algorithm and an isolation forest algorithm are used to monitor server operating data in real time. When abnormal data fluctuations are detected, fault alarms can be triggered within milliseconds, notifying maintenance personnel in a timely manner.

[0098] According to an embodiment of the present invention, the above method also includes: encoding the operation information using a dictionary coding algorithm to obtain symbol data; assigning codes to the symbols according to the frequency of occurrence of multiple symbols in the symbol data to obtain target codes corresponding to the multiple symbols; encoding the symbol data using multiple target codes to obtain target data, and the target data is used to transmit the encoded data of the operation information.

[0099] According to an embodiment of the present invention, electronic devices acquire sensor data installed on various real components in real time, which requires the transmission of a large amount of data. A data compression protocol is designed to meet the monitoring data and transmission requirements of electronic devices.

[0100] This data compression protocol uses an advanced compression algorithm that combines dictionary coding and Huffman coding to efficiently compress monitoring data. Huffman coding assigns codes to data based on the frequency of its occurrence, and then encodes the data using the assigned codes.

[0101] On the premise of ensuring data integrity and availability, it greatly reduces bandwidth usage during data transmission, effectively alleviates network transmission pressure, and improves data transmission efficiency. It is suitable for stable and fast transmission of electronic equipment monitoring data in environments with limited network bandwidth.

[0102] In the case of monitoring data, compressing the operation information can reduce data bandwidth usage to 1 / 3 of traditional general compression protocols, while ensuring that more than 95% of the original information can be restored after data decompression, ensuring data integrity and availability.

[0103] Lightweight agents are deployed on electronic devices. These agents have powerful log parsing and sensor data preprocessing capabilities. They can preliminarily screen and process large amounts of raw data locally and only send refined key event data, effectively reducing data transmission delays.

[0104] Figure 3 A schematic diagram of a fault handling method according to an embodiment of the present invention is shown.

[0105] like Figure 3 As shown, the operating information 310 of the real component is transmitted to the intelligent diagnosis unit 320 and the dynamic visualization data receiving unit 350 through edge computing and data compression protocols.

[0106] Intelligent diagnostic unit 320 deploys a predictive model. By inputting real-world component operating information and fault dependencies into the predictive model, the actual faulty component 330 can be quickly inferred. This reduces fault location time from an average of 15 minutes using traditional methods to less than 6 minutes, significantly improving server repair response speed. The predictive model also matches appropriate repair solutions 340 from a knowledge base based on the fault characteristics of the electronic device. It also annotates the confidence level of each repair solution 340, dynamically recommending targeted repair solutions and providing decision support to users. These repair solutions 340 are then displayed on a visual interface 380.

[0107] Edge computing can pre-process operational data and implement efficient anomaly detection mechanisms, enabling real-time data processing and rapid response. Furthermore, the application of data compression protocols reduces data transmission bandwidth usage to one-third of traditional protocols while ensuring data quality, effectively improving data transmission efficiency and reducing operation and maintenance costs.

[0108] The real component's operating information 310 is transmitted to the dynamic visualization data receiving unit 350 via an edge computing and data compression protocol to update the heat map in the electronic device model 360 in real time. Simultaneously, the real faulty component 330 is transmitted to the dynamic visualization data receiving unit 350 to update the faulty component sub-model in the electronic device model 360. The faulty component sub-model is highlighted in real time (e.g., flashing red), and dynamic lighting effects (e.g., shadows and reflections) are combined to enhance visual recognition.

[0109] Control the image acquisition device to acquire a faulty component image of a real faulty component; determine the acquisition posture of the image acquisition device relative to the real faulty component based on the faulty component image; determine the target position information of the virtual guide 370 based on the acquisition posture and the position information of the image acquisition device, so as to use the target position information to display the virtual guide 370 on the visual interface 380 of the wearable device.

[0110] The visual interface 380 includes a maintenance plan 340 , an electronic device model 360 , and a virtual guide 370 .

[0111] Figure 4A A schematic diagram of an image matching algorithm for user repair of an electronic device according to an embodiment of the present invention is shown.

[0112] like Figure 4A As shown, a user 440 wears AR glasses to repair an electronic device. The image acquisition device 410 on the AR glasses can capture action images 450 in real time to recognize hand movements and implement action tracking. At the same time, in response to the AR glasses receiving control information, the image acquisition device 410 captures an image of the faulty component.

[0113] At the same time, the inertial measurement unit 420 on the AR glasses can collect user behavior data in real time.

[0114] The image matching algorithm 460 may include: matching the faulty component image with multiple reference faulty component images to obtain a matching result; when the matching result indicates that there is a target reference faulty component image that matches the faulty component image among the multiple reference faulty component images, determining the posture corresponding to the target reference faulty component image as the acquisition posture; when the matching result indicates that there is no target reference faulty component image that matches the faulty component image among the multiple reference faulty component images, determining the acquisition posture based on the user behavior data obtained by the inertial measurement unit 420.

[0115] Image matching algorithm 460 may also include matching action image 450 with an image of a reference action in operation step guidance pop-up window 374 to determine that the user's maintenance action is the same as the reference action. Furthermore, the image of the reference action in operation step guidance pop-up window 374 is determined based on the fault type of the actual faulty component 330.

[0116] When a user is repairing an electronic device, the virtual guide 370 includes a fault repair path icon 371 , an animated icon 372 for component disassembly, a voice interaction button 373 , and an operation step guidance pop-up window 374 .

[0117] Figure 4B A schematic diagram shows a method for detecting an action during a user repairing an electronic device according to an embodiment of the present invention.

[0118] like Figure 4B As shown, the method for detecting an action during a user repairing an electronic device includes operations S410 to S450.

[0119] In operation S410 , when it is detected that the user's behavior represents that the user repairs the electronic device, a repair action in the user's action image is recognized.

[0120] In operation S420, it is determined whether the maintenance action is different from the reference action in the operation step instruction pop-up window. If so, operation S430 is executed; if not, operation S450 is executed.

[0121] In operation S430, it is determined whether the difference meets a preset difference condition. If so, operation S450 is executed; if not, operation S440 is executed.

[0122] The preset difference conditions may be different action types, the distance between the hand and the actual faulty component being greater than the preset repair distance, different repair auxiliary parts, etc.

[0123] In operation S440, the operation difference content is transmitted to the wearable device.

[0124] Operational differences may include errors in action types, errors in maintenance auxiliary parts, etc.

[0125] In operation S450 , the motion image is continuously collected.

[0126] Figure 5 A flowchart of a fault handling method applied to a wearable device according to an embodiment of the present invention is shown.

[0127] like Figure 5 As shown, the fault handling method applied to the wearable device of this embodiment includes operations S510 to S540.

[0128] In operation S510, when it is detected that status information between the user and the wearable device meets a preset condition, a contact signal is sent, where the contact signal indicates that the user has worn the wearable device.

[0129] In operation S520, in response to receiving the control signal, an image acquisition device provided in the wearable device is used to capture a faulty component image of a real faulty component, where the real faulty component is obtained by performing fault detection on multiple real components based on operating information of the multiple real components in the electronic device and fault dependency relationships between the multiple real components.

[0130] In operation S530, the faulty component image is sent so that the electronic device determines the acquisition posture of the image acquisition device relative to the real faulty component based on the faulty component image; and determines the target position information of the virtual guidance based on the acquisition posture and the position information of the image acquisition device.

[0131] In operation S540, a virtual guide is displayed on a visual interface of the wearable device using the target position information, where the target position information is used to indicate a position of a virtual faulty component displayed on the visual interface relative to the virtual electronic device.

[0132] According to an embodiment of the present invention, the method further comprises: in response to a user's selection operation on the time information displayed in the visual interface, displaying a historical electronic device model corresponding to the time information.

[0133] According to an embodiment of the present invention, the electronic device model can support free model rotation, zooming, and component level drilling. When a faulty node is detected, the faulty component is automatically highlighted in bright red in real time.

[0134] According to an embodiment of the present invention, the temperature information of real components is presented in the form of a heat map at the corresponding position of the electronic device. Dynamic arrows are generated based on the communication direction of the communication signal between components to display the network link status. A fault sequence timeline is generated according to the chronological order of the fault occurrence recorded by the log system. In response to the user's selection of the time information displayed on the fault sequence timeline in the visual interface, the historical electronic device model corresponding to the time information is displayed, thereby realizing the superposition display of multi-dimensional information on the same visual interface.

[0135] Design adaptive visualization mapping rules. For example, a temperature threshold triggers a color gradient in a heat map (the color changes from blue to red when the temperature rises from 25 degrees Celsius to 60 degrees Celsius). As the amount of communication data increases, the arrows can be dynamically thickened.

[0136] According to an embodiment of the present invention, the visual interface is used to display at least one of a first virtual scene and a second virtual scene, the first virtual scene represents a simulated environment of the electronic device model, and the second virtual scene represents a real environment where the electronic device is located.

[0137] According to an embodiment of the present invention, the visualization interface is used to display a simulation test sandbox, which is used to simulate repair of a real faulty component in a first virtual scenario or a second virtual scenario.

[0138] A simulated testing sandbox environment is created within the visual interface, allowing users to simulate various repair operations, such as restarting services and replacing components, in a virtual environment. Real-time monitoring and in-depth analysis of data changes and system responses during simulated operations accurately predict the potential outcomes of actual repair operations. Based on these predictions, users can proactively assess the feasibility and effectiveness of repair plans, avoiding unnecessary errors and losses during actual physical operations and significantly reducing repair risks.

[0139] Leveraging the built-in image acquisition device and inertial measurement unit in AR glasses, image matching and gesture-resolving algorithms project virtual maintenance instructions (such as fault path arrows and disassembly step animations) into the real scene. Combined with real-time operation tracking technology (such as hand motion recognition), the system dynamically adjusts the synchronization between virtual instructions and physical operations, and supports voice command interaction (recognition accuracy ≥ 95%).

[0140] The application of AR / VR-assisted maintenance guidance and simulation test sandbox provides users with accurate operation guidance and risk assessment methods, reducing the error rate from 8% in traditional maintenance methods to below 0.8%, effectively reducing equipment damage and increased maintenance costs caused by error.

[0141] Embodiments of the present invention are applicable to a variety of scenarios. In cloud data scenarios, they can support aggregated fault analysis for ultra-large clusters, such as thousands of servers. By comprehensively analyzing large amounts of server fault data in a cluster, they can automatically identify the types of batch faults and generate standardized batch repair work orders, significantly improving the operational efficiency of cloud data centers.

[0142] In edge computing scenarios, the interface loading speed is specially optimized, and a lightweight rendering engine and efficient data transmission protocol are used. This allows the visual interface to be quickly loaded on a low-power edge server, and it can still maintain smooth interactive responses in a weak network environment, meeting the real-time and low resource consumption requirements of edge computing scenarios.

[0143] In high-reliability scenarios such as aerospace, the system adds hardware-level redundancy design, such as the use of dual-control chips and other technologies, to ensure stable operation of the server and normal maintenance and positioning functions in extreme environments, meeting the needs of these special scenarios with extremely high reliability requirements.

[0144] Figure 6 An interaction diagram of a fault handling method according to an embodiment of the present invention is shown.

[0145] like Figure 6 As shown, the interaction diagram of the fault handling method includes operations S610 to S690.

[0146] In operation S610, status information between a user and a wearable device is detected.

[0147] In operation S620, when it is detected that the status information between the user and the wearable device meets a preset condition, a contact signal is sent to the electronic device.

[0148] In operation S630, in response to receiving the contact signal indicating that the user has worn the wearable device, a control signal is transmitted to the wearable device.

[0149] In operation S640, in response to receiving the control signal, an image capturing device provided in the wearable device is used to capture an image of the faulty component of the actual faulty component.

[0150] In operation S650, the faulty component image is transmitted to the electronic device.

[0151] In operation S660, a capture position of the image capture device relative to the actual faulty component is determined based on the faulty component image.

[0152] In operation S670, target position information of the virtual guide is determined based on the captured pose and position information of the image capture device.

[0153] In operation S680, the target location information is transmitted to the wearable device.

[0154] In operation S690, a virtual guide is displayed on a visual interface of the wearable device using the target location information.

[0155] Figure 7 A structural block diagram of a fault handling device applied to an electronic device according to an embodiment of the present invention is shown.

[0156] like Figure 7 As shown, the fault handling device 700 applied to an electronic device of this embodiment includes a fault detection module 710 , a control module 720 , a first determination module 730 and a second determination module 740 .

[0157] The fault detection module 710 is configured to perform fault detection on multiple real components in the electronic device based on the operating information of the multiple real components and the fault dependencies between the multiple real components to obtain the real faulty components. In one embodiment, the fault detection module 710 can be configured to perform the operation S210 described above, which will not be further described here.

[0158] The control module 720 is configured to, in response to receiving a contact signal indicating that the user has worn the wearable device, control an image acquisition device provided on the wearable device to capture an image of the faulty component of the actual faulty component. In one embodiment, the control module 720 may be configured to perform operation S220 described above, which will not be further described here.

[0159] The first determination module 730 is used to determine the acquisition position of the image acquisition device relative to the actual faulty component based on the faulty component image. In one embodiment, the first determination module 730 can be used to perform the operation S230 described above, which will not be repeated here.

[0160] Second determination module 740 is configured to determine target location information for the virtual guide based on the captured posture and position information of the image acquisition device, so as to display the virtual guide on the visual interface of the wearable device using the target location information. The target location information indicates the location of the virtual faulty component relative to the virtual electronic device in the visual interface. In one embodiment, second determination module 740 may be configured to perform operation S240 described above, and will not be further described herein.

[0161] According to an embodiment of the present invention, the first determination module 730 further includes a first matching submodule and a first obtaining submodule. The first matching submodule is configured to match the faulty component image with multiple component submodels in the electronic device model to obtain a faulty component submodel that matches the actual faulty component, where the electronic device model is constructed based on the component information of the multiple actual components. The first obtaining submodule is configured to obtain a capture pose of the image acquisition device based on the image position of the actual faulty component in the faulty component image and the first virtual position of the faulty component submodel in the first virtual scene.

[0162] According to an embodiment of the present invention, for the second virtual scene, the first determination module 730 includes a second matching submodule, a second obtaining submodule, and a third obtaining submodule. The second matching submodule is used to match the faulty component image with a plurality of reference faulty component images to obtain a matching result. The plurality of reference faulty component images are obtained by capturing a plurality of real components in an electronic device in different postures using an image acquisition device. The second obtaining submodule is used to determine the posture corresponding to the target reference faulty component image as the acquisition posture when the matching result indicates that there is a target reference faulty component image that matches the faulty component image among the plurality of reference faulty component images. The third obtaining submodule is used to determine the acquisition posture based on user behavior data obtained by an inertial measurement unit provided in the wearable device when the matching result indicates that there is no target reference faulty component image that matches the faulty component image among the plurality of reference faulty component images.

[0163] According to an embodiment of the present invention, the second determination module 740 includes a first conversion submodule and a second conversion submodule. The first conversion submodule is configured to convert the original position information of the virtual guide based on the position information of the image acquisition device to obtain intermediate position information of the virtual guide relative to the image acquisition device. The virtual guide is an icon obtained from a database based on the fault type of the actual faulty component, and the original position information is the positions of multiple pixels in the icon. The second conversion submodule is configured to convert the intermediate position information into the target position information of the virtual guide based on the acquired posture.

[0164] According to an embodiment of the present invention, the fault detection module 710 includes a feature extraction submodule, an input submodule, a splicing submodule, and a fault detection submodule. The feature extraction submodule is used to extract features from the operating information of multiple real components according to time information to obtain a time series feature sequence; the input submodule is used to input the fault dependency relationships between multiple real components into the attention network of the prediction model to obtain attention features; the splicing submodule is used to splice the time series feature sequence and the attention features to obtain a target feature sequence; and the fault detection submodule is used to perform fault detection on multiple real components using the target feature sequence.

[0165] According to an embodiment of the present invention, the apparatus further includes: a first encoding module, an allocation module, and a second encoding module. The first encoding module is configured to encode the operation information using a dictionary encoding algorithm to obtain symbol data. The allocation module is configured to assign codes to the symbols based on the frequencies of occurrence of multiple symbols in the symbol data to obtain target codes corresponding to the multiple symbols. The second encoding module is configured to encode the symbol data using multiple target codes to obtain target data, which is used to transmit the encoded data of the component information.

[0166] According to an embodiment of the present invention, any multiple modules among the fault detection module 710, the control module 720, the first determination module 730, and the second determination module 740 may be combined into a single module, or any one of these modules may be split into multiple modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of other modules and implemented in a single module. According to an embodiment of the present invention, at least one of the fault detection module 710, the control module 720, the first determination module 730, and the second determination module 740 may be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application-specific integrated circuit (ASIC), or may be implemented in hardware or firmware through any other reasonable means of circuit integration or packaging, or may be implemented in any one of the three implementation methods of software, hardware, and firmware, or any appropriate combination of any of these. Alternatively, at least one of the fault detection module 710 , the control module 720 , the first determination module 730 , and the second determination module 740 may be at least partially implemented as a computer program module, which may perform corresponding functions when executed.

[0167] Figure 8 A structural block diagram of a fault handling apparatus applied to a wearable device according to an embodiment of the present invention is shown.

[0168] like Figure 8 As shown, the fault handling device 800 applied to a wearable device of this embodiment includes a first sending module 810 , a collection module 820 , a second sending module 830 and a first display module 840 .

[0169] The first sending module 810 is configured to send a contact signal when detecting that the status information between the user and the wearable device meets a preset condition, wherein the contact signal indicates that the user has worn the wearable device. In one embodiment, the first sending module 810 can be configured to perform the operation S510 described above, which will not be repeated here.

[0170] In response to receiving the control signal, acquisition module 820 utilizes an image acquisition device provided in the wearable device to capture a faulty component image of a real faulty component. The real faulty component is obtained by performing fault detection on multiple real components in the electronic device based on operational information of the multiple real components and the fault dependency relationships between the multiple real components. In one embodiment, acquisition module 820 can be used to perform operation S520 described above, which will not be further described here.

[0171] The second sending module 830 is configured to send the image of the faulty component so that the electronic device can determine the image capture device's position relative to the actual faulty component based on the image of the faulty component. The electronic device can then determine the virtual guidance target location based on the position and the image capture device's position information. In one embodiment, the second sending module 830 can be configured to perform operation S530 described above, which will not be further described here.

[0172] The first display module 840 is configured to display a virtual guide on a visual interface of the wearable device using the target location information, where the target location information indicates the location of the virtual faulty component displayed on the visual interface relative to the virtual electronic device. In one embodiment, the first display module 840 can be configured to perform operation S540 described above, which will not be further described herein.

[0173] According to an embodiment of the present invention, the apparatus further includes a second display module configured to display a historical electronic device model corresponding to the time information in response to a user's selection operation on the time information displayed in the visual interface.

[0174] According to embodiments of the present invention, any multiple of the first transmitting module 810, the acquisition module 820, the second transmitting module 830, and the first display module 840 may be combined into a single module, or any one of these modules may be split into multiple modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of other modules and implemented in a single module. According to embodiments of the present invention, at least one of the first transmitting module 810, the acquisition module 820, the second transmitting module 830, and the first display module 840 may be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application-specific integrated circuit (ASIC), or may be implemented in hardware or firmware through any other reasonable means of circuit integration or packaging, or implemented in any one of software, hardware, and firmware, or any suitable combination of these. Alternatively, at least one of the first sending module 810 , the acquisition module 820 , the second sending module 830 and the first display module 840 may be at least partially implemented as a computer program module, which may perform corresponding functions when executed.

[0175] A wearable device of the present invention includes: one or more processors; and a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the fault handling method applied to the wearable device.

[0176] An electronic device of the present invention includes: one or more processors; a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the fault handling method applied to the electronic device.

[0177] Figure 9 A block diagram of an electronic device suitable for implementing a fault handling method according to an embodiment of the present invention is shown.

[0178] like Figure 9As shown, the electronic device 101 according to an embodiment of the present invention includes a processor 901, which can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 902 or programs loaded from a storage unit 908 into a random access memory (RAM) 903. The processor 901 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or related chipsets and / or a special-purpose microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 901 may also include onboard memory for caching purposes. The processor 901 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present invention.

[0179] The RAM 903 stores various programs and data required for the operation of the electronic device 101. The processor 901, ROM 902, and RAM 903 are connected to each other via a bus 904. The processor 901 executes the programs in the ROM 902 and / or RAM 903 to perform various operations according to the method flow of the embodiment of the present invention. It should be noted that the programs may also be stored in one or more memories other than the ROM 902 and RAM 903. The processor 901 may also execute the programs stored in the one or more memories to perform various operations according to the method flow of the embodiment of the present invention.

[0180] According to an embodiment of the present invention, electronic device 101 may further include an input / output (I / O) interface 905, which is also connected to bus 904. Electronic device 101 may also include one or more of the following components connected to I / O interface 905: an input section 906 including a keyboard, mouse, etc.; an output section 907 including devices such as a cathode ray tube (CRT), liquid crystal display (LCD), and speakers; a storage section 908 including a hard disk; and a communication section 909 including a network interface card such as a LAN card or modem. Communication section 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to I / O interface 905 as needed. Removable media 911, such as a magnetic disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed in drive 910 as needed, so that computer programs read from the removable media can be installed into storage section 908 as needed.

[0181] The present invention also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments, or may exist independently and not incorporated into the device / apparatus / system. The computer-readable storage medium carries one or more programs, which, when executed, implement the method according to the embodiments of the present invention.

[0182] According to an embodiment of the present invention, a computer-readable storage medium may be a non-volatile computer-readable storage medium, and may include, for example, but not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. For example, according to an embodiment of the present invention, a computer-readable storage medium may include the ROM 902 and / or RAM 903 described above, and / or one or more memories other than ROM 902 and RAM 903.

[0183] An embodiment of the present invention further includes a computer program product, which includes a computer program containing program code for executing the method shown in the flowchart. When the computer program product is executed in a computer system, the program code is used to enable the computer system to implement the fault handling method provided by the embodiment of the present invention.

[0184] The computer program executes the above functions defined in the system / device of the embodiment of the present invention when executed by the processor 901. According to the embodiment of the present invention, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0185] In one embodiment, the computer program may be stored on a tangible storage medium such as an optical storage device or a magnetic storage device. In another embodiment, the computer program may be transmitted and distributed in the form of a signal on a network medium, downloaded and installed via the communication portion 909, and / or installed from a removable medium 911. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to wireless, wired, or any suitable combination thereof.

[0186] In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 909 and / or installed from a removable medium 911. When the computer program is executed by the processor 901, the above-described functions defined in the system of the embodiment of the present invention are performed. According to the embodiment of the present invention, the systems, devices, means, modules, units, etc. described above can be implemented by computer program modules.

[0187] According to an embodiment of the present invention, the program code for executing the computer program provided by the embodiment of the present invention can be written in any combination of one or more programming languages. Specifically, these computer programs can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, languages ​​such as Java, C++, Python, "C" or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect via the Internet).

[0188] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present invention. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the above-mentioned module, program segment, or a part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0189] It will be understood by those skilled in the art that the features described in the various embodiments of the present invention may be combined and / or coupled in various ways, even if such combinations or couplings are not explicitly described in the present invention. In particular, the features described in the various embodiments of the present invention may be combined and / or coupled in various ways without departing from the spirit and teachings of the present invention. All such combinations and / or couplings fall within the scope of the present invention.

[0190] The above describes embodiments of the present invention. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of the present invention. Although each embodiment has been described separately above, this does not mean that the measures in each embodiment cannot be advantageously used in combination. Without departing from the scope of the present invention, those skilled in the art may make various substitutions and modifications, which should all fall within the scope of the present invention.

Claims

1. A fault handling method, applied to electronic equipment, characterized in that: The method comprises: Performing fault detection on multiple real components in an electronic device based on operating information of the multiple real components and fault dependency relationships between the multiple real components to obtain real faulty components, wherein the operating information includes operating data and environmental data, and the fault dependency relationships represent the associated logic of mutual triggering between faults occurring in different real components. The fault dependency relationships are categorized as direct dependency, indirect dependency, causal dependency, unidirectional dependency, bidirectional dependency, and cascade dependency; In response to receiving a contact signal indicating that a user has worn the wearable device, controlling an image acquisition device provided on the wearable device to acquire a faulty component image of the actual faulty component; Determining, based on the image of the faulty component, a capture position of the image capture device relative to the actual faulty component; Determining target position information of the virtual guide based on the captured posture and position information of the image capture device, so as to display the virtual guide on a visual interface of the wearable device using the target position information, wherein the target position information is used to indicate a position of a virtual faulty component relative to a virtual electronic device in the visual interface; The visual interface is used to display a first virtual scene, wherein the first virtual scene represents a simulated environment of the electronic device model; The determining, based on the faulty component image, the acquisition posture of the image acquisition device relative to the real faulty component further includes: Matching the faulty component image with a plurality of component sub-models in the electronic device model to obtain a faulty component sub-model that matches the real faulty component, the electronic device model being constructed based on component information of the plurality of real components; Obtaining a capture posture of the image capture device according to an image position of the real faulty component in the faulty component image and a first virtual position of the faulty component sub-model in the first virtual scene; The electronic device model is constructed based on the following method: obtaining an initial model based on component position information and structural information of the plurality of real components; The initial model is rendered according to current temperature information of the plurality of real components to obtain an electronic device model with a thermal map.

2. The method according to claim 1, characterized in that The visual interface is further configured to display a second virtual scene, wherein the second virtual scene represents a real environment in which the electronic device is located; For the second virtual scene, determining the acquisition posture of the image acquisition device relative to the real faulty component based on the faulty component image includes: Matching the faulty component image with a plurality of reference faulty component images to obtain a matching result, wherein the plurality of reference faulty component images are obtained by capturing a plurality of real components in the electronic device at different postures using the image acquisition device; When the matching result indicates that there is a target reference faulty component image that matches the faulty component image among the plurality of reference faulty component images, determining a pose corresponding to the target reference faulty component image as the acquisition pose; When the matching result indicates that the target reference faulty component image that matches the faulty component image does not exist among the multiple reference faulty component images, the acquisition posture is determined based on user behavior data obtained by an inertial measurement unit provided in the wearable device.

3. The method according to claim 1, characterized in that The determining of target position information of the virtual guidance based on the acquired posture and position information of the image acquisition device includes: Converting original position information of the virtual guide according to position information of the image acquisition device to obtain intermediate position information of the virtual guide relative to the image acquisition device, wherein the virtual guide is an icon obtained from a database according to the fault type of the real faulty component, and the original position information is the positions of multiple pixels in the icon; Based on the acquired posture, the intermediate position information is converted into the target position information of the virtual guidance.

4. The method according to claim 1, wherein The method of performing fault detection on the plurality of real components according to the operation information of the plurality of real components in the electronic device and the fault dependency relationship between the plurality of real components to obtain the real faulty components includes: Extracting features from the operating information of the plurality of real components according to time information to obtain a time series feature sequence; Inputting the fault dependency relationship between the plurality of real components into an attention network of a prediction model to obtain an attention feature; Concatenating the temporal feature sequence and the attention feature to obtain a target feature sequence; Fault detection is performed on a plurality of the real components using the target feature sequence.

5. The method according to claim 1, wherein The fault dependency relationship is obtained from a fault propagation graph, where nodes in the fault propagation graph represent real components, and edges between nodes represent fault association relationships between multiple real components.

6. The method according to claim 1, wherein The method further comprises: Encoding the operation information using a dictionary encoding algorithm to obtain symbolic data; assigning codes to the symbols according to the frequencies of occurrence of the multiple symbols in the symbol data to obtain target codes corresponding to the multiple symbols respectively; The symbol data is encoded using a plurality of the target codes to obtain target data, and the target data is used to transmit the encoded data of the operation information.

7. A fault handling method, applied to a wearable device, characterized in that: The method comprises: When it is detected that the status information between the user and the wearable device meets a preset condition, sending a contact signal, wherein the contact signal indicates that the user has worn the wearable device; In response to receiving a control signal, an image acquisition device provided in the wearable device is used to acquire a faulty component image of a real faulty component, wherein the real faulty component is obtained by performing fault detection on multiple real components in the electronic device based on operating information of the multiple real components and fault dependency relationships between the multiple real components, wherein the operating information includes operating data and environmental data, and the fault dependency relationships represent the association logic of mutual triggering between faults occurring in different real components, and the fault dependency relationships are categorized into direct dependency, indirect dependency, causal dependency, unidirectional dependency, bidirectional dependency, and cascade dependency; Sending the image of the faulty component so that the electronic device determines, based on the image of the faulty component, a capture posture of the image capture device relative to the real faulty component; and determining target position information of the virtual guidance based on the capture posture and position information of the image capture device; Using the target location information, the virtual guide is displayed on a visual interface of the wearable device, wherein the target location information is used to indicate a position of a virtual fault component displayed on the visual interface relative to a virtual electronic device; The visual interface is used to display a first virtual scene, wherein the first virtual scene represents a simulated environment of the electronic device model; The determining, based on the faulty component image, the acquisition posture of the image acquisition device relative to the real faulty component further includes: Matching the faulty component image with a plurality of component sub-models in the electronic device model to obtain a faulty component sub-model that matches the real faulty component, the electronic device model being constructed based on component information of the plurality of real components; Obtaining a capture posture of the image capture device according to an image position of the real faulty component in the faulty component image and a first virtual position of the faulty component sub-model in the first virtual scene; The electronic device model is constructed based on the following method: obtaining an initial model based on component position information and structural information of the plurality of real components; The initial model is rendered according to current temperature information of the plurality of real components to obtain an electronic device model with a thermal map.

8. The method according to claim 7, characterized in that The method further comprises: In response to the user's selection operation on the time information displayed in the visual interface, a historical electronic device model corresponding to the time information is displayed.

9. The method according to claim 7, characterized in that The visual interface is further configured to display a second virtual scene, where the second virtual scene represents a real environment in which the electronic device is located.

10. The method according to claim 9, characterized in that The visual interface is used to display a simulation test sandbox, and the simulation test sandbox is used to perform simulated repair on the real faulty component in the first virtual scene or the second virtual scene.

11. An electronic device comprising: one or more processors; a memory for storing one or more computer programs, It is characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 1 to 6.

12. A wearable device comprising: one or more processors; a memory for storing one or more computer programs, It is characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 7 to 10.

13. A computer-readable storage medium having a computer program or instruction stored thereon, characterized in that: When the computer program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 10 are implemented.

Images