Abnormal information display method and device, equipment and readable storage medium
By establishing a communication channel with devices equipped with display screens, abnormal information of devices not equipped with display screens is transmitted and displayed, which solves the problem of how to display abnormal information on devices without display screens and achieves fast and accurate abnormal feedback and positioning.
Patent Information
- Application Number
- CN202410315696.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-15
- Publication Date
- 2025-09-16
AI Technical Summary
How to display abnormal information on electronic devices that are not equipped with a display screen has become an urgent problem that needs to be solved.
A communication channel is established between a second device equipped with a display screen and a first device not equipped with a display screen to transmit and display abnormal information of the first device.
It realizes the display of abnormal information of devices without display screens, quickly and accurately locates and feedbacks abnormal phenomena, and facilitates subsequent repairs.
Smart Images

Figure CN120653513A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of computer technology, and in particular to a method, apparatus, device, and readable storage medium for displaying abnormal information. Background Art
[0002] With the development of computer technology, the types and number of electronic devices are increasing. During the use of electronic devices, abnormal phenomena may occur in the electronic devices, such as excessive resource usage of the electronic devices, slow network speed of the electronic devices, etc. In this case, the electronic devices need to display abnormal information to indicate excessive resource usage, slow network speed, etc. If the electronic device is equipped with a display screen, the electronic device can display abnormal information on the display screen to provide feedback to the user about the abnormal phenomenon. However, for electronic devices that are not equipped with a display screen, how to display abnormal information has become a problem that needs to be solved urgently. Summary of the Invention
[0003] The present application provides a method, apparatus, device, and readable storage medium for displaying abnormal information, which can be used to display abnormal information of a device without a display screen through a device equipped with a display screen. The technical solution includes the following contents.
[0004] In a first aspect, a method for displaying abnormal information is provided, the method comprising:
[0005] When an object is detected in an environment where the first device is located, identifying the object to obtain an identification result, the first device being a device not equipped with a display screen, and the identification result being used to indicate whether the object is a second device equipped with a display screen;
[0006] If the recognition result indicates that the object is a second device equipped with a display screen, establishing a communication channel with the second device;
[0007] The abnormality information of the first device is transmitted to the second device through the communication channel, and the abnormality information is used to be displayed on the second device.
[0008] In a second aspect, a method for displaying abnormal information is provided, the method comprising:
[0009] Establishing a communication channel with a first device, where the first device is not equipped with a display screen;
[0010] obtaining abnormal information of the first device through the communication channel;
[0011] The abnormal information is displayed through the equipped display screen.
[0012] In a third aspect, a device for displaying abnormal information is provided, the device comprising:
[0013] an identification module configured to, upon detecting the presence of an object in the environment of the first device, identify the object and obtain an identification result, wherein the first device is a device not equipped with a display screen, and the identification result is used to indicate whether the object is a second device equipped with a display screen;
[0014] an establishing module, configured to establish a communication channel with the second device if the recognition result indicates that the object is a second device equipped with a display screen;
[0015] The transmission module is used to transmit the abnormal information of the first device to the second device through the communication channel, and the abnormal information is used to be displayed on the second device.
[0016] In one possible implementation, the recognition module is used to capture an image of the object to obtain an object image; perform feature extraction on the object image to obtain a first image feature, where the first image feature is used to characterize visual information of the object; and determine the recognition result based on the first image feature.
[0017] In one possible implementation, the recognition module is used to obtain a second image feature, where the second image feature is used to characterize visual information of a device equipped with a display screen; calculate a feature distance between the first image feature and the second image feature; and determine the recognition result based on the feature distance.
[0018] In one possible implementation, the recognition module is used to activate the first image feature through an activation function to obtain probability data, where the probability data is used to characterize the probability that the object is a device equipped with a display screen; and determine the recognition result based on the probability data.
[0019] In a possible implementation, the transmission module is configured to encrypt the exception information of the first device to obtain encrypted data; and send the encrypted data to the second device through the communication channel, where the encrypted data is used to decrypt the exception information to obtain the exception information.
[0020] In a possible implementation, the method is executed by a first process in the first device, and the first process is independent of other processes in the first device.
[0021] In a possible implementation, the first device includes a second process, and the second process is configured to obtain status data of the first device and determine the abnormality information based on the status data;
[0022] The device further comprises:
[0023] An acquisition module is used to obtain the exception information from the second process.
[0024] In one possible implementation, the first device is used for payment, and the first device includes a third process. The third process is used to send a biometric image to a server and receive account information related to the biometric image fed back by the server, and the account information is used to transfer resources when the payment is successful.
[0025] In a fourth aspect, a device for displaying abnormal information is provided, the device comprising:
[0026] An establishing module, configured to establish a communication channel with a first device, where the first device is not equipped with a display screen;
[0027] an acquisition module, configured to acquire abnormal information of the first device through the communication channel;
[0028] The display module is used to display the abnormal information through an equipped display screen.
[0029] In one possible implementation, the acquisition module is used to receive encrypted data transmitted by the first device through the communication channel, where the encrypted data is obtained by encrypting the exception information; send the encrypted data to the server so that the server decrypts the encrypted data to obtain the exception information; and receive the exception information fed back by the server.
[0030] In a possible implementation, the first device includes an indicating component for indicating a state of the first device, the abnormality information is used to describe that the first device is in an abnormal state, and the apparatus further includes:
[0031] An acquisition module, configured to acquire an image of the indicating component to obtain an image of the indicating component;
[0032] The sending module is used to send the indication component image and the abnormality information to a designated device, where the designated device is a device used by a target to repair the first device.
[0033] In a possible implementation, the sending module is configured to add the abnormality information to the indicator component image to obtain a target image; and send the target image to the designated device.
[0034] In a possible implementation, the display module is further configured to display the indication component image;
[0035] The device further comprises:
[0036] A search module is used to search for abnormal information corresponding to identification data of the indicator component image from a designated storage area according to a selection operation on the indicator component image, wherein the designated storage area stores identification data and corresponding abnormal information, and the identification data is used to identify the indicator component image.
[0037] In a fifth aspect, a system for displaying abnormal information is provided, the system comprising a first device not equipped with a display screen and a second device equipped with a display screen;
[0038] The first device is used to execute the method for displaying abnormal information described in the first aspect, and the second device is used to execute the method for displaying abnormal information described in the second aspect.
[0039] In a sixth aspect, an electronic device is provided, comprising a processor and a memory, wherein the memory stores at least one computer program, and the at least one computer program is loaded and executed by the processor so that the electronic device implements any of the above-mentioned methods for displaying abnormal information.
[0040] In the seventh aspect, a computer-readable storage medium is also provided, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor to enable the electronic device to implement any of the above-mentioned methods for displaying abnormal information.
[0041] In an eighth aspect, a computer program is also provided, wherein at least one computer program is loaded and executed by a processor to enable an electronic device to implement any of the above-mentioned methods for displaying abnormal information.
[0042] In the ninth aspect, a computer program product is also provided, wherein at least one computer program is stored in the computer program product, and the at least one computer program is loaded and executed by a processor to enable the electronic device to implement any of the above-mentioned methods for displaying abnormal information.
[0043] The technical solution provided by this application brings at least the following beneficial effects:
[0044] In the technical solution provided by the present application, the first device is not equipped with a display screen. If the first device detects an object, determines that the distance between the first device and the object is not greater than the set distance, and identifies that the object is a second device equipped with a display screen, the first device establishes a communication channel with the second device, and transmits the abnormal information of the first device to the second device through the communication channel, so as to display the abnormal information on the second device, thereby enabling the device with a screen to receive the abnormal information of the device without a screen and display the abnormal information. Since the abnormal information can reflect the abnormal phenomenon, the abnormal information of the device without a display screen is displayed by the device with a display screen, and the abnormal phenomenon of the device without a display screen is fed back to the user by the device with a display screen, thereby quickly and accurately locating the problem of the device without a display screen, and facilitating the subsequent repair of the device without a display screen. BRIEF DESCRIPTION OF THE DRAWINGS
[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0046] Figure 1 This is a schematic diagram of an implementation environment of a method for displaying abnormal information provided by an embodiment of the present application;
[0047] Figure 2 This is a flow chart of a method for displaying abnormal information provided by an embodiment of the present application;
[0048] Figure 3 This is a flowchart of another method for displaying abnormal information provided by an embodiment of the present application;
[0049] Figure 4 This is a schematic diagram of information storage provided by an embodiment of the present application;
[0050] Figure 5 is a schematic diagram of a target image provided in an embodiment of the present application;
[0051] Figure 6 is a schematic diagram of a palm brushing device provided in an embodiment of the present application;
[0052] Figure 7 This is an interactive flow chart of a method for displaying abnormal information provided by an embodiment of the present application;
[0053] Figure 8 This is an architectural diagram of a mobile phone provided in an embodiment of the present application;
[0054] Figure 9This is an architectural diagram of a palm-swiping device provided in an embodiment of the present application;
[0055] Figure 10 This is a schematic structural diagram of a device for displaying abnormal information provided by an embodiment of the present application;
[0056] Figure 11 This is a schematic structural diagram of a device for displaying abnormal information provided by an embodiment of the present application;
[0057] Figure 12 1 is a schematic diagram of a display system for abnormal information provided by an embodiment of the present application;
[0058] Figure 13 This is a schematic diagram of the structure of a terminal device provided in an embodiment of the present application;
[0059] Figure 14 This is a structural diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION
[0060] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.
[0061] It should be noted that the terms "first," "second," and the like in this application are used to distinguish similar objects and are not necessarily used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Instead, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
[0062] In daily life, electronic devices may experience abnormalities. If the electronic device is equipped with a display screen, the electronic device can display abnormal information on the screen to provide feedback to the user. However, for electronic devices without a display screen, how to display abnormal information has become an urgent problem that needs to be solved.
[0063] Based on the above reasons, an embodiment of the present application provides a method for displaying abnormal information, which can display the abnormal information of a first device that is not equipped with a display screen through a second device equipped with a display screen, thereby providing feedback to the user on the abnormal phenomenon of the first device, facilitating subsequent targeted processing of the first device.
[0064] like Figure 1 As shown, Figure 11 is a schematic diagram of an implementation environment of a method for displaying abnormal information provided in an embodiment of the present application, wherein the implementation environment includes a first device 101, a second device 102, and a server 103. The first device 101, the second device 102, and the server 103 are connected to each other via a network, and the network includes but is not limited to at least one of a wired network, a mobile communication network, a wireless local area network, a WiFi (Wireless Fidelity) network, NFC (Near Field Communication), Bluetooth, and the like.
[0065] The first device 101 is any device not equipped with a display screen. For example, the first device 101 can be a palm-swipe device, a facial recognition device, a router, a home appliance, etc. The second device 102 is any device equipped with a display screen. For example, the second device 102 can be a smartphone, a desktop computer, a tablet computer, a laptop computer, etc. The server 103 can be a single server, or a server cluster consisting of multiple servers, or any one of a cloud computing platform and a virtualization center. The server 103 can have functions such as data processing, data storage, and data transmission and reception, which are not limited in the embodiments of the present application. The number of the first device 101, the second device 102, and the server 103 is not limited and can be one or more.
[0066] like Figure 2 As shown, Figure 2 This is a flow chart of a method for displaying abnormal information provided by an embodiment of the present application. This method can be applied to the above-mentioned Figure 1 In the implementation environment shown, the method of the embodiment of the present application is executed by a first device, and the method includes the following steps.
[0067] In step 201, when an object is detected in the environment of the first device, the object is identified to obtain an identification result. The first device is a device not equipped with a display screen, and the identification result is used to indicate whether the object is a second device equipped with a display screen.
[0068] In an embodiment of the present application, the first device or a detection device other than the first device can detect the environment in which the first device is located to determine whether there is an object in the environment. Optionally, the first device is equipped with an object sensor, which is a sensor for sensing whether there is an object within the detection range. The type of object sensor is not limited here. For example, the object sensor includes a proximity sensor (P-sensor), which is a sensor for sensing whether there is an object within the detection range and, when sensing the presence of an object, determining the distance between it and the object. For another example, the object sensor includes a magnetic field sensor, which is a sensor for sensing changes in the magnetic field. When an object that generates a magnetic field or causes a change in the magnetic field enters the detection range of the magnetic field sensor, the magnetic field sensor can sense the change in the magnetic field, thereby determining whether there is an object within the detection range. The object sensor can continuously detect whether there is an object within its detection range (i.e., the environment in which the first device is located), and when the presence of an object is detected, the first device identifies the object to obtain an identification result.
[0069] In an exemplary embodiment, upon detecting an object, the first device may determine the distance between it and the object. Optionally, because the distance sensor is located on the first device, the distance between it and the object detected by the distance sensor may be considered the distance between the first device and the object. If the distance between the first device and the object is not greater than a set distance, it indicates that the object is close to the first device. In this case, the first device identifies the object. By identifying objects within the set distance, the frequency of object recognition by the first device is reduced, thereby conserving computing resources of the first device.
[0070] The type of object is not limited herein. For example, an object includes a living organism, a part of a living organism (such as a palm, face, etc.), an electronic product, a cup, clothing, etc. In addition, the embodiment of the present application does not limit the method for determining the set distance. For example, the set distance is a value pre-set based on experience, or the set distance is an arbitrary value input by the user. Optionally, the set distance is less than the detection distance of the distance sensor.
[0071] Optionally, the first device may identify the object and obtain a recognition result by, but is not limited to, acquiring an image of the object and identifying the object based on the image. For example, the first device may perform edge detection on the image of the object to obtain an edge detection result, where the edge detection result is used to describe the edge contour of the object in the image. Different objects correspond to different edge contours. For example, some mobile phones have edge contours that approximate rounded rectangles, while some cups have edge contours that approximate cylinders. Based on this, the first device may identify the object based on the edge detection result to obtain a recognition result.
[0072] In a possible implementation, the step 201 of “identifying the object to obtain an identification result” includes steps 2011 to 2013 (not shown in the figure).
[0073] Step 2011: Capture an image of the object to obtain an object image.
[0074] In an embodiment of the present application, the first device is equipped with an image acquisition device for acquiring images, for example, the image acquisition device is a camera or a scanner. Optionally, the image acquisition device is a 3D camera, which includes various devices such as traditional optical cameras, depth cameras, and infrared cameras. The image acquisition device is used to acquire an image of an object to obtain an object image. The embodiment of the present application does not limit the color attributes and size of the object image. For example, the object image can be a color image or a grayscale image.
[0075] Step 2012: extract features from the object image to obtain first image features. The first image features are used to represent visual information of the object.
[0076] In actual application, the first device can directly extract features from the object image, or it can preprocess the object image first, and then extract features from the preprocessed object image. The preprocessing method is not limited here. Exemplarily, preprocessing the object image includes: performing at least one of scaling, rotating, flipping, brightness adjustment, and saturation adjustment on the object image. Optionally, the object image is preprocessed using an image processing library such as OpenCV (Open Source Computer Vision Library, open source computer vision library) or PIL (Python Imaging Library, Python image processing library). By preprocessing the object image, the image can be made clearer, which is conducive to subsequent stable processing of the image.
[0077] In one possible implementation, the first device may perform feature extraction on an object image or a preprocessed object image using a deep learning model. The embodiments of the present application do not limit the type, structure, etc. of the deep learning model. For example, the deep learning model may include at least one convolutional neural network such as MobileNets (an image processing model deployed on mobile devices) and a residual network (ResNet), and the convolutional neural network includes at least one network layer selected from the group consisting of a feedforward layer, a convolutional layer, a linear layer, an activation layer, and a normalization layer.
[0078] Exemplarily, a training image can be obtained, and a deep learning model can be obtained by training the training image. In an embodiment of the present application, since the first device is used to identify whether the object is the second device, based on this, the training image can be a device image. Since the model, color, appearance, etc. of the device are diverse, multiple device images and labels of each device image can be obtained. The label of the device image is obtained by annotation and is used to characterize the image processing result obtained after image processing of the device image. Each device image is input into the neural network model to be trained, and the neural network model is used to extract features of each device image to obtain device image features, and the prediction result is determined based on the device image features. The prediction result of the device image is obtained by prediction of the neural network model, and is used to characterize the image processing result obtained after image processing of the device image. The neural network model is trained based on the labels and prediction results of each device image.
[0079] It is understood that the above training process can be repeated multiple times. That is, the neural network model is iteratively trained multiple times using multiple device images and their labels, continuously optimizing the neural network model to obtain a deep learning model. The deep learning model is then used to extract features from the object image or preprocessed object image to obtain first image features, which are used to represent visual information such as the object's color and appearance.
[0080] It is understandable that different deep learning models have different structures and the methods of feature extraction for object images also vary. Taking the deep learning model ResNet as an example, ResNet includes multiple residual structures, each of which includes a convolution layer, an activation layer, a convolution layer, and an activation layer connected in series. The object image can be mapped to a corresponding embedding vector and then input into ResNet. The first residual structure performs convolution processing, activation processing, and convolution processing on the embedding vector of the object image in sequence to obtain a processing result. The embedding vector and the processing result are concatenated to obtain a concatenated result. The concatenated result is activated to obtain the image features output by the first residual structure. The non-first residual structure performs convolution processing, activation processing, and convolution processing on the image features output by the previous residual structure in sequence to obtain a processing result. The image features output by the previous residual structure and the processing result are concatenated to obtain a concatenated result. The concatenated result is activated to obtain the image features output by the non-first residual structure. The image features output by the last residual structure are the first image features.
[0081] Step 2013: Determine a recognition result based on the first image feature.
[0082] The embodiments of this application do not limit the method for determining the recognition result based on the first image feature. Optionally, an edge detection result is determined based on the first image feature, and the object is identified based on the edge detection result to obtain the recognition result. Alternatively, the first device can determine the recognition result according to Implementation A or Implementation B as shown below.
[0083] In implementation method A, step 2013 includes: obtaining a second image feature, where the second image feature is used to characterize visual information of a device equipped with a display screen; calculating a feature distance between the first image feature and the second image feature; and determining a recognition result based on the feature distance.
[0084] In the embodiments of the present application, the first device may acquire multiple reference images, where the reference images are images of a device equipped with a display screen. The method for acquiring the reference images is not limited herein. For example, the first device may acquire reference images input by a user, or may acquire reference images via the internet, or may capture reference images, etc.
[0085] Typically, there are many devices equipped with display screens. Based on this, any two reference images can correspond to the same or different devices. For example, mobile phones are equipped with display screens, and the rear cameras of different mobile phones vary in shape, location, number, etc. Therefore, the first device can use images of various known mobile phones as reference images.
[0086] In the embodiment of the present application, the first device may directly extract features from the reference image, or may first preprocess the reference image and then perform feature extraction on the preprocessed reference image. The method for preprocessing the reference image is similar to the method for preprocessing the object image, and the method for extracting features from the reference image or the preprocessed reference image is similar to the method for extracting features from the object image or the preprocessed object image. Please refer to the description of step 2012 and will not be repeated here.
[0087] By performing feature extraction on a reference image or a preprocessed reference image, a second image feature is obtained. The second image feature is used to characterize visual information such as the color and appearance of the device equipped with a display screen corresponding to the reference image. Since there are multiple reference images, each reference image corresponds to a second image feature. Therefore, the first device can obtain multiple second image features.
[0088] For any second image feature, the first device may calculate a feature distance based on the first image feature and the second image feature according to a feature distance calculation formula. The feature distance calculation formula is not limited herein. For example, the feature distance calculation formula may include at least one of a cosine distance formula, a Euclidean distance formula, and a Manhattan distance formula.
[0089] After calculating the characteristic distances corresponding to each second image feature, for any characteristic distance, if the characteristic distance is not greater than the distance threshold, it means that the first image feature and the second image feature corresponding to the characteristic distance are similar, thereby indicating that the object image is similar to the reference image, that is, the object is similar to the device equipped with a display screen. In this case, the first device can determine that the recognition result is that the object is a second device equipped with a display screen. On the contrary, if the characteristic distance is greater than the distance threshold, the first device can determine that the recognition result is that the object is not a second device. In particular, the embodiment of the present application does not limit the method for determining the distance threshold. Exemplarily, the distance threshold is a numerical value input by the user, or the distance threshold is a numerical value pre-set based on manual experience.
[0090] By calculating the distance between the image features of an object and the image features of a device equipped with a display screen, a similarity comparison between the object and the device equipped with a display screen is achieved at the feature level, thereby improving the accuracy of the comparison results and accurately identifying whether the object is a device equipped with a display screen.
[0091] In implementation B, step 2013 includes: activating the first image feature through an activation function to obtain probability data, where the probability data is used to characterize the probability that the object is a device equipped with a display screen; and determining a recognition result based on the probability data.
[0092] The embodiments of the present application do not limit the type of activation function. Exemplarily, the activation function includes any one of the Sigmoid function (also known as the S-shaped growth curve), the Softmax function (also known as the normalized exponential function), etc.
[0093] Taking the activation function as the Sigmoid function as an example, the first device can use the Sigmoid function to activate the first image feature to obtain probability data, which is greater than or equal to 0 and less than or equal to 1. The probability data is used to characterize the probability that the object is a device equipped with a display screen. The larger the probability data, the higher the probability that the object is a device equipped with a display screen. If the probability data is greater than the first probability threshold, it means that the object has a higher probability of being a device equipped with a display screen. In this case, the first device can determine that the recognition result is that the object is the second device. On the contrary, if the probability data is not greater than the first probability threshold, the first device can determine that the recognition result is that the object is not the second device. In particular, the embodiment of the present application does not limit the method for determining the first probability threshold. Exemplarily, the first probability threshold is a value input by the user, or the first probability threshold is a value pre-set based on manual experience.
[0094] Taking the activation function as the Softmax function as an example, the first device can use the Softmax function to activate the first image feature to obtain multiple probability data, and the sum of these probability data is 1. Each probability data corresponds to an object category, and these object categories include the designated device category to which the device equipped with a display screen belongs. The probability data corresponding to the designated device category is used to characterize the probability that the object is a device equipped with a display screen. The larger the probability data, the higher the probability that the object is a device equipped with a display screen. If the probability data corresponding to the designated device category is not less than the second probability threshold, it means that the object has a higher probability of being a device equipped with a display screen. In this case, the first device can determine that the recognition result is that the object is the second device. On the contrary, if the probability data corresponding to the designated device category is less than the second probability threshold, the first device determines that the recognition result is that the object is not the second device.
[0095] The embodiment of the present application does not limit the method for determining the second probability threshold. Exemplarily, the second probability threshold is a numerical value input by the user, or the second probability threshold is a numerical value pre-set based on manual experience, or the second probability threshold is any probability data among multiple probability data. Optionally, if the second probability threshold is the largest probability data among the multiple probability data, in this case, if the largest probability data among the multiple probability data corresponds to a specified device category, the first device determines that the recognition result is that the object is the second device; if the largest probability data among the multiple probability data does not correspond to the specified device category, the first device determines that the recognition result is that the object is not the second device.
[0096] By activating the image features of the object, the probability that the object is a device equipped with a display screen is obtained, which enables the possibility of predicting the object's configuration at the feature level, improves the accuracy of the prediction results, and thus accurately identifies whether the object is a device equipped with a display screen.
[0097] Step 202: If the recognition result indicates that the object is a second device equipped with a display screen, a communication channel is established with the second device.
[0098] The embodiments of the present application do not limit the type of communication channel. Exemplarily, the communication channel includes any one of Bluetooth, Near Field Communication (NFC), etc. The establishment method of each communication channel is similar. The establishment process is described below using Bluetooth as an example.
[0099] If the first device determines that the recognition result indicates that the object is the second device, the first device broadcasts a Bluetooth connection request, and the Bluetooth connection request carries the device identification of the first device. After receiving the Bluetooth connection request, the second device displays a prompt message in response to the Bluetooth connection request, and the prompt message is used to prompt the user whether to allow the second device to establish a Bluetooth connection with the first device. If the user performs a confirmation operation in response to the prompt message, the second device sends a confirmation message to the first device in response to the confirmation operation, and the confirmation message carries the device identification of the second device. After receiving the confirmation message, the first device extracts the device identification of the second device from the confirmation message and stores the device identification of the second device. From then on, the first device and the second device successfully establish a Bluetooth communication channel.
[0100] In actual applications, the second device can be any device equipped with a display screen. For example, the first device is a palm-swiping device, and the second device can be a mobile phone or a smart watch, etc., and there is an application software or applet on the second device that enables the palm-swiping function.
[0101] Optionally, the first device stores the device identifications of multiple security devices, and the security device is a device that is bound to the first device and has passed security authentication. After the first device obtains the device identification of the second device, it compares the device identification of the second device with the device identifications of each security device. If there is a security device with a device identification that is the device identification of the second device, the first device determines that the second device is a security device and establishes a communication channel with the second device. If there is no security device with a device identification that is the device identification of the second device, the first device determines that the second device is not a security device. In this case, the first device may not establish a communication channel with the second device, or the first device may perform security authentication on the second device and establish a communication channel with the second device after the authentication is passed. By establishing a communication channel with the security device, abnormal information can be displayed on the security device subsequently, thereby ensuring the security of the data.
[0102] Step 203: Transmit the abnormal information of the first device to the second device through the communication channel, and the abnormal information is used to be displayed on the second device.
[0103] In an embodiment of the present application, the first device can obtain the status data of the first device in real time and store the status data locally. Optionally, the first device stores the status data in the form of a snapshot. That is, after obtaining the status data, the first device can, on the one hand, store the status data in a first storage area such as a memory or cache, and on the other hand, copy the status data and store the copied status data in a second storage area such as a disk or hard disk. Storing the status data in the form of a snapshot can prevent the loss of the status data.
[0104] Exemplarily, the status data includes the device identification of the first device, the location information of the first device, the network speed of the first device, resource occupancy data, etc. The device identification is a serial number (SN) consisting of multiple character strings. Each device corresponds to a unique serial number, that is, the serial number of the device is a number (Identity Document, ID) that uniquely identifies the device. Resource occupancy data includes CPU (Central Processing Unit) occupancy, GPU (Graphics Processing Unit) occupancy, storage resource occupancy, computing resource occupancy, etc.
[0105] After acquiring the status data of the first device, the first device may determine abnormal information based on the status data. It is understandable that for different status data, the method of determining whether the status data is abnormal information also varies.
[0106] For example, if the status data includes the device identification of the first device, when the device identification of the first device is not unique, for example, the device identification of another device of the same model as the first device is the device identification of the first device, the device identification of the first device is abnormal information.
[0107] For another example, if the status data includes location information of the first device, the location information is not information of the designated location. For example, the designated location is region A, and the first device is located in region B, then the location information is abnormal information.
[0108] For another example, if the status data includes the network speed of the first device, if the network speed is lower than a specified network speed, then the network speed is abnormal information. Alternatively, if the status data includes resource occupancy data, if the resource occupancy data is higher than a specified data, then the resource occupancy data is abnormal information.
[0109] After the first device determines the abnormal information, it can transmit the abnormal information to the second device through the communication channel so that the second device displays the abnormal information. The embodiment of the present application does not limit the way in which the second device displays the abnormal information. For example, there is an application such as communication software or application software corresponding to the first device on the second device, or there is a small program corresponding to the first device on the second device. For example, if the first device is a palm-swiping device, then there is an application or small program corresponding to the palm-swiping device on the second device.
[0110] Among them, an application is a program that needs to be downloaded and installed before it can be used, while a mini-program is a program that can be used without downloading and installing. In some cases, the communication software downloaded and installed on the second device includes a mini-program. When the user is using the application or mini-program, the second device sends a first prompt message to the user, and the first prompt message is used to prompt the user whether to allow the application or mini-program to receive data transmitted through the communication channel. If the user performs a confirmation operation on the first prompt message, the second device determines, in response to the confirmation operation, that the user allows the application or mini-program to receive data transmitted through the communication channel. In this case, after the first device transmits abnormal information to the second device through the communication channel, the application or mini-program of the second device can receive the abnormal information and display the abnormal information.
[0111] In a possible implementation, step 203 includes: encrypting the abnormality information of the first device to obtain encrypted data; and sending the encrypted data to the second device through a communication channel, where the encrypted data is used to decrypt the abnormality information.
[0112] In an embodiment of the present application, the second device or server can generate a public key and a private key according to an encryption algorithm, and the first device receives the public key sent by the second device through a communication channel, or the first device receives the public key sent by the server. The first device uses the public key based on the encryption algorithm to encrypt the abnormal information to obtain encrypted data, and sends the encrypted data to the second device through the communication channel. The second device stores the encrypted data, and when it is necessary to restore the data before encryption, it can decrypt the encrypted data to obtain the abnormal information, thereby locating the abnormal phenomenon of the first device.
[0113] Among them, the process of decrypting encrypted data includes two implementation methods as shown below. In one implementation method, the second device generates a public key and a private key, and the second device uses the private key to decrypt the encrypted data based on the encryption algorithm to obtain exception information. In another implementation method, the server generates a public key and a private key, and after the second device receives the encrypted data, it sends the encrypted data to the server. The server uses the private key to decrypt the encrypted data based on the encryption algorithm to obtain exception information, and sends the exception information to the second device. Regardless of the implementation method, the second device can obtain the exception information obtained by decrypting the encrypted data and display the exception information.
[0114] The type of encryption algorithm is not limited herein. For example, the encryption algorithm includes, but is not limited to, any one of the AES (Advanced Encryption Standard) and RSA encryption algorithms. The exception information is encrypted using the encryption algorithm, and the encrypted data is transmitted, thereby ensuring the security of data transmission.
[0115] In one possible implementation, the above-mentioned method for displaying abnormal information is executed by a first process in the first device, and the first process is independent of other processes in the first device. In other words, the first process exists in the first device. The first process exists independently and is used to detect the distance between the first device and an object in conjunction with a distance sensor. When the distance is not greater than a set distance, the object is identified to obtain an identification result. When the identification result shows that the object is a second device, a communication channel is established with the second device, and abnormal information of the first device is obtained, and the abnormal information is transmitted to the second device via the communication channel.
[0116] Since the first process exists independently and is specifically used to execute the above Figure 2 The method for displaying related exception information is thus independent of the first process and other processes on the first device. In other words, the process of the first device feeding back exception information to the second device is unaffected by other processes, thus avoiding the impact of the feedback of exception information due to instability of other processes and reducing the probability of feedback failure.
[0117] In one possible implementation, the first device includes a second process, which is used to obtain status data of the first device and determine abnormal information based on the status data. In this case, step 203 also includes: obtaining abnormal information from the second process. In this case, the first device has a second process. The second process exists independently and is used to obtain status data of the first device, store the status information, and determine abnormal information based on the status data. The relevant content of the status data of the first device and the method of determining abnormal information based on the status data have been described above and will not be repeated here. When the first process needs to obtain abnormal information of the first device, the first process can communicate with the second process to obtain abnormal information from the second process and send the abnormal information to the second device, or encrypt the abnormal information to obtain encrypted data and send the encrypted data to the second device.
[0118] Because the second process exists independently, it does not affect other processes on the first device. This means that the first device's acquisition of exception information is unaffected by other processes, preventing instability in other processes from affecting the acquisition of exception information and, consequently, the feedback of exception information to the second device.
[0119] In one possible implementation, the first device is used for payment, and the first device includes a third process. The third process is used to send a biometric image to a server and receive account information related to the biometric image fed back by the server. The account information is used to transfer resources when the payment is successful.
[0120] In an embodiment of the present application, the first device is used to make payments based on biometrics, where biometrics refer to physiological or behavioral characteristics inherent in a living being, such as palm, face, gait, etc. Optionally, if the first device is a palm-scanning device, the first device can make payments based on palms, or if the first device is a facial recognition device, the first device can make payments based on faces.
[0121] The first device includes an image acquisition device that captures a biometric image of the user. For example, the image acquisition device is a camera that captures an image of the user's face or palm to obtain a biometric image. The biometric image can be a color image or a grayscale image.
[0122] It is understandable that at least one image can be obtained by collecting biometric features through an image acquisition device, and these images can be collectively referred to as streaming data. There is a third process in the first device, and the third process exists independently. The third process is used to filter out a biometric image from the streaming data and send the biometric image to the server. The screening method is not limited here. For example, for any image in the streaming data, the image can be scored from multiple aspects, and the scores of each aspect are weighted to obtain a quality score. From each image in the streaming data, the image with the highest quality score is filtered out, and the filtered image is used as the biometric image. These aspects include but are not limited to: the ratio of the image area where the biometric feature is located to the entire image, the direction facing the biometric feature in the image, the contrast, brightness, clarity of the image, etc.
[0123] After receiving the biometric image, the server can perform feature extraction on the biometric image to obtain a first feature vector. The first feature vector is used to describe visual information such as texture, color, and shape of the biometric features in the biometric image. The feature extraction method for the biometric image can be similar to the feature extraction method for the object image in step 2012. The implementation principles of the two methods are similar and will not be further described here.
[0124] The server also includes account information for multiple objects and a second feature vector for each object. The second feature vector for each object is obtained by extracting features from a standard image of the object. The standard image of each object is an image obtained by capturing the object's biometric features using an image acquisition device. The second feature vector describes visual information such as texture, color, and shape of the biometric features in the standard image.
[0125] For any second eigenvector, the server may calculate the characteristic distance based on the first eigenvector and the second eigenvector according to a characteristic distance calculation formula. The characteristic distance calculation formula is not limited herein. For example, the characteristic distance calculation formula may include at least one of a cosine distance formula, a Euclidean distance formula, and a Manhattan distance formula.
[0126] After calculating the characteristic distances corresponding to each second eigenvector, the maximum characteristic distance can be selected from the characteristic distances. If the maximum characteristic distance is not greater than the distance threshold, it indicates that the first eigenvector and the second eigenvector corresponding to the maximum characteristic distance are similar, thereby indicating that the biometric image is similar to the standard image corresponding to the second eigenvector, that is, the user's biometric characteristics are similar to the biometric characteristics of the object corresponding to the standard image. In this case, the server can use the account information of the object as the account information related to the biometric image. Conversely, if the maximum characteristic distance is greater than the distance threshold, the server can determine that there is no account information related to the biometric image. Based on this, the biometric image is recognized and the account information is obtained. Optionally, the distance threshold is a value pre-set based on manual experience.
[0127] Optionally, if the server determines account information associated with the biometric image, the server sends this account information to the first device, allowing the third process on the first device to obtain the account information. Account information includes, but is not limited to, user identity information, membership information, or resource data. The third process can obtain the user's payment status. If the user's payment is successful, the third process transfers resources from the account information, transferring certain resources from the account information to another account information. If the user's payment fails, the third process cannot transfer resources from the account information, meaning the total amount of resources in the account information remains unchanged.
[0128] Alternatively, if the server cannot determine the account information associated with the biometric image, the user may be new. In this case, the server sends an error message to the first device, providing feedback to the first device that the user has not bound the biometric to the account information. Upon receiving the error message, the first device may issue a prompt using a light or sound, or send a prompt message to a device associated with the first device, which may be displayed on the associated device, indicating that the user has not bound the biometric to the account information.
[0129] The user can use the second device to bind their biometrics to their account information. Optionally, the user logs into the application software or mini-program corresponding to the first device on the second device using the user's account information. The image capture device captures the user's biometrics to obtain a standard image. The application software or mini-program then binds the standard image to the account information and sends the account information and the bound standard image to the server. Upon receiving the account information and the corresponding standard image, the server can extract features from the standard image to obtain a second feature vector. This allows the server to subsequently identify the user's biometric image based on the second feature vectors of each object and obtain the account information.
[0130] The account information may be the account information of the application software or the account information of the mini-program. If the communication software downloaded and installed on the second device includes the mini-program, the account information may also be the account information of the communication software.
[0131] The first device corresponds to a QR code that is used to identify the first device. The QR code is scanned by the corresponding application software on the second device, allowing the application software to identify the first device and display the biometric image collected by the first device. Alternatively, the QR code is scanned by the communication software on the second device, opening a mini-program in the communication software. The mini-program then identifies the first device and displays the biometric image collected by the first device. The biometric image is then used as a standard image in the application software or mini-program and bound to the account information.
[0132] Different biometric images correspond to different QR codes. In other words, the QR code can not only identify the first device but also record the biometric image. The second device scans the QR code to obtain the biometric image and binds it to the account information as a standard image.
[0133] Optionally, during the process of binding the biometric image with the account information, a first prompt message may be displayed by the application or mini-program, prompting the user whether to allow the application or mini-program to receive data transmitted via the communication channel. If the user does not perform any action in response to the first prompt message or the user performs a deny action in response to the prompt message, the second device determines that the user does not allow the application or mini-program to receive data transmitted via the communication channel. If the user performs a confirm action in response to the first prompt message, the second device determines that the user allows the application or mini-program to receive data transmitted via the communication channel.
[0134] Because the third process exists independently, it does not affect other processes on the first device. In other words, resource transfers by the third process are unaffected by other processes, preventing resource transfers from being affected by instability in other processes and ensuring functional stability on the first device.
[0135] In actual applications, in addition to the first process, second process, and third process mentioned above, the first device may have more processes. Any process of the first device can be turned off or on at any time. It is understandable that each process is independent of each other, and the change frequency of different processes also varies. For example, under normal circumstances, the first device will frequently transfer resources and obtain status data, and the frequency of feedback of abnormal information is relatively low, while the first process is used to feedback abnormal information, the second process is used to obtain status data, and the third process is used for resource transfer. Based on this, the change frequency of the first process is low, and the change frequency of the second and third processes is high. By setting up each independent process, it is possible to isolate processes with different change frequencies and reduce the risks caused by dependencies between processes.
[0136] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, storage, and display, etc.), and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data must comply with the relevant laws, regulations, and standards of the relevant region. For example, the biometric images and object images involved in this application are all obtained with full authorization.
[0137] In the above method, the first device is not equipped with a display screen. If the first device detects an object, determines that the distance between the first device and the object is not greater than the set distance, and identifies that the object is a second device equipped with a display screen, the first device establishes a communication channel with the second device, and transmits abnormal information of the first device to the second device through the communication channel, so as to display the abnormal information on the second device, thereby enabling the device with a screen to receive abnormal information of the device without a screen and display the abnormal information. Since abnormal information can reflect abnormal phenomena, the abnormal information of the device without a display screen is displayed by the device with a display screen, and the abnormal phenomenon of the device without a display screen is fed back to the user by the device with a display screen, thereby quickly and accurately locating the problem of the device without a display screen, and facilitating the subsequent repair of the device without a display screen.
[0138] like Figure 3 As shown, Figure 3 This is a flowchart of another method for displaying abnormal information provided by an embodiment of the present application, which can be applied to the above-mentioned Figure 1In the implementation environment shown, the second device executes the method of the embodiment of the present application, which includes the following steps.
[0139] Step 301: Establish a communication channel with a first device, where the first device is not equipped with a display screen.
[0140] The content of step 301 can be found in the relevant descriptions of step 201 and step 202. The implementation principles of the two are similar and will not be repeated here.
[0141] Step 302: Acquire abnormal information of the first device through the communication channel.
[0142] The content of the abnormal information in step 302 can be found in the description of step 203 and will not be repeated here. In one possible implementation, the first device sends the abnormal information to the second device via a communication channel so that the second device can obtain the abnormal information.
[0143] In one possible implementation, step 302 includes: receiving encrypted data transmitted by the first device through the communication channel, the encrypted data being obtained by encrypting the exception information; sending the encrypted data to the server so that the server decrypts the encrypted data to obtain the exception information; and receiving the exception information fed back by the server.
[0144] For details about encryption and decryption, please refer to the description of step 203. The implementation principles of the two are similar and will not be repeated here.
[0145] Step 303: Display abnormal information via the equipped display screen.
[0146] Among them, the content of the abnormal information displayed by the second device can be found in the description of step 203. The implementation principles of the two are similar and will not be repeated here.
[0147] In one possible implementation, the first device includes an indicator component for indicating the state of the first device, and the abnormality information describes that the first device is in an abnormal state. In this case, the method of this embodiment of the application further includes: capturing an image of the indicator component to obtain an image of the indicator component; and sending the image of the indicator component and the abnormality information to a designated device, where the designated device is the device being repaired. This step may be performed after step 302.
[0148] The embodiments of the present application do not limit the type of indicating component. For example, the indicating component includes at least one of a signal light or an instrument panel. In practical applications, the color, quantity, brightness, etc. of the signal light can indicate the state of the first device, and the data indicated by the pointer in the instrument panel can also reflect the state of the first device. For example, if the SN of the first device is not unique, the signal light used to indicate the SN will emit red light; if the SN of the first device is unique, the signal light used to indicate the SN will emit white light. For another example, the data indicated by the instrument panel is the CPU occupancy rate.
[0149] As mentioned above, the abnormality information of the first device is determined based on the status data of the first device. The abnormality information can indicate that the first device is in an abnormal state, and the status data of the first device is used to reflect the state of the first device. The indicating component is used to indicate the state of the first device. Therefore, when the first device is in an abnormal state, the first device determines that abnormality information exists, and in this case, the indicating component indicates that the first device is in an abnormal state. Conversely, when the first device is not in an abnormal state, the first device determines that abnormality information does not exist, and in this case, the indicating component indicates that the first device is not in an abnormal state.
[0150] When the second device receives abnormal information, it indicates that the indicator component indicates that the first device is in an abnormal state. In this case, the second device can capture an image of the indicator component. In the embodiment of the present application, the second device is equipped with an image acquisition device, which uses the image acquisition device to capture an image of the indicator component to obtain an image of the indicator component. The image of the indicator component can be a color image or a grayscale image.
[0151] Generally, when a first device is in an abnormal state, it is necessary to repair the first device to restore it to a normal state, thereby ensuring that all functions of the first device can be used normally. In an embodiment of the present application, the second device can send an image of an indicator component and abnormality information to a designated device used by the person repairing the first device. The transmission method is not limited herein.
[0152] For example, an application or mini-program corresponding to the first device exists on the second device. Generally, the application or mini-program has a channel for providing feedback, and the object can receive information through this channel. For example, the application or mini-program has a customer service channel, through which the user can provide feedback. Based on this, the user can use the channel in the application or mini-program to send an image of an indicator component and abnormality information to the object repairing the first device, thereby enabling the second device to send the image of the indicator component and abnormality information to the designated device.
[0153] For another example, a second device may have communication software that includes multiple communication channels for objects, including an object that repairs the first device. A user can use the communication channel of the object that repairs the first device to send an image of an indicator component and abnormality information to the object that repairs the first device, thereby enabling the second device to send the image of the indicator component and abnormality information to the designated device.
[0154] In one possible implementation, before sending the indication component image and the abnormality information to the designated device, the method further includes: displaying the indication component image; and searching for abnormality information corresponding to identification data of the indication component image from a designated storage area based on a selection operation on the indication component image, wherein the identification data and the corresponding abnormality information are stored in the designated storage area, and the identification data is used to identify the indication component image.
[0155] In an embodiment of the present application, after the second device acquires the indicator component image, it can store the indicator component image. The indicator component image can be stored in a designated storage area or in a storage area other than the designated storage area. In an embodiment of the present application, the designated storage area is not limited. Exemplarily, the designated storage area includes any storage area such as memory, cache, hard disk, or magnetic disk. For example, the designated storage area is an area for storing images.
[0156] The second device may also generate identification data for representing the indicator component image, and the generation method is not limited herein. For example, the second device may use the MD5 Message-Digest Algorithm to generate identification data for the indicator component image. The identification data is a unique hash value of a fixed length. Alternatively, a designated storage area may store multiple images including the indicator component image. The second device may sort the multiple images and determine the sorting of the indicator component image among the multiple images as the identification data for the indicator component image.
[0157] The second device may store identification data of the indicator component image in a designated storage area. Furthermore, the second device may store abnormality information in the designated storage area. Optionally, the abnormality information and the identification data of the indicator component image are stored in the same file in the designated storage area, thereby associating the abnormality information with the identification data of the indicator component image, thereby associating the abnormality information with the indicator component image.
[0158] like Figure 4 As shown, Figure 4It is a schematic diagram of an information storage provided by an embodiment of the present application. In an embodiment of the present application, the indication component image includes images A to C, and the second device uses the MD5 information digest algorithm to generate the MD5 hash value of each image. The second device can store images A to C, and in a designated storage area, store the MD5 hash value of abnormal information A and image A (denoted as image A-MD5) in file A, similarly, store the MD5 hash value of abnormal information B and image B (denoted as image B-MD5) in file B, and store the MD5 hash value of abnormal information C and image C (denoted as image C-MD5) in file C.
[0159] The second device can display various images in the designated storage area, including the indicator component image. If a user selects the indicator component image, the second device, in response to the selection, determines identification data of the indicator component image, identifies a file containing the identification data from various files in the designated storage area, and reads the exception information from the file, thereby acquiring the indicator component image and the corresponding exception information.
[0160] In a possible implementation, sending the indication component image and the abnormality information to the designated device includes: adding the abnormality information to the indication component image to obtain a target image; and sending the target image to the designated device.
[0161] In an embodiment of the present application, after the second device obtains the indicator component image and the abnormality information, it may display a second prompt message, which prompts the user whether to merge the indicator component image and the abnormality information. For example, after a user selects a contact in a communication software contact list, they can select the indicator component image in the chat interface of that contact. Based on the user's selection, the second device obtains the indicator component image and the corresponding abnormality information and displays a second prompt message, "Whether to merge the image and abnormality information."
[0162] If the user performs a denial operation with respect to the second prompt information, the second device, in response to the denial operation, directly sends the indicator component image and the abnormality information to the designated device. If the user performs a confirmation operation with respect to the second prompt information, the second device, in response to the confirmation operation, adds the abnormality information to the indicator component image to obtain a target image, and sends the target image to the designated device.
[0163] In one possible implementation, the second device adds the abnormality information to the indicator component image as a watermark. During this addition process, the second device may perform at least one pre-processing operation on the indicator component image, such as scaling, rotation, flipping, brightness adjustment, and saturation adjustment, and set a character format for the watermark. The abnormality information that conforms to the character format is added to the pre-processed indicator component image as a watermark to obtain a target image.
[0164] For example, the second device reads the indicator component image and uses an image processing library such as Python's PIL library or OpenCV library to set the watermark's font, size, and other character formats. The image processing library then pre-processes the indicator component image's color, transparency, brightness, and contrast. Finally, the image processing library adds abnormal information that conforms to the character format as a watermark to the pre-processed indicator component image, thereby obtaining the target image.
[0165] After the second device sends the target image to the designated device, the designated device can perform OCR (Optical Character Recognition) on the target image to separate the abnormal information and the indicator component image from the target image, so as to facilitate the subsequent positioning of the problem of the first device based on the abnormal information and the indicator component image, thereby performing targeted repairs on the first device.
[0166] Optionally, the first device encrypts the abnormal information to obtain encrypted data, and sends the encrypted data to the second device. After receiving the encrypted data, the second device adds the encrypted data to the indicator component image to obtain a target image, and sends the target image to the designated device or server. Figure 5 As shown, Figure 5 This is a schematic diagram of a target image provided in an embodiment of the present application. As can be seen from the figure, encrypted data is added to the indicator component image in the form of a watermark.
[0167] The designated device or server can perform OCR (Optical Character Recognition) on the target image to separate the encrypted data and the indicator component image from the target image, and decrypt the encrypted data to obtain the exception information. The server can feed the decrypted exception information back to the second device, causing the second device to display the exception information.
[0168] Similar to how the server decrypts encrypted data, the designated device can obtain exception information sent by the server, obtained by decrypting the encrypted data using the private key. This exception information includes the first device's SN, resource usage data, network speed, location information, etc.
[0169] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, storage, and display, etc.), and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data must comply with the relevant laws, regulations, and standards of the relevant region. For example, the biometric images and object images involved in this application are all obtained with full authorization.
[0170] In the above method, the first device is not equipped with a display screen, and the second device is equipped with a display screen. The second device establishes a communication channel with the first device, obtains abnormal information from the first device through the communication channel, and displays the abnormal information. This enables the device with a screen to receive abnormal information from the device without a screen and display the abnormal information. Because abnormal information can reflect abnormal phenomena, the device with a display screen displays the abnormal information of the device without a display screen, and the device with a display screen can provide feedback to the user about the abnormal phenomenon of the device without a display screen, thereby quickly and accurately locating the problem of the device without a display screen and facilitating subsequent repair of the device without a display screen.
[0171] The above describes the method of the embodiment of the present application from the perspective of method steps. The following is a detailed description of the method in conjunction with the scenario. The method of the embodiment of the present application can be applied to the scenario of abnormal feedback for any screenless device, for example, the screenless device is a palm swiping device, or a facial recognition device, router, household appliance, etc.
[0172] Take the palm-swiping device as an example. Figure 6 A palm-scanning device equipped with a display screen is shown. Generally, a palm-scanning device equipped with a display screen can provide abnormality feedback through the display screen. For palm-scanning devices without a display screen, abnormality feedback can be provided through a mobile phone equipped with a display screen based on the method of the embodiments of the present application. The palm-scanning device without a display screen corresponds to the first device mentioned above, and the mobile phone equipped with a display screen corresponds to the second device mentioned above.
[0173] like Figure 7 As shown, Figure 7 This is an interactive flow chart of a method for displaying abnormal information provided by an embodiment of the present application. The mobile phone includes an instant messaging application client, and the abnormal information is displayed based on steps 701 to 712 shown below through interaction between the client, the palm-swiping device, and the instant messaging application server.
[0174] Step 701: The client activates the palm-swiping function by interacting with the palm-swiping device.
[0175] Generally speaking, when a palm-swiping device is installed in a store, users need to activate the palm-swiping function on their mobile phones when they go to the store to use the palm-swiping device. The process of activating the palm-swiping function mainly includes: the user places the palm on the camera area of the palm-swiping device, and the palm-swiping device captures the image of the palm to obtain a palm image, which corresponds to the biometric image or object image mentioned above. The palm-swiping device recognizes the palm image. If the palm-swiping device cannot recognize the account information corresponding to the palm image, the palm-swiping device determines that the user is a new user. In this case, the user uses the client to scan the QR code of the palm-swiping device to identify the palm-swiping device. The user opens the palm-swiping applet corresponding to the palm-swiping device, binds the palm image and the account information of the palm-swiping applet in the palm-swiping applet, and sends the palm image and the account information bound to the palm image to the palm-swiping device. Optionally, the account information of the palm-swiping applet is the account information of the instant messaging application.
[0176] Step 702: The palm-swiping device returns the activation result.
[0177] If the palm-swiping device receives the palm image and the account information bound to it, it indicates that the user has successfully bound the palm image and account information. The palm-swiping device then sends the client a notification indicating that the palm-swiping function has been activated. If the palm-swiping device does not receive the palm image and the account information bound to it, it indicates that the user has not successfully bound the palm image and account information. The palm-swiping mini-program then sends the client a notification indicating that the palm-swiping function has not been activated.
[0178] Optionally, after the palm-swiping device is turned on, it will automatically open the palm-swiping application and incubate the palm-swiping recognition process. The palm-swiping recognition process corresponds to the third process mentioned above, which is used to send palm images to the server, receive account information feedback from the server, and transfer account information resources if the payment is successful.
[0179] Step 703: The client confirms based on the prompt information that the client is allowed to establish a Bluetooth connection with the palm-swiping device.
[0180] During the process of binding a palm image to account information, the Palm Brush mini-program can generate a prompt message, prompting the user to allow the client to establish a Bluetooth connection with the Palm Brush device. If the user agrees to the Bluetooth connection, the client can subsequently establish a Bluetooth communication channel with the Palm Brush device and transmit data via Bluetooth.
[0181] Step 704: The device status update process detects the device status in real time.
[0182] After the palm-brush device is powered on, it automatically opens the palm-brush application and initiates the device status update process. The device status update process corresponds to the second process mentioned above and is used to obtain the status data of the palm-brush device and determine abnormal information based on this status data. In other words, the device status of the palm-brush device is monitored in real time through the device status update process, and abnormal information is determined if the palm-brush device is in an abnormal state.
[0183] Step 705: The abnormality feedback process detects in real time whether a mobile phone exists.
[0184] After the palm-swiping device is powered on, it automatically opens the palm-swiping app and initiates the exception feedback process. The exception feedback process corresponds to the first process mentioned above and is used to interact with the client in accordance with the methods of the present embodiment to display abnormal information about the palm-swiping device on the client. In other words, the exception feedback process detects in real time whether a mobile phone is within the palm-swiping device's detection range.
[0185] Step 706: When the palm-scanning device is abnormal, use a mobile phone to take a photo of the palm-scanning device to obtain an image of the palm-scanning device.
[0186] If the user finds that the palm-swiping device is abnormal, for example, due to network or thread blocking and other issues, the palm-swiping device cannot transfer resources based on the palm image. In this case, the user uses a mobile phone to approach the palm-swiping device, takes a photo of the palm-swiping device, and obtains an image of the palm-swiping device. The palm-swiping device includes an indicator light, and the palm-swiping device image includes the image area where the indicator light is located, so that the palm-swiping device image can reflect the abnormal situation of the palm-swiping device. The palm-swiping device image corresponds to the indicator component image mentioned above.
[0187] Step 707: The palm-swiping device establishes a Bluetooth connection with the client and encrypts the abnormal information to obtain encrypted data.
[0188] When a phone is near a palm-swiping device, the abnormality feedback process can identify it. This process obtains abnormality information from the device status update process and establishes a Bluetooth connection with the phone. It then encrypts the abnormality information to generate encrypted data.
[0189] Step 708: The palm-swiping device sends the encrypted data to the client via Bluetooth.
[0190] Step 709: The client opens the real-time communication interface and selects the palm-swiping device image according to the user's operation.
[0191] After the mobile phone captures the hand-swiping device image, it stores it in the photo album application. When the hand-swiping device image is needed, the user opens the client's real-time communication interface, accesses the photo album application through the client, and selects the hand-swiping device image in the photo album application.
[0192] 710 , the client adds the encrypted data to the palm-swiping device image in the form of a watermark to obtain a target image.
[0193] When a mobile phone stores a palm-swipe device image in the photo album app, it generates an MD5 hash of the image. After receiving the encrypted data transmitted via Bluetooth, the MD5 hash and the encrypted data are stored in a file. When a user selects a palm-swipe device image in the photo album app, the client identifies the file containing the MD5 hash based on the palm-swipe device image's MD5 hash and reads the encrypted data from the file. The client then adds the encrypted data as a watermark to the palm-swipe device image, resulting in the target image.
[0194] Step 711: The client sends the target image to the server.
[0195] Step 712: The server sends an exception message to the client.
[0196] The client sends the target image to the server. After receiving the target image, the server extracts the encrypted data from the target image, decrypts the encrypted data to obtain the abnormal information, and sends the abnormal information to the client so that the client can display the abnormal information.
[0197] based on Figure 7 The interactive process shown in the embodiment of the present application provides the following Figure 8 The architecture diagram of the mobile phone shown in the figure. The mobile phone includes a photo album application software and an instant messaging application software. Among them, the photo album application software is used to display images. The instant messaging application software includes a Bluetooth module, a decryption module, a photo album access module, a network module and a Shuazhang applet. The Bluetooth module is used to allow the instant messaging application software to receive encrypted data transmitted via Bluetooth. The decryption module is used to decrypt the encrypted data to obtain abnormal information. The photo album access module is used to access the photo album application software and read the Shuazhang device image from the photo album application software. The network module is used to enable the instant messaging application software to be connected to the Internet to send the target image to the server. The instant messaging application software can use the Shuazhang applet to interact with the Shuazhang device.
[0198] based on Figure 7 The interactive process shown in the embodiment of the present application provides the following Figure 9The architectural diagram of the palm-swiping device shown. The palm-swiping device includes a camera for collecting palm images of the palm located in the camera area. The palm-swiping device also includes a palm-swiping application, which includes a Bluetooth module, a palm-swiping recognition process, a device status update process, and an abnormality feedback process. Among them, the Bluetooth module is used to allow the palm-swiping device to transmit encrypted data via Bluetooth. The palm-swiping recognition process is used to perform a biopsy on the palm, collect streaming media data from the palm that passes the biopsy, and filter out high-quality palm images from the streaming media data. The device status update process is used to obtain status data such as the CPU data, memory data, location information, SN, network speed, etc. of the palm-swiping device, and determine abnormal information based on the status data. The abnormality feedback process is used to detect an object in the camera area, collect the object image, and when the object is identified as a mobile phone based on the object image, establish a Bluetooth connection with the mobile phone, and transmit abnormal information to the mobile phone via Bluetooth.
[0199] Figure 10 FIG. 1 is a schematic diagram showing the structure of a display device for abnormal information provided by an embodiment of the present application. Figure 10 As shown, the device includes:
[0200] An identification module 1001 is configured to, upon detecting an object in an environment where a first device is located, identify the object and obtain an identification result, where the first device is a device not equipped with a display screen, and the identification result is used to indicate whether the object is a second device equipped with a display screen;
[0201] An establishing module 1002 is configured to establish a communication channel with the second device if the recognition result indicates that the object is a second device equipped with a display screen;
[0202] The transmission module 1003 is configured to transmit abnormal information of the first device to the second device through a communication channel, where the abnormal information is displayed on the second device.
[0203] In one possible implementation, the recognition module 1001 is used to capture an image of an object to obtain an object image; perform feature extraction on the object image to obtain a first image feature, where the first image feature is used to characterize visual information of the object; and determine a recognition result based on the first image feature.
[0204] In one possible implementation, the recognition module 1001 is configured to obtain a second image feature, where the second image feature is used to characterize visual information of a device equipped with a display screen; calculate a feature distance between the first image feature and the second image feature; and determine a recognition result based on the feature distance.
[0205] In one possible implementation, the recognition module 1001 is configured to activate the first image feature through an activation function to obtain probability data, where the probability data is used to characterize the probability that the object is a device equipped with a display screen; and determine a recognition result based on the probability data.
[0206] In a possible implementation, the transmission module 1003 is configured to encrypt the abnormality information of the first device to obtain encrypted data; and send the encrypted data to the second device through a communication channel, where the encrypted data is decrypted to obtain the abnormality information.
[0207] In a possible implementation, the method is executed by a first process in a first device, and the first process is independent of other processes in the first device.
[0208] In one possible implementation, the first device includes a second process, the second process being configured to obtain status data of the first device and determine abnormality information based on the status data;
[0209] The device also includes:
[0210] The acquisition module is used to obtain exception information from the second process.
[0211] In one possible implementation, the first device is used for payment, and the first device includes a third process. The third process is used to send a biometric image to a server and receive account information related to the biometric image fed back by the server. The account information is used to transfer resources when the payment is successful.
[0212] In the above-mentioned device, the first device is not equipped with a display screen. If the first device detects an object, determines that the distance between the first device and the object is not greater than the set distance, and identifies that the object is a second device equipped with a display screen, the first device establishes a communication channel with the second device, and transmits abnormal information of the first device to the second device through the communication channel, so as to display the abnormal information on the second device, thereby enabling the device with a screen to receive abnormal information of the device without a screen and display the abnormal information. Since abnormal information can reflect abnormal phenomena, the abnormal information of the device without a display screen is displayed by the device with a display screen, and the abnormal phenomenon of the device without a display screen is fed back to the user by the device with a display screen, thereby quickly and accurately locating the problem of the device without a display screen, and facilitating the subsequent repair of the device without a display screen.
[0213] Figure 11 FIG. 1 is a schematic diagram showing the structure of a display device for abnormal information provided by an embodiment of the present application. Figure 11 As shown, the device includes:
[0214] Establishing module 1101, configured to establish a communication channel with a first device, where the first device is not equipped with a display screen;
[0215] An acquisition module 1102 is configured to acquire abnormal information of the first device through a communication channel;
[0216] The display module 1103 is used to display abnormal information through the equipped display screen.
[0217] In one possible implementation, the acquisition module 1102 is used to receive encrypted data transmitted by the first device through the communication channel, where the encrypted data is obtained by encrypting the exception information; send the encrypted data to the server so that the server decrypts the encrypted data to obtain the exception information; and receive the exception information fed back by the server.
[0218] In one possible implementation, the first device includes an indicating component for indicating a state of the first device, the exception information is used to describe that the first device is in an abnormal state, and the apparatus further includes:
[0219] An acquisition module is used to acquire an image of the indicating component to obtain an image of the indicating component;
[0220] The sending module is used to send the indication component image and abnormality information to a designated device, where the designated device is a device used by an object to repair the first device.
[0221] In a possible implementation, the sending module is configured to add abnormality information to the indicator component image to obtain a target image; and send the target image to a designated device.
[0222] In a possible implementation, the display module is further configured to display an image of an indication component;
[0223] The device also includes:
[0224] The search module is used to search for abnormal information corresponding to the identification data of the indicator component image from a designated storage area according to a selection operation on the indicator component image. The designated storage area stores identification data and corresponding abnormal information, and the identification data is used to identify the indicator component image.
[0225] In the above-mentioned device, the first device is not equipped with a display screen, while the second device is equipped with a display screen. The second device establishes a communication channel with the first device, obtains abnormal information from the first device through the communication channel, and displays the abnormal information. This enables the device with a screen to receive and display abnormal information from the device without a screen. Because abnormal information can reflect abnormal phenomena, the device with a display screen displays the abnormal information of the device without a display screen, allowing the device with a display screen to provide feedback to the user about the abnormal phenomena of the device without a display screen, thereby quickly and accurately locating problems with the device without a display screen and facilitating subsequent repairs of the device without a display screen.
[0226] It should be understood that the above Figure 10 or Figure 11 The provided device is illustrated only by the division of the above-mentioned functional modules when implementing its functions. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiments are based on the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.
[0227] Figure 12 FIG. 1 is a schematic diagram of a display system for abnormal information provided by an embodiment of the present application. Figure 12 As shown, the system includes a first device 1201 not equipped with a display screen and a second device 1202 equipped with a display screen. The first device 1201 is used to perform Figure 2 The content of the related method embodiment; the second device 1202 is used to execute Figure 3 The content of the relevant method embodiment.
[0228] In the above system, the first device is not equipped with a display screen, while the second device is equipped with a display screen. The first device establishes a communication channel with the second device and transmits abnormality information of the first device to the second device through the communication channel, so that the second device can receive and display the abnormality information. The abnormality information of the device without a display screen is displayed on the device with a display screen, thereby enabling the device with a display screen to provide feedback to the user about the abnormality of the device without a display screen, thereby quickly and accurately locating the problem of the device without a display screen and facilitating subsequent repair of the device without a display screen.
[0229] It should be understood that the above Figure 12 The provided system and method embodiments belong to the same concept, and their specific implementation processes are detailed in the method embodiments and will not be repeated here.
[0230] Figure 13 FIG2 shows a block diagram of a terminal device 1300 provided by an exemplary embodiment of the present application. The terminal device 1300 includes a processor 1301 and a memory 1302 .
[0231] The processor 1301 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1301 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), or PLA (Programmable Logic Array). The processor 1301 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1301 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1301 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.
[0232] The memory 1302 may include one or more computer-readable storage media, which may be non-transitory. The memory 1302 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1302 is used to store at least one computer program, which is executed by the processor 1301 to implement the method for displaying abnormal information provided in the method embodiment of the present application.
[0233] In some embodiments, terminal device 1300 may optionally include a peripheral device interface 1303 and at least one peripheral device. The processor 1301, memory 1302, and peripheral device interface 1303 may be connected via a bus or signal lines. Each peripheral device may be connected to peripheral device interface 1303 via a bus, signal lines, or circuit boards. Specifically, the peripheral device may include at least one of a radio frequency circuit 1304, a display screen 1305, a camera assembly 1306, an audio circuit 1307, and a power supply 1308.
[0234] The peripheral device interface 1303 can be used to connect at least one I / O (Input / Output)-related peripheral device to the processor 1301 and the memory 1302. In some embodiments, the processor 1301, the memory 1302, and the peripheral device interface 1303 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1301, the memory 1302, and the peripheral device interface 1303 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.
[0235] The RF circuit 1304 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1304 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1304 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the RF circuit 1304 includes an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The RF circuit 1304 can communicate with other terminals via at least one wireless communication protocol. Such wireless communication protocols include, but are not limited to, the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1304 may also include circuitry related to Near Field Communication (NFC), although this application does not limit this.
[0236] The display screen 1305 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 1305 is a touch screen display, the display screen 1305 also has the ability to collect touch signals on the surface or above the surface of the display screen 1305. The touch signal can be input as a control signal to the processor 1301 for processing. In this case, the display screen 1305 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, there can be one display screen 1305, which is set on the front panel of the terminal device 1300; in other embodiments, there can be at least two display screens 1305, which are respectively set on different surfaces of the terminal device 1300 or in a folding design; in other embodiments, the display screen 1305 can be a flexible display screen, which is set on the curved surface or folding surface of the terminal device 1300. Even more, the display screen 1305 can be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 1305 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).
[0237] The camera assembly 1306 is used to capture images or videos. Optionally, the camera assembly 1306 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 1306 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.
[0238] The audio circuit 1307 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals that are input into the processor 1301 for processing, or input into the RF circuit 1304 to achieve voice communication. For the purpose of stereo sound collection or noise reduction, there can be multiple microphones, each located in different parts of the terminal device 1300. The microphone can also be an array microphone or an omnidirectional collection microphone. The speaker is used to convert the electrical signal from the processor 1301 or the RF circuit 1304 into sound waves. The speaker can be a traditional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 1307 may also include a headphone jack.
[0239] Power supply 1308 is used to power various components in terminal device 1300. Power supply 1308 can be AC power, DC power, a disposable battery, or a rechargeable battery. When power supply 1308 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is charged via a wired line, while a wireless rechargeable battery is charged via a wireless coil. The rechargeable battery can also support fast charging technology.
[0240] In some embodiments, the terminal device 1300 further includes one or more sensors 1309 , including but not limited to: an acceleration sensor 1311 , a gyroscope sensor 1312 , a pressure sensor 1313 , an optical sensor 1314 , and a proximity sensor 1315 .
[0241] The accelerometer 1311 can detect the magnitude of acceleration along the three coordinate axes of the coordinate system established by the terminal device 1300. For example, the accelerometer 1311 can be used to detect the components of gravity acceleration along the three coordinate axes. The processor 1301 can control the display screen 1305 to display the user interface in a landscape or portrait view based on the gravity acceleration signal collected by the accelerometer 1311. The accelerometer 1311 can also be used to collect game or user motion data.
[0242] The gyroscope sensor 1312 can detect the body orientation and rotation angle of the terminal device 1300. The gyroscope sensor 1312 can work with the acceleration sensor 1311 to collect the user's 3D movements of the terminal device 1300. Based on the data collected by the gyroscope sensor 1312, the processor 1301 can implement the following functions: motion sensing (such as changing the UI based on the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.
[0243] The pressure sensor 1313 can be set on the side frame of the terminal device 1300 and / or the lower layer of the display screen 1305. When the pressure sensor 1313 is set on the side frame of the terminal device 1300, it can detect the user's grip signal of the terminal device 1300, and the processor 1301 performs left and right hand recognition or shortcut operations based on the grip signal collected by the pressure sensor 1313. When the pressure sensor 1313 is set on the lower layer of the display screen 1305, the processor 1301 controls the operable controls on the UI interface based on the user's pressure operation on the display screen 1305. The operable controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.
[0244] Optical sensor 1314 is used to detect ambient light intensity. In one embodiment, processor 1301 can control the display brightness of display screen 1305 based on the ambient light intensity detected by optical sensor 1314. Specifically, when the ambient light intensity is high, the display brightness of display screen 1305 is increased; when the ambient light intensity is low, the display brightness of display screen 1305 is decreased. In another embodiment, processor 1301 can also dynamically adjust the shooting parameters of camera assembly 1306 based on the ambient light intensity detected by optical sensor 1314.
[0245] Proximity sensor 1315, also known as a distance sensor, is typically located on the front panel of terminal device 1300. Proximity sensor 1315 is used to detect the distance between the user and the front of terminal device 1300. In one embodiment, when proximity sensor 1315 detects that the distance between the user and the front of terminal device 1300 is gradually decreasing, processor 1301 controls display screen 1305 to switch from the screen-on state to the screen-off state. When proximity sensor 1315 detects that the distance between the user and the front of terminal device 1300 is gradually increasing, processor 1301 controls display screen 1305 to switch from the screen-off state to the screen-on state.
[0246] Those skilled in the art will understand that Figure 13 The structure shown in the figure does not constitute a limitation on the terminal device 1300, and the terminal device 1300 may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component arrangement.
[0247] Figure 14This is a schematic diagram of the structure of the server provided in the embodiment of the present application. The server 1400 may have relatively large differences due to different configurations or performances, and may include one or more processors 1401 and one or more memories 1402, wherein the one or more memories 1402 store at least one computer program, and the at least one computer program is loaded and executed by the one or more processors 1401 to implement the display method of abnormal information provided by the above-mentioned various method embodiments. Exemplarily, the processor 1401 is a CPU. Of course, the server 1400 may also have components such as a wired or wireless network interface, a keyboard, and an input and output interface for input and output. The server 1400 may also include other components for implementing device functions, which will not be described in detail here.
[0248] In an exemplary embodiment, a computer-readable storage medium is further provided, in which at least one computer program is stored. The at least one computer program is loaded and executed by a processor to enable an electronic device to implement any of the above-mentioned methods for displaying abnormal information.
[0249] Optionally, the computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a compact disc (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, or the like.
[0250] In an exemplary embodiment, a computer program is further provided. The computer program is at least one, and the at least one computer program is loaded and executed by a processor to enable the electronic device to implement any of the above-mentioned methods for displaying abnormal information.
[0251] In an exemplary embodiment, a computer program product is further provided. The computer program product stores at least one computer program, which is loaded and executed by a processor to enable an electronic device to implement any of the above-mentioned methods for displaying abnormal information.
[0252] It should be understood that the term "plurality" used herein refers to two or more. "And / or" describes a relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: A exists alone, A and B exist simultaneously, or B exists alone. The character " / " generally indicates an "or" relationship between the associated objects.
[0253] The serial numbers of the above embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0254] The above description is merely an exemplary embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the principles of the present application shall be included in the scope of protection of the present application.
Claims
1. A method for displaying abnormal information, characterized in that: The method comprises: When an object is detected in an environment where the first device is located, identifying the object to obtain a recognition result, the first device being a device not equipped with a display screen, and the recognition result being used to indicate whether the object is a second device equipped with a display screen; If the recognition result indicates that the object is a second device equipped with a display screen, establishing a communication channel with the second device; The abnormality information of the first device is transmitted to the second device through the communication channel, and the abnormality information is used to be displayed on the second device.
2. The method according to claim 1, characterized in that The identifying the object to obtain an identification result includes: Capturing an image of the object to obtain an object image; Performing feature extraction on the object image to obtain a first image feature, where the first image feature is used to represent visual information of the object; The recognition result is determined based on the first image feature.
3. The method according to claim 2, characterized in that The determining the recognition result based on the first image feature includes: Acquire a second image feature, where the second image feature is used to represent visual information of a device equipped with a display screen; calculating a feature distance between the first image feature and the second image feature; The recognition result is determined based on the feature distance.
4. The method according to claim 2, characterized in that The determining the recognition result based on the first image feature includes: activating the first image feature using an activation function to obtain probability data, where the probability data is used to represent a probability that the object is a device equipped with a display screen; The recognition result is determined based on the probability data.
5. The method according to claim 1, wherein: The transmitting the abnormal information of the first device to the second device through the communication channel includes: encrypting the abnormal information of the first device to obtain encrypted data; The encrypted data is sent to the second device through the communication channel, and the encrypted data is used to decrypt to obtain the abnormality information.
6. The method according to any one of claims 1 to 5, characterized in that The method is performed by a first process in the first device, and the first process is independent of other processes in the first device.
7. The method according to any one of claims 1 to 5, characterized in that The first device includes a second process, the second process being configured to obtain status data of the first device and determine the abnormality information based on the status data; Before transmitting the abnormal information of the first device to the second device through the communication channel, the method further includes: The exception information is obtained from the second process.
8. The method according to any one of claims 1 to 5, characterized in that The first device is used for payment, and the first device includes a third process. The third process is used to send a biometric image to a server and receive account information related to the biometric image fed back by the server. The account information is used to transfer resources when the payment is successful.
9. A method for displaying abnormal information, characterized in that: The method comprises: Establishing a communication channel with a first device, where the first device is not equipped with a display screen; obtaining abnormal information of the first device through the communication channel; The abnormal information is displayed through the equipped display screen.
10. The method according to claim 9, characterized in that The acquiring the abnormal information of the first device through the communication channel includes: receiving encrypted data transmitted by the first device through the communication channel, where the encrypted data is obtained by encrypting the abnormality information; Sending the encrypted data to a server, so that the server decrypts the encrypted data to obtain the abnormal information; Receive the abnormal information fed back by the server.
11. The method according to claim 9 or 10, characterized in that The first device includes an indicating component for indicating a state of the first device, the abnormality information is used to describe that the first device is in an abnormal state, and the method further includes: Capturing an image of the indicating component to obtain an image of the indicating component; The indication component image and the abnormality information are sent to a designated device, the designated device being a device used by a target for repairing the first device.
12. The method according to claim 11, characterized in that The sending the indication component image and the abnormality information to the designated device includes: Adding the abnormal information to the indicator component image to obtain a target image; The target image is sent to the designated device.
13. The method according to claim 11, characterized in that Before sending the indication component image and the abnormality information to the designated device, the method further includes: displaying the indication component image; According to the selection operation on the indicator component image, abnormal information corresponding to the identification data of the indicator component image is searched from a designated storage area, wherein the designated storage area stores identification data and corresponding abnormal information, and the identification data is used to identify the indicator component image.
14. A display system for abnormal information, characterized in that: The system includes a first device not equipped with a display screen and a second device equipped with a display screen; The first device is used to execute the method for displaying abnormal information according to any one of claims 1 to 8, and the second device is used to execute the method for displaying abnormal information according to any one of claims 9 to 13.
15. A display device for abnormal information, characterized in that: The device comprises: an identification module configured to, upon detecting the presence of an object in the environment of the first device, identify the object and obtain an identification result, wherein the first device is a device not equipped with a display screen, and the identification result is used to indicate whether the object is a second device equipped with a display screen; an establishing module, configured to establish a communication channel with the second device if the recognition result indicates that the object is a second device equipped with a display screen; The transmission module is used to transmit the abnormal information of the first device to the second device through the communication channel, and the abnormal information is used to be displayed on the second device.
16. A display device for abnormal information, characterized in that: The device comprises: An establishing module, configured to establish a communication channel with a first device, where the first device is not equipped with a display screen; an acquisition module, configured to acquire abnormal information of the first device through the communication channel; The display module is used to display the abnormal information through an equipped display screen.
17. An electronic device, characterized in that: The electronic device includes a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor so that the electronic device implements the method for displaying abnormal information as described in any one of claims 1 to 13.
18. A computer-readable storage medium, characterized in that The computer-readable storage medium stores at least one computer program, and the at least one computer program is loaded and executed by the processor to enable the electronic device to implement the method for displaying abnormal information according to any one of claims 1 to 13.
19. A computer program product, characterized in that The computer program product stores at least one computer program, and the at least one computer program is loaded and executed by a processor to enable the electronic device to implement the method for displaying abnormal information according to any one of claims 1 to 13.