A processing method and device

Abstract

The present application discloses a processing method and device, including: obtaining first data transmitted by a target device; obtaining second data including environmental information of the environment where the target device is located; processing the first data and the second data to obtain the first data and the second data that are associated with each other.

Description

Technical Field

[0001] This application relates to the field of information processing technologies, and in particular, to a processing method and a device. Background Art

[0002] During the process of a user using an electronic device, the user usually can only judge the data processing process of the electronic device based on their own experience to obtain the external performance data of the electronic device. That is, even if the user can obtain internal data such as the software and hardware configuration parameters of the electronic device through human-computer interaction, the external performance data of the electronic device cannot be associated with the internal data of the electronic device itself. Summary of the Invention

[0003] Based on the above problems, embodiments of this application provide a processing method and a device.

[0004] The technical solution provided by the embodiments of this application is as follows:

[0005] Embodiments of this application provide a processing method, including:

[0006] Obtain first data transmitted by a target device;

[0007] Obtain second data including environmental information of the environment where the target device is located;

[0008] Process the first data and the second data to obtain the first data and the second data with an established association.

[0009] In one implementation, the obtaining of the first data transmitted by the target device includes:

[0010] Through a communication connection with the target device, obtain first data related to the operating state of the target device;

[0011] The obtaining of the second data including environmental information of the environment where the target device is located includes:

[0012] Collect second data related to the operating state of the target device output by the target device;

[0013] Among them, the first data and the second data with the established association can be used to determine the operating state of the target device.

[0014] In one implementation, the method further includes:

[0015] Obtain input third data; among them, the first data and the second data with the established association, and the third data can be used to determine the operating state of the target device.

[0016] In one implementation, the first data includes data generated by the target device after the communication connection is established; the method further includes:

[0017] Obtain fourth data transmitted by the target device; wherein, the fourth data includes data generated by the target device before the communication connection is established; the first data, the second data, and the fourth data for establishing the association can be used to determine the operating state of the target device.

[0018] In one implementation, the method further includes:

[0019] Analyze the first data to determine acquisition parameters; wherein, the acquisition parameters at least include location information and / or identification information of at least one module of the target device; the acquisition data is used for a data acquisition device to acquire the second data.

[0020] In one implementation, the first data includes text data; the second data includes first image data; processing the first data and the second data to obtain the associated first data and second data includes:

[0021] Process the text data and the first image data to obtain second image data; wherein, the second image data includes at least part of the data in the first image data and data obtained from at least part of the data in the text data.

[0022] In one implementation, the first image data includes a set of multiple frames of image data; the second image data includes a set of multiple frames of image data; processing the text data and the first image data to obtain the second image data includes:

[0023] Obtain first time period information of the text data and second time period information of the first image data;

[0024] Based on the first time period information and the second time period information, determine a target time period;

[0025] Process target image data and target text data to obtain the second image data; wherein, the target image data includes multiple frames of image data within the target time period in the first image data; the target text data includes at least part of the text data within the target time period in the text data; the nth frame of image data in the second image data includes at least part of the image data of the nth frame of image data in the target image data and data obtained from the text data at the nth moment in the target text data; n is an integer greater than or equal to 1.

[0026] In one embodiment, the method further includes:

[0027] Analyze the first data and the second data associated with each other to obtain an analysis result;

[0028] Based on the analysis result, obtain first instruction information; wherein, the first instruction information includes instruction information for performing an operation on the target device;

[0029] Output the first instruction information.

[0030] In one embodiment, the method further includes:

[0031] Send the first data and the second data associated with each other to a remote processing device;

[0032] Obtain second instruction information transmitted by the remote processing device; wherein, the second instruction information is obtained by analyzing the first data and the second data associated with each other; the second instruction information includes instruction information for performing an operation on the target device;

[0033] Output the second instruction information.

[0034] An embodiment of the present application further provides a processing device, including:

[0035] A first communication module, configured to obtain first data transmitted by a target device;

[0036] An acquisition module, configured to obtain second data including environmental information of the environment where the target device is located;

[0037] A processing module, configured to process the first data and the second data to obtain the first data and the second data associated with each other.

[0038] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor of an electronic device, the processing method as described in any one of the foregoing can be implemented.

[0039] In the processing method provided by the embodiment of the present application, the processing device can obtain first data related to the operating state of the target device through its communication connection with the target device, and can also collect second data related to the operating state of the target device output by the target device, and obtain the first data and the second data associated with each other, thereby realizing an overall, highly flexible, and objective association between the internal data of the target device, that is, the first data, and the external data of the target device, that is, the second data. Description of the Drawings

[0040] Figure 1 Schematic flowchart of the processing method provided by the embodiment of the present application;

[0041] Figure 2 Schematic flowchart of obtaining the second image data provided by the embodiment of the present application;

[0042] Figure 3 Schematic flowchart of outputting the first instruction information provided by the embodiment of the present application;

[0043] Figure 4 Schematic flowchart of outputting the second instruction information provided by the embodiment of the present application;

[0044] Figure 5 Schematic structural diagram implemented by the processing method provided by the embodiment of the present application;

[0045] Figure 6 Schematic structural diagram of the processing device provided by the embodiment of the present application. Detailed implementation manners

[0046] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application.

[0047] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0048] In the process of users using various electronic devices, users usually can only subjectively judge the external performance of the electronic device data processing process based on their own experience to obtain the external performance data of the electronic device. Sometimes users can also obtain internal data of the electronic device such as software and hardware configuration parameters, but users cannot associate the above external performance data with the internal data of the electronic device.

[0049] Based on the above problems, the embodiments of the present application provide a processing method and a processing device.

[0050] The embodiment of the present application first provides a processing method, which can be implemented by a processor of a processing device. The above-mentioned processor can be at least one of an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a central processing unit (CPU), a controller, a microcontroller, and a microprocessor.

[0051] Figure 1 The following is a flow chart of the processing method provided in the embodiment of the present application. Figure 1 As shown, the process may include steps 101 to 103:

[0052] Step 101: Obtain first data transmitted by a target device.

[0053] In one embodiment, the target device may include an electronic device used by a user, such as a television, a washing machine, an air conditioner, and a computer device, etc.; illustratively, the target device may also be a smart mobile device, such as a smart phone and a smart watch, etc.

[0054] In one embodiment, a communication connection may be established between the processing device and the target device, and the processing device receives the first data transmitted by the target device through the communication connection; exemplarily, the above-mentioned communication connection may be a wired connection or a wireless connection; exemplarily, the wired connection may be achieved by connecting the processing device and the target device via a standard communication bus such as Type-C.

[0055] In one embodiment, the target device may trigger real-time transmission of the first data after detecting that a communication connection between the target device and the processing device has been established; exemplarily, the target device may transmit the first data to the processing device only after receiving a data acquisition instruction sent by the processing device; exemplarily, the target device may obtain or generate the first data and transmit the first data to the target device only after establishing a communication connection with the processing device and receiving a data acquisition instruction sent by the processing device.

[0056] In one embodiment, the first data may include the data currently processed by the target device, such as the video data currently played by the target device and the text data displayed, etc.; Exemplarily, the first data may further include additional parameters of the data currently processed by the target device, where the above additional parameters may include the size of the video data, the playing progress of the video data, the decoding method of the video data, and the decoding rate of the video data, etc., and the above additional parameters may further include the storage address of the text data and the identification information of the application program for displaying the text data, etc.

[0057] In one embodiment, the first data may further include the resource data relied on by the target device during the data processing. Exemplarily, the resource data relied on by the target device during the data processing may include the data representation of the hardware resources or software resources occupied for implementing the data processing, such as the size of the memory space occupied for implementing the data processing, the size of the hard disk storage space occupied, the number of processes created and the identification of each process, and the priority of the threads included in each process, etc.

[0058] In one embodiment, the first data may further include the data generated by the target device during the data processing, such as the target video generated during the video acquisition process, the target file obtained during the data download process, and the target text obtained during the text editing process, etc.

[0059] In one embodiment, the first data may further include the operation data executed by the user during the data processing of the target device, such as the number of times the user pauses the video acquisition during the video acquisition process, the resolution parameters set by the user for the image acquisition device, such as the network connection parameters selected by the user during the data download process, and the data storage address, etc.

[0060] Step 102, obtain second data including environmental information of the environment where the target device is located.

[0061] In one embodiment, the environmental information of the environment where the target device is located may include the brightness information, humidity information, temperature information, noise information, time information, and air quality level information, etc., of the environment where the target device is located.

[0062] In one embodiment, the environmental information of the environment where the target device is located may include the information about the impact of the target device on its surrounding environment. For example, when the target device is a television, the environmental information may include the degree of influence on the temperature and / or brightness of the environment where the television is located due to the continuous playing of the television program; when the target device is a cleaning device such as an air purifier, the environmental information of the environment where the cleaning device is located may include the air quality information in the space where the cleaning device is located.

[0063] In one embodiment, the second data may further include time information corresponding to the environmental information of the environment where the target device is located. For example, the air quality information corresponds to the environmental information of the first period, the temperature information corresponds to the environmental information of the second period, and so on.

[0064] In one embodiment, the second data may be obtained through the sensor device of the processing device. For example, the temperature information of the environment where the target device is located can be obtained through the temperature sensor of the processing device, and the brightness information of the environment where the target device is located can be obtained through the brightness sensor of the processing device, and so on.

[0065] Step 103: Process the first data and the second data to obtain the first data and the second data with an established association.

[0066] In one embodiment, the processing device may associate the first data and the second data according to the time information carried in the first data and the second data, so as to obtain the first data and the second data with an established association.

[0067] In one embodiment, the processing device may associate the first data and the second data according to a pre-set association strategy, so as to obtain the first data and the second data with an established association. Exemplarily, the association strategy may include analyzing the correlation degree between at least part of the data in the first data and at least part of the data in the second data. When the correlation degree is greater than or equal to a preset threshold, the first data and the second data are associated. Correspondingly, when the correlation degree is less than the preset threshold, the first data and the second data may not be associated.

[0068] As can be seen from the above, the processing method provided by the embodiments of the present application can process the first data and the second data to obtain the first data and the second data with an established association after obtaining the first data transmitted by the target device and the second data including the environmental information of the environment where the target device is located. Since the first data is the internal data of the target device transmitted by the target device, and the second data is the external data including the environmental information of the environment where the target device is located, therefore, since the internal state information of the target device can be obtained through the first data, and the second data can objectively represent the external data of the impact of the target device on its surrounding environment, then, through the first data and the second data with an established association, not only can the data of both the internal state and the external performance of the target device be objectively and accurately obtained at the same time, but also the internal data and the external performance data of the target device can be flexibly integrated and associated, thereby realizing an objective, highly flexible and holistic integration between the internal data and the external performance data of the target device.

[0069] Exemplarily, when the target device is the device used by the user, the processing device can be a device such as a smartphone that facilitates user operation. Through the simple data processing of the smartphone device that the user is familiar with and can operate flexibly, the external data and internal data of the device used by the user can be objectively and accurately associated, thereby laying a foundation for the user to accurately grasp the true performance of the electronic device.

[0070] Based on the foregoing embodiments, in the processing method provided in the embodiments of the present application, obtaining the first data transmitted by the target device can be achieved in the following manner:

[0071] Obtain the first data related to the operating state of the target device through the communication connection with the target device.

[0072] In one implementation manner, the operating state of the target device may include the normal operating state of the target device, or may include the abnormal operating state of the target device.

[0073] In one implementation manner, the first data related to the operating state of the target device may include data related to the continuous operating state of the target device, such as the memory occupancy rate when the computer device is in a continuous operating state.

[0074] In one implementation manner, the first data related to the operating state of the target device may include data related to the specified operating state of the target device, such as the data of the task scheduling process of the computer device for multi-task concurrency when the computer device is in the data download state.

[0075] In one implementation manner, the first data related to the operating state of the target device may include data related to the abnormal operating state of the target device, such as data related to the serious lag state that occurs during the video playback process of the target device. Exemplarily, the first data at this time may include the video data obtained by the processor of the target device, the decoding state data of the video decoder, the decoding state data of the audio decoder, and the image display state of the display device, etc.

[0076] In one implementation manner, the first data related to the operating state of the target device may include data that continues to be updated as the operating state of the target device continues, and may also include data that is generated only after the target device switches to the specified state. For example, when the target device runs abnormally, the device abnormal operation data captured by the abnormal capture mechanism set in the target device.

[0077] In one implementation manner, the first data related to the operating state of the target device may be data that is generated only after the target device receives the data acquisition instruction sent by the processing device through the communication connection.

[0078] Correspondingly, in the processing method provided by the embodiments of the present application, the second data including the environmental information of the environment where the target device is located can be obtained in the following manner:

[0079] Collect the second data related to the operating state of the target device output by the target device.

[0080] Among them, the associated first data and second data can be used to determine the operating state of the target device.

[0081] In one implementation, the processing device can collect the second data related to the operating state of the target device through sensors; for example, the processing device can collect data corresponding to the type of the sensor through at least one sensor and determine these data as the second data. For example, the processing device can collect the flashing state of the indicator light of the target device through an image acquisition device, collect the sound output by the target device through a sound sensor, and collect the brightness information of the display screen of the target device through a brightness sensor, and then determine at least one of the flashing state of the indicator light, the output sound, and the brightness information as the second data.

[0082] In one implementation, the processing device can integrate at least two types of data related to the operating state of the target device collected by it and determine the integration result as the second data. For example, the processing device integrates the sound output by the target device collected through a sound sensor and the brightness information of the display screen of the target device collected through a brightness sensor to obtain the second data related to the video playback state of the target device.

[0083] In one implementation, the associated first data and second data can be used to determine the current operating state of the target device, such as whether the current video playback state of the target device is normal; for example, the associated first data and second data can also be used to determine the historical operating state of the target device, such as the operating state of the target device from five minutes before the current moment to the current moment. In this case, the time range covered by the first data and / or the second data can include the period from five minutes before the current moment to the current moment.

[0084] In one implementation, the associated first data and second data can also be used to predict the operating state of the target device at the next moment or after a specified period. For example, according to the associated first data and second data, the currently available memory resources in the target device and the memory resources required to be applied for by at least one application program currently in the running state can be obtained, so as to predict the operating state of the target device at the next moment. At this time, the operating state of the target device at the next moment can include the abnormal operating state of at least one application program caused by the failure of memory resource application.

[0085] As can be seen from the above, in the processing method provided by the embodiments of the present application, the processing device can obtain the first data related to the operating state of the target device through the communication connection between it and the target device, and can also collect the second data related to the operating state of the target device output by the target device, so as to determine the operating state of the target device based on the associated first data and second data. In this way, after the processing device obtains the internal data, that is, the first data, which can accurately represent the operating state of the target device, it can also collect the external data, that is, the second data, related to the operating state of the target device. Therefore, on the basis of improving the objectivity of the external data of the operating state of the target device, by establishing the associated first data and second data, the operating state of the target device can be determined more comprehensively and objectively from both internal and external aspects.

[0086] In the related art, when a user uses an electronic device, if the actual performance of the electronic device is different from the user's expected result, the user may seek help from the after-sales technical personnel of the electronic device. However, if the user has insufficient understanding of the working principle of the electronic device or the description of the actual operating performance of the electronic device is not objective and accurate enough, the after-sales technical personnel cannot accurately obtain the true state of the electronic device, thus unable to provide more targeted device usage suggestions for the user, which reduces the communication efficiency between the user and the after-sales technical personnel and also reduces the efficiency of solving user problems.

[0087] In the processing method provided by the embodiments of the present application, when the target device is a user device and the processing device is a smart phone that the user can use proficiently, without the need for the user to have professional knowledge related to the operating state of the electronic device, through the data processing process of the application program set in the smart phone that can implement the processing method, the first data related to the operating state inside the user device and the second data related to the operating state output by the user device collected can be comprehensively, objectively and quickly associated. On the one hand, the objectivity of the second data of the user device is improved. On the other hand, by establishing the associated first data and second data, not only the flexible integration between the external data and the internal data of the user device is realized, but also the operating state of the electronic device used by the user can be determined flexibly and objectively as a whole, thus solving the technical problem in the related art that the after-sales technical personnel cannot accurately master the fault state of the user device because the user cannot accurately describe the actual operating performance of the user device.

[0088] Based on the foregoing embodiments, the processing method provided by the embodiments of the present application may further include the following operations:

[0089] Obtain the input third data.

[0090] The associated first data, second data, and third data can be used to determine the operating status of the target device.

[0091] In one implementation, the third data may include at least one of text data, picture data, audio data, and gesture data.

[0092] In one implementation, the third data may include data related to the overall operating status of the target electronic device. For example, when the target electronic device is a computer device, the third data may include: the computer device is able to respond to user input instructions in a timely manner.

[0093] In one embodiment, the third data may include data related to the operating status of at least one module of the target electronic device. For example, when the target electronic device is a computer device, the third data may include: the display screen becomes stuck during the video playback process. At this time, the third data includes data related to the operating status of both the display screen and the video playback module.

[0094] In one embodiment, the third data may include data on the duration of a certain state of at least one module, such as the duration of the display screen being in a stuck state is 10 minutes; exemplarily, the third data may also include data on the operation performed by the target device before at least one module is in a certain state, such as the target device is in a video conference state before the display screen is in a stuck state.

[0095] In the embodiment of the present application, the third data can be obtained by any of the following methods:

[0096] The human-computer interaction window of the processing device can display controls or areas for users to input data. After the user touches the above controls or areas, the user can perform data input operations. The processing device detects and identifies the input operations performed by the user, thereby obtaining third data; exemplarily, the user's editing operations on the above controls or areas can also include selection operations on multiple options.

[0097] The sensor of the processing device can collect audio data of the user and determine the collected audio data as the third data.

[0098] The image acquisition device of the processor may continuously acquire images of the user, recognize gestures and / or postures in the acquired images, and determine the results of the gesture and / or posture recognition as third data.

[0099] In one embodiment, by analyzing the first data, the second data, and the third data that are associated with each other, a first result can be obtained. Based on the first result, the overall operating state of the target device can be determined. For example, when the third data indicates that the target device is in a normal operating state, it can be determined whether there is any data related to an abnormal operating state in the first data and the second data that are associated with each other. If there is no data related to an abnormal operating state in the first data and the second data, it can be determined that the overall operating state of the target device is consistent with the operating state represented by the third data. If there is data related to an abnormal operating state in the first data and the second data, it can be determined that the overall operating state of the target device is inconsistent with the operating state represented by the third data.

[0100] In one embodiment, the second result obtained by analyzing the first data, the second data, and the third data that are associated with each other can be used to determine the operating state of at least one module of the target device. For example, when the third data includes data related to at least one module, the third data can be analyzed to obtain the module identifiers of at least one module, and then the data in the first data and the second data that are associated with each other and correspond to the at least one module identifier can be analyzed to determine the operating state of at least one module.

[0101] In one embodiment, the third data can be analyzed, and then based on the fault description information obtained from the third data, the target module can be determined. Then, the data in the first data and the second data that are associated with each other and correspond to the target module can be analyzed to determine the operating state of the target module.

[0102] In one embodiment, time information can be obtained from the third data, and based on the time information, the first data and the second data that are associated with each other can be analyzed to determine the operating state of at least one module during the time period corresponding to the time information.

[0103] In one embodiment, the operating state of at least one module can also be analyzed to determine the abnormal level of at least one module. For example, the operating state of the CPU of the target device can be analyzed to determine whether the operating state of the CPU is at a severe abnormal level.

[0104] In one embodiment, the operating state of at least one module can be analyzed to determine the load level of at least one module, and based on the number of modules whose load level is greater than or equal to a preset threshold, the operating state of the target device can be determined. For example, if the number of modules whose load level is greater than or equal to the preset threshold is greater than or equal to a first threshold, it can be determined that the target device is currently in an overloaded operating state. If the number of modules whose load level is greater than or equal to the preset threshold is less than the first threshold, it can be determined that the target device is currently in a stable operating state.

[0105] In one embodiment, the above analysis process of the first data, the second data, and the third data for establishing the association can be implemented by the processor of the processing device or by the processor of other devices. The embodiments of the present application do not limit this.

[0106] As can be seen from the above, the processing method provided by the embodiments of the present application can obtain the third data related to the target device after obtaining the first data and the second data for establishing the association. Moreover, the first data, the second data, and the third data for establishing the association can be used to determine the operating state of the target device. Thus, by adjusting or changing the third data, the operating states of different aspects, different times, or different modules of the target device can be determined. Therefore, through the third data, a diverse and flexible analysis of the first data and the second data for establishing the association can be achieved, thereby further improving the flexibility of determining the operating state of the target device.

[0107] Based on the foregoing embodiments, in the processing method provided by the embodiments of the present application, the first data includes the data generated by the target device after the communication connection is established.

[0108] In one embodiment, the target device can start generating the first data after detecting the establishment of the communication connection and transmit the first data to the processing device through the communication connection.

[0109] In one embodiment, the target device starts generating the first data after detecting the communication connection. Exemplarily, the target device can transmit the first data to the processing device only after receiving the data acquisition instruction sent by the processing device.

[0110] Correspondingly, the processing method provided by the embodiments of the present application may further include the following steps:

[0111] Obtain the fourth data transmitted by the target device.

[0112] Wherein, the fourth data includes the data generated by the target device before the communication connection is established; the first data, the second data, and the fourth data for establishing the association can be used to determine the operating state of the target device.

[0113] In one embodiment, the fourth data may include the data generated by the target device within a preset period before the communication connection is established, for example, the data generated within five minutes before the communication connection is established.

[0114] In one embodiment, the fourth data may include the data related to the operating state of at least one module generated by the target device within a preset period before the communication connection is established, for example, the data related to the operating state of the video decoder generated within five minutes before the communication connection is established.

[0115] In one embodiment, after receiving the data acquisition instruction including the module identifier and / or time period information sent by the processing device, the target device may filter the historical data generated by the target device before the communication connection is established based on the module identifier and / or time period information in the data acquisition instruction to obtain the fourth data, and send the fourth data to the processing device.

[0116] In one embodiment, by analyzing the associated first data and second data, the operating state of the target device at the moment when the communication connection is established and during the time period covered by the first data can be determined. By analyzing the fourth data, the operating state of the target device before the communication connection is established and during the time period covered by the fourth data can be obtained. Thus, by analyzing the associated first data, second data, and fourth data, the operating state of the target device at the moment when the communication connection is established, during the time period covered by the first data, and during the time period covered by the fourth data can be determined.

[0117] In one embodiment, by analyzing the associated first data and second data, the module identifier of the module in the target device that is in an abnormal operating state at the moment when the communication connection is established and during the time period covered by the first data can be determined. Then, based on this module identifier, the fourth data is analyzed, so that the operating state of the module corresponding to the above module identifier at the moment when the communication connection is established, during the time period covered by the first data, and during the time period covered by the fourth data can be determined; exemplarily, the number of the above module identifiers may be at least one.

[0118] In one embodiment, based on the operating state of the target device or at least one module at the moment when the communication connection is established, during the time period covered by the first data, and during the time period covered by the fourth data, the operating state of the target device or at least one module after the time period covered by the first data can be predicted.

[0119] Exemplarily, the analysis process of the associated first data, second data, and fourth data may be implemented by the processing device or by other devices, and the embodiments of the present application do not limit this.

[0120] As can be seen from the above, in the processing method provided by the embodiments of the present application, the first data and the fourth data are respectively the data generated by the target device before and after the communication connection is established. Thus, by establishing the associated first data, geothermal data, and fourth data, at least the historical operating state and the current operating state of the target device can be determined, thereby realizing the coherent determination of the operating state of the target device within a certain time length range.

[0121] Based on the foregoing embodiments, the processing method provided by the embodiments of the present application may further include the following steps:

[0122] Analyze the first data to determine the acquisition parameters.

[0123] Among them, the acquisition parameters at least include the position information and / or identification information of at least one module of the target device; the acquired data is used for the data acquisition device to acquire the second data.

[0124] In one implementation, at least one module of the target device may include modules integrated with the target device, such as the display module and the indicator light module of a television device, etc.

[0125] In one implementation, at least one module of the target device may further include modules associated with the target device, such as an external storage module connected to a computer device, etc.

[0126] In one implementation, the position information of at least one module of the target device may include the position information of at least one module of the target device relative to a specified module, where the specified module may include a module with a relatively high degree of recognizability in the target device. For example, when the target device is a television, the specified module may be the display screen, and the position information of at least one module of the television can be described by the position information of at least one module relative to the display screen. For example, the position information of the image acquisition module may include the edge area at the top of the display screen.

[0127] In one implementation, the identification information of at least one module of the target device may include naming information containing the function description of at least one module. For example, the identification information of the camera module may include "image acquisition module".

[0128] In one implementation, the identification information of at least one module of the target device may include the number information of at least one module. For example, the number of the image acquisition module is 1, the number of the display screen is 2, etc.

[0129] In one implementation, the acquisition parameters may further include at least one of the attitude information of the image acquisition device when acquiring the second data, the continuous acquisition time information of the image acquisition device when acquiring the second data, the number of times the image acquisition device performs image acquisition, and the time interval information between different image acquisition operations.

[0130] In one implementation, the image acquisition device may be set in the processing device or may also be set in other devices that have established a communication connection with the processing device.

[0131] In one implementation, the processing device may determine the acquisition parameters in the following manner:

[0132] Analyze at least part of the first data to obtain the identification information of the modules in which the target device is currently in an operating state. Exemplarily, the location information of the modules can also be determined based on the identification information of the modules and the structure information of the target device. Exemplarily, the structure information of the target device may include the relative position relationship between multiple modules in the target device, the location information of the modules, and the correspondence relationship between the location information and the identification information of the modules.

[0133] Analyze at least part of the first data to obtain the time point when the target device is in a specified state, and then obtain the identification information of at least one module within the time period containing this time point in the first data. The location information of the modules can also be determined based on the identification information of the modules and the structure information of the target device.

[0134] In one implementation, the processing device can output acquisition parameters to instruct the user to control the image acquisition device to execute an image acquisition process based on at least one of the information such as the location information and / or identification information of at least one module included in the acquisition parameters, the attitude information of the image acquisition device, and the continuous acquisition time of the image acquisition device, so as to obtain the second data.

[0135] In one implementation, the processing device can transmit the acquisition parameters to the image acquisition device where the image acquisition device is located, so that the image acquisition device automatically and intelligently controls the image acquisition device to acquire the second data based on the acquisition parameters. Exemplarily, the image acquisition device can be the processing device itself or an electronic device that establishes a communication connection with the processing device.

[0136] As can be seen from the above, the processing method provided by the embodiments of the present application can determine acquisition parameters including at least the location information and / or identification information of at least one module of the target device after analyzing the first data, for the image acquisition device to acquire the second data. Thus, the processing method provided by the embodiments of the present disclosure can determine how the image acquisition device acquires the second data according to the acquisition parameters obtained by analyzing the first data, so that the relevance between the second data acquired by the image acquisition device and the first data is stronger. Therefore, the associated first data and second data can represent the operating state of the target device more comprehensively and objectively.

[0137] Based on the foregoing embodiments, in the processing method provided by the embodiments of the present application, the first data includes text data, and the second data includes first image data.

[0138] Correspondingly, processing the first data and the second data to obtain the associated first data and second data can be achieved in the following manner:

[0139] Process the text data and the first image data to obtain second image data.

[0140] Among them, the second image data includes at least part of the data in the first image data and the data obtained from at least part of the text data.

[0141] In one implementation, the text data may include log data generated during the operation of the target device. Exemplarily, the log data may include all data generated during the operation of the target device for recording the operation status of the target device and carrying time information; Exemplarily, the log data may include exception log data obtained through an exception capture mechanism set in the target device after an exception occurs during the operation of the target device; Exemplarily, the log data may further include data representing the system and / or application operation logs of the target device captured when a specified condition is detected to be satisfied during the operation of the target device; Exemplarily, the specified condition may include at least one of the conditions that the memory occupancy rate is greater than or equal to a first threshold and the concurrent task volume is greater than or equal to a second threshold.

[0142] In one implementation, the log data may include data generated during the software operation of the target device, and may also include data generated during the hardware driving process or the hardware operation process of the target device.

[0143] In one implementation, the first image data included in the second data may be collected by an image acquisition device of a processing device, or may be that after an image acquisition device of an image acquisition device collects the first image data, the first image data is transmitted to the processing device.

[0144] In one implementation, at least part of the data in the first image data may include data obtained by cropping the first image data; Exemplarily, the first image data may be cropped according to keywords carried in the text data.

[0145] In one implementation, the data obtained from at least part of the text data may include the module identifiers of all modules included in the text data, and may also include the module identifiers of the modules in the target operating state in the text data; Exemplarily, the target operating state may include a state in which an abnormal phenomenon occurs at least once.

[0146] In one implementation, the data obtained from at least part of the text data may include the module identifiers of at least one module, and the position information of at least one module can be determined by combining the structure information of the target device.

[0147] In one implementation, processing the text data and the first image data to obtain the second image data may be implemented by any of the following methods:

[0148] According to the position information of at least one module obtained by processing text data, mark the image regions corresponding to the at least one module in the first image data, so as to obtain the second image data.

[0149] According to the position information of at least one module, identify the first image data to obtain an identification result, crop the first image data according to the identification result to obtain at least part of the data of the first image data including at least one module, and then mark at least one module in at least part of the data of the first image data obtained by cropping, so as to obtain the second image data; Exemplarily, the identification result may include the pixel position information of the image regions corresponding to at least one module in the first image data.

[0150] Exemplarily, marking the image regions corresponding to at least one module in the first image data, and marking at least one module in at least part of the data of the first image data obtained by cropping may include at least one of identifying the image regions corresponding to at least one module with lines and adding a text description of the operating state of the module obtained by extracting from the text data at a certain moment or during a certain period in the image region.

[0151] As can be seen from the above, in the processing method provided by the embodiments of the present application, when the first data includes text data and the second data includes the first image data, the second image data obtained by processing the text data and the first image data includes at least part of the data in the first image data and the data obtained from at least part of the data of the text data, so that the second image data includes not only the data obtained from the text data output by the target device, that is, the internal data of the target device, but also at least part of the data in the first image data, that is, the external data of the target device. Thus, through the second image data, an intuitive display of both the internal data and the external data of the target device can be obtained simultaneously.

[0152] In the related art, the most direct means for a user to obtain the external performance data of an electronic device is usually to take a photo of at least part of the area of the electronic device. The user can also obtain the text data output by the electronic device with the help of some devices or apparatuses, but the user cannot associate the photo taken by him / her with the text data output by the electronic device.

[0153] However, through the processing method provided by the embodiments of the present application, through the data processing process of the application program set in a device well-known to users such as a smart phone for implementing the processing method, the text data output by the target device and the first image data collected can be processed, so that the first image data can be visually and objectively associated with the text data output by the target device.

[0154] Furthermore, in actual applications, users usually obtain text data transmitted by electronic devices and collect, for example, the first image data mentioned above when the electronic device operates abnormally or needs to understand the performance of the electronic device. However, through the text data transmitted by the electronic device and the collected first image data, users cannot determine the actual operating status or performance of the electronic device.

[0155] However, through the processing method provided in the embodiment of the present application, when the text data contains data related to the operating status of the target device and the first image data includes image data related to the actual operating status of the target device, the operating status information and / or performance information of the target device can be obtained intuitively, vividly, objectively and accurately by processing the text data and the second image data obtained by the first image data.

[0156] Based on the foregoing embodiment, in the processing method provided in the embodiment of the present application, the first image data includes a set of multiple frames of image data, and the second image data includes a set of multiple frames of image data.

[0157] In one implementation, the first image data may be video data acquired by an image acquisition device; correspondingly, the second image data may also be video data including multiple frames of image data.

[0158] Accordingly, the second image data can be obtained by Figure 2 The process shown is implemented as follows, Figure 2 A schematic diagram of a process for obtaining second image data provided in an embodiment of the present application, such as Figure 2 As shown, the process may include steps 201 to 203:

[0159] Step 201: Acquire first time period information of text data and second time period information of first image data.

[0160] In one embodiment, the text data may be log data transmitted by the target device, and therefore, the text data may carry time information corresponding to each data; exemplarily, the first time period information may include the time information when the first log data in the text data is generated, and the time period information between the time information when the last log data in the text data is generated. For example, the first log data is generated at 12:29:36 on January 26, 2022, and the last log data is generated at 12:39:36 on January 26, 2022. Then, the first time period information may be the information of the time period between 12:36 on January 26, 2022 and 12:39 on January 26, 2022.

[0161] In one embodiment, the first time period information may include the time period between the time point when an anomaly appears in the log data and the time point when the anomaly recovery process of the target device ends. For example, if the time point when the data with the anomaly appears in the log data is 12:30 on January 26, 2022, and the time point when the anomaly recovery process of the target device ends is 12:39 on January 26, 2022, then the first time period information may include the information of the time period between 12:30 on January 26, 2022 and 12:39 on January 26, 2022.

[0162] In one embodiment, the first time period information may be determined from the time period information covered by the text data after analyzing the text data, based on a preset analysis strategy or based on the user's selection.

[0163] In one embodiment, the second time period information may include the information of the time period between the time point corresponding to the first frame image data of the first image data and the time point corresponding to the last frame image data of the first image data.

[0164] In one embodiment, the second time period information may include a partial time period within the time period between the time point corresponding to the first frame image data of the first image data and the time point corresponding to the last frame image data of the first image data; exemplarily, the first image data may be analyzed based on the data obtained from at least part of the text data, so as to obtain the second time period information. For example, if the data obtained by analyzing at least part of the data in the text data indicates that the first module and the second module of the target device are in an abnormal operating state, then the position information of the first module and the second module can be obtained based on the module identifiers of the first module and the second module, and then, based on the position information of the first module and the second module, multiple frames of images in the first image data are identified, and the time period corresponding to the time points in the multiple frames of image data including the first module and the second module is determined as the second time period information.

[0165] Step 202: Determine the target time period based on the first time period information and the second time period information.

[0166] In one embodiment, the intersection period of the first period information and the second period information can be determined as the target period. For example, if the first period information includes the period from 12:30 on January 26, 2022 to 12:39 on January 26, 2022, and the second period information includes the period from 12:31 on January 26, 2022 to 12:40 on January 26, 2022, then the period between 12:31 on January 26, 2022 and 12:39 on January 26, 2022 can be determined as the target period. Exemplarily, when the first period information and the second period information completely overlap, the target period can be the period represented by the first period information or the period represented by the second period information.

[0167] In one embodiment, the target period can be determined based on the data content of at least part of the text data corresponding to the first period information and the image features carried in multiple frames of images corresponding to the second period information. For example, if at least part of the text data corresponding to the first period information indicates that the operating states of the first module and the second module are in abnormal states, and the multiple frames of images corresponding to the second period information indicate that the operating state of the second module is in an abnormal state, then at least part of the data in the text data related to the abnormal state of the second module can be used to intercept the first period information to obtain the third period information, and then the intersection of the third period information and the second period information is determined as the target period.

[0168] Step 203: Process the target image data and the target text data to obtain the second image data.

[0169] Among them, the target image data includes multiple frames of image data within the target period in the first image data; the target text data includes at least part of the text data within the target period in the text data; the nth frame of image data of the second image data includes at least part of the image data of the nth frame of the target image and the data obtained from the text data at the nth moment of the target text data, where n is an integer greater than or equal to 1.

[0170] In one embodiment, the target image data can be obtained by intercepting the first image data based on the target period. Exemplarily, multiple frames of images with time information within the target period can be intercepted from the first image data, and the intercepted multiple frames of images are determined as the target image data.

[0171] In one embodiment, the target text data can be obtained by intercepting at least part of the text data in the text data based on the target period.

[0172] In one implementation, each frame of image data in the target image data can be fused with each data in the target text data according to the time information carried by each frame of image data in the target image data and the time information carried by each data in the target text data, so as to obtain each frame of fused image data. Then, according to the time information of each frame of fused image data, each frame of graphic data after fusion is integrated to obtain the second image data.

[0173] Exemplarily, the process of obtaining each frame of image data in the second image data can be similar to the process of obtaining the second image data in the foregoing embodiment, and will not be elaborated here.

[0174] As can be seen from the above, in the processing method provided by the embodiments of the present application, when the first image includes a set of multiple frames of image data, the target time period can be determined based on the first time period information of the text data and the second time period information of the first image data. Then, at least part of the text data corresponding to the target time period in the text data and multiple frames of image data corresponding to the target time period in the first image data are processed to obtain the second image data including multiple frames of data. In this way, the second image data obtained through the image set of multiple frames of image data collected and the text information transmitted by the target device can not only more intuitively display the data integration results in the internal and external two dimensions of the target device, but also more continuously display the data integration results of the target device during the target time period from the time dimension.

[0175] Moreover, under the condition that the multiple frames of image data included in the first image data are related to the operating state of the target device and the text data is the data related to the operating state of the target device transmitted by the target device, by processing the text data and the first image data to obtain the second image data, it is also possible to continuously, vividly and objectively display the operating state of the target device during a certain time period from the time dimension.

[0176] Based on the foregoing embodiment, the processing method provided by the embodiments of the present application may further include Figure 3 the process shown in Figure 3 which is a schematic flowchart of outputting the first instruction information provided by the embodiments of the present application. As Figure 3 shown, this process may include steps 301 to 303:

[0177] Step 301: Analyze the associated first data and second data to obtain an analysis result.

[0178] In one implementation, the analysis result can be used to indicate whether the current operating state of the target device is normal; Exemplarily, the analysis result can be used to indicate whether the target device is currently in an overloaded operating state.

[0179] In one embodiment, the analysis result may include the reason for the target device to switch to an abnormal operating state, or the reason for at least one module in the target device to switch to an abnormal operating state; for example, the analysis result may further include the reason for the target device to be in an overloaded operating state currently.

[0180] In one embodiment, the first data and the second data associated within a specified time period may be analyzed to obtain an analysis result; for example, the specified time period may be determined by the processing device based on a data analysis strategy, or may be determined based on the time range covered by the first data and the second data associated selected by the user.

[0181] For example, the third data, the first data and the second data associated may also be analyzed to obtain an analysis result.

[0182] Step 302: Obtain first instruction information based on the analysis result.

[0183] Among them, the first instruction information includes instruction information for performing an operation on the target device.

[0184] In one embodiment, the first instruction information may include the number of times of performing an operation on the target device.

[0185] In one embodiment, when the first instruction information includes multiple operations to be performed on the target device, the first instruction information may further include the sequence information between each operation, and the time interval information between adjacent operations.

[0186] In one embodiment, for example, the first instruction information may further include the condition information for performing at least one operation. For example, when a specified indicator light of the target device flashes red, perform the first operation; when the specified indicator light flashes blue, perform the second operation; when the second operation ends and the display screen of the target device outputs the first information, perform the third operation; if the second operation ends and the display screen outputs the second information, perform the fourth operation.

[0187] In one embodiment, the first instruction information may be obtained based on the operating state of the target device indicated by the analysis result; for example, when the analysis result indicates that at least one module of the target device is in an abnormal operating state, the first instruction information obtained based on the analysis result may include an instruction to reset at least one module; for example, when the analysis result indicates that at least one module of the target device is overloaded, the first instruction information obtained based on the analysis result may include an instruction to pause or stop occupying at least one application program.

[0188] Step 303: Output the first instruction information.

[0189] In one implementation, after outputting the first instruction information, the user of the processing device and / or the target device can perform operations on the target device based on various information included in the first instruction information.

[0190] As can be seen from the above, for the processing method provided by the embodiments of the present application, after obtaining the first data transmitted by the target device and the second data of the environmental information of the environment where the target device is located, it is possible to analyze the associated first data and second data to obtain an analysis result, and then obtain and output the first instruction information based on the analysis result to instruct an operation to be performed on the target device. Since the first instruction information is determined based on the analysis result obtained by analyzing the associated first data and second data, the first instruction information is related to both the internal data of the target device, i.e., the first data, and the external data, i.e., the second data, and the first instruction information can also be consistent with the device characteristics of the target device, thereby improving the accuracy and pertinence of the operation and reducing the probability of misoperation.

[0191] In practical applications, if the target device is a device with a large volume, such as a large-size electronic display screen, and if a problem occurs during the user's use of the electronic display screen and the user cannot clearly and accurately describe the fault manifestation of the electronic display screen when communicating with the after-sales technical personnel, then the accessories or detection tools that the after-sales technical personnel need to carry will be relatively many. On the one hand, this increases the cost of the after-sales technical personnel's on-site maintenance, and on the other hand, it also reduces the pertinence of the after-sales technical personnel's on-site maintenance.

[0192] To solve the above technical problems, the after-sales technical personnel usually guide the user to take some pictures or videos online according to the user's subjective description and send them to the after-sales technical personnel to assist the after-sales technical personnel in understanding the fault condition of the electronic device; however, in the case where the fault manifestation of the electronic device is complex and the user does not understand the working principle of the electronic device well, the accuracy of the user's subjective description is insufficient, so the pertinence of the picture-taking suggestions or video-taking suggestions provided by the after-sales technical personnel will also be insufficient.

[0193] In the processing method provided in the embodiments of the present application, when both the first data and the second data are related to the operating state of the target device, during the process of the user using the target device, if the operating state of the target device is abnormal, the internal data transmitted by the target device, that is, the first data, and the external data including the environmental information of the environment where the target device is located, that is, the second data, can be obtained in real time. Then, based on the analysis result obtained by analyzing the associated first data and second data, the first instruction information is obtained and output for the user of the target device to perform self-check on the target device. In this way, not only can the efficiency of the user's self-help in solving the faults of the target device be improved, but also the cost of after-sales technicians' on-site maintenance can be reduced.

[0194] Based on the foregoing embodiments, the processing method provided in the embodiments of the present application may further include Figure 4 the process shown in Figure 4 which is a schematic flowchart of outputting the second instruction information provided in the embodiments of the present application. As Figure 4 shown, this process may include steps 401 to 403:

[0195] Step 401: Send the associated first data and second data to a remote processing device.

[0196] Exemplarily, the remote processing device may be a device for further analyzing the associated first data and second data; Exemplarily, the remote processing device may be the device where the after-sales service system of the target device is located, which can remotely receive data related to the operating state of the target device sent by other devices such as a processing device and analyze these data, and can also receive operations of professional technicians such as after-sales technicians of the target device, such as the manual analysis operation of the after-sales technician on the associated first data and second data.

[0197] Exemplarily, the processing device may also send the third data and / or the fourth data to the remote processing device for the remote processing device to analyze the third data and / or the fourth data, the associated first data, and the second data.

[0198] Step 402: Obtain the second instruction information transmitted by the remote processing device.

[0199] Among them, the second instruction information is obtained by analyzing the associated first data and second data; the second instruction information includes instruction information for performing operations on the target device.

[0200] In one implementation manner, the second instruction information may be obtained by the remote processing device analyzing the associated first data and second data.

[0201] In one embodiment, the second instruction information may also be obtained by an after-sales technician of the target device analyzing the first data and the second data for establishing an association received by the remote processing device.

[0202] Exemplarily, the second instruction information may also be obtained by an after-sales technician of the remote device or the target device analyzing the third data and / or the fourth data, the first data and the second data for establishing an association.

[0203] Exemplarily, in the embodiments of the present application, the second instruction information may include all the contents in the first instruction information, and may also include the generation time of the second instruction information, an overall analysis report on the current operating state of the target device, etc.; Exemplarily, when the second instruction information is generated based on the analysis of an after-sales technician of the target device, the second instruction information may also include the contact information of the above-mentioned after-sales technician, so as to facilitate efficient communication between the user of the target device and the after-sales technician.

[0204] Step 403: Output the second instruction information.

[0205] Exemplarily, after the processing device outputs the second instruction information, the user of the target device may perform at least one operation on the target device according to the second instruction information.

[0206] As can be seen from the above, for the processing method provided by the embodiments of the present application, after sending the first data and the second data for establishing an association to the remote processing device, it is possible to obtain the second instruction information transmitted by the remote processing device and output the second instruction information for the user of the target device to perform at least one operation on the target device. Thus, the processing method provided by the embodiments of the present application realizes efficient and accurate remote maintenance of the fault problems occurring during the operation of the target device, which can not only reduce the cost of on-site maintenance by the after-sales technicians of the target device, but also improve the fault maintenance efficiency of the target device.

[0207] Figure 5 It is a schematic structural diagram implemented by the processing method provided by the embodiments of the present application. As Figure 5As shown in the figure, the target device 501 may include a first processor 5011, a first chip 5012, a second chip 5013, and may also include a first module 5014, a second module 5015, and a third module 5016. Among them, the first processor 5011, the first chip 5012, the second chip 5013, and may also include the first module 5014, the second module 5015, and the third module 5016 may be disposed on the main board of the target device 501. The second processor 5017 may be a processor provided for the target device 501 to collect the first data and transmit the first data to the processing device 502. The second processor 5017 may be fixedly disposed on the main board of the target device 501 or may be capable of being pluggably connected to the main board of the target device 501. Exemplarily, the first processor 5011 may be the CPU of the target device 501.

[0208] Exemplarily, the second processor 5017 may establish data connections with the first processor 5011, the first chip 5012, the second chip 5013, and may also include the first module 5014, the second module 5015, and the third module 5016 respectively. Exemplarily, these data connections may include connections established through a general data bus. The general data bus may include a Universal Serial Bus (USB), an Inter-Integrated Circuit (I2C), a Universal Asynchronous Receiver / Transmitter (UART), a Serial Peripheral Interface (SPI), or a General-Purpose Input / Output (GPIO).

[0209] Exemplarily, the first processor 5011, the first chip 5012, the second chip 5013, the first module 5014, the second module 5015, and the third module 5016 may respectively send the log data generated during their operation to the second processor 5017 through the data connections between them and the second processor 5017. The second processor 5017 may send the above log data to the processing device 502 through the communication connection between its communication module 5021 and the processing device 502. Exemplarily, the above log data may be the first data in the foregoing embodiments.

[0210] Exemplarily, the processing device 502 may include a communication module 5021, an image acquisition module 5022, a data display module 5023, and a video fusion module 5024. Among them, the communication module 5021 is used to receive log data, i.e., the first data, from the target device 501. Exemplarily, the processing device 502 may further include a third processor (not shown in the figure). The third processor may analyze the log data, i.e., the first data, to obtain and output acquisition data, so as to instruct the user of the processing device 502 to control the image acquisition module 5022 of the processing device 502 to acquire the first image data. After the acquisition of the first image data is completed, the video fusion module 5024 performs fusion processing on the first image data and the log data to obtain the second image data. Exemplarily, the first image data and the second image data may be displayed through the data display module 5023.

[0211] Exemplarily, the third processor may analyze the second image data to obtain an analysis result, then obtain the first instruction information according to the analysis result, and then output the first instruction information through the data display module 5023 to instruct the user to perform at least one operation on the target device.

[0212] Exemplarily, the communication module 5021 may send the second image data to a remote processing device, receive the second instruction information transmitted by the remote processing device, and then output the second instruction information to instruct the user to perform at least one operation on the target device.

[0213] Exemplarily, the user may also input data through the man-machine interaction window provided by the data display module 5023. The processing device 501 may obtain the third data. Among them, the third data, the first data associated therewith, and the second data can determine the operating state of the target device 501.

[0214] Exemplarily, the processing device 502 may further obtain historical data, i.e., the fourth data, before the log data is generated in the target device. Among them, the fourth data, the first data associated therewith, and the second data can be used to determine the operating state of the target device.

[0215] As can be seen from the above, through the processing method provided by the embodiments of the present application, without the user's understanding of the operating principle of the target device 501 and without the user's detailed description of the operating state of the target device 501, through the data transmission between the processing device 502 and the target device 501 and the data acquisition and video fusion operations of the processing device 502, the accurate positioning of the operating state of the target device 501 can be achieved, thereby reducing the cost of after-sales technicians' on-site maintenance and improving the efficiency of fault location and solution of the target device 501.

[0216] Based on the foregoing embodiments, an embodiment of the present application further provides a processing device 502. Figure 6 It is a schematic structural diagram of the processing device 502 provided by the embodiment of the present application. As Figure 6 shown, the processing device 502 may include a first communication module 601, a collection module 602, and a processing module 603; where:

[0217] The first communication module 601 is configured to obtain first data transmitted by a target device;

[0218] The collection module 602 is configured to obtain second data including environmental information of the environment where the target device is located;

[0219] The processing module 603 is configured to process the first data and the second data to obtain the first data and the second data that are associated.

[0220] In one implementation, the first communication module 601 is configured to obtain first data related to the operating state of the target device through a communication connection with the target device;

[0221] The collection module 602 is configured to collect second data related to the operating state of the target device output by the target device;

[0222] Among them, the first data and the second data that are associated can be used to determine the operating state of the target device.

[0223] In one implementation, the processing module 603 is configured to obtain input third data; where the first data and the second data that are associated, and the third data can be used to determine the operating state of the target device.

[0224] In one implementation, the first communication module 601 is configured to obtain fourth data transmitted by the target device; where the fourth data includes data generated by the target device before the communication connection is established; the first data and the second data that are associated, and the fourth data can be used to determine the operating state of the target device.

[0225] In one implementation, the processing module 603 is configured to analyze the first data to determine acquisition parameters; where the acquisition parameters at least include location information and / or identification information of at least one module of the target device; the acquisition data is used for a data acquisition device to collect the second data.

[0226] In one implementation, the first data includes text data; the second data includes first image data; the processing module 603 is configured to process the text data and the first image data to obtain second image data; where the second image data includes at least part of the data in the first image data and data obtained from at least part of the data in the text data.

[0227] In one embodiment, the first image data includes a set of multiple frames of image data; the second image data includes a set of multiple frames of image data;

[0228] A processing module 603, configured to obtain first time period information of text data and second time period information of the first image data; determine a target time period based on the first time period information and the second time period information; process target image data and target text data to obtain second image data; wherein, the target image data includes multiple frames of image data within the target time period in the first image data; the target text data includes at least part of the text data within the target time period in the text data; the nth frame of image data in the second image data includes at least part of the image data of the nth frame of image data in the target image data and data obtained from the text data at the nth moment in the target text data; n is an integer greater than or equal to 1.

[0229] In one embodiment, the processing module 603 is configured to analyze the first data and the second data that are associated, to obtain an analysis result; obtain first instruction information based on the analysis result; wherein, the first instruction information includes instruction information for performing an operation on a target device; output the first instruction information.

[0230] In one embodiment, the processing device 502 further includes a second communication module, configured to send the first data and the second data that are associated to a remote processing device; obtain second instruction information transmitted by the remote processing device; wherein, the second instruction information is obtained by analyzing the first data and the second data that are associated; the second instruction information includes instruction information for performing an operation on a target device;

[0231] The processing module 603 is configured to output the second instruction information.

[0232] Exemplarily, the foregoing first communication module 601, acquisition module 602, processing module 603, and second communication module may be implemented by a processor of the processing device 502.

[0233] Based on the foregoing embodiments, an embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor of an electronic device, it can implement the processing method described in any previous embodiment.

[0234] The descriptions of the foregoing embodiments tend to emphasize the differences between the embodiments, and their similarities or similarities can be referred to each other. For the sake of brevity, they are not elaborated herein again.

[0235] The methods disclosed in the method embodiments provided in the present application can be arbitrarily combined without conflict to obtain new method embodiments.

[0236] The features disclosed in each product embodiment provided by this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0237] The features disclosed in each method or device embodiment provided by this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0238] It should be noted that the above computer-readable storage medium can be a read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), ferromagnetic random access memory (FRAM), flash memory, magnetic surface memory, optical disc, or compact disc read-only memory (CD-ROM), etc.; it can also be various electronic devices including one or any combination of the above memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0239] It should be noted that in this article, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitations, an element defined by the statement "including one..." does not exclude the existence of additional identical elements in the process, method, article or device including that element.

[0240] The serial numbers of the embodiments of this application above are only for description and do not represent the superiority or inferiority of the embodiments.

[0241] Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general hardware nodes. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions for causing a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in various embodiments of the present application.

[0242] This application is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each flow and / or block in the flowchart and / or block diagram, as well as the combination of flows and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the heating module of a general computer, a special computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the heating module of the computer or other programmable data processing devices generate means for implementing the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 or multiple blocks.

[0243] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory generate a manufactured article including instruction means, and the instruction means implement the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 or multiple blocks.

[0244] These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process. Thus, the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 or multiple blocks.

[0245] The above are only the preferred embodiments of the present application, and do not limit the patent scope of the present application accordingly. Any equivalent structural or equivalent process transformation made by using the specification and drawings of the present application, or directly or indirectly applied to other related technical fields, shall be included in the patent protection scope of the present application by the same token.

Claims

1. A processing method, comprising: Obtaining first data transmitted by a target device; the first data includes text data; Obtaining second data including environmental information of the environment where the target device is located; the second data includes first image data; Obtaining first time period information of the text data and second time period information of the first image data; Determining a target time period based on the first time period information and the second time period information; Processing target image data and target text data to obtain second image data; wherein, the target image data includes multiple frames of image data within the target time period in the first image data; the target text data includes at least part of the text data within the target time period in the text data; the nth frame of image data in the second image data includes at least part of the image data of the nth frame of image data in the target image data and data obtained from the text data at the nth moment in the target text data; n is an integer greater than or equal to 1; the first data and the second data are associated based on the time information carried in the first data and the second data.

2. The method according to claim 1, wherein, The obtaining of the first data transmitted by the target device includes: Obtaining, through a communication connection with the target device, first data related to the operating state of the target device; The obtaining of the second data including environmental information of the environment where the target device is located includes: Collecting second data output by the target device and related to the operating state of the target device; Wherein, the first data and the second data that are associated can be used to determine the operating state of the target device.

3. The method according to claim 2, wherein, The method further includes: Obtaining input third data; wherein, the first data, the second data, and the third data that are associated can be used to determine the operating state of the target device.

4. The method according to claim 2, wherein The first data includes data generated by the target device after the communication connection is established; the method further includes: Obtaining fourth data transmitted by the target device; wherein, the fourth data includes data generated by the target device before the communication connection is established; the first data, the second data, and the fourth data that are associated can be used to determine the operating state of the target device.

5. According to the method of any one of claims 1 to 4, the method further includes: Analyzing the first data to determine acquisition parameters; wherein, the acquisition parameters at least include position information and / or identification information of at least one module of the target device; the acquisition parameters are used for a data acquisition device to acquire the second data.

6. The method according to claim 1, wherein The second image data includes at least part of the data in the first image data and data obtained from at least part of the text data.

7. The method according to claim 1, wherein, The method further includes: Analyzing the first data and the second data that are associated to obtain an analysis result; Obtaining first instruction information based on the analysis result; wherein, the first instruction information includes instruction information for performing an operation on the target device; Outputting the first instruction information.

8. The method according to claim 1, wherein The method further includes: Send the first data and the second data for establishing the association to a remote processing device; Obtain second instruction information transmitted by the remote processing device; wherein, the second instruction information is obtained by analyzing the first data and the second data for establishing the association; the second instruction information includes instruction information for performing an operation on the target device; Output the second instruction information.

9. A processing device, comprising: A first communication module, configured to obtain first data transmitted by a target device; The first data includes text data; An acquisition module, configured to obtain second data including environmental information of an environment where the target device is located; the second data includes first image data; A processing module, configured to obtain first time period information of the text data and second time period information of the first image data; based on the first time period information and the second time period information, determine a target time period; Process target image data and target text data to obtain second image data; wherein, the target image data includes multiple frames of image data within the target time period in the first image data; the target text data includes at least part of the text data within the target time period in the text data; the nth frame of image data of the second image data includes at least part of the image data of the nth frame of image data of the target image data, and data obtained from the text data at the nth moment of the target text data; n is an integer greater than or equal to 1; the first data and the second data are associated based on time information carried in the first data and the second data.

Images