Method, device and equipment for positioning abnormal problem of intelligent cabin system

Abstract

The invention discloses an abnormal problem positioning method, device and equipment for an intelligent cabin system. The method comprises the following steps: respectively acquiring a text log and an audio and video log recorded in a system operation process; the audio and video log comprises an audio and video log at the current moment and a historical audio and video log; and according to the text log and the audio and video log, positioning the abnormity of the intelligent cabin system. According to the method, the situation that repair cannot be promoted due to the fact that a dual problem cannot be reproduced and a user or a tester cannot clearly describe the problem can be avoided, the communication cost of the development and the tester for the problem is reduced, and the solving efficiency of the abnormal problem of the system is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of log collection, and in particular to a method, device and equipment for locating abnormal problems of an intelligent cockpit system. Background Art

[0002] The smart cockpit system integrates many functions and services, such as navigation, entertainment, communication, etc. These functions may cause various abnormalities during operation. Therefore, it is necessary to locate whether the smart cockpit system has any abnormalities.

[0003] The current method for locating whether there is an abnormality in the smart cockpit system is to locate whether there is an abnormality in the system by collecting abnormality logs during the operation of the system. The method of collecting abnormality logs is usually to store text data when the system is running, that is, to record the text data generated when the system is running. When an abnormality occurs in the system operation, it is possible to trace back the changes in past text data to confirm the source of the system abnormality and the cause of the problem, which helps to locate the system abnormality.

[0004] However, the currently collected exception logs are text data. Although some causes of system exceptions can be obtained by analyzing text logs, there are still system exceptions that are difficult to locate by relying solely on text logs. Especially for some occasional problems, and when users or testers do not clearly describe the exceptions, it is difficult for system maintenance engineers to reproduce and locate system exceptions based only on the existing methods of collecting exception logs. Summary of the invention

[0005] In order to overcome the problems existing in the related art, the present invention provides a method, device and equipment for locating abnormal problems of an intelligent cockpit system, so as to solve the defect of the related art that system abnormal problems are difficult to locate by relying solely on text logs.

[0006] According to a first aspect of the present invention, a method for locating abnormal problems of an intelligent cockpit system is provided, the method comprising:

[0007] Respectively obtain text logs and audio and video logs recorded during the operation of the system; the audio and video logs include: the current audio and video logs and historical audio and video logs;

[0008] According to the text log and the audio and video log, the abnormality of the smart cockpit system is located.

[0009] Specifically, obtaining the audio and video logs recorded during the operation of the system includes:

[0010] Monitoring call instructions; the call instructions are used to monitor whether the system operation is abnormal, and the call instructions are triggered when an abnormality occurs;

[0011] After receiving the retrieval instruction, extracting the audio and video data recorded during the operation of the system from the storage medium;

[0012] The audio and video data recorded during the operation of the system is converted into the audio and video log.

[0013] Specifically, the storage medium includes: cache, disk;

[0014] The audio and video data recorded during the operation of the system is the audio and video data obtained by real-time screen recording of the system operation process according to a preset cache time and compressing the recorded audio and video data.

[0015] Specifically, the compressed audio and video data is:

[0016] The audio and video data are compressed according to a preset compression rate and a preset compression format and stored in the storage medium in the order of recording time.

[0017] Specifically, the audio and video data stored in the storage medium are: when the remaining storage space of the storage medium is less than the preset storage space, the audio and video data remaining after deleting the oldest historical audio and video data stored in the storage medium.

[0018] Specifically, deleting the earliest historical audio and video data stored in the storage medium includes: deleting all key frames corresponding to the earliest historical audio and video data stored, and all common frames corresponding to each key frame.

[0019] Specifically, the audio and video data recorded during the operation of the system is audio and video data embedded with a time watermark according to the system time.

[0020] Specifically, the calling instruction at least includes:

[0021] A call-up instruction recognized by the voice recognition function; or

[0022] A call command triggered by a pre-set call button; or

[0023] The call command is triggered by the abnormal signal sent by the monitoring system.

[0024] According to a second aspect of the present invention, a system is provided, a device for locating abnormal problems in an intelligent cockpit system, the system comprising:

[0025] An acquisition unit, used to respectively acquire text logs and audio and video logs recorded during the operation of the system; the audio and video logs include: audio and video logs at the current moment and historical audio and video logs;

[0026] The positioning unit is used to locate the abnormality of the intelligent cockpit system according to the text log and the audio and video log.

[0027] According to the third invention of the present invention, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the method for locating abnormal problems of the intelligent cockpit system described in any embodiment of the present invention is implemented.

[0028] The present invention discloses a method, device and equipment for locating abnormal problems of an intelligent cockpit system. The method locates the abnormalities of the system by acquiring audio and video log files and text logs recorded during the operation of the system, so that developers can directly refer to the audio and video data of the system during operation, such as the screen operation picture, when locating the abnormal problems of the system, and intuitively understand the user operation path for a period of time before and after the abnormality occurs in the system, thereby avoiding the situation where occasional problems cannot be reproduced and the repair cannot be promoted due to unclear description of the problem by the user or tester, reducing the communication cost of developers and testers on the problem, and improving the efficiency of solving system abnormal problems.

[0029] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 The present invention is a flowchart of a method for locating abnormal problems in an intelligent cockpit system according to an embodiment.

[0031] Figure 2 The present invention is a system operation flow chart showing a method of obtaining audio and video logs recorded during system operation according to an embodiment of the present invention.

[0032] Figure 3 It is an operation flow chart of obtaining audio and video logs recorded during system operation according to an embodiment of the present invention.

[0033] Figure 4 It is a structural schematic diagram of a device for locating abnormal problems in an intelligent cockpit system according to an embodiment of the present invention.

[0034] Figure 5 It is a specific structural schematic diagram of an audio and video log acquisition unit in a device for locating abnormal problems in an intelligent cockpit system according to an embodiment of the present invention.

[0035] Figure 6 It is a schematic diagram of the structure of a computing device hardware according to an embodiment of the present invention. DETAILED DESCRIPTION

[0036] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0037] The terms used in the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The singular forms "a", "the" and "the" used in the present invention and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0038] It should be understood that although the terms first, second, third, etc. may be used in the present invention to describe various information, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present invention, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0039] The present invention is described in detail below with reference to the accompanying drawings and specific embodiments.

[0040] like Figure 1 As shown, Figure 1 FIG. 1 is a flow chart of a method for locating abnormal problems of an intelligent cockpit system according to an embodiment of the present invention, comprising the following steps:

[0041] Step S101, respectively obtaining text logs and audio and video logs recorded during the operation of the system;

[0042] Specifically, the audio and video log is obtained by recording the audio and video data during the operation of the system, and the audio and video data includes: the audio and video data at the current moment of the system operation, and the historical audio and video data. In an embodiment of the present invention, the audio and video data at the current moment refers to the latest recorded audio and video data containing the screen display data of the real-time operation of the system; and the historical audio and video data refers to the audio and video data recorded at other moments after the system is started and before the current moment. Correspondingly, the audio and video log also includes: the audio and video log at the current moment and the historical audio and video log; wherein the audio and video log at the current moment is converted from the audio and video data at the current moment, and the historical audio and video log is converted from the historical audio and video data.

[0043] Step S102: locating the abnormality of the smart cockpit system according to the text log and the audio and video log.

[0044] Specifically, when a user performs an operation, the smart cockpit system may display an abnormal screen related to the current operation but not in line with the expected operation, or an abnormal screen completely unrelated to the current operation for various reasons. And when the user performs the same operation again, the probability of this abnormal screen appearing is extremely low or even does not appear, which is the so-called occasional problem. Reproducing the occasional problem is the most basic way to solve system abnormalities. If the problem cannot reproduce the occasional problem, then the cost of verification and falsification of the subsequent system abnormal problem location and repair solution is very high. Therefore, if there is an operation path before the abnormal screen occurs or audio and video when the problem occurs, it will provide great help for the reproduction of occasional problems. In this regard, the present invention provides a solution for collecting system audio and video data as a text log supplement to locate whether the system is abnormal. The solution is: the audio and video data of the system screen operation can be recorded during the operation of the system, and when anomalies such as occasional problems occur, the recorded audio and video data and the recorded text data can be used to accurately locate the abnormality of the system.

[0045] Compared with the existing technical solutions, since only the text data generated when the system is running is collected and processed, there are still some visual problems, and the help of text logs is relatively limited. When analyzing the problem, engineers can only try to find the user's operation path as much as possible to try to reproduce the problem, and fix it after the problem is reproduced. This increases the cost of fixing the problem. Whether it is the system development stage or the system online operation stage, when a problem occurs in the system, users including testers are concerned about the abnormal results. They don’t know much about the process of the problem and often find it difficult to describe the entire process clearly. At this time, if there is some visual information when the problem occurs, allowing development engineers to see the process of the problem can effectively improve the efficiency of problem location, especially some vision-related problems. Moreover, for some occasional problems during system operation, the cost of reproduction will be higher. In this case, audio and video materials at the scene of the problem are often the key to solving the problem.

[0046] The method proposed by the present invention can extract audio and video information of a period of time before and after the system occurs to help locate the problem, thereby reducing the communication cost of developers and testers for the problem and improving the efficiency of problem solving. Moreover, compared with the existing technical solutions, the present invention can also record all the visual information seen when the problem occurs, avoiding the situation where the occasional problem cannot be reproduced and the problem cannot be described clearly by the user or tester.

[0047] Since it is difficult for users or testers to describe in detail the performance when an exception occurs, the method proposed in the present invention can more clearly understand the performance when the problem occurs by exporting audio and video logs that record the audio and video data of the exception, thereby more quickly determining the direction of problem investigation and improving the efficiency of solving abnormal problems.

[0048] Further, in step S101, obtaining the audio and video logs recorded during the operation of the system may include:

[0049] A monitoring and retrieving instruction; the retrieving instruction is used to monitor whether there is any abnormality in the operation of the system, and the retrieving instruction is triggered when an abnormality occurs; after receiving the retrieving instruction, the audio and video data recorded during the operation of the system is extracted from the storage medium; the audio and video data recorded during the operation of the system is converted into an audio and video log.

[0050] Specifically, when a problem occurs, you can call an instruction as an abnormal log export signal to export all audio and video data in the buffer (the exported data includes the audio and video data recorded when the system abnormality occurs), and convert the exported audio and video data into an audio and video log, and transfer it from the memory to the hard disk. The so-called audio and video log is the audio and video data saved in the form of a log file.

[0051] In addition, since the audio and video data recorded by the system in real time is stored in the cache, the temporary data stored in the cache will be refreshed every time the system is shut down and restarted. Therefore, the audio and video data stored in the cache is temporary and cannot be applied to other scenarios after the system is shut down. In this regard, by converting the audio and video data into audio and video logs, the recorded audio and video data can be converted into audio and video logs and stored in the hard disk for long-term storage, so that it can be obtained for analysis in other required scenarios.

[0052] The method provided by the present invention can obtain the audio and video data of the system abnormality in real time by monitoring the call command, thereby improving the efficiency of locating the system abnormality problem. By converting the audio and video data recorded during the system operation into an audio and video log, the scope of system abnormality locating can be expanded, further improving the efficiency of system locating.

[0053] In the present invention, developers can trigger the call-up instructions through voice or button signals to export the audio and video data of screen operations as audio and video logs. After the export, when analyzing the problem, the developer can locate or reproduce the problem according to the operation steps recorded on the screen recorded in the audio and video log, thereby improving the efficiency of solving occasional problems.

[0054] Specifically, when recording the screen, in order to record the operation path before the exception occurs, the entire system screen can be recorded to avoid missing key operations.

[0055] Furthermore, the storage medium includes: a cache, a disk; the audio and video data recorded during the operation of the system is the audio and video data obtained by real-time recording of the system operation process according to a preset cache time and compressing it.

[0056] Specifically, the preset cache time refers to the time consumed by the operation process of the recording system according to the preset time length. When recording audio and video data, the cache time is set in advance to achieve the recording of audio and video data of different durations. For example, if it is implemented as a long-term recording, the audio and video data recorded each time can include a longer screen recording time, so that the operation path recorded in an audio and video data is more complete, and the situation where key operation steps are missed in the gap between audio and video data recording is reduced; and if it is implemented as a short-time recording logic, it can avoid the situation where the audio and video data recorded at one time takes up too much space and causes cache failure. The longer the cache time, the more space is required. Taking H264 as an example, caching 5 hours of data at a bit rate of 10Mbps will occupy 20G of disk, which is enough to burst the disk space of the vehicle computer. Therefore, in some embodiments, if it is set to record the screen for a long time, the recorded audio and video data can also be stored directly on the disk. As for solving the problem, usually only the video data within a period of time before the problem occurs is of reference value, and the rest is just noise. Therefore, in some embodiments, the recording time can also be set to 1 hour, 30 minutes or other time, and the recorded video can be compressed and stored in a buffer. The recorded audio and video data can also be stored in other places according to actual needs, and the present invention is not limited to this.

[0057] Specifically, the present invention can realize caching of audio and video data of different durations by setting different preset caching times, so as to adapt to different application scenarios.

[0058] Furthermore, the compressed audio and video data is: audio and video data compressed according to a preset compression rate and a preset compression format and stored in a storage medium in a chronological order of recording.

[0059] Specifically, the present invention compresses the audio and video data recorded during the operation of the system according to a preset compression rate and a preset compression format, and stores the compressed audio and video data in a cache in the chronological order of recording. Since the audio and video data is more for recording the process of the problem, some efficient compression formats and appropriate compression rates can be used to compress the recorded audio and video data to save cache resources. Although different compression formats will affect the size of the occupied space and the quality of the audio and video, as long as the audio and video data finally saved can identify the user operation path. In an embodiment of the present invention, the compression format used can be H264.

[0060] It should be noted that the compression format used can be determined based on the device where the system is located, such as the resources available to the vehicle computer and the amount of data stored, and the present invention does not impose any limitation on this.

[0061] The method provided by the present invention can save the memory resources occupied by each audio and video data by compressing the audio and video data recorded during the operation of the system and then caching it, avoiding the cache storage space from being exhausted too quickly, so that audio and video data can be recorded for a longer time.

[0062] Furthermore, to implement the solution of the present invention, the system may allocate a storage space in the cache during operation to be used as a storage area for audio and video data such as screen display data.

[0063] Specifically, the size of the space allocated for storing screen display data can be obtained by calculating the size of the cached video data, and the size of the cached data is determined by the recorded video duration, frame rate, compression format and bit rate. For example, assuming that 30 seconds of screen recording data is cached, and the audio and video data is compressed using the H264 format with a bit rate of 10Mbps, and considering that this function is only used as a recording operation path, if 15FPS is used for calculation, the memory size occupied is

[0064] size=10Mbps*30s / 8=37.5Mb.

[0065] If necessary, the compression bitrate can be reduced to reduce the memory required.

[0066] Furthermore, the audio and video data stored in the storage medium are: when the remaining storage space of the storage medium is less than the preset storage space, the audio and video data remaining after deleting the oldest historical audio and video data in the storage medium.

[0067] Specifically, in an embodiment of the present invention, the system starts recording the screen after startup, and the recorded data is stored in a fixed-size area in the memory or on the disk according to the configuration. When the recorded audio and video data exceeds the preset space size, the earliest saved audio and video data will be deleted to ensure that the cached data is data from the current time point to a period of time ago. Generally speaking, the earlier the audio and video data is saved, the less helpful it is for reproducing the operation path where the problem occurs. Therefore, when the remaining storage space in the cache is insufficient, more storage space can be freed up to save the latest audio and video data at the current moment by deleting the earliest saved audio and video data, further reducing the memory space that needs to be allocated.

[0068] The method provided by the present invention can reduce the allocated memory space on the one hand, by deleting the historical audio and video data with the earliest storage time in the storage medium and using the remaining audio and video data as the audio and video data, so that the system abnormality locating device occupies less space and is more conducive to the integration of the device; on the other hand, it can increase the storage space of the storage medium, thereby increasing the speed of extracting audio and video data from the storage medium, and further improving the efficiency of locating system abnormality problems.

[0069] Furthermore, deleting the oldest historical audio and video data stored in the storage medium includes: deleting all key frames corresponding to the oldest historical audio and video data stored, and all common frames corresponding to each key frame.

[0070] Specifically, a video is an image sequence composed of several continuous video frames. When the audio and video data is compressed, the video frames in the audio and video data can be divided into several key frames and several ordinary frames corresponding to each key frame; wherein, the key frame is a video frame in the video that mainly reflects the significant features of each shot in the video, and the audio and video data information contained in it is quite different from the data information of other video frames; and the ordinary frame is a relatively redundant video frame, and its information volume is highly similar to the key frame, and the ordinary frames corresponding to the same key frame have less information difference from each other; in the time series of the video, the ordinary frame is located after its corresponding key frame. In some compression algorithms, most of the information in the ordinary frame will be compressed, and only the difference information between it and the corresponding key frame will be retained. When playing, the difference information and the key frame data are used to restore the ordinary frame, thereby compressing the space occupied by the video data. Compressed video data usually takes up a lot of storage space. Key frames and ordinary frames together constitute a complete video sequence, but ordinary frames are often more numerous and redundant to a certain extent. Therefore, the present invention deletes all key frames and ordinary frames corresponding to the earliest historical audio and video data. On the one hand, it can significantly reduce the storage space occupied and provide sufficient storage space for new audio and video data; on the other hand, if only some frames are deleted (for example, only key frames or ordinary frames are deleted), it may cause inconsistency and damage to the video data. Deleting key frames and corresponding ordinary frames at the same time can ensure that the integrity of the video data is not destroyed, because doing so will not leave isolated frames that cannot be correctly decoded or displayed. On the other hand, in the video decoding process, key frames are the basis for reconstructing the video sequence. If key frames are deleted and the corresponding ordinary frames are still retained, then in the decoding process, it may be encountered that the reference frame cannot be found, resulting in decoding errors or the video cannot be played normally. The present invention can avoid such potential decoding errors by deleting key frames and corresponding ordinary frames at the same time.

[0071] Furthermore, before deleting the historical audio and video data with the earliest storage time in the storage medium, the method may further include: obtaining key frame data corresponding to the deleted historical audio and video data and saving the key frame data.

[0072] Specifically, key frames are the core information in video data. They contain the main content and motion trajectory of the video and can reflect some screen changes in the user's operation path. Therefore, by saving the key frame data corresponding to the deleted historical audio and video data, the main content of the video can be restored or partially reconstructed when needed, even if the original video data has been deleted, thereby avoiding the phenomenon of important screens being omitted when reproducing the problematic operation path.

[0073] Furthermore, the audio and video data recorded during the operation of the system may be audio and video data embedded with a time watermark according to the system time.

[0074] Specifically, the audio and video data recorded during system operation can be timestamped at the millisecond level to correlate with other logs generated in the system when the problem occurs, that is, the audio and video data is marked with the system time in the form of a watermark. Through the audio and video data embedded with the time watermark, the text logs generated at the same system time can be found, so that they can be analyzed synchronously with the text logs to improve the efficiency of locating and solving problems.

[0075] Furthermore, the retrieval instructions monitored in step S101 may at least include: retrieval instructions recognized by a voice recognition function; or retrieval instructions triggered by a preset retrieval key; or retrieval instructions triggered by an abnormal signal sent by the monitoring system.

[0076] Specifically, the retrieval instruction can be a corresponding signal sent by a user when manually triggered or when the docking system operation monitoring module finds that the system is abnormal, thereby indicating the audio and video data that need to be saved, and the audio and video data in the cache that has not been saved will naturally be periodically cleaned up, thereby ensuring that it does not occupy too much system storage space. In some embodiments, if the voice function is available when an abnormal situation occurs, the retrieval instruction can be triggered by speaking a command such as "save log" by voice. Specifically, in other embodiments, the retrieval instruction can also be triggered by pressing a button in the car, wherein the button used to trigger the retrieval instruction can be a physical button or a virtual button, which can be set to be triggered by pressing once, or by pressing multiple times or long pressing, and it can be set according to actual needs, and the present invention does not limit this. Specifically, in other embodiments, the system itself can also monitor the system operation status, and automatically trigger the retrieval instruction after monitoring the abnormal signal, and save the audio and video data in the cache to avoid the operator failing to find the abnormality in time and missing the key audio and video data when the abnormality occurs. Specifically, the system of the present invention may use one or more of the above methods to trigger the acquisition of the call instruction, or may use other methods to trigger the acquisition of the call instruction to adapt to the working environment of different systems, and the present invention is not limited to this.

[0077] Specifically, in the present invention, an abnormal situation may refer to any operation during program running that does not meet the expectations of program running. When an abnormal situation occurs, the audio and video data at that time may be exported for analysis. Even if the program running results meet expectations, as long as the user believes that the picture just generated on the screen is worthy of improvement, a call instruction may be issued to export that piece of audio and video data.

[0078] Specifically, when receiving a call instruction to convert audio and video data into audio and video logs, the location for saving the audio and video logs can be configured to facilitate the unified management and export of logs. For example, if there are other log collection modules in the system, and the log collection modules collect logs of other aspects, the audio and video logs obtained by the method of the present invention can be configured to be saved in the same or corresponding location as the storage location of other logs, so that the logs when the same problem occurs, whether text, data or audio and video, can be put together.

[0079] like Figure 2 and Figure 3 As shown, the present invention also provides a specific embodiment of obtaining the audio and video logs recorded during the operation of the system; wherein, Figure 2 is a system operation flow chart showing a method of obtaining audio and video logs recorded during system operation according to an embodiment of the present invention. Figure 3 It is an operation flow chart of obtaining audio and video logs recorded during system operation according to an embodiment of the present invention.

[0080] Specifically, in step S301, when the smart cockpit system and other systems are started, the system first checks to determine whether the video caching function is turned on. If the video caching function is not turned on, it is impossible to obtain audio and video data and generate audio and video logs, and the audio and video log acquisition process will be directly exited.

[0081] Specifically, in step S302, when the video cache function is turned on, the screen recording function is enabled to obtain audio and video data during the operation of the system.

[0082] Specifically, in step S303, audio and video data of a fixed length are cached in a loop; that is, when the screen recording time reaches the specified preset cache time, the obtained audio and video data will be cached; and after each caching of audio and video data, it will be determined whether the cached data exceeds the reserved maximum cache space; when the cached data exceeds the maximum cache space, the earliest cached audio and video data will be deleted to reserve enough space to save the next cached audio and video data, otherwise the screen recording will continue to obtain and cache new audio and video data.

[0083] Specifically, in step S304, while recording the screen to obtain audio and video data, real-time signal monitoring is performed to determine whether a call instruction is obtained; wherein the call instruction can be automatically triggered by an abnormal program operation, or can be actively issued by the user.

[0084] Specifically, in step S305, after receiving the retrieval instruction, all audio and video data stored in the cache are extracted, converted into corresponding audio and video logs, and the generated audio and video logs are saved to the preset system log storage area for archiving.

[0085] Specifically, in step S306, the audio and video logs and other logs are finally exported together for developers to analyze the problem.

[0086] Specifically, the implementation process of each of the above steps is detailed in the implementation process of the corresponding steps in the above method, which will not be repeated here.

[0087] Corresponding to the embodiment of the method for locating abnormal problems in a smart cockpit system described above, the present invention also provides a device for locating abnormal problems in a smart cockpit system.

[0088] like Figure 4 As shown, Figure 4 4 is a schematic diagram of a structure of a device for locating abnormal problems of an intelligent cockpit system according to an embodiment of the present invention. The device 400 for locating abnormal problems of an intelligent cockpit system includes the following units:

[0089] The acquisition unit 410 is used to respectively acquire the text log and the audio and video log recorded during the operation of the system; the audio and video log includes: the audio and video log at the current moment and the historical audio and video log; the acquisition unit includes: the audio and video log acquisition unit 411 and the text log acquisition unit 412 (not shown in the drawings). Among them, the text log acquisition unit 412 is used to acquire the text log recorded during the operation of the system, and the audio and video log acquisition unit 411 is used to acquire the audio and video log recorded during the operation of the system.

[0090] The positioning unit 420 is used to locate the abnormality of the smart cockpit system based on the text log and the audio and video log.

[0091] The acquisition unit 410 may specifically include the following when acquiring the audio and video logs recorded during the operation of the system:

[0092] Monitor the call command; the call command is used to monitor whether the system operation is abnormal, and the call command is triggered when an abnormality occurs;

[0093] After receiving the retrieval instruction, extract the audio and video data recorded during the system operation from the storage medium;

[0094] Convert the audio and video data recorded during system operation into audio and video logs.

[0095] Preferably, the above storage medium may include: a cache, a disk;

[0096] The audio and video data recorded during the system operation process can be the audio and video data obtained by real-time screen recording of the system operation process according to a preset cache time and compressing the recorded audio and video data.

[0097] Preferably, the audio and video data obtained by the above compression can be:

[0098] The audio and video data is compressed according to a preset compression rate and a preset compression format and stored in a storage medium in the order of the recording time.

[0099] Preferably, the audio and video data stored in the storage medium may be the remaining audio and video data after deleting the oldest historical audio and video data stored in the storage medium when the remaining storage space of the storage medium is less than the preset storage space.

[0100] Preferably, deleting the oldest historical audio and video data stored in the storage medium may include: deleting all key frames corresponding to the oldest historical audio and video data stored, and all common frames corresponding to each key frame.

[0101] Preferably, the audio and video data recorded during the operation of the system may be audio and video data embedded with a time watermark according to the system time.

[0102] Preferably, the above-mentioned calling instruction may at least include:

[0103] A call-up instruction recognized by the voice recognition function; or

[0104] A call command triggered by a pre-set call button; or

[0105] The call command is triggered by the abnormal signal sent by the monitoring system.

[0106] The implementation process of the functions and effects of each unit in the above system is specifically described in the implementation process of the corresponding steps in the above method, which will not be repeated here.

[0107] Figure 5It is a specific structural diagram of an audio and video log acquisition unit 411 in an abnormal problem location device of an intelligent cockpit system according to an embodiment of the present invention. Among them, the audio and video log acquisition unit 411 includes an audio and video data acquisition unit 4111 and an audio and video log conversion unit 4112. The audio and video data acquisition unit 4111 includes a screen recording unit 41111 and a data processing unit 41112. Among them, the screen recording unit 41111 is used to realize the continuous real-time screen recording of the system operation process, and when the screen recording time reaches the preset cache time, the audio and video data of the corresponding cache time is generated; and the data processing unit 41112 is used to realize the storage of the audio and video data of the corresponding cache time in the cache, and before the audio and video data of the corresponding cache time is stored in the cache, the audio and video data of the corresponding cache time is compressed according to the preset compression rate and the preset compression format, and the embedding of the time watermark according to the system time and the like, and when the remaining storage space of the cache is less than the compressed audio and video data, the functions of deleting the oldest historical audio and video data saved in the cache and the like. The audio and video log conversion unit 4112 includes a signal monitoring unit 41121 and a storage export unit 41122; wherein the signal monitoring unit 41121 is used to implement functions such as monitoring and calling instructions; the storage export unit 41122 is used to implement functions such as converting the audio and video data at the current moment and the historical audio and video data into corresponding audio and video logs after receiving the calling instructions. Specifically, the implementation process of the functions and effects of the above-mentioned units is detailed in the implementation process of the corresponding steps in the above-mentioned method, which will not be repeated here.

[0108] The present invention also provides a computer device, which at least includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method described in any of the above embodiments when executing the program.

[0109] Figure 6 A more specific hardware structure diagram of a computing device provided by the present invention is shown, and the device may include: a processor 601, a memory 602, an input / output interface 603, a communication interface 604, and a bus 605. The processor 601, the memory 602, the input / output interface 603, and the communication interface 604 are connected to each other through the bus 605 in the device.

[0110] The processor 601 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, etc., for executing relevant programs to implement the technical solution provided by the present invention. The processor 601 can also include a graphics card, which can be a Nvidia titan X graphics card or a 1080Ti graphics card, etc.

[0111] The memory 602 can be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 602 can store an operating system and other application programs. When the technical solution provided by the present invention is implemented by software or firmware, the relevant program code is stored in the memory 602 and called and executed by the processor 601.

[0112] The input / output interface 603 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device can include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device can include a display, a speaker, a vibrator, an indicator light, etc.

[0113] The communication interface 604 is used to connect a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).

[0114] The bus 605 includes a path for transmitting information between various components of the device (eg, the processor 601 , the memory 602 , the input / output interface 603 , and the communication interface 604 ).

[0115] It should be noted that, although the above device only shows the processor 601, the memory 602, the input / output interface 603, the communication interface 604 and the bus 605, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the solution of the present invention, and does not necessarily include all the components shown in the figure.

[0116] The present invention also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the method described in any of the above embodiments is implemented.

[0117] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0118] It can be known from the description of the above implementation methods that those skilled in the art can clearly understand that the present invention can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present invention or certain parts of the embodiments.

[0119] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer, which may be in the form of a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver, a game console, a tablet computer, a wearable device or a combination of any of these devices.

[0120] Each embodiment of the present invention is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The system embodiment described above is merely schematic, wherein the units described as separate components may or may not be physically separated, and the functions of each unit may be implemented in the same or multiple software and / or hardware when implementing the scheme of the present invention. It is also possible to select some or all of the units according to actual needs to achieve the purpose of the scheme of this embodiment. A person of ordinary skill in the art can understand and implement it without paying creative labor.

[0121] Obviously, the above embodiments of the present invention are only examples for clearly explaining the present invention, and are not intended to limit the implementation methods of the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention shall be included in the protection scope of the claims of the present invention.

Claims

1. A method for locating abnormal problems in an intelligent cockpit system, characterized in that: The method comprises: Respectively obtain text logs and audio and video logs recorded during the operation of the system; the audio and video logs include: the current audio and video logs and historical audio and video logs; According to the text log and the audio and video log, the abnormality of the smart cockpit system is located.

2. The method according to claim 1, characterized in that Obtaining the audio and video logs recorded during system operation includes: Monitoring call instructions; the call instructions are used to monitor whether the system operation is abnormal, and the call instructions are triggered when an abnormality occurs; After receiving the retrieval instruction, extracting the audio and video data recorded during the operation of the system from the storage medium; The audio and video data recorded during the operation of the system is converted into the audio and video log.

3. The method according to claim 2, characterized in that The storage medium includes: cache, disk; The audio and video data recorded during the operation of the system is the audio and video data obtained by real-time screen recording of the system operation process according to a preset cache time and compressing the recorded audio and video data.

4. The method according to claim 3, characterized in that The compressed audio and video data is: The audio and video data are compressed according to a preset compression rate and a preset compression format and stored in the storage medium in the order of recording time.

5. The method according to claim 4, characterized in that The audio and video data stored in the storage medium are: when the remaining storage space of the storage medium is less than the preset storage space, the audio and video data remaining after deleting the historical audio and video data with the earliest storage time in the storage medium.

6. The method according to claim 5, characterized in that The deleting of the earliest historical audio and video data stored in the storage medium includes: deleting all key frames corresponding to the earliest historical audio and video data stored, and all common frames corresponding to each key frame.

7. The method according to claim 4, characterized in that The audio and video data recorded during the operation of the system are audio and video data embedded with a time watermark according to the system time.

8. The method according to any one of claims 2 to 7, characterized in that: The calling instruction at least includes: A call-up instruction recognized by the voice recognition function; or A call command triggered by a pre-set call button; or The call command is triggered by the abnormal signal sent by the monitoring system.

9. A device for locating abnormal problems in an intelligent cockpit system, characterized in that: include: An acquisition unit, used to respectively acquire text logs and audio and video logs recorded during the operation of the system; the audio and video logs include: audio and video logs at the current moment and historical audio and video logs; The positioning unit is used to locate the abnormality of the intelligent cockpit system according to the text log and the audio and video log.

10. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method for locating abnormal problems in the intelligent cockpit system described in any one of claims 1-8 is implemented.

Images