Intelligent cockpit video management method, device and equipment
Through the intelligent cockpit video management method, video features are extracted and written into historical logs, the problem of insufficient storage space in the intelligent cockpit monitoring system is solved, efficient video data storage and management is realized, ensuring data integrity and user review convenience sex.
Patent Information
- Application Number
- CN202411315022.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-20
- Publication Date
- 2024-11-05
AI Technical Summary
The existing smart cockpit monitoring system has insufficient storage space due to the large amount of historical video data, which affects the integrity of the data and system stability.
By extracting video features, write historical video logs to each interval and upload them to the central intelligent gateway. If the video features trigger a specific driving state, the videos of the corresponding time period will be uploaded forward to ensure data integrity and storage efficiency.
When occupying a small amount of storage space, video data is effectively saved to ensure that important information is not missed, and improve data management efficiency and user review convenience.
Smart Images

Figure CN118900310A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of intelligent monitoring technology, and in particular to an intelligent cockpit video management method, device and equipment. Background Art
[0002] With the development of automobile intelligence and networking technology, intelligent cockpit monitoring systems are becoming more and more common in modern vehicles. Intelligent cockpit monitoring systems monitor the vehicle's internal environment and the driver's status in real time through a series of sensors and cameras to improve driving safety and riding comfort. These systems include driver monitoring systems, passenger monitoring systems, and other related environmental monitoring systems.
[0003] At present, monitoring systems not only provide real-time monitoring, but also generate and store a large amount of historical video data. These data include historical videos generated during driving, which are of great significance for post-event analysis, accident responsibility determination and system optimization.
[0004] As the functions of the intelligent cockpit monitoring system continue to increase, the storage demand for video data is also growing rapidly. Due to the excessive amount of historical video data, the limited capacity of existing storage devices cannot meet long-term storage needs. Especially in the case of long-term driving or high-frequency use, the amount of video data will expand rapidly, resulting in insufficient storage space. This not only affects the integrity and availability of historical data, but also poses challenges to the stable operation of the system. Summary of the invention
[0005] In view of this, the present application provides a smart cockpit video management method, device and equipment for saving video data while occupying a small amount of storage.
[0006] Specifically, the present application is implemented through the following technical solutions:
[0007] A first aspect of the present application provides an intelligent cockpit video management method, the method comprising:
[0008] Extracting video features of the third video, writing the video features into a historical video log of a corresponding time at each interval, uploading the log to the smart cockpit, and uploading the log to the central smart gateway by the smart cockpit;
[0009] If the video feature triggers the driving state for uploading the second video, then the first time period of the triggering time is traced back to upload the second video until the driving state that triggers the uploading of the second video ends and continues for the second time period.
[0010] A second aspect of the present application provides an intelligent cockpit video management device, the device comprising an extraction module, a processing module and an upload module, wherein:
[0011] The extraction module is used to extract the video features of the third video;
[0012] The processing module is used to write the video features into the historical video log of the corresponding time at each interval time period;
[0013] The uploading module is used to upload to the smart cockpit, and the smart cockpit uploads to the central smart gateway;
[0014] The uploading module is used to trace back the first time period of the triggering time if the video feature triggers the driving state for uploading the second video, and upload the second video until the driving state that triggers the uploading of the second video ends and continues for a second time period.
[0015] The third aspect of the present application provides an intelligent cockpit video management device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the steps of any one of the methods provided in the first aspect of the present application are implemented.
[0016] The fourth aspect of the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of any one of the methods provided in the first aspect of the present application.
[0017] The smart cockpit video management method, device and equipment provided by the present application extracts the video features of the third video, writes the video features into the historical video log of the corresponding time at each interval time period, uploads it to the smart cockpit, and is uploaded to the central smart gateway by the smart cockpit. When the video feature triggers the driving state of uploading the second video, it traces back to the first time period of the triggering time, uploads the second video, and continues for the second time period after the driving state that triggers the uploading of the second video ends. In this way, by writing the video features into the historical video log at regular intervals, the historical video log ensures that the video within the corresponding interval time can be completely preserved without missing important information. Furthermore, because the memory usage of the video features is much smaller than that of the video captured by the camera device, the saved content can occupy a small amount of memory. In this way, historical videos are stored while ensuring that the memory usage is low to meet the user's reference needs. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 A flowchart of the first embodiment of the intelligent cockpit video management method provided in this application;
[0019] Figure 2 Flow chart of Embodiment 2 of the intelligent cockpit video management method provided in this application;
[0020] Figure 3A schematic diagram of a first video acquisition method embodiment 1 provided in the present application;
[0021] Figure 4 This is a flowchart of Embodiment 3 of the intelligent cockpit video management method provided in this application;
[0022] Figure 5 A schematic diagram of a first embodiment of a second video acquisition method provided by the present application;
[0023] Figure 6 A flowchart of Embodiment 4 of the intelligent cockpit video management method provided in this application;
[0024] Figure 7 A hardware structure diagram of the intelligent cockpit video management device in which the intelligent cockpit video management device of the present application is located;
[0025] Figure 8 This is a structural diagram of Example 1 of the intelligent cockpit video management device provided in this application. DETAILED DESCRIPTION
[0026] Here, exemplary embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application.
[0027] The terms used in this application are only for the purpose of describing specific embodiments and are not intended to limit this application. The singular forms of "a", "said" and "the" used in this application are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used in this article refers to and includes any or all possible combinations of one or more associated listed items.
[0028] It should be understood that although the terms first, second, third, etc. may be used in the present application to describe various information, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".
[0029] The present application provides a smart cockpit video management method, device and equipment for storing video data while occupying a small amount of storage.
[0030] Specific embodiments are given below to introduce the technical solution of the present application in detail.
[0031] Figure 1 This is a flow chart of the first embodiment of the intelligent cockpit video management method provided by this application. Please refer to Figure 1 , the method provided in this embodiment may include:
[0032] S101, extracting video features of the third video, writing the video features into a historical video log of a corresponding time at each interval time period, uploading the log to the smart cockpit, and uploading the log to the central smart gateway by the smart cockpit.
[0033] The method provided in this embodiment is applied to smart cockpit video. The smart cockpit video is described in detail below. The smart cockpit video includes:
[0034] (1) A first video triggered in response to an instruction from a central intelligent gateway; the first video is a real-time video of the smart cockpit that is collected, and the first video is not stored in a storage device of the smart cockpit or the central intelligent gateway.
[0035] Specifically, the smart cockpit refers to an in-vehicle system that integrates various devices and functions in the car into a unified system through electronic and information technologies to improve the comfort, safety and convenience of the driver and passengers. It should be noted that the driver of the car is in the smart cockpit during driving.
[0036] Furthermore, the central intelligent gateway is responsible for connecting and managing the various electronic control units of the smart cockpit and providing a communication interface with the external network. For example, in one embodiment, the central intelligent gateway collects data from cameras and sensors in the smart cockpit for processing and transmission.
[0037] Furthermore, the specific type of the camera device for collecting the video is determined according to actual needs, and is not limited in this embodiment. For example, a camera or sensor in the smart cockpit can be used as the camera device.
[0038] It should be noted that when the driver of the vehicle or the superior administrator needs to view the first video, a corresponding instruction is issued based on the central intelligent gateway to trigger the camera device to start collecting real-time video.
[0039] Furthermore, the first video is video data collected in real time by the camera device in the smart cockpit. It is captured and transmitted in real time when actually used. In specific implementation, the first video will not be stored in the storage device of the smart cockpit or the central smart gateway. In other words, the first video is processed in real time instead of being saved in local storage for subsequent access or analysis.
[0040] In specific implementation, in this step, when an instruction to view the first video issued by the central intelligent gateway is detected, the first video shot in real time by the camera device is displayed.
[0041] (2) Responding to a second video triggered based on the driving status; the second video is stored in a storage device of the smart cockpit or the central smart gateway.
[0042] Specifically, the specific content of the driving state that triggers the second video is determined according to actual needs, and is not limited in this embodiment. For example, in one embodiment, when the driving state is fatigue, the second video is triggered to be stored. For another example, in another embodiment, when the driving state is not focused, the second video is triggered to be stored.
[0043] Furthermore, the second video is stored in the smart cockpit or the central smart gateway. By storing the second video, the system can provide a detailed event record for subsequent analysis and processing.
[0044] (3) a historical video log extracted based on the third video; the historical video log is non-video data carrying time nodes, and the historical video log is stored in a storage device of the smart cockpit or the central smart gateway;
[0045] Specifically, the third video is a historical video continuously recorded by the camera device.
[0046] Furthermore, the historical video log stores specific data in the third video and the time when the third video was shot. It should be noted that the historical video log is not video data, and a data format with a smaller data volume than the video can be selected as the data format of the historical video log.
[0047] It should be noted that, by recording the time node and metadata information of the third video through the historical video log related to the third video, the detailed situation in the third video can be obtained by saving the historical video log.
[0048] The smart cockpit video management method provided in this embodiment introduces the first video, the second video and the third video in detail. These three videos include all video types in the smart cockpit. In this way, the first video can be used to monitor the in-vehicle environment and the driver's status in real time to ensure driving safety; the second video can be used to record specific events that occur during driving, and the events can be analyzed and reviewed in detail, which is helpful for improving driving behavior; the historical video log corresponding to the third video can be used to access and trace back historical data, which has been collected and stored. Combined with the historical video log, users can quickly perform data analysis and troubleshooting. Through the video in the smart cockpit, driving safety and data management efficiency are greatly improved, providing convenience and reliability for users.
[0049] Furthermore, the video features of the third video may be extracted by a traditional feature extraction method or by a neural network feature extraction method, which is not limited in the present embodiment.
[0050] It should be noted that the video features of the third video include important events of the third video. For example, in one embodiment, the video features include key frames, object detection results, scene changes, etc. in the third video features.
[0051] Furthermore, the specific duration of the interval time period is set according to actual needs, and is not limited in this embodiment. For example, in one embodiment, the interval time period can be set to 30 minutes.
[0052] In specific implementation, in this step, when writing the video feature into the historical video log, the time point corresponding to the video feature needs to be synchronously saved. For example, in one embodiment, the time when the video feature occurs is marked as the video feature and then saved in the historical video log.
[0053] It should be noted that the data volume of the historical video log is much smaller than the third video of the corresponding time length. The third video can be fully understood through the video features in the historical video log, which facilitates the restoration of the third video without saving the third video.
[0054] S102: If the video feature triggers the driving state for uploading the second video, trace back to the first time period of the triggering time, and upload the second video until the driving state that triggers the uploading of the second video ends and continues for a second time period.
[0055] Specifically, the specific driving state included in the driving state that triggers uploading the second video is set according to actual needs, and is not limited in this embodiment. For example, in one embodiment, when a driving state such as the driver is distracted, the driver is making a phone call, the driver yawns, or the vehicle collides, uploading the second video is triggered.
[0056] Furthermore, the specific duration of the first time period is determined according to actual needs, and is not limited in this embodiment. For example, in one embodiment, the first time period can be set to 10 seconds.
[0057] It should be noted that the video camera device for shooting the video is integrated with a storage function, and the video is stored for a first time period after shooting the video, so as to form a second video. In other words, after the current data is obtained by the video camera device, it is deleted after the first time period. It is understandable that by storing the captured video for the first time period, it can be ensured that an accurate second video is obtained when tracing back the video.
[0058] Furthermore, the specific duration of the second time period is determined according to actual needs, and is not limited in this embodiment. For example, in one embodiment, the second time period can be set to 3 minutes. For another example, in another embodiment, the second time period can be set to the duration of the current driving state.
[0059] When this step is implemented specifically, for example, in one embodiment, in combination with the above embodiment, when the driver answers the phone, the uploading of the second video is triggered, and all videos from 10 seconds before the call is answered to the time when the driver hangs up the phone (puts down the phone) are confirmed as the second video, and uploaded and saved.
[0060] The smart cockpit video management method, device and equipment provided in this embodiment extracts the video features of the third video, writes the video features into the historical video log of the corresponding time at each interval time period, uploads it to the smart cockpit, and is uploaded to the central smart gateway by the smart cockpit. When the video feature triggers the driving state of uploading the second video, it traces back to the first time period of the triggering time, uploads the second video, and continues for the second time period after the driving state that triggers the uploading of the second video ends. In this way, by writing the video features into the historical video log at regular intervals, the historical video log ensures that the video in the corresponding interval time can be completely preserved without missing important information. Furthermore, since the memory usage of the video features is much smaller than that of the video captured by the camera device, the saved content can occupy a small amount of memory. In this way, historical videos are stored while ensuring that the memory usage is low, meeting the user's reference needs.
[0061] Optionally, the third video includes a video of the smart cockpit captured by a camera in the smart cockpit and a video of the vehicle operation captured by the front camera; the video of the smart cockpit includes: a driver video, or a driver video and a rear cabin video;
[0062] (1) Determine the driving status based on the driver video and the vehicle operation data, or based on the driver video, the rear cabin video, and the vehicle operation data.
[0063] Specifically, the video of the smart cockpit may include a camera installed inside the smart cockpit, and the camera installed inside the smart cockpit may capture the driver's video. It is understood that the driver's video may record information such as the driver's behavior, status, and reaction.
[0064] Furthermore, the video of the smart cockpit may also include a rear cabin video, which records the environment in the rear cabin and the conditions of the cargo or passengers through a camera installed in the rear cabin.
[0065] Furthermore, the front camera is installed at the front of the vehicle, and the video of the vehicle operation is collected by the front camera. In specific implementation, for example, in one embodiment, the driving recorder can be directly used as the front camera of the vehicle. For another example, in another embodiment, a dedicated camera device can be installed as the front camera of the vehicle.
[0066] Specifically, when the video of the smart cockpit includes the driver's video, the vehicle operation data is used to determine whether an abnormality occurs in the vehicle operation. It should be noted that the vehicle operation data can be compared with the preset vehicle driving standard to determine whether an abnormality occurs in the vehicle. In specific implementation, for example, in one embodiment, when it is determined based on the vehicle operation data that the vehicle is driving diagonally and occupying a non-motorized vehicle lane, it is determined based on the driver's video that the driver is distracted, and the driving state at this time is determined to be fatigue driving.
[0067] Furthermore, when the video of the smart cockpit includes the driver video and the rear cabin video, the driving state is determined by combining the driver video, the rear cabin video and the driving data. For example, in one embodiment, it is determined that the vehicle is tilted based on the vehicle operation data, the driver is yawning based on the driver video, and the cargo in the rear cabin has fallen based on the rear cabin video, and the driving state at this time is determined to be tilted.
[0068] (2) If the driving status falls into the upload event library, the second video is uploaded.
[0069] Specifically, the upload event library contains a variety of abnormal driving states. In specific implementation, the specific driving states contained in the upload event library can be determined according to actual needs, and this is not limited in this embodiment. For example, in one embodiment, the driving states in the upload event library can be set to distracted driving, smoking, making phone calls, yawning, blocking, and leaving the post. When the driving states in the upload event library appear, the corresponding second video is uploaded.
[0070] It should be noted that the driving state in the uploaded event library can be used to mark the second video so as to determine the abnormal driving state described in the uploaded second video.
[0071] When this step is specifically implemented, when the driving state is the same as the driving state in the uploaded event library, the second video corresponding to the driving state is uploaded.
[0072] The smart cockpit video management method provided in this embodiment first determines the driving state based on the driver video and vehicle operation data, or based on the driver video, rear cabin video and vehicle operation data, and uploads the second video when the driving state falls into the upload event library. In this way, the driving state corresponding to the vehicle is comprehensively analyzed in multiple dimensions through the vehicle operation data and the video of the smart cockpit, and the second video can be uploaded in time when the driving state corresponds to the upload event library. In this way, the timeliness and accuracy of the upload of the second video are guaranteed, the omission and misjudgment of events are avoided, and the effectiveness of the second video is improved.
[0073] Figure 2 This is a flow chart of the second embodiment of the intelligent cockpit video management method provided by this application. Please refer to Figure 2 Based on the above embodiment, the first video triggered in response to the instruction of the central intelligent gateway includes the video of the smart cockpit and the video of the vehicle running; the step of obtaining the first video includes:
[0074] S201. In response to a first user request for a first video, uploading a first video in the smart cockpit to the central smart gateway.
[0075] Specifically, the first user request is used to request a first video recorded in real time. When the user needs to view the first video, the first user request is initiated through the cloud platform.
[0076] Furthermore, the vehicle's cloud platform is a comprehensive online platform for managing and processing a large amount of vehicle-related data and services. In specific implementation, for example, the cloud platform includes a front-end user interface and a vehicle-cloud gateway. The front-end user interface provides an interface for drivers, administrators, and other users to view and manage vehicle data, receive notifications and alarms, and perform remote operations; the vehicle-cloud gateway is responsible for transmitting data on the vehicle to the cloud platform and transmitting instructions from the cloud platform back to the vehicle.
[0077] It should be noted that when using the smart cockpit, the central intelligent gateway needs to be logged into the cloud platform.
[0078] Further, when the cloud platform sends the first user request to the central intelligent gateway, the cloud platform requests the first video from the smart cockpit through the central intelligent gateway. At this time, the smart cockpit uploads the first video through the streaming media server.
[0079] In specific implementation, the first video can be uploaded to the central intelligent gateway, or the first video can be uploaded to the cloud platform through the central intelligent gateway. This is not limited in this embodiment.
[0080] S202: The central intelligent gateway uploads the first video to a cloud platform, and plays the first video based on the cloud platform.
[0081] In a specific implementation, after the first video is uploaded to the cloud platform, the first video is played based on the front-end user interface of the cloud platform.
[0082] Furthermore, when the user finishes watching the first video, an instruction to end the first video is sent through the cloud platform to stop uploading the first video.
[0083] When implementing it specifically, Figure 3 This is a schematic diagram of the first video acquisition method embodiment 1 provided by this application. Please refer to Figure 3 , upload the first video to the cloud platform through the smart cockpit, and complete the playback of the first video. It should be noted that when a network failure or poor network signal occurs, the playback of the first video is stopped.
[0084] The smart cockpit video management method provided in this embodiment responds to a first user request for a first video, uploads the first video in the smart cockpit to the central smart gateway, and then uploads the first video to the cloud platform through the central smart gateway, and plays the first video based on the cloud platform. In this way, when the first video needs to be viewed, the first video can be quickly and accurately viewed through the cloud platform.
[0085] Figure 4 This is a flowchart of the third embodiment of the intelligent cockpit video management method provided by this application. Please refer to Figure 4 Based on the above embodiment, the second video triggered in response to the driving state includes a video of the smart cockpit and a video of the vehicle operation; the step of acquiring the second video includes:
[0086] S401. In response to a second user request for a second video, obtain the second video that has been uploaded.
[0087] Specifically, the second user request is used to request the second video triggered by the event. When the user needs to view the second video, the second user request is initiated through the cloud platform.
[0088] It should be noted that the second user request includes a video type list of the second video that the user wants to view, and the grouping of the second video is determined by the video type list. For example, in one embodiment, the user wants to view the second video of fatigue driving and distracted driving, and the video type list included in the second user request is fatigue driving and distracted driving.
[0089] Furthermore, the second video is stored by the smart cockpit based on a preset storage rule. After the smart cockpit generates the second video, it is stored in the storage of the smart cockpit or the central smart gateway. It should be noted that when storing the second video, the video type is marked according to the type of driving state triggered by the second video.
[0090] Furthermore, after receiving the second user request, the stored second video is obtained based on the FTP (File Transfer Protocol, FTP for short) server and uploaded to the cloud platform.
[0091] S402: Play the second video.
[0092] When implementing it specifically, Figure 5 This is a schematic diagram of the first embodiment of the second video acquisition method provided by this application. Figure 5 , when the user views the second video, the second video of the corresponding type is uploaded to the cloud platform and played for the user.
[0093] For further information, please refer to Figure 5 , the second user request may carry a second video type list, and the second video type list includes multiple video types. For example, in one embodiment, when the user is more concerned about the situation in the rear cabin, the rear cabin may be selected in the second video type to view the second video in the rear cabin. For another example, in another embodiment, when the user is more concerned about distracted driving, smoking, making or receiving phone calls, and yawning, distracted driving, smoking, making or receiving phone calls, and yawning may be selected in the second video type to view the corresponding second video.
[0094] For further information, please refer to Figure 5 The central intelligent gateway continuously monitors whether an event that triggers the storage of the second video occurs according to the uploaded event library to ensure that the second video can be stored in time. It should be noted that the detection of the event can be completed through the central intelligent gateway or through the smart cockpit.
[0095] The smart cockpit video management method provided in this embodiment first responds to the second user's request for the second video, obtains the uploaded second video, and then plays the second video. In this way, when the user needs to view the second video, the corresponding type of second video is uploaded to the front-end interface in time and played for the user, which can ensure that the user can view the second video efficiently and accurately.
[0096] Figure 6 This is a flowchart of the fourth embodiment of the intelligent cockpit video management method provided by this application. Please refer to Figure 6 , based on the above embodiment, the step of extracting the video features of the third video, writing the video features into the historical video log of the corresponding time at each interval time period, uploading to the smart cockpit, and uploading from the smart cockpit to the central smart gateway further includes:
[0097] S601. Based on a third user request for a third video, obtain the historical video log corresponding to the third user request.
[0098] Specifically, the third user requests a third video for continuous recording, and when the user needs to view the third video, the third user request is initiated through the cloud platform.
[0099] It should be noted that the third user request includes time information of the third video to be requested. By matching the time information with the time of the third video, the third video to be viewed can be accurately obtained.
[0100] S602: Generate a fourth user request based on the historical video log, and obtain the video feature corresponding to the fourth user request.
[0101] Specifically, after the central intelligent gateway receives the third user request, it generates a fourth user request. It should be noted that the fourth user request is used to obtain the video features corresponding to the third video. It is understandable that the storage device of the vehicle stores the video features corresponding to the third video, and the third video can be generated by obtaining the video features of the third video.
[0102] S603: Obtain the corresponding third video based on the video feature, and play the third video.
[0103] Specifically, the third video can be determined by video features based on a traditional video acquisition method, and the generated third video can be uploaded to a cloud platform for playing for users.
[0104] It should be noted that video features may include representative key frames automatically selected based on the video, objects, faces, license plates and location information detected in the video, motion trajectory vectors of each pixel and feature point in the video that change over time, audio features, etc. In specific implementation, these video features are compressed and stored.
[0105] Furthermore, when a third video needs to be consulted, the video scene can be reconstructed based on the video features. For example, in one embodiment, in combination with the above example, key frames are used to generate animations, detected object information is superimposed on key frames or generated video frames, and motion scenes in the video are simulated based on motion vectors or other dynamic information.
[0106] It should be noted that the third video can also be enriched based on AI generation technology combined with video features. In specific implementation, the third video is deeply supplemented by AI technology to improve the coherence and completeness of the third video.
[0107] The smart cockpit video management method provided in this embodiment first obtains the historical video log corresponding to the third user request based on the third user request for the third video, then generates a fourth user request based on the historical video log, obtains the video feature corresponding to the fourth user request, and finally obtains the corresponding third video based on the video feature and plays the third video. In this way, when the user needs to view the third video, the third video is obtained through the video feature of the third video corresponding to the third video, so as to quickly and accurately play the third video for the user.
[0108] Optionally, the first video is used for a driving state that is not limited to triggering uploading of the second video based on the video feature;
[0109] If the driving state identified by the monitoring person through the first video is an abnormal state, the monitoring person sends a command through the central intelligent gateway to trigger the smart cockpit to upload the second video.
[0110] Specifically, when a video feature that triggers uploading of the second video appears in the first video, it is determined to upload the second video. The specific implementation process of this step can be referred to the description in the above embodiment, and will not be repeated here.
[0111] Furthermore, when the monitor who views the first video determines that the driving state of the vehicle is abnormal, the monitor may issue an instruction to upload the second video. At this time, the smart cockpit uploads the second video according to the uploading method of the second video.
[0112] The intelligent cockpit video management method provided in this embodiment makes the storage and uploading of the second video more flexible, expands the scope of the second video, and improves the user experience by allowing the monitoring person to independently judge whether to upload the second video.
[0113] Corresponding to the aforementioned embodiment of an intelligent cockpit video management method, the present application also provides an embodiment of an intelligent cockpit video management device.
[0114] The embodiment of the intelligent cockpit video management device of the present application can be applied to the intelligent cockpit video management equipment. The device embodiment can be implemented by software, or by hardware or a combination of software and hardware. Taking software implementation as an example, as a device in a logical sense, it is formed by the processor of the intelligent cockpit video management device in which it is located reading the corresponding computer program instructions in the non-volatile memory into the memory and running them. From the hardware level, if Figure 7 As shown in the figure, it is a hardware structure diagram of the intelligent cockpit video management device where the intelligent cockpit video management device of the present application is located. Figure 7In addition to the processor, memory, network interface, and non-volatile memory shown, the smart cockpit video management device where the device is located in the embodiment may also include other hardware according to the actual function of the smart cockpit video management device, which will not be described in detail.
[0115] Figure 8 This is a structural diagram of the first embodiment of the intelligent cockpit video management device provided by this application. Figure 8 The device provided in this embodiment includes an extraction module 810, a processing module 820 and an upload module 830, wherein:
[0116] The extraction module 810 is used to extract the video features of the third video;
[0117] The processing module 820 is used to write the video features into the historical video log of the corresponding time at each interval time period;
[0118] The uploading module 830 is used to upload to the smart cockpit, and the smart cockpit uploads to the central smart gateway;
[0119] The uploading module 830 is used to trace back the first time period of the triggering time if the video feature triggers the driving state for uploading the second video, and upload the second video until the driving state that triggers the uploading of the second video ends and continues for a second time period.
[0120] The device of this embodiment can be used to perform Figure 1 The steps, specific implementation principles and implementation processes of the method embodiment shown are similar and will not be repeated here.
[0121] Optionally, the uploading module 830 is further used to upload the second video when the driving state falls into the upload event library.
[0122] Optionally, the uploading module 830 is specifically configured to upload the first video in the smart cockpit to the central smart gateway in response to a first user request for the first video;
[0123] The processing module 820 is specifically used for the central intelligent gateway to upload the first video to the cloud platform and play the first video.
[0124] Optionally, the uploading module 830 is further specifically configured to obtain the uploaded second video in response to a second user request for the second video;
[0125] The processing module 820 is further specifically configured to play the second video.
[0126] Optionally, the processing module 820 is further specifically configured to obtain the historical video log corresponding to the third user request based on the third user request for the third video;
[0127] The processing module 820 is further specifically configured to generate a fourth user request based on the historical video log, and obtain the video feature corresponding to the fourth user request;
[0128] The processing module 820 is further specifically configured to obtain the corresponding third video based on the video feature and play the third video.
[0129] Optionally, the uploading module 830 is also used to trigger the smart cockpit to upload the second video by issuing an instruction through the central intelligent gateway if the driving state identified by the monitoring person through the first video is an abnormal state.
[0130] Please continue to refer to Figure 7 The present application also provides an intelligent cockpit video management device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the steps of any one of the methods provided in the first aspect of the present application are implemented.
[0131] The present application also provides a computer-readable storage medium having a computer program stored thereon, and when the program is executed by a processor, the steps of any one of the methods provided in the present application are implemented.
[0132] The implementation process of the functions and effects of each unit in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and will not be repeated here.
[0133] For the device embodiment, since it basically corresponds to the method embodiment, the relevant parts can refer to the partial description of the method embodiment. The device embodiment described above is only schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present application scheme. A person of ordinary skill in the art can understand and implement it without paying any creative work.
[0134] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.
Claims
1. A smart cockpit video management method, characterized in that: The smart cockpit video includes: A first video triggered in response to an instruction of a central intelligent gateway; the first video is a real-time video of the smart cockpit that is collected, and the first video is not stored in a storage device of the smart cockpit or the central intelligent gateway; Responding to a second video triggered based on a driving state; the second video is stored in a storage device of the smart cockpit or the central smart gateway; A historical video log extracted based on the third video; the historical video log is non-video data carrying a time node, and the historical video log is stored in a storage device of the smart cockpit or the central smart gateway; The method comprises: Extracting video features of the third video, writing the video features into a historical video log of a corresponding time at each interval, uploading the log to the smart cockpit, and uploading the log to the central smart gateway by the smart cockpit; If the video feature triggers the driving state for uploading the second video, then the first time period of the triggering time is traced back to upload the second video until the driving state that triggers the uploading of the second video ends and continues for the second time period.
2. The method according to claim 1, characterized in that The third video includes a video of the smart cockpit captured by a camera in the smart cockpit and a video of the vehicle operation captured by a front camera; The video of the smart cockpit includes: a driver video, or a driver video and a rear cabin video; Determining a driving state based on the driver video and the vehicle operation data, or based on the driver video, the rear cabin video, and the vehicle operation data; If the driving status falls into the upload event library, the second video is uploaded.
3. The method according to claim 1, characterized in that The first video triggered in response to the instruction of the central intelligent gateway includes a video of the intelligent cockpit and a video of the vehicle running; Acquiring the first video includes: In response to a first user request for a first video, uploading the first video in the smart cockpit to the central smart gateway; The central intelligent gateway uploads the first video to the cloud platform and plays the first video based on the cloud platform.
4. The method according to claim 1, characterized in that The second video triggered in response to the driving state includes a video of the smart cockpit and a video of the vehicle operation; The step of obtaining the second video includes: In response to a second user request for a second video, acquiring the uploaded second video; Play the second video.
5. The method according to claim 1, characterized in that The method further comprises: extracting the video features of the third video, writing the video features into the historical video log of the corresponding time at each interval time period, uploading the video features to the smart cockpit, and uploading the video features to the central smart gateway by the smart cockpit. Based on a third user request for a third video, obtaining the historical video log corresponding to the third user request; Generate a fourth user request based on the historical video log, and obtain the video feature corresponding to the fourth user request; The corresponding third video is obtained based on the video feature, and the third video is played.
6. The method according to claim 1, characterized in that The first video is used for driving status that is not limited to triggering uploading of the second video based on the video feature; If the driving state identified by the monitoring person through the first video is an abnormal state, the monitoring person sends a command through the central intelligent gateway to trigger the smart cockpit to upload the second video.
7. An intelligent cockpit video management device, characterized in that: The device comprises an extraction module, a processing module and an upload module, wherein: The extraction module is used to extract video features of the third video; The processing module is used to write the video features into the historical video log of the corresponding time at each interval time period; The uploading module is used to upload to the smart cockpit, and the smart cockpit uploads to the central smart gateway; The uploading module is used to trace back the first time period of the triggering time if the video feature triggers the driving state for uploading the second video, and upload the second video until the driving state that triggers the uploading of the second video ends and continues for a second time period.
8. The device according to claim 7, characterized in that The processing module is further used to determine the driving state based on the driver video and the vehicle operation data, or based on the driver video and the rear cabin video and the vehicle operation data; The processing module is further configured to upload the second video if the driving status falls into an upload event library.
9. An intelligent cockpit video management device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method according to any one of claims 1 to 6 when executing the program.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
