Vehicle remote monitoring method and device, electronic equipment and storage medium

Abstract

The invention provides a vehicle remote monitoring method and device, electronic equipment and a storage medium, and the method comprises the steps: collecting multi-source vehicle data of a target vehicle at a vehicle end, selecting target vehicle state data according to the vehicle state data, superposing a camera video with the target vehicle state data for virtual screen rendering, and carrying out the virtual screen rendering. And generating a corresponding virtual screen video frame, unifying a timestamp for the virtual screen video frame, and in response to the detection that the driver and / or the target vehicle is in a predefined abnormal state, performing end-to-end encryption on the virtual screen video frame through a preset communication protocol and then transmitting the encrypted virtual screen video frame to the target terminal in real time.

Description

Technical Field

[0001] This application relates to the field of vehicle networking technology, and more specifically, to a method, device, electronic device, and storage medium for remote vehicle monitoring. Background Technology

[0002] The vehicle-to-everything (V2X) and remote monitoring solutions integrate a variety of cutting-edge technologies, aiming to achieve the interconnection of vehicles with everything, and ultimately realize intelligent management and services through real-time collection, transmission and analysis of vehicle data.

[0003] Currently, the main method involves collecting vehicle status data at the vehicle end and uploading it to the manufacturer's cloud. The cloud then performs data processing such as video transcoding and information overlay before finally displaying the data on a mobile phone or a family member's device.

[0004] However, the original video data is large in volume and difficult to store in the cloud. The data seen by family members has been processed in the cloud, making it difficult to directly verify the original state of the vehicle and posing privacy risks, resulting in generally low data reliability. Cloud forwarding and transcoding increase latency, which may prevent timely notification of family members in the event of a driving abnormality, resulting in generally low efficiency and quality of remote monitoring. Summary of the Invention

[0005] In view of this, the purpose of this application is to provide a method, device, electronic device, and storage medium for remote vehicle monitoring. This method generates virtual screen video frames by overlaying camera video with target vehicle status data and then timestamping these frames before transmitting them to the target terminal in real-time with end-to-end encryption upon detecting an anomaly. This eliminates the need for cloud storage, allowing family members to directly verify the vehicle's original status on their terminals. Furthermore, encoding and end-to-end encryption compress transmission bandwidth while ensuring encrypted end-to-end data transmission, guaranteeing that family members see the actual vehicle data, avoiding privacy risks, and improving data reliability. In addition, family members can be notified in real-time of any driving anomalies, and their terminals can receive real-time camera footage and key vehicle data, improving the efficiency and quality of remote monitoring.

[0006] In a first aspect, embodiments of this application provide a method for remote vehicle monitoring, the method comprising: Collect multi-source vehicle data of the target vehicle at the vehicle end; wherein, the vehicle data includes at least camera video and multi-dimensional vehicle status data; Select the target vehicle status data from the vehicle status data, overlay the camera video with the target vehicle status data for virtual screen rendering, generate the corresponding virtual screen video frame, and assign a unified timestamp to the virtual screen video frame; In response to the detection that the driver and / or the target vehicle are in a predefined abnormal state, the virtual screen video frames are encrypted end-to-end using a preset communication protocol and then transmitted in real time to the target terminal; wherein the target terminal includes at least a family member terminal.

[0007] In one possible implementation, the method further includes: The target terminal receives the virtual screen video frame and performs end-to-end decryption of the virtual screen video frame; The virtual screen video frames are decoded based on a preset encoding protocol, and the decoded virtual screen video frames are overlaid and displayed on the target terminal.

[0008] In one possible implementation, the method further includes: The vehicle-side verification information for the virtual screen video frame is determined; wherein, the verification information includes frame signature and hash chain; The credibility of the virtual screen video frame is verified based on the verification information.

[0009] In one possible implementation, the method further includes: The vehicle terminal and the target terminal are connected through a preset lightweight signaling channel; When the driver and / or the target vehicle are in the abnormal state, the abnormal event corresponding to the abnormal state is notified to the target terminal through the vehicle terminal.

[0010] In one possible implementation, the method further includes: After receiving the abnormal event notification from the vehicle, the target terminal starts receiving virtual screen video frames.

[0011] In one possible implementation, the method further includes: Select an alternative notification mechanism other than the lightweight signaling channel; The abnormal event will be notified to the target terminal based on the backup notification mechanism.

[0012] In one possible implementation, the method further includes: The virtual screen video frames are compressed based on a preset encoding protocol.

[0013] Secondly, embodiments of this application also provide a vehicle remote monitoring device, the device comprising: The acquisition module is used to acquire multi-source vehicle data of the target vehicle at the vehicle end; wherein the vehicle data includes at least camera video and multi-dimensional vehicle status data; The rendering module is used to select target vehicle status data from the vehicle status data, overlay the camera video with the target vehicle status data to perform virtual screen rendering, generate corresponding virtual screen video frames, and assign a unified timestamp to the virtual screen video frames. The transmission module is configured to, in response to detecting that the driver and / or the target vehicle is in a predefined abnormal state, encrypt the virtual screen video frame end-to-end using a preset communication protocol and transmit it to the target terminal in real time; wherein the target terminal includes at least a family member terminal.

[0014] In one possible implementation, the device further includes: The decryption module is used to perform end-to-end decryption of the virtual screen video frame when the target terminal receives the virtual screen video frame. The display module is used to decode the virtual screen video frames based on a preset encoding protocol and overlay the decoded virtual screen video frames on the target terminal.

[0015] In one possible implementation, the device further includes: The determination module is used to determine the verification information of the vehicle-side for the video frame of the virtual screen; wherein, the verification information includes frame signature and hash chain; The verification module is used to verify the credibility of the virtual screen video frame based on the verification information.

[0016] In one possible implementation, the device further includes: A connection module is used to establish a connection between the vehicle terminal and the target terminal through a preset lightweight signaling channel; The first notification module is used to notify the target terminal of the abnormal event corresponding to the abnormal state through the vehicle terminal when the driver and / or the target vehicle is in the abnormal state.

[0017] In one possible implementation, the device further includes: The startup module is used to initiate virtual screen video frame reception after the target terminal receives an abnormal event notification from the vehicle.

[0018] In one possible implementation, the device further includes: The selection module is used to select an alternative notification mechanism other than the lightweight signaling channel; The second notification module is used to notify the target terminal of the abnormal event based on the backup notification mechanism.

[0019] In one possible implementation, the device further includes: The compression module is used to compress the virtual screen video frames based on a preset encoding protocol.

[0020] Thirdly, embodiments of this application provide an electronic device, including: a processor, a storage medium, and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor communicates with the storage medium via the bus, and the processor executes the machine-readable instructions to perform the steps of the vehicle remote monitoring method as described in any of the first aspects.

[0021] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the steps of the vehicle remote monitoring method described in any one of the first aspects.

[0022] This application provides a vehicle remote monitoring method, device, electronic device, and storage medium. It collects multi-source vehicle data from the target vehicle at the vehicle end, selects target vehicle status data from vehicle status data, overlays camera video with the target vehicle status data for virtual screen rendering, generates corresponding virtual screen video frames, and assigns a unified timestamp to the virtual screen video frames. In response to the detection of a predefined abnormal state of the driver and / or the target vehicle, the virtual screen video frames are encrypted end-to-end using a preset communication protocol and transmitted to the target terminal in real time. This application, by overlaying camera video with target vehicle status data to generate virtual screen video frames and assigning a unified timestamp to the virtual screen video frames, transmits them to the target terminal in real time with end-to-end encryption upon detecting an anomaly. It eliminates the need for cloud storage, allowing family members to directly verify the original vehicle status on their terminals. Furthermore, through encoding and end-to-end encryption, it compresses transmission bandwidth while ensuring encrypted end-to-end data transmission, ensuring that what family members see is the actual vehicle data, avoiding privacy risks, and improving data reliability. In addition, family members can be notified in real time in case of driving abnormalities. Family members' terminals can receive the vehicle's camera footage and key vehicle data in real time, improving the efficiency and quality of remote monitoring.

[0023] To make the above-mentioned objectives, features and advantages of this application more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0024] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0025] Figure 1 This is a flowchart of a vehicle remote monitoring method provided according to an embodiment of this application; Figure 2 This is a schematic diagram of the structure of a vehicle remote monitoring device provided according to an embodiment of this application; Figure 3 This is a schematic diagram of the structure of an electronic device provided according to an embodiment of this application. Detailed Implementation

[0026] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. It should be understood that the accompanying drawings in this application are for illustrative and descriptive purposes only and are not intended to limit the scope of protection of this application. Furthermore, it should be understood that the schematic drawings are not drawn to scale. The flowcharts used in this application illustrate operations implemented according to some embodiments of this application. It should be understood that the operations in the flowcharts may not be implemented in sequence, and steps without logical contextual relationships may be reversed or implemented simultaneously. In addition, those skilled in the art, guided by the content of this application, may add one or more other operations to the flowcharts, or remove one or more operations from the flowcharts.

[0027] Furthermore, the described embodiments are merely some, not all, of the embodiments of this application. The components of the embodiments of this application described and illustrated herein can typically be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely to illustrate selected embodiments of the application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0028] It should be noted that the term "comprising" will be used in the embodiments of this application to indicate the presence of the features declared thereafter, but does not exclude the addition of other features.

[0029] Considering that the vehicle-to-everything (V2X) and remote monitoring solutions integrate a variety of cutting-edge technologies, aiming to achieve the interconnection of vehicles with everything, and ultimately realize intelligent management and services through real-time collection, transmission and analysis of vehicle data.

[0030] Currently, the main method involves collecting vehicle status data at the vehicle end and uploading it to the manufacturer's cloud. The cloud then performs data processing such as video transcoding and information overlay before finally displaying the data on a mobile phone or a family member's device.

[0031] However, the original video data is large in volume and difficult to store in the cloud. The data seen by family members has been processed in the cloud, making it difficult to directly verify the original state of the vehicle and posing privacy risks, resulting in generally low data reliability. Cloud forwarding and transcoding increase latency, which may prevent timely notification of family members in the event of a driving abnormality, resulting in generally low efficiency and quality of remote monitoring.

[0032] To address this issue, this application provides a method, device, electronic device, and storage medium for remote vehicle monitoring. It generates virtual screen video frames by overlaying camera video with target vehicle status data and then timestamping these frames before transmitting them in real-time, end-to-end encrypted to the target terminal upon detecting an anomaly. This eliminates the need for cloud storage, allowing family members to directly verify the vehicle's original status on their terminals. Encoding and end-to-end encryption compress transmission bandwidth while ensuring encrypted end-to-end data transmission, guaranteeing that family members see the actual vehicle data, avoiding privacy risks, and improving data reliability. Furthermore, it can notify family members in real-time of any driving anomalies, allowing family members to receive real-time camera footage and key vehicle data on their terminals, thus improving the efficiency and quality of remote monitoring.

[0033] Figure 1 This is a flowchart of a vehicle remote monitoring method provided according to an embodiment of this application. For example... Figure 1 As shown in the embodiments of this application, the vehicle remote monitoring method may specifically include: S101. Collect multi-source vehicle data of the target vehicle at the vehicle end.

[0034] S102. Select the target vehicle status data in the vehicle status data, overlay the camera video with the target vehicle status data for virtual screen rendering, generate the corresponding virtual screen video frame, and assign a unified timestamp to the virtual screen video frame.

[0035] S103. In response to detecting that the driver and / or the target vehicle are in a predefined abnormal state, the virtual screen video frame is encrypted end-to-end using a preset communication protocol and then transmitted to the target terminal in real time.

[0036] In the aforementioned remote vehicle monitoring method, virtual screen video frames are generated by overlaying camera video with target vehicle status data and then timestamping them. Upon detection of an anomaly, these frames are transmitted end-to-end in real-time with encrypted transmission. This eliminates the need for cloud storage, allowing family members to directly verify the vehicle's original status on their devices. Encoding and end-to-end encryption compress transmission bandwidth while ensuring encrypted end-to-end data transmission, guaranteeing that family members see the actual vehicle data, avoiding privacy risks, and improving data reliability. Furthermore, family members can be notified in real-time of any driving anomalies, and their devices can receive real-time camera footage and key vehicle data, improving the efficiency and quality of remote monitoring.

[0037] The exemplary steps described above in the embodiments of this application are illustrated below with specific examples: S101 collects multi-source vehicle data of the target vehicle at the vehicle end.

[0038] In this embodiment, the vehicle data includes at least camera video and multi-dimensional vehicle status data. The vehicle status data includes at least vehicle CAN data (vehicle speed, braking, accelerator pedal position, gear information, etc.), ADAS status (collision warning, active braking, etc.), passive safety system status (seat belts, airbags), body control status (door status), and fault diagnosis information. Multi-source vehicle data is collected at the vehicle end for subsequent processing.

[0039] S102, select the target vehicle status data in the vehicle status data, overlay the camera video with the target vehicle status data for virtual screen rendering, generate the corresponding virtual screen video frame, and assign a unified timestamp to the virtual screen video frame.

[0040] In this embodiment, the target vehicle status data refers to the key vehicle status data selected from the collected vehicle status data. For example, speed, gear, and ADAS status are selected as the target vehicle status data from the collected vehicle status data. The virtual screen video frame integrates the camera video and the target vehicle status data. The camera video and the target vehicle data are superimposed on the virtual screen for rendering to generate the virtual screen video frame. The timestamps of the virtual screen video frames are synchronized to form a consistent multi-source data stream for subsequent processing.

[0041] Optionally, the virtual screen video frames can be compressed based on a preset encoding protocol. For example, H.264 / H.265 encoding can be used to compress the virtual screen video frames. This can reduce network transmission bandwidth.

[0042] S103, in response to detecting that the driver and / or the target vehicle is in a predefined abnormal state, the virtual screen video frame is encrypted end-to-end using a preset communication protocol and then transmitted to the target terminal in real time.

[0043] In this embodiment, the communication protocol is the protocol for end-to-end encryption of the virtual screen video frames; the abnormal state includes the predefined abnormal state of the driver and the abnormal state of the target vehicle, wherein the abnormal state of the driver can be such as hands off the steering wheel or fatigue, and the abnormal state of the target vehicle can be such as fault alarm or collision warning; the communication protocol can be such as SRTP or QUIC / TLS; the target terminal includes at least a family member terminal, or it can be the driver's terminal, and this application describes it as a family member terminal; when the abnormal state of the driver and / or the abnormal state of the target vehicle is detected, it indicates that an abnormal event has been triggered, and the virtual screen video frames are encrypted end-to-end through the communication protocol and then transmitted to the target terminal in real time.

[0044] Optionally, virtual screen video frames can be transmitted to the target terminal in real time via a transport protocol (e.g., WebRTC / NAT traversal or QUIC).

[0045] Here, end-to-end encryption is implemented using SRTP or QUIC / TLS, ensuring secure data transmission over public 4G / 5G networks. Upon an anomaly, data is directly pushed to family members' devices via WebRTC / NAT traversal or QUIC, avoiding cloud processing or storage.

[0046] Therefore, data transmission is only initiated when there is a driving malfunction or vehicle malfunction, reducing bandwidth consumption and privacy risks.

[0047] The vehicle remote monitoring method provided in this application collects multi-source vehicle data of the target vehicle at the vehicle end, selects the target vehicle status data from the vehicle status data, overlays the camera video with the target vehicle status data for virtual screen rendering, generates corresponding virtual screen video frames, and assigns a unified timestamp to the virtual screen video frames. In response to the detection of a predefined abnormal state of the driver and / or the target vehicle, the virtual screen video frames are encrypted end-to-end using a preset communication protocol and transmitted to the target terminal in real time. This vehicle remote monitoring method generates virtual screen video frames by overlaying camera video with the target vehicle status data for virtual screen rendering, and after assigning a unified timestamp to the virtual screen video frames, it transmits them to the target terminal in real time with end-to-end encryption when an abnormality is detected. It eliminates the need for cloud storage, allowing family members to directly verify the original vehicle status on their terminals. Furthermore, through encoding and end-to-end encryption, it compresses transmission bandwidth while ensuring encrypted end-to-end data transmission, ensuring that what family members see is the actual vehicle data, avoiding privacy risks and improving data reliability. In addition, family members can be notified in real time in case of driving abnormalities. Family members' terminals can receive the vehicle's camera footage and key vehicle data in real time, improving the efficiency and quality of remote monitoring.

[0048] Furthermore, the target terminal receives the virtual screen video frame, performs end-to-end decryption of the virtual screen video frame, decodes the virtual screen video frame based on a preset encoding protocol, and overlays the decoded virtual screen video frame on the target terminal.

[0049] Optionally, the virtual screen video frames can be displayed as visual icons, numerical values, or graphics. This ensures the intuitiveness of the display.

[0050] Specifically, the target terminal is the family terminal. The family terminal receives the video stream and multi-source data (i.e., virtual screen video frames) transmitted from the vehicle terminal, performs end-to-end decryption on the virtual screen video frames, decodes the H.264 / H.265 virtual screen video frames, and overlays the decrypted key vehicle data to achieve virtual screen display.

[0051] Therefore, the target terminal decodes and displays the virtual screen image, overlaying key vehicle statuses for easy and intuitive understanding.

[0052] Furthermore, the verification information for the virtual screen video frames on the vehicle side is determined; the credibility of the virtual screen video frames is verified based on the verification information. The verification information includes frame signatures and hash chains.

[0053] Specifically, the integrity and authenticity of the data are verified based on the frame signature or hash chain on the vehicle side to ensure that the data has not been tampered with, thereby achieving trustworthiness verification.

[0054] It should be noted that the target terminal stores the received virtual screen video frames locally.

[0055] Furthermore, a connection is established between the vehicle-mounted terminal and the target terminal via a pre-defined lightweight signaling channel. When the driver and / or the target vehicle is in an abnormal state, the vehicle-mounted terminal notifies the target terminal of the abnormal event corresponding to the abnormal state. The lightweight signaling channel can be WebSocket, MQTT, or Push notification, etc.

[0056] It should be noted that after the target terminal receives the abnormal event notification from the vehicle, it starts receiving virtual screen video frames.

[0057] Specifically, the vehicle and the target terminal can establish a connection through a lightweight signaling channel (WebSocket, MQTT, or Push notification), and when an abnormal state is triggered, the target terminal is notified to start receiving video streams.

[0058] Furthermore, an alternative notification mechanism other than the lightweight signaling channel is selected; the target terminal is then notified of the abnormal event based on this alternative notification mechanism. This alternative notification mechanism can be an encrypted SMS message, a one-time access token, etc.

[0059] Specifically, a backup notification mechanism can be selected to ensure reliable notification of critical events.

[0060] In summary, this application directly integrates camera footage and multi-source vehicle data with virtual screen rendering on the vehicle side, generating video frames with unified timestamps. These frames are then transmitted directly to family members' terminals via an end-to-end encrypted channel, completely bypassing the cloud and ensuring that what family members see is the actual data from the vehicle, thus enhancing data verifiability and legal evidentiary value. Through low-latency direct connection technologies such as WebRTC / QUIC, millisecond-level connection establishment and video streaming can be achieved after anomaly triggers, allowing family members' terminals to receive key vehicle status images and data almost simultaneously. This facilitates immediate judgment and intervention in high-risk scenarios such as fatigue driving and collision warnings. By avoiding cloud storage, it effectively prevents vehicle data from being stolen or misused on third-party servers. To address potential risks, H.264 / H.265 encoding combined with encryption mechanisms such as SRTP / QUIC / TLS is employed. This not only compresses transmission bandwidth but also ensures end-to-end encrypted data transmission, preventing man-in-the-middle attacks and unauthorized interception. Key data such as camera video, vehicle speed, braking status, ADAS information, and vehicle control status are overlaid on the virtual screen in real time and presented in a unified frame order. Users can intuitively understand the overall vehicle status without having to separately parse multiple data interfaces. This integrated display not only improves the user experience but also provides a complete chain of evidence for scenarios such as accident liability determination and insurance claims. By completing the integrated rendering and encoding locally on the vehicle, transmission is triggered only in abnormal situations, significantly reducing bandwidth and computational overhead during normal driving.

[0061] Figure 2 This is a structural schematic diagram of a vehicle remote monitoring device provided according to an embodiment of this application; as shown below. Figure 2 As shown, the vehicle remote monitoring device 200 of this application embodiment may specifically include: The acquisition module 201 is used to acquire multi-source vehicle data of the target vehicle at the vehicle end; wherein, the vehicle data includes at least camera video and multi-dimensional vehicle status data.

[0062] The rendering module 202 is used to select target vehicle status data from vehicle status data, overlay the camera video with the target vehicle status data for virtual screen rendering, generate corresponding virtual screen video frames, and assign a unified timestamp to the virtual screen video frames.

[0063] The transmission module 203 is used to transmit the virtual screen video frame to the target terminal in real time after end-to-end encryption through a preset communication protocol in response to detecting that the driver and / or the target vehicle is in a predefined abnormal state; wherein the target terminal includes at least a family terminal.

[0064] In one possible implementation, the apparatus further includes: The decryption module is used to perform end-to-end decryption of virtual screen video frames received by the target terminal. The display module is used to decode virtual screen video frames based on a preset encoding protocol and overlay the decoded virtual screen video frames on the target terminal.

[0065] In one possible implementation, the apparatus further includes: The determination module is used to determine the verification information of the virtual screen video frame on the vehicle side; wherein, the verification information includes frame signature and hash chain; The verification module is used to verify the credibility of virtual screen video frames based on verification information.

[0066] In one possible implementation, the apparatus further includes: The connection module is used to establish a connection between the vehicle and the target terminal through a preset lightweight signaling channel; The first notification module is used to notify the target terminal of the abnormal event corresponding to the abnormal state through the vehicle terminal when the driver and / or the target vehicle is in an abnormal state.

[0067] In one possible implementation, the apparatus further includes: The startup module is used to initiate virtual screen video frame reception after the target terminal receives an abnormal event notification from the vehicle.

[0068] In one possible implementation, the apparatus further includes: The selection module is used to select an alternative notification mechanism other than the lightweight signaling channel; The second notification module is used to notify the target terminal of the abnormal event based on the backup notification mechanism.

[0069] In one possible implementation, the apparatus further includes: The compression module is used to compress virtual screen video frames based on a preset encoding protocol.

[0070] The vehicle remote monitoring device provided in this application collects multi-source vehicle data of the target vehicle at the vehicle end, selects the target vehicle status data from the vehicle status data, overlays the camera video with the target vehicle status data for virtual screen rendering, generates corresponding virtual screen video frames, and assigns a unified timestamp to the virtual screen video frames. In response to the detection of a predefined abnormal state of the driver and / or the target vehicle, the virtual screen video frames are encrypted end-to-end using a preset communication protocol and transmitted to the target terminal in real time. This vehicle remote monitoring device generates virtual screen video frames by overlaying camera video with the target vehicle status data for virtual screen rendering, and after assigning a unified timestamp to the virtual screen video frames, it transmits them to the target terminal in real time with end-to-end encryption when an abnormality is detected. It eliminates the need for cloud storage, allowing family members to directly verify the original vehicle status on their terminals. Furthermore, through encoding and end-to-end encryption, it compresses transmission bandwidth while ensuring encrypted end-to-end data transmission, ensuring that what family members see is the actual vehicle data, avoiding privacy risks and improving data reliability. In addition, family members can be notified in real time in case of driving abnormalities. Family members' terminals can receive the vehicle's camera footage and key vehicle data in real time, improving the efficiency and quality of remote monitoring.

[0071] like Figure 3 As shown in the embodiment of this application, an electronic device 300 includes a processor 301, a memory 302, and a bus. The memory 302 stores machine-readable instructions executable by the processor 301. When the electronic device is running, the processor 301 communicates with the memory 302 via the bus, and the processor 301 executes the machine-readable instructions to perform the steps of the vehicle remote monitoring method described above.

[0072] Specifically, the memory 302 and processor 301 can be general-purpose memory and processor, without any specific limitations. When the processor 301 runs the computer program stored in the memory 302, it can execute the above-mentioned vehicle remote monitoring method.

[0073] Corresponding to the above-described vehicle remote monitoring method, this application embodiment also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the steps of the above-described vehicle remote monitoring method.

[0074] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems and devices described above can be referred to the corresponding processes in the method embodiments, and will not be repeated here. In the several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. Furthermore, multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed mutual coupling or direct coupling or communication connection can be through some communication interfaces; the indirect coupling or communication connection of devices or modules can be electrical, mechanical, or other forms.

[0075] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0076] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0077] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a processor-executable, non-volatile, computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the deployment methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0078] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for remote vehicle monitoring, characterized in that, The method includes: Collect multi-source vehicle data of the target vehicle at the vehicle end; wherein, the vehicle data includes at least camera video and multi-dimensional vehicle status data; Select the target vehicle status data from the vehicle status data, overlay the camera video with the target vehicle status data for virtual screen rendering, generate the corresponding virtual screen video frame, and assign a unified timestamp to the virtual screen video frame; In response to the detection that the driver and / or the target vehicle are in a predefined abnormal state, the virtual screen video frames are encrypted end-to-end using a preset communication protocol and then transmitted to the target terminal in real time; wherein the target terminal includes at least a family member's terminal.

2. The method according to claim 1, characterized in that, The method further includes: The target terminal receives the virtual screen video frame and performs end-to-end decryption of the virtual screen video frame; The virtual screen video frames are decoded based on a preset encoding protocol, and the decoded virtual screen video frames are overlaid and displayed on the target terminal.

3. The method according to claim 2, characterized in that, The method further includes: The vehicle-side verification information for the virtual screen video frame is determined; wherein, the verification information includes frame signature and hash chain; The credibility of the virtual screen video frame is verified based on the verification information.

4. The method according to claim 1, characterized in that, The method further includes: The vehicle terminal and the target terminal are connected through a preset lightweight signaling channel; When the driver and / or the target vehicle are in the abnormal state, the abnormal event corresponding to the abnormal state is notified to the target terminal through the vehicle terminal.

5. The method according to claim 4, characterized in that, The method further includes: After receiving the abnormal event notification from the vehicle, the target terminal starts receiving virtual screen video frames.

6. The method according to claim 5, characterized in that, The method further includes: Select an alternative notification mechanism other than the lightweight signaling channel; The abnormal event will be notified to the target terminal based on the backup notification mechanism.

7. The method according to claim 1, characterized in that, The method further includes: The virtual screen video frames are compressed based on a preset encoding protocol.

8. A vehicle remote monitoring device, characterized in that, The device includes: The acquisition module is used to acquire multi-source vehicle data of the target vehicle at the vehicle end; wherein the vehicle data includes at least camera video and multi-dimensional vehicle status data; The rendering module is used to select target vehicle status data from the vehicle status data, overlay the camera video with the target vehicle status data to perform virtual screen rendering, generate corresponding virtual screen video frames, and assign a unified timestamp to the virtual screen video frames. The transmission module is configured to, in response to detecting that the driver and / or the target vehicle is in a predefined abnormal state, encrypt the virtual screen video frames end-to-end using a preset communication protocol and transmit them to the target terminal in real time; wherein the target terminal includes at least a family member terminal.

9. An electronic device, characterized in that, include: The device includes a processor, a memory, and a bus. The memory stores machine-readable instructions executable by the processor. When the electronic device is running, the processor communicates with the memory via the bus. When the machine-readable instructions are executed by the processor, the steps of the vehicle remote monitoring method as described in any one of claims 1 to 7 are performed.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, performs the steps of the vehicle remote monitoring method as described in any one of claims 1 to 7.

Images