Data sharing method, system and device based on automobile data recorder and storage medium
By preprocessing and encrypting the dashcam data, generating target data and performing cloud-based model fusion, the problem of insufficient utilization of dashcam data is solved, and data sharing and support for multiple application scenarios are achieved.
Patent Information
- Application Number
- CN202510783241.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-06-12
- Publication Date
- 2025-09-05
AI Technical Summary
In the existing technology, scattered driving recorder data cannot fully realize the application value of its traffic data.
By preprocessing the video data of the dashcam, extracting 3D point cloud data and the first time series data, generating 4D scene data, and encrypting it, the generated target data is sent to the cloud for video reconstruction and model fusion to generate street scenes.
It improves the security and privacy of dashcam data, can generate street scenes, and supports data sharing in various application scenarios such as autonomous driving and traffic incident processing.
Smart Images
Figure CN120602631A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of data processing technology, and in particular to a data sharing method, system, device and storage medium based on a driving recorder. Background Art
[0002] Driving recorders are widely used in cars. A large number of driving recorders record a large amount of traffic data. The scattered driving recorder data cannot play its full role. How to effectively apply the traffic data recorded by driving recorders has become a problem currently faced. Summary of the Invention
[0003] In view of this, an object of the embodiments of the present invention is to provide a data sharing method, system, device and storage medium based on a driving recorder, which can fully utilize the traffic data recorded by the driving recorder to achieve data sharing.
[0004] On the one hand, an embodiment of the present invention provides a data sharing method based on a driving recorder, which is applied to a vehicle side, including:
[0005] Acquire video data and positioning data from a driving recorder, and pre-process the video data to obtain identification data and first time series data;
[0006] Extracting 3D point cloud data from the video data, and determining 4D scene data based on the 3D point cloud data and the first time series data;
[0007] The 4D scene data is encrypted according to the identification data to obtain target data; if a sharing instruction is obtained, the target data and the positioning data are sent to the cloud, so that the cloud generates a street scene according to the target data and the positioning data.
[0008] Optionally, if a non-sharing instruction is obtained, the method further includes:
[0009] A first call request instruction is obtained, and if the first call request instruction is verified to be successful, the target data is sent to the cloud.
[0010] On the other hand, an embodiment of the present invention provides a data sharing method based on a driving recorder, which is applied to the cloud, including:
[0011] Acquire a plurality of vehicle-side encrypted target data and positioning data, and perform video reconstruction based on the target data and the positioning data to obtain vehicle-side model data; the target data includes 3D point cloud data and first time series data;
[0012] Acquiring surface data, extracting point cloud data of the surface data, and constructing surface model data based on the point cloud data of the surface data; the surface data includes second time series data;
[0013] Model fusion is performed based on the vehicle-side model data and the surface model data to generate a street scene.
[0014] Optionally, performing video reconstruction based on the target data and the positioning data to obtain vehicle-side model data includes:
[0015] The target data of several vehicle ends are time-series aligned according to the first time-series data, and the target data of several vehicle ends are track-superimposed according to the positioning data to obtain vehicle-end model data.
[0016] Optionally, performing model fusion based on the vehicle-side model data and the surface model data to generate a street scene includes:
[0017] The point cloud data of the vehicle-side model data and the surface model data at the same position and time are fused to generate a street scene.
[0018] Optionally, the method further includes:
[0019] Obtaining a second call request instruction, and determining a call level and call data according to the second call request instruction;
[0020] If the call level is level one, the decrypted call data is fed back;
[0021] If the calling level is level 2, encrypted calling data is fed back.
[0022] On the other hand, an embodiment of the present invention provides a data sharing system based on a driving recorder, including a vehicle terminal and a cloud terminal connected in communication, wherein:
[0023] The vehicle side is used to execute the above-mentioned vehicle side data sharing method;
[0024] The cloud is used to execute the above-mentioned cloud data sharing method.
[0025] On the other hand, an embodiment of the present invention provides a data sharing device based on a driving recorder, comprising:
[0026] at least one processor;
[0027] at least one memory for storing at least one program;
[0028] When the at least one program is executed by the at least one processor, the at least one processor implements the above-mentioned data sharing method.
[0029] On the other hand, an embodiment of the present invention provides a computer-readable storage medium storing a program executable by a processor. When the program is executed by the processor, it is used to perform the above-mentioned data sharing method.
[0030] On the other hand, an embodiment of the present invention provides a vehicle, which includes a driving recorder and a domain controller, and the domain controller is used to execute the above-mentioned vehicle-side data sharing method.
[0031] The implementation of the embodiment of the present invention includes the following beneficial effects: the vehicle side pre-processes the video data obtained from the driving recorder to obtain identification data and first time series data, determines 4D scene data based on the 3D point cloud data and the first time series data of the video data, and encrypts the 4D scene data based on the identification data to obtain target data, thereby improving the security and privacy of the data. If a sharing instruction is obtained, the target data and positioning data are sent to the cloud; the cloud side reconstructs the video based on the encrypted target data and positioning data to obtain vehicle-side model data, extracts point cloud data of the surface data, and constructs surface model data based on the point cloud data of the surface data. Finally, the model is fused based on the vehicle-side model data and the surface model data to generate a street scene, thereby fully utilizing the traffic data recorded by the driving recorder, and generating a street scene in combination with the surface data, realizing data sharing, and facilitating use in various application scenarios, such as autonomous driving, traffic incident processing, etc. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] Figure 1 This is a structural block diagram of a data sharing system based on a driving recorder provided by an embodiment of the present invention;
[0033] Figure 2 This is a flowchart of a data sharing method based on a driving recorder applied to a vehicle side provided by an embodiment of the present invention;
[0034] Figure 3 This is a flowchart of a method for sharing data based on a driving recorder in the cloud provided by an embodiment of the present invention;
[0035] Figure 4 This is a structural block diagram of another data sharing system based on a driving recorder provided by an embodiment of the present invention;
[0036] Figure 5 This is a structural block diagram of a data sharing system based on a driving recorder applied to a vehicle side provided by an embodiment of the present invention;
[0037] Figure 6 This is a structural block diagram of a data sharing system based on a driving recorder and applied to the cloud, provided by an embodiment of the present invention;
[0038] Figure 7 This is a structural block diagram of a data sharing device based on a driving recorder provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0039] The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. The step numbers in the following embodiments are provided for ease of description only and do not limit the order of the steps. The order of execution of the steps in the embodiments can be adaptively adjusted based on the understanding of those skilled in the art.
[0040] It should be noted that, although the functional modules are divided in the device schematic diagram and the logical order is shown in the flow chart, in some cases, the steps shown or described can be performed in a different order than the module division in the device or the order in the flow chart. The terms "first", "second", etc. in the specification and claims and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or precedence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0041] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein are for the purpose of describing the embodiments of this application only and are not intended to limit this application.
[0042] Some technical terms in this embodiment are explained below.
[0043] A driving recorder (DVR) is an instrument that records images, sounds and other related information while a vehicle is driving. After installing a driving recorder, it can capture video images of the vehicle's interior and surrounding environment, including roads, traffic signs and other vehicles.
[0044] The development of smart cities has accelerated the construction of integrated vehicle-road-cloud systems, connecting people, vehicles, and roads. Both vehicle- and road-side data are processed in the cloud, and vehicle-road monitoring is achieved through the construction of virtualized road models using digital twins. Road-side data can be acquired through road monitoring equipment (cameras, speedometers, etc.) and satellite positioning, while vehicle-side data is collected through onboard sensors. Information such as vehicle speed and alarms can be directly transmitted to the cloud. However, video data collected by vehicles requires security and labeling before it can be used in the cloud.
[0045] See Figure 1 An embodiment of the present invention provides a dashcam-based data sharing system, comprising a cloud and several vehicle-based systems. The vehicle-based systems are equipped with dashcams. The dashcam data acquired by the vehicle-based systems is processed and sent to the cloud-based system. The cloud-based system generates street scenes based on the received dashcam data and surface data from the road-based system, enabling data sharing. The vehicle-based systems are also equipped with memory to store the dashcam data.
[0046] See Figure 2 The embodiment of the present invention provides a data sharing method based on a driving recorder, which is applied to a vehicle side and includes steps S110 to S130:
[0047] S110 , obtaining video data and positioning data from a driving recorder, preprocessing the video data, and obtaining identification data and first time series data.
[0048] Dashcam video data includes pedestrians, intersections, and vehicles. Preprocessing includes image recognition and classification, object detection, semantic segmentation, and text labeling, such as detecting changing dynamic objects, detecting changing traffic lights or signs, and detecting lane curvature. Labeled data refers to data in the video data that requires further processing, such as sensitive data like license plates or pedestrian faces that requires encryption or obfuscation. Labeled data includes but is not limited to 2D images or graphics. First time series data refers to the time series contained in the video data.
[0049] S120 , extracting 3D point cloud data from the video data, and determining 4D scene data according to the 3D point cloud data and the first time series data.
[0050] 3D point cloud data refers to point cloud data of video data in three-dimensional space, and 4D scene data refers to 3D point cloud data including time data. Specifically, the 3D point cloud data is calibrated according to the first time series data to determine the 4D scene data.
[0051] S130. Encrypt the 4D scene data according to the identification data to obtain target data; if a sharing instruction is obtained, send the target data and positioning data to the cloud, so that the cloud generates a street scene according to the target data and positioning data.
[0052] Encryption processing is determined by actual application and is not specifically limited in this embodiment. For example, password editing, coding, or masking can be used. Target data refers to data uploaded to the cloud. The vehicle is equipped with a function to enable / disable DVR resource sharing. If this function is enabled, DVR resources are automatically uploaded to the cloud for storage and application. If this function is disabled, DVR resources are stored only on the vehicle. If the vehicle receives a sharing command, it sends the target data and positioning data to the cloud, which then generates a street scene based on the target data and positioning data.
[0053] Optionally, if a non-sharing instruction is obtained, the method further includes:
[0054] S140: Obtain a first call request instruction. If the first call request instruction is verified to be successful, send the target data to the cloud.
[0055] A first call request is a request sent by another user to the vehicle to retrieve dashcam video data. Upon receiving the first call request, the vehicle sends it back to the vehicle owner, for example, by displaying it on the dashcam and receiving the vehicle owner's verification result. If the vehicle owner approves, the first call request is verified successfully, and the vehicle sends the target data to the cloud. If the vehicle owner disapproves, the first call request fails verification, and the vehicle sends back a request failure message.
[0056] Specifically, users who apply for information can apply for DVR information such as vehicles and pedestrians passing through the road section through the cloud. The owner's vehicle has the DVR upload function and the function is turned on, which can receive applications from other users. When other car owners apply for information on a certain road section through a third-party ecological application on the cloud, if the current resources are not met, they can feedback the requirements in the application (resource labels such as road sections and time, and the application must include a user feedback link). The cloud collects the requirements obtained by the application and locates the vehicles passing through the location during the period through road sensors, cameras, satellites, etc. (the vehicle has ordinary user permissions). When the cloud searches for such vehicles and attempts to remotely capture them but fails, it sends an application for DVR resources to the vehicle. The application is actively awakened by the third-party ecological application on the cloud to provide the owner with an operation window. If the owner agrees, the function is turned on and the DVR resources are uploaded to the public, thus completing the DVR resource request interaction between the owner, the cloud and other users.
[0057] See Figure 3 , an embodiment of the present invention provides a data sharing method based on a driving recorder, which is applied to the cloud and includes steps S210 to S230:
[0058] S210. Obtain a plurality of vehicle-side encrypted target data and positioning data, perform video reconstruction based on the target data and positioning data, and obtain vehicle-side model data; the target data includes 3D point cloud data and first time series data.
[0059] Vehicle-side model data refers to road traffic data derived from dashcam video data from multiple vehicles. After receiving the encrypted target data and positioning data from the vehicle, the cloud reconstructs the 3D point cloud data based on the positioning data and the first time series data to determine the vehicle-side model data for the same time and space.
[0060] S220 , acquiring surface data, extracting point cloud data of the surface data, and constructing surface model data according to the point cloud data of the surface data; the surface data includes second time series data.
[0061] Roadside surface data can be obtained through road monitoring equipment (cameras, speedometers, etc.) and satellite positioning. Surface model data refers to traffic-related point cloud data determined based on the surface data's point cloud data. Secondary time series data refers to the time series data of the surface data. Specifically, surface data is obtained from external or internal cloud sources, point cloud data of the surface data is extracted, and data extraction or deletion is performed on the point cloud data to construct the surface model data.
[0062] S230: Perform model fusion based on the vehicle-side model data and the surface model data to generate a street scene.
[0063] The specific operations of model fusion are determined by the actual application, including but not limited to merging identical data and enhancing complementary data. For example, digital twin technology can be used to generate virtual street scenes. These virtual street scenes can be used for navigation applications, street monitoring, and capturing user vehicle behavior data. They can also serve as a virtual vehicle testing environment, facilitating the development of advanced intelligent driving capabilities.
[0064] Cloud processing also involves classifying vehicle-side video identification. For example, when users search for roadside, they can filter by search categories such as street location, time or accident.
[0065] Optionally, video reconstruction is performed based on the target data and positioning data to obtain vehicle-side model data, including:
[0066] S211. Time-series alignment is performed on target data of several vehicle ends according to the first time-series data, and trajectory superposition is performed on target data of several vehicle ends according to the positioning data to obtain vehicle-end model data.
[0067] Specifically, target data from several vehicle ends are marked and classified according to the first time series data. In the same time series, trajectories of target data from several vehicle ends are superimposed according to the positioning data, and duplicate parts are deleted. Vehicle-end model data is obtained based on the target data after superimposing the trajectories corresponding to multiple time series data.
[0068] Optionally, a model fusion is performed based on the vehicle-side model data and the surface model data to generate a street scene, including:
[0069] S231. Fusing the point cloud data of the vehicle-side model data and the surface model data at the same location and time to generate a street scene.
[0070] The point cloud data of the vehicle-side model data and the surface model data at the same location and time are fused, the same data are merged, and different complementary data are superimposed to generate a street scene.
[0071] In a specific embodiment, the virtual environment is generated as follows:
[0072] Step 1: Align the dashcam clocks of the target data sent by the vehicle, and align the dedistorted point cloud data. Fuse multiple dashcams, such as accurate vehicle trajectory, point cloud loop detection, and point cloud and trajectory superposition, to obtain vehicle-side model data.
[0073] Step 2: Perform point cloud data extraction, downsampling, and data segmentation on the acquired surface data, and perform progressive morphological filtering based on the point cloud segmentation file to obtain surface model data.
[0074] Step 3: Semantically annotate the vehicle-side model data and the surface model data to identify key elements and record coordinate information.
[0075] Step 4: Align the vehicle-side model data and the surface model data, and complete the orthophoto base map generation, road key information extraction, and road modeling tool map drawing.
[0076] Optionally, the data sharing method based on the driving recorder further includes:
[0077] S241. Obtain a second call request instruction, and determine a call level and call data according to the second call request instruction;
[0078] S242: If the call level is level 1, the decrypted call data is fed back;
[0079] S243: If the call level is level 2, encrypted call data is fed back.
[0080] The second call request instruction refers to a video call request instruction sent by a third-party user to the cloud. The second call request instruction includes the applicant's level and the request data. Users of different levels have different permissions. Users with a call level of one have higher permissions, while users with a call level of two have lower permissions. Those skilled in the art will appreciate that the call level is determined based on actual application and can include two or more levels. For example, the security system can be set to level one, and other ordinary users can be set to level two.
[0081] Specifically, the cloud receives a second call request instruction sent by another user and determines the call level and call data based on the second call request instruction. If the call level is level 1, the cloud returns the decrypted call data to the other user; if the call level is level 2, the cloud returns the encrypted call data to the other user. It should be noted that if the vehicle is set to not share information, users of all levels must apply for DVR resources from the vehicle.
[0082] In one specific embodiment, when the vehicle-side DVR resource upload function is enabled, i.e., resource sharing, users at the first level can directly access resources from the cloud. Users at the second level view resources with a masked, encrypted layer. At this point, the first-level user has the highest priority, and the first-level user terminal obtains the masked, decrypted resources. When the vehicle-side DVR resource upload function is disabled, i.e., resource sharing is not allowed, users of all levels must apply for DVR resources from the vehicle-side. Unlike ordinary users, the resources obtained by first-level users are decrypted and not publicly available in cloud applications.
[0083] The implementation of the embodiment of the present invention includes the following beneficial effects: the vehicle side pre-processes the video data obtained from the driving recorder to obtain identification data and first time series data, determines 4D scene data based on the 3D point cloud data and the first time series data of the video data, and encrypts the 4D scene data based on the identification data to obtain target data, thereby improving the security and privacy of the data. If a sharing instruction is obtained, the target data and positioning data are sent to the cloud; the cloud side reconstructs the video based on the encrypted target data and positioning data to obtain vehicle-side model data, extracts point cloud data of the surface data, and constructs surface model data based on the point cloud data of the surface data. Finally, the model is fused based on the vehicle-side model data and the surface model data to generate a street scene, thereby fully utilizing the traffic data recorded by the driving recorder, and generating a street scene in combination with the surface data, realizing data sharing, and facilitating use in various application scenarios, such as autonomous driving, traffic incident processing, etc.
[0084] See Figure 1 , an embodiment of the present invention provides a data sharing system based on a driving recorder, including a vehicle side and a cloud side connected in communication, wherein,
[0085] A vehicle side, configured to execute the above-mentioned vehicle side data sharing method;
[0086] A cloud is used to execute the above-mentioned cloud data sharing method.
[0087] The vehicle side includes a domain controller and a memory. The domain controller can be a vehicle-integrated domain controller, or a separate high-level driving assistance domain controller (HAD, Highly Autonomous Driving) and cockpit domain controller (CSC, Cockpit Domain Controller). In a specific embodiment, see Figure 4 The vehicle side includes a high-level driving assistance domain controller (HAD) and a cockpit domain controller (CSC). The high-level driving assistance domain controller (HAD) performs DVR image information classification, sensitive encryption and other processing. After processing, it is uploaded to the cockpit domain controller (CSC), which then forwards it to the cloud for a second time.
[0088] The cloud includes but is not limited to the local area network and the public network. The cloud communicates with the vehicle through the local area network, and the cloud stores and applies DVR resources through the public network.
[0089] In one specific embodiment, during the vehicle-side information classification process, the coded or marked area information can be filtered and processed in conjunction with the emotion information from the driver monitoring system (DMS) and occupant monitoring system (OMS), adding flexible processing methods. For example, if the radar or camera captures an object that is not within the classification range but causes emotional fluctuations in the vehicle occupant, this can be recorded as an additional annotation. Repeated data capture or big data training can be performed. Subsequently, the types of information classification can be increased, enhancing vehicle monitoring safety and indirectly influencing the judgment logic of autonomous emergency braking (AEB). Generally, vehicles equipped with DMS and OMS components are equipped with vehicle occupant emotion recognition functions with clear signals and values. If the vehicle-side DVR resource does not recognize the labeled information according to the classification, but the vehicle-side DMS / OMS repeatedly recognizes the occupant's emotion signals and value fluctuations, the image of this period is sliced and uploaded to the cloud. The cloud can then use data training methods such as AI and big data models to identify the repeatedly occurring unlabeled scenes, objects, and other content. Such methods can indirectly increase the strategic classification of vehicle-side DVR processing and enhance DVR road condition monitoring.
[0090] It can be seen that the contents of the above method embodiments are all applicable to the present system embodiments. The functions specifically implemented by the present system embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.
[0091] See Figure 5 The embodiment of the present invention provides a data sharing system based on a driving recorder, which is applied to a vehicle side and includes:
[0092] The first module is used to obtain video data and positioning data of the driving recorder, pre-process the video data, and obtain identification data and first time series data;
[0093] The second module is used to extract 3D point cloud data from the video data and determine 4D scene data based on the 3D point cloud data and the first time series data;
[0094] The third module is used to encrypt the 4D scene data according to the identification data to obtain the target data; if a sharing instruction is obtained, the target data and positioning data are sent to the cloud, so that the cloud generates a street scene based on the target data and positioning data.
[0095] See Figure 6 The embodiment of the present invention provides a data sharing system based on a driving recorder, which is applied to the cloud and includes:
[0096] The fourth module is used to obtain a number of encrypted target data and positioning data on the vehicle side, perform video reconstruction based on the target data and positioning data, and obtain vehicle side model data; the target data includes 3D point cloud data and first time series data;
[0097] A fifth module is configured to acquire surface data, extract point cloud data of the surface data, and construct surface model data based on the point cloud data of the surface data; the surface data includes second time series data;
[0098] The sixth module is used to perform model fusion based on vehicle-side model data and surface model data to generate street scenes.
[0099] It can be seen that the contents of the above method embodiments are all applicable to the present system embodiments. The functions specifically implemented by the present system embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.
[0100] See Figure 7 The embodiment of the present invention provides a data sharing device based on a driving recorder, comprising:
[0101] at least one processor;
[0102] at least one memory for storing at least one program;
[0103] When at least one program is executed by at least one processor, the at least one processor implements the above-mentioned data sharing method.
[0104] Among them, the memory is a non-transient computer-readable storage medium that can be used to store non-transient software programs and non-transient computer executable programs. The memory may include a high-speed random access memory and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory optionally includes a remote memory remotely arranged relative to the processor, and these remote memories can be connected to the processor via a network. Examples of the above-mentioned network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network and a combination thereof.
[0105] It can be seen that the contents of the above method embodiments are all applicable to the present device embodiments. The functions specifically implemented by the present device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.
[0106] In addition, embodiments of the present application further disclose a computer program product or computer program, which is stored in a computer-readable storage medium. A processor of a computer device can read the computer program from the computer-readable storage medium and execute the computer program, causing the computer device to perform the above-described method.
[0107] An embodiment of the present invention further provides a computer-readable storage medium storing a program executable by a processor. When executed by the processor, the program is used to implement the above-described method. Similarly, the contents of the above-described method embodiment are applicable to the present storage medium embodiment. The functions implemented by the present storage medium embodiment are the same as those of the above-described method embodiment, and the beneficial effects achieved are also the same as those achieved by the above-described method embodiment.
[0108] It is understood that all or some steps, systems in the disclosed method above can be implemented as software, firmware, hardware and appropriate combinations thereof. Some physical components or all physical components can be implemented as software by a processor, such as a central processing unit, a digital signal processor or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application specific integrated circuit. Such software can be distributed on a computer-readable medium, and the computer-readable medium can include computer storage media (or non-transitory media) and communication media (or temporary media). As known to those of ordinary skill in the art, the term computer storage medium is included in any method or technology for storing information (such as computer-readable instructions, data structures, program modules or other data) and is volatile and non-volatile, removable and non-removable media. Computer storage media includes but is not limited to RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassette, magnetic tape, disk storage or other magnetic storage device, or can be used to store desired information and any other medium that can be accessed by a computer. Furthermore, as is well known to those skilled in the art, communication media typically embodies computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.
[0109] In another aspect, an embodiment of the present invention provides a vehicle comprising a driving recorder and a domain controller, wherein the domain controller is configured to execute the vehicle-side data sharing method described above. Specifically, the vehicle can be a private vehicle, such as a sedan, SUV, MPV, or pickup truck. The vehicle can also be an operating vehicle, such as a van, bus, small truck, or large trailer. The vehicle can be a gasoline vehicle or a new energy vehicle. When the vehicle is a new energy vehicle, it can be a hybrid vehicle or a pure electric vehicle.
[0110] It should be understood that in this application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.
[0111] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.
[0112] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.
[0113] The above is a specific description of the preferred implementation of the present invention, but the invention is not limited to the embodiments. Those skilled in the art can make various equivalent modifications or substitutions without violating the spirit of the present invention. These equivalent modifications or substitutions are all included in the scope defined by the claims of this application.
Claims
1. A data sharing method based on a driving recorder, characterized in that: Applied to vehicle side, including: Acquire video data and positioning data from a driving recorder, and pre-process the video data to obtain identification data and first time series data; Extracting 3D point cloud data from the video data, and determining 4D scene data based on the 3D point cloud data and the first time series data; The 4D scene data is encrypted according to the identification data to obtain target data; if a sharing instruction is obtained, the target data and the positioning data are sent to the cloud, so that the cloud generates a street scene according to the target data and the positioning data.
2. The method according to claim 1, characterized in that If a non-sharing instruction is obtained, the method further includes: A first call request instruction is obtained, and if the first call request instruction is verified to be successful, the target data is sent to the cloud.
3. A data sharing method based on a driving recorder, characterized in that: Applied to the cloud, including: Acquire a plurality of vehicle-side encrypted target data and positioning data, and perform video reconstruction based on the target data and the positioning data to obtain vehicle-side model data; the target data includes 3D point cloud data and first time series data; Acquiring surface data, extracting point cloud data of the surface data, and constructing surface model data based on the point cloud data of the surface data; the surface data includes second time series data; Model fusion is performed based on the vehicle-side model data and the surface model data to generate a street scene.
4. The method according to claim 3, characterized in that The video reconstruction is performed based on the target data and the positioning data to obtain vehicle-side model data, including: The target data of several vehicle ends are time-series aligned according to the first time-series data, and the target data of several vehicle ends are track-superimposed according to the positioning data to obtain vehicle-end model data.
5. The method according to claim 3, characterized in that Performing model fusion based on the vehicle-side model data and the surface model data to generate a street scene includes: The point cloud data of the vehicle-side model data and the surface model data at the same position and time are fused to generate a street scene.
6. The method according to claim 3, characterized in that The method further comprises: Obtaining a second call request instruction, and determining a call level and call data according to the second call request instruction; If the call level is level one, the decrypted call data is fed back; If the calling level is level 2, encrypted calling data is fed back.
7. A data sharing system based on a driving recorder, characterized in that: Including the vehicle side and the cloud side of the communication connection, among which, The vehicle end is used to perform the method according to any one of claims 1-2; The cloud is used to execute the method according to any one of claims 3 to 6.
8. A data sharing device based on a driving recorder, characterized in that: include: at least one processor; at least one memory for storing at least one program; When the at least one program is executed by the at least one processor, the at least one processor implements the method according to any one of claims 1 to 6.
9. A computer-readable storage medium storing a program executable by a processor, characterized in that: The processor-executable program is configured to perform the method according to any one of claims 1 to 6 when executed by the processor.
10. A vehicle, characterized in that: The vehicle includes a driving recorder and a domain controller, and the domain controller is used to execute the method according to any one of claims 1-2.