Vehicle and communication system

Abstract

The present application relates to the field of vehicles. Provided are a vehicle and a communication system. The vehicle comprises a plurality of environment perception sensors, a sensor management apparatus and a plurality of vehicle-mounted functional modules. Each environment perception sensor is used for collecting data of the surrounding environment of the vehicle and outputting perception data. The sensor management apparatus is directly connected to the plurality of environment perception sensors, so as to implement decoupling between the environment perception sensors and the vehicle-mounted functional modules in the vehicle. The sensor management apparatus uniformly manages the perception data from the environment perception sensors, and the sensor management apparatus can, in response to a data request from any one of the plurality of vehicle-mounted functional modules, store or output first data. The data request is related to a target environment perception sensor, and the first data is related to the perception data from the target environment perception sensor. Therefore, when the vehicle processes (stores or outputs) the first data, irrelevant vehicle modules can be prevented from being started, thereby reducing unnecessary power waste of the vehicle.

Description

Vehicle and communication system

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on March 26, 2024, with application number 202410357278.8 and invention name “A Vehicle and Communication System”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the field of vehicles, and in particular to a vehicle and a communication system. Background Art

[0003] Upper-level applications such as autonomous driving, assisted driving, driving recorders, Sentry Mode (parking monitoring), and smart vehicle search require video data from cameras. Some applications utilize independent cameras installed outside the vehicle, with different cameras integrated into different vehicle modules. For example, a surround-view camera is integrated into the autonomous driving module for autonomous driving applications, a forward-facing camera is integrated into the intelligent cockpit module for driving recorders, and a rearview camera is integrated into the intelligent cockpit module for reverse imaging and driver assistance.

[0004] Some applications complete their tasks by requesting to reuse video data from dedicated cameras in other applications. For example, in Sentry Mode, it is desirable to use video data from all external cameras (including surround-view cameras, front-view cameras, and rear-view cameras) for environmental monitoring. However, due to the high degree of coupling between cameras and vehicle modules, when Sentry Mode acquires camera data, vehicle modules that are strongly bound to the cameras are also activated. For example, when using surround-view camera video data, the autonomous driving module is activated, wasting vehicle power. Summary of the Invention

[0005] The present application provides a vehicle and communication system, which decouples the environmental perception sensors and on-board functional modules in the vehicle and sets a sensor management device to uniformly manage the perception data of the environmental perception sensors. When the on-board functional modules request to process relevant data of the sensors, irrelevant vehicle modules can be prevented from being started, thereby reducing unnecessary power waste in the vehicle.

[0006] In a first aspect, the present application provides a vehicle comprising a plurality of environment perception sensors, a sensor management device, and a plurality of vehicle-mounted functional modules.

[0007] Each of the multiple environmental perception sensors is configured to collect data about the vehicle's surrounding environment and output the perception data. A sensor management device is directly connected to the multiple environmental perception sensors and configured to obtain the perception data from the multiple environmental perception sensors. The sensor management device is further configured to respond to a data request sent by a first onboard functional module and store or output first data. The first onboard functional module is any one of the multiple onboard functional modules. The data request is associated with a target environmental perception sensor, and the first data is associated with the perception data from the target environmental perception sensor.

[0008] In this application, the sensor management device is directly connected to multiple environmental perception sensors to decouple the environmental perception sensors and on-board functional modules in the vehicle, and a sensor management device is set to uniformly manage the perception data of the environmental perception sensors. The sensor management device responds to the data request of the first on-board functional module and stores or outputs the first data; in this way, the vehicle can avoid irrelevant vehicle modules from being started when processing (storing or outputting) the first data, thereby reducing unnecessary power waste in the vehicle.

[0009] In one possible implementation of the first aspect, in the vehicle, the sensor management device and the plurality of onboard functional modules are separately provided. Furthermore, the plurality of onboard functional modules include at least one of the following: an intelligent driving domain controller, a cockpit domain controller, or a communication unit, the communication unit being configured to connect the vehicle to the first device.

[0010] In this application, the sensor management device and multiple vehicle-mounted functional modules are set separately, which can ensure that the environmental perception sensors and vehicle-mounted functional modules in the vehicle are decoupled.

[0011] In one possible implementation of the first aspect, the multiple in-vehicle functional modules include an intelligent driving domain controller and a cockpit domain controller. Furthermore, the sensor management device is further configured to respond to a first data request sent by the intelligent driving domain controller and store or output the first data. The sensor management device is further configured to respond to a second data request sent by the cockpit domain controller and store or output the first data. Both the first data request and the second data request are related to the target environment perception sensor.

[0012] In this application, both the intelligent driving domain controller and the cockpit domain controller can send a data request to the sensor management device to cause the sensor management device to store or output the first data. For example, when the sensor management device outputs the first data, the intelligent driving domain controller or the cockpit domain controller obtains the first data from the sensor management device.

[0013] In a possible implementation of the first aspect, the above-mentioned multiple vehicle-mounted functional modules include an intelligent driving domain controller, which is connected to all or part of the multiple environmental perception sensors and obtains perception data from all or part of the sensors.

[0014] In this application, the intelligent driving domain controller can be directly connected to all or part of the environmental perception sensors to directly obtain the sensor's perception data, ensuring higher security and credibility of the perception data, and can respond to data acquisition with low latency.

[0015] In one possible implementation of the first aspect, the vehicle further includes a first power supply unit configured to independently power the sensor management device and the plurality of environmental perception sensors when the vehicle is powered off. Furthermore, when the vehicle is powered off, at least one of the plurality of onboard functional modules is powered off.

[0016] In this application, a vehicle is provided with a first power supply unit to independently power the environment perception sensor and the sensor management device when the vehicle is powered off. Thus, when the vehicle is powered off, the environment perception sensor and the sensor management device can still sense the vehicle's surrounding environment to obtain first data, and output or store the first data. This not only enables environmental perception when the vehicle is powered off, but also prevents at least one onboard functional module from being activated when the vehicle is powered off, thereby reducing unnecessary power waste in the vehicle.

[0017] In one possible implementation of the first aspect, the vehicle further includes a second power supply unit configured to supply power to the vehicle when the vehicle is powered on. In the present application, the vehicle is further provided with a second power supply unit configured to supply power to the vehicle when the vehicle is powered on, i.e., to supply power to all parts of the vehicle requiring electrical energy, including the environmental perception sensors and the sensor management device. In other words, the first power supply unit does not supply power when the vehicle is powered on.

[0018] In a possible implementation of the first aspect, the data request includes vehicle-mounted application information that triggers the data request in the first vehicle-mounted functional module, and the vehicle-mounted application information corresponds to the target environment perception sensor.

[0019] In the present application, when the sensor management device receives the data request from the first vehicle-mounted functional module, it can determine the corresponding target environment perception sensor based on the above correspondence.

[0020] In a possible implementation of the first aspect, the data request includes first information, and the first information is used to indicate a target environment perception sensor. The sensor management device can directly determine the target environment perception sensor according to the data request.

[0021] In a possible implementation of the first aspect, the sensor management device is further configured to store, when a first accident occurs to the vehicle, perception data of the environment perception sensor corresponding to the first accident.

[0022] In this application, when a vehicle has a first accident, the sensor management device can quickly respond and store the perception data of the environmental perception sensor corresponding to the first accident to prevent the loss of perception data when the accident occurs, so as to facilitate subsequent investigation into the cause of the accident.

[0023] In one possible implementation of the first aspect, the sensor management device is further configured to, when a first accident occurs on the vehicle, generate video data of the first accident based on perception data from an environmental perception sensor corresponding to the first accident, the video data of the first accident including location information of the first accident. The sensor management device is further configured to transmit the video data of the first accident to the first device.

[0024] In the present application, when a vehicle has a first accident, the above-mentioned sensor management device will generate video data of the first accident with accident location information, and send the video data to the first device, so that the first device can be informed that the vehicle has had a first accident and quickly respond to the accident. For example, the first device issues an alarm based on the video data of the first accident, and / or the first device pushes the video data of the first accident to relevant users (such as the owner of the vehicle, or the owner's emergency contact, etc.) so that the first accident can be handled in a timely manner to ensure the safety of the vehicle and the driver.

[0025] In a possible implementation of the first aspect, the sensor management device is further configured to perform parking environment monitoring and generate environment monitoring results based on perception data from the target environment perception sensor when the vehicle is powered off.

[0026] In this application, when the vehicle is powered off, the sensor management device has an independent power supply and can perform parking environment monitoring and processing based on the perception data from the target environment perception sensor and generate environmental monitoring results, which can not only avoid unnecessary power waste of the vehicle, but also monitor the surrounding environment when the vehicle is powered off.

[0027] In a possible implementation of the first aspect, the sensor management device is further configured to store perception data from the target environment perception sensor when the environment monitoring result indicates that the vehicle has a second accident.

[0028] In the present application, in the event of a second accident involving the vehicle, the sensor management device can quickly respond and store the perception data of the target environment perception sensor to prevent the loss of perception data when the accident occurs, facilitating subsequent investigation into the cause of the accident.

[0029] In one possible implementation of the first aspect, the sensor management device is further configured to generate video data of the second accident based on perception data from the target environment perception sensor when the environmental monitoring results indicate that the vehicle has experienced a second accident. The video data of the second accident includes location information of the second accident. The sensor management device is further configured to transmit the video data of the second accident to the first device.

[0030] In the present application, in the event that a second accident occurs to the vehicle, the above-mentioned sensor management device will generate video data of the second accident with accident location information, and send the video data to the first device, so that the first device can be informed that a second accident has occurred to the vehicle and quickly respond to the accident. For example, the first device issues an alarm based on the video data of the second accident, and / or the first device pushes the video data of the second accident to relevant users (such as the vehicle owner, or the vehicle owner's emergency contact, etc.) so that the second accident can be handled in a timely manner to ensure the safety of the vehicle and the driver.

[0031] In a second aspect, the present application also provides a communication system comprising the vehicle of the first aspect.

[0032] On the third aspect, the present application also provides a sensor management method, which is applied to a sensor management device in a vehicle, and the vehicle also includes multiple environmental perception sensors and multiple vehicle-mounted functional modules. Each of the multiple environmental perception sensors is used to collect the surrounding environment data of the vehicle and output perception data. The sensor management device is directly connected to the multiple environmental perception sensors. The above-mentioned sensor management method includes the following steps: receiving a data request sent by a first vehicle-mounted functional module. The first vehicle-mounted functional module is any one of the multiple vehicle-mounted functional modules. The above-mentioned data request is related to the target environmental perception sensor. In response to the above-mentioned data request, the first data is stored or output. The above-mentioned first data is related to the perception data from the target environmental perception sensor.

[0033] In this application, because the sensor management device is directly connected to multiple environmental perception sensors, the environmental perception sensors in the vehicle are decoupled from the onboard functional modules, allowing the sensor management device to centrally manage the perception data of the vehicle's environmental perception sensors. Specifically, the sensor management device can respond to a data request from a first onboard functional module and store or output the first data. This allows the vehicle to avoid activating unrelated vehicle modules while processing (storing or outputting) the first data, thereby reducing unnecessary power waste in the vehicle.

[0034] In a fourth aspect, the present application also provides a data acquisition method, which is applied to a first vehicle-mounted functional module in a vehicle, and the vehicle also includes multiple environmental perception sensors, a sensor management device and multiple vehicle-mounted functional modules. Among them, the first vehicle-mounted functional module is any one of the multiple vehicle-mounted functional modules. Each of the multiple environmental perception sensors is used to collect the surrounding environment data of the vehicle and output perception data. The sensor management device is directly connected to the multiple environmental perception sensors. The above-mentioned data acquisition method includes the following steps: sending a data request to the sensor management device. The above-mentioned data request is related to the target environmental perception sensor. Receiving first data from the sensor management device. The above-mentioned first data is related to the perception data from the target environmental perception sensor.

[0035] In this application, because the sensor management device is directly connected to multiple environmental perception sensors, the environmental perception sensors in the vehicle are decoupled from the onboard functional modules. This allows the sensor management device to centrally manage the perception data from the vehicle's environmental perception sensors. Specifically, the sensor management device can output first data in response to a data request from a first onboard functional module. This prevents unrelated vehicle modules from being activated when the first onboard functional module acquires the first data, thus reducing unnecessary power waste in the vehicle.

[0036] In a fifth aspect, the present application further provides a sensor management device, comprising a unit or module for executing the sensor management method described in the third aspect.

[0037] In a sixth aspect, the present application further provides a data acquisition device, comprising a unit or module for executing the data acquisition method described in the fourth aspect.

[0038] In the seventh aspect, the present application also provides a vehicle comprising the device described in the fifth aspect or the sixth aspect.

[0039] In an eighth aspect, the present application also provides a communication device comprising a processor and a memory, wherein the processor and the memory are connected, wherein the memory is used to store program code, and the processor is used to call the program code to execute the method described in the third aspect or the fourth aspect.

[0040] In a ninth aspect, the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement the method as described in the third aspect or the fourth aspect.

[0041] In a tenth aspect, the present application further provides a computer program product comprising instructions, which, when run on a computer, enables the computer to execute the method described in the third aspect or the fourth aspect.

[0042] In the eleventh aspect, the present application also provides a chip, which includes a processor and a data interface, and the processor reads instructions stored in the memory through the data interface to execute the method described in the third aspect or the fourth aspect.

[0043] Optionally, as an implementation method, the chip may further include a memory, in which instructions are stored, and the processor is used to execute the instructions stored on the memory. When the instructions are executed, the processor is used to execute the method described in the third aspect or the fourth aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The following is an introduction to the drawings used in the embodiments of this application.

[0045] FIG1 is a schematic structural diagram of a vehicle provided in an embodiment of the present application;

[0046] FIG2 is a schematic diagram of the structure of a communication system provided in an embodiment of the present application;

[0047] FIG3A is a schematic diagram of an internal interaction process of a vehicle provided by an embodiment of the present application;

[0048] FIG3B is a schematic diagram of another internal interaction process of a vehicle provided by an embodiment of the present application;

[0049] FIG3C is a schematic diagram of another internal interaction process of a vehicle provided by an embodiment of the present application;

[0050] FIG3D is a schematic diagram of another internal interaction process of a vehicle provided by an embodiment of the present application;

[0051] FIG3E is a schematic diagram of another internal interaction process of a vehicle provided by an embodiment of the present application;

[0052] FIG3F is a schematic diagram of another internal interaction process of a vehicle provided by an embodiment of the present application;

[0053] FIG4 is a flow chart of a data acquisition method provided in an embodiment of the present application;

[0054] FIG5 is a schematic structural diagram of a sensor management device provided in an embodiment of the present application;

[0055] FIG6 is a schematic structural diagram of a data acquisition device provided in an embodiment of the present application;

[0056] FIG7 is a schematic structural diagram of a communication device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0057] The technical solution in this application will be described below with reference to the accompanying drawings.

[0058] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described in this application as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0059] The "at least one" mentioned in the embodiments of this application refers to one or more, and "plurality" refers to two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can be represented by: a, b, c, (a and b), (a and c), (b and c), or (a and b and c), where a, b, c can be single or multiple. "And / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can be represented by: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. The serial numbers of the steps in the embodiments of this application (such as step S1, step S21, etc.) are only for distinguishing different steps and do not limit the order of execution between the steps.

[0060] Furthermore, unless otherwise specified, ordinal numbers such as "first" and "second" in the embodiments of this application are used to distinguish multiple objects and are not used to limit the order, timing, priority, or importance of multiple objects. For example, the first device and the second device are only for ease of description and do not indicate differences in structure, importance, etc. between the first and second devices. In some embodiments, the first device and the second device can also be the same device.

[0061] In the above embodiments, the term "when" can be interpreted to mean "if...", "after...", "in response to determining...", or "in response to detecting...", depending on the context. The above are merely optional embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the concepts and principles of the present application shall be included in the scope of protection of the present application.

[0062] To facilitate understanding, the following first introduces relevant terms and other related concepts involved in the embodiments of this application.

[0063] (1) Domain Controller

[0064] Based on the centralized functional partitioning, the vehicle electronic control system can be divided into the power domain (safety), chassis domain (vehicle motion), cockpit domain (entertainment information), autonomous driving domain (driving assistance) and body domain (body electronics), corresponding to the power domain controller, chassis domain controller, cockpit domain controller (CDC), autonomous driving domain controller and body domain controller respectively.

[0065] Exemplarily, the power domain is used for the optimization and control of the powertrain, while also having functions such as electrical intelligent fault diagnosis, intelligent power saving, and bus communication. The chassis domain is used to integrate the vehicle's lateral, longitudinal, and vertical control functions such as braking, steering, and suspension to achieve integrated control. The cockpit domain is used to integrate cockpit electronics such as head-up display, instrumentation, and in-vehicle infotainment to achieve one-chip multi-screen. The autonomous driving domain is used to enable the vehicle to have multi-sensor fusion, positioning, path planning, decision control, image recognition, high-speed communication, data processing, and other capabilities. The body domain is used to integrate the functions of the body controller and air-conditioning damper control, tire pressure monitoring, PEPS, gateway, and other functions. As another example, the body domain can be integrated with the cockpit domain.

[0066] The cockpit domain controller can also be called a cockpit domain control module. The autonomous driving domain controller can also be called an autonomous driving module, an intelligent driving domain controller, or an intelligent driving computing platform. The intelligent driving computing platform can be translated as a mobile data center (MDC) or a motion domain controller (MDC).

[0067] (2) Vehicles

[0068] Vehicles refer to various land transportation vehicles, including cars, electric vehicles, trucks, buses, etc.

[0069] Exemplarily, the vehicle includes an environmental perception sensor, a domain controller, a communication unit, and a positioning module, wherein the environmental perception sensor includes one or more of the following devices: at least one millimeter-wave radar, at least one lidar, and at least one camera.

[0070] Millimeter-wave radar is a radar that operates in the millimeter wave band (Millimeter Wave) and is used to collect the transmission time and speed of a light beam reaching an obstacle; or to calculate the distance, speed, and other data of surrounding obstacles after collecting the transmission time and speed of the light beam.

[0071] LiDAR is a radar system that uses laser beams to detect a target's position, velocity, and other characteristic parameters. It operates by transmitting a detection signal (a laser beam) toward the target and then comparing the received signal reflected from the target (the target echo) with the transmitted signal. After appropriate processing, relevant target data such as distance, direction, altitude, velocity, attitude, and even shape can be obtained.

[0072] The camera is used to collect surrounding images or videos. When the camera is a smart camera, the camera can collect images or videos and analyze the images or videos to obtain the speed and distance of surrounding obstacles.

[0073] For example, in an embodiment of the present application, the camera includes any camera installed at any position of the vehicle, such as the front, left front, left rear, right front, right rear, rear, etc. of the vehicle. For example, an infrared camera installed at the front of the vehicle for acquiring infrared images / videos is used, for example, in a nighttime assisted driving system; a front-view camera installed at the front of the vehicle is responsible for acquiring images / videos of objects in front of the vehicle (road conditions and environment, etc.), for example, in an autonomous driving application; a rear-view camera installed at the rear of the vehicle is responsible for acquiring images / videos of objects behind the vehicle (road conditions and environment, etc.), for example, in a reversing image application; and a surround-view camera for capturing a field of view greater than or equal to 180 degrees, which can obtain panoramic images / videos, for example, in an assisted driving system (such as providing the driver with a full range of vision). The surround-view camera can be implemented using a wide-angle or fisheye camera, etc.

[0074] (3) Sentinel Mode

[0075] Sentry (Clairvoyance) mode is a safety feature built into smart connected vehicles based on the vehicle's existing sensors, cameras and other hardware. It helps drivers obtain real-time vehicle safety information when leaving the vehicle, automatically collects and records images around the vehicle, and sends alerts to the driver's mobile phone. Car owners can use their mobile phones to control the vehicle's horn, flashing lights, and remote voice functions.

[0076] Various applications are integrated into the vehicle, such as autonomous driving, driving recorder, sentry mode, and smart vehicle search. These high-level applications rely on camera video data to function. Some of these applications utilize independent cameras installed outside the vehicle, with different cameras integrated into different vehicle modules. For example, a surround-view camera is integrated into the autonomous driving module for autonomous driving applications, a forward-facing camera is integrated into the intelligent cockpit module for driving recorder, and a rearview camera is integrated into the intelligent cockpit module for reverse imaging and driver assistance.

[0077] Additionally, some applications complete their tasks by requesting to reuse video data from dedicated cameras used by other applications. For example, in Sentry Mode, it is desirable to use video data from all external cameras (including surround-view cameras, front-view cameras, and rear-view cameras) for environmental monitoring. However, due to the high degree of coupling between cameras and vehicle modules, when Sentry Mode acquires camera data, vehicle modules that are strongly bound to the cameras are also activated. For example, when using surround-view camera video data, the autonomous driving module is activated, wasting vehicle power.

[0078] Therefore, an embodiment of the present application provides a vehicle, which includes a plurality of environmental perception sensors, a sensor management device and a plurality of vehicle-mounted functional modules. In the vehicle, the sensor management device is directly connected to the plurality of environmental perception sensors to achieve decoupling of the environmental perception sensors and the vehicle-mounted functional modules in the vehicle, and a sensor management device is provided to uniformly manage the perception data of the environmental perception sensors, and the sensor management device responds to the data request of the first vehicle-mounted functional module to store or output the first data. In this way, the vehicle can avoid irrelevant vehicle modules from being started when processing (storing or outputting) the first data, thereby reducing unnecessary power waste of the vehicle. The first vehicle-mounted functional module is any one of the plurality of vehicle-mounted functional modules. The above-mentioned data request is related to the target environmental perception sensor, and the above-mentioned first data is related to the perception data from the target environmental perception sensor.

[0079] In addition, the present invention also provides a sensor management method, which is applied to the sensor management device in the above vehicle. The sensor management method can be executed by the sensor management device or a chip in the sensor management device.

[0080] In addition, embodiments of the present application further provide a data acquisition method, applicable to the first vehicle-mounted functional module. The data acquisition method may be performed by a data acquisition device or a chip within the data acquisition device. For example, the data acquisition device may be the first vehicle-mounted functional module, etc.

[0081] The vehicle provided in this application is described in detail below.

[0082] Referring to FIG. 1 , FIG. 1 is a schematic diagram of the structure of a vehicle provided in an embodiment of the present application. Vehicle 101 includes multiple environmental perception sensors, a sensor management device 102, and multiple on-board functional modules. The multiple environmental perception sensors may be N environmental perception sensors, where N is a positive integer and N is greater than or equal to two, such as environmental perception sensor 1, environmental perception sensor 2, and environmental perception sensor 3. The multiple on-board functional modules may be M on-board functional modules, where M is a positive integer and M is greater than or equal to two, such as on-board functional module 1 and on-board functional module 2.

[0083] The sensor management device 102 is directly connected to multiple environmental perception sensors. Each of the multiple environmental perception sensors is used to collect data about the vehicle's surrounding environment and output perception data. The environmental perception sensor can be at least one of the following: at least one millimeter-wave radar, at least one lidar, or at least one camera. The at least one camera can be at least one of the following: a front-view camera, a rear-view camera, a left-view camera, a right-view camera, a surround-view camera, or an infrared camera.

[0084] The sensor management device is configured to obtain perception data from multiple environmental perception sensors. A first vehicle-mounted functional module is configured to send a data request to the sensor management device. The first vehicle-mounted functional module is any one of the multiple vehicle-mounted functional modules. The data request is associated with a target environmental perception sensor. The sensor management device is further configured to store or output first data in response to the data request sent by the first vehicle-mounted functional module.

[0085] The first data is related to the perception data from the target environment perception sensor. For example, the first data can be the perception data of the target environment perception sensor itself, or it can be data processed based on the perception data of the target environment perception sensor, for example, the perception data of the target environment perception sensor is processed by perspective combination, perspective splitting, frame rate adjustment, cropping, or removal of sensitive information (desensitization).

[0086] Exemplarily, storing the first data means storing the first data in any storage location in the vehicle. Outputting the first data means transmitting the first data to another module or other device (such as a first device) in the vehicle. In the embodiment of the present application, the first device may be a remote device such as a server.

[0087] Exemplarily, the first vehicle-mounted functional module is further configured to receive first data from the sensor management device.

[0088] In the embodiment of the present application, the sensor management device is directly connected to a plurality of environmental perception sensors to decouple the environmental perception sensors and the on-board functional modules in the vehicle, and the increase and decrease of environmental perception sensors are easy to achieve; and a sensor management device is provided to uniformly manage the perception data of the environmental perception sensors, and the sensor management device responds to the data request of the first on-board functional module and stores or outputs the first data; in this way, the vehicle can avoid irrelevant vehicle modules from being started when processing (storing or outputting) the first data, which can effectively reduce unnecessary power waste of the vehicle. For example, in the vehicle of the embodiment of the present application, when obtaining camera data in sentry mode, the cockpit domain controller can directly request the camera data from the sensor management device, and there is no need to start the automatic driving module, thereby avoiding power waste of the vehicle.

[0089] For example, referring to FIG. 2 , FIG. 2 is a schematic diagram of the structure of a communication system provided in an embodiment of the present application. In FIG. 2 , the communication system includes a vehicle 101 and a first device 201. The environmental perception sensors included in vehicle 101 include a front-view camera, a surround-view camera, a rear-view camera, a lidar, and an infrared camera. The specific number of each environmental perception sensor can be set according to actual conditions and is not limited.

[0090] In one possible implementation, in the above-mentioned vehicle, the sensor management device and the multiple on-board functional modules are separately provided. Moreover, the multiple on-board functional modules include at least one of the following: an intelligent driving domain controller MDC, a cockpit domain controller CDC or a communication unit, and the communication unit is used to connect the vehicle to the first device. The on-board functional module can also be other vehicle modules that need to obtain the first data, without limitation. In an embodiment of the present application, the sensor management device can be a physical device, and the sensor management device and the multiple on-board functional modules are separately provided in hardware, which can ensure that the environmental perception sensors and the on-board functional modules in the vehicle are decoupled.

[0091] Exemplarily, the above-mentioned communication units include a telematics box (TBOX), Bluetooth, Near Link, a wireless fidelity (Wi-Fi) network, and the like.

[0092] Referring to Figure 2, the vehicle-mounted functional module 202 takes the intelligent driving domain controller MDC and the cockpit domain controller CDC as examples, and applications such as automatic / assisted driving are integrated in the intelligent driving domain controller MDC. Business applications such as driving records, accident records, reversing images, surround-view images, car search applications, parking environment records, sentry mode (parking environment monitoring / alarm) are all integrated in the cockpit domain controller CDC. When the above applications need to obtain the first data, they apply to the sensor management device 102 in a unified manner. Exemplarily, the sensor management device 102 includes a first interface, and the first interface is used to receive a data request sent by the first vehicle-mounted functional module. In an embodiment of the present application, data requests are made by applying a unified interface to facilitate centralized management of data requests.

[0093] The embodiment of the present application decouples the link between the environment perception sensor hardware and the application, and adds a sensor management device 102 to uniformly manage and accept data requests from various applications.

[0094] In another possible embodiment, the sensor management device can be a virtual device. To higher-level applications, the sensor management device appears as a virtual environmental sensor. Therefore, the sensor management device can be integrated into the vehicle's modules. For example, the sensor management device can be integrated into the cockpit domain controller (CDC). This eliminates the need for the MDC to relay sensor data, avoiding the need to activate the MDC and conserving vehicle power.

[0095] In one possible implementation, the intelligent driving domain controller (MDC) is connected to all or some of the multiple environmental perception sensors and acquires perception data from all or some of the sensors. Referring to Figure 2 , all of the vehicle's environmental perception sensors are directly connected to the intelligent driving domain controller (MDC).

[0096] In an embodiment of the present application, the intelligent driving domain controller can be directly connected to all or part of the environmental perception sensors to directly obtain the perception data of the sensors, ensuring that the obtained perception data is more secure and reliable, and can respond to data acquisition with low latency.

[0097] For example, since some functions of the autonomous driving module have high security and latency requirements for some perception data, direct data transmission is required. The intelligent driving domain controller MDC can directly initiate data requests to the environmental perception sensors in the vehicle.

[0098] In one possible implementation, referring to FIG. 2 , the vehicle 101 further includes a first power supply unit configured to independently power the sensor management device 102 and the plurality of environmental perception sensors when the vehicle 101 is powered off. Furthermore, when the vehicle 101 is powered off, at least one of the plurality of onboard functional modules is powered off.

[0099] When the vehicle is powered off, both the intelligent driving domain controller (MDC) and the cockpit domain controller (CDC) are powered off. When the onboard functional module is a TBOX, it goes into hibernation. If the TBOX receives a command, it wakes up its own power supply module to provide power to the TBOX.

[0100] The first power supply unit can be a physical independent battery or a virtual independent battery. Virtualization means that a part of the battery module is dedicated for power supply, rather than actually installing a separate battery.

[0101] In an embodiment of the present application, a vehicle is provided with a first power supply unit to independently power the environment perception sensor and the sensor management device when the vehicle is powered off. Thus, even when the vehicle is powered off, the environment perception sensor and the sensor management device can still sense the vehicle's surrounding environment to obtain first data, and output or store the first data. This not only enables environmental perception when the vehicle is powered off, but also prevents at least one onboard functional module from being activated when the vehicle is powered off, thereby reducing unnecessary power waste in the vehicle.

[0102] For example, when the user leaves the vehicle, if there is a need to perceive the environment outside the vehicle, the first power supply unit provides independent power supply for the environmental perception sensor and the sensor management device. Since the decoupled environmental perception sensor shares power with other vehicle modules, other unnecessary modules do not need to be powered on. Therefore, the power consumption when monitoring the vehicle's surrounding environment after the user leaves the vehicle is greatly reduced. For example, the power consumption for monitoring the vehicle in a parked state and accident alarm is greatly reduced. After the CDC sends a data request to the sensor management device 102, it can be powered off. The first power supply unit provides independent power supply for the environmental perception sensor and the sensor management device. The environmental perception sensor and the sensor management device can continue to monitor the vehicle's surrounding environment with low power consumption.

[0103] In one possible embodiment, the vehicle further includes a second power supply unit configured to supply power to the vehicle when the vehicle is powered on. In this embodiment of the present application, the vehicle further includes a second power supply unit configured to supply power to the vehicle when the vehicle is powered on, i.e., to supply power to all parts of the vehicle requiring electrical energy, including the environmental perception sensors and the sensor management device. In other words, the first power supply unit does not supply power when the vehicle is powered on.

[0104] In one possible embodiment, the sensor management device 102 includes a storage unit. The storage unit in this case is a memory built into the sensor management device, i.e., a memory. Alternatively, referring to FIG. 2 , the vehicle 101 further includes a storage unit, and the sensor management device 102 is connected to the storage unit. The storage unit in this case can be understood as external memory. The storage capacity of external memory is greater than that of internal memory, and therefore, writing data to the external memory takes longer than writing data to the internal memory. The above-mentioned storage unit is used to provide the sensor management device with independent storage space for storing perception data from the target environment perception sensor.

[0105] In one possible implementation, referring to FIG2 , vehicle 101 further includes a positioning module, and sensor management device 102 is connected to the positioning module. The sensor management device is further configured to obtain location information of the positioning module and associate perception data from the target environment perception sensor with the location information.

[0106] The positioning module may be a Global Positioning System (GPS) module, a Galileo Satellite Navigation System (GLONASS) module, a Global Navigation Satellite System (GLONASS) module, or a Beidou Satellite Navigation System module.

[0107] In one possible implementation, when the multiple in-vehicle functional modules include an intelligent driving domain controller and a cockpit domain controller, the sensor management device is further configured to respond to a first data request sent by the intelligent driving domain controller and store or output the first data. The sensor management device is further configured to respond to a second data request sent by the cockpit domain controller and store or output the first data. Both the first data request and the second data request are related to the target environment perception sensor.

[0108] In this embodiment of the present application, both the intelligent driving domain controller and the cockpit domain controller can send a data request to the sensor management device, causing the sensor management device to store or output the first data. For example, when the sensor management device outputs the first data, the intelligent driving domain controller or the cockpit domain controller obtains the first data from the sensor management device.

[0109] It can be seen from Figure 2 that, unlike the existing technology, when the cockpit domain controller CDC needs to obtain camera data in sentry mode, it does not need to initiate a data request to the intelligent driving domain controller MDC, but only needs to initiate a data request to the sensor management device to obtain the required camera data.

[0110] In a possible implementation, the data request includes vehicle-mounted application information that triggers the data request in the first vehicle-mounted functional module, and the vehicle-mounted application information corresponds to the target environment perception sensor.

[0111] In the embodiment of the present application, when the sensor management device receives the data request from the first vehicle-mounted functional module, it can determine the corresponding target environment perception sensor based on the above correspondence.

[0112] For example, referring to Figure 3A, Figure 3A is a schematic diagram of the internal interaction process of a vehicle provided in an embodiment of the present application. When the user uses the automatic / assisted driving function, the vehicle is in a powered-on high-voltage state. When the autonomous driving application requires data with lower data security levels and latency requirements, it can be obtained through the sensor management device. Specifically, the autonomous driving application running in the intelligent driving domain controller MDC transmits a data request to the sensor management device. The sensor management device processes the perception data of the target environment perception sensor based on the application information contained in the received data request and the configuration file corresponding to the application to obtain first data, and then provides the first data to the autonomous driving application.

[0113] Exemplarily, the configuration file corresponding to the autonomous driving application can be pre-stored in the sensor management device, and the sensor management device can determine the configuration file corresponding to the application based on the application information. For example, the configuration file includes information indicating the target environment perception sensor, for example, the target environment perception sensor is a front-view camera, a left-view camera, and a right-view camera. The configuration file may also include relevant information about the first data, for example, relevant information about the first data is the frame rate of the first data, the pixel size of the first data, the size of the first data (such as the size of the video), etc. Based on the perception data uploaded by multiple environment perception sensors in the vehicle, the sensor management device obtains the first data after pre-processing (such as cropping, frame rate adjustment, etc.) based on the configuration file and outputs it to the intelligent driving domain controller MDC. When the configuration file does not include relevant information about the first data, it can be understood that the first data is the perception data itself of the target environment perception sensor.

[0114] Furthermore, when autonomous driving applications require data with high security and latency requirements, they can obtain unprocessed perception data from directly connected environmental perception sensors. Similarly, the autonomous driving application transmits a data request to the environmental perception sensor, which includes information indicating the target environmental perception sensor. Based on the data request, the multiple environmental perception sensors in the vehicle can determine the target environmental perception sensor and directly output the perception data from the target environmental perception sensor to the intelligent driving domain controller (MDC).

[0115] For another example, refer to Figure 3B, which is a schematic diagram of another internal interaction process in a vehicle provided by an embodiment of the present application. For parking monitoring applications (such as Sentry Mode and Parking Guard), the interaction process with the sensor management device is shown in Figure 3B. Specifically, when the user has left the vehicle and the vehicle is powered off, if the user uses parking monitoring, Sentry Mode can be activated by simply activating the sensor management device. The sensor management device utilizes a first power supply unit to ensure that the sensor management device and multiple environmental perception sensors remain active while the vehicle is powered off. The sensor management device can monitor data around the user's parking location. Based on the data request, the sensor management device determines that the requested application is a parking monitoring application. Based on the configuration file of the parking monitoring application, the sensor management device can determine the relevant information of the target environmental perception sensor and the first data. For example, if the target environmental perception sensor is four-way camera data from the front camera, rear camera, left camera, and right camera (or six-way data from the front camera, left front camera, left rear camera, right front camera, right rear camera, and rear camera), the relevant information of the first data can indicate how to combine the data from the target environmental perception sensors to obtain the surround view video data, i.e., the first data. The sensor management device can generate the first data based on the configuration file and output it to the cockpit domain controller CDC. The cockpit domain controller CDC monitors the parking environment based on the first data. When the cockpit domain controller CDC monitors the parking environment based on the first data and determines that the vehicle has not had an accident, the first data is desensitized and uploaded to the first device (taking the cloud server as an example). The desensitization process includes removing sensitive information such as faces and license plate numbers. The cockpit domain controller CDC can upload the desensitized first data to the cloud server through the communication unit in the vehicle. Similarly, when the configuration file does not include relevant information of the first data, it can be understood that the first data is the perception data itself of the target environment perception sensor.

[0116] In addition, users can request to remotely view parking surveillance videos through the application. The user sends a viewing request to the cloud server, and the cloud server responds to the viewing request and sends the corresponding parking surveillance video to the user.

[0117] Furthermore, when the cockpit domain controller (CDC) monitors the parking environment based on the first data and determines that a second accident has occurred (e.g., vandalism, door-opening, malicious skidding, or a collision with a delivery vehicle), the CDC sends a vehicle location request to the sensor management device. This request includes the time of the second accident. The sensor management device then outputs the vehicle's location corresponding to that time to the CDC based on the time of the second accident. The sensor management device, using its positioning module, can obtain the vehicle's location information at each moment. Therefore, based on the time of the second accident, the sensor management device can obtain the vehicle's location corresponding to that time. Based on the time of the second accident, the vehicle's location corresponding to that time, and the first data, the CDC generates alarm data. This alarm data is a video of the second accident that includes the vehicle's location. Furthermore, this alarm data may be desensitized data. The CDC sends this alarm data to the cloud server for malicious incident alerting. Upon receiving the alarm, the cloud server initiates a cloud-linked alarm for timely alarm processing. The cloud server can also proactively push this alarm data to users to ensure timely notification of the accident.

[0118] Furthermore, when the cockpit domain controller (CDC) monitors the parking environment based on the first data and determines that the vehicle has not been involved in an accident, the first data can be stored locally. Furthermore, after receiving a data request from the cockpit domain controller (CDC), the environment perception sensor and the sensor management device can be powered by the first power supply unit to enable the environment perception sensor and the sensor management device to continue to monitor the parking environment, even if the CDC is powered off.

[0119] For another example, referring to Figure 3B , the interaction process with the sensor management device for a vehicle-finding application (such as smart vehicle search and vehicle location viewing) is shown in Figure 3B . Specifically, when a user activates a vehicle-finding application, they have already left the vehicle and the vehicle is powered off. When the user activates the parked vehicle search function, the cockpit domain controller (CDC) sends a data request to the sensor management device, which includes information about the parked vehicle search application. The sensor management device determines the corresponding configuration file based on the application information and generates first data based on the configuration file. For example, the configuration file indicates information about the target environment perception sensor and first data. The target environment perception sensor is a front-view camera and a rear-view camera, and the information about the first data indicates that the first data is a front-view video with the parking location marked. The sensor management device transmits the first data to the cockpit domain controller (CDC) to enable real-time upload of the vehicle's external environment. Furthermore, the cockpit domain controller (CDC) can desensitize the first data before uploading it to the cloud. Users can remotely view real-time video outside the vehicle by sending a viewing request to the cloud server. In response to the viewing request, the cloud server sends the corresponding real-time video outside the vehicle to the user, helping them quickly find their vehicle.

[0120] Likewise, when the configuration file does not include relevant information about the first data, it can be understood that the first data is the perception data of the target environment perception sensor itself.

[0121] The vehicle position can be obtained by using a positioning module in the vehicle, or the vehicle position can be obtained by parsing the perception data of the target environment perception sensor to obtain the parking space of the vehicle (such as the parking space number, etc.).

[0122] For another example, the user may also remotely wake up the vehicle's communication unit, such as TBOX, through an application. TBOX may wake up the sensor management device to generate and upload the first data to the cloud.

[0123] For another example, referring to FIG3C , for a vehicle-finding application, the sensor management device may also directly upload the desensitized first data to the cloud through the vehicle's communication unit, such as TBOX, after generating the first data.

[0124] In another possible implementation, the data request includes first information, and the first information is used to indicate the target environment perception sensor. The sensor management device can directly determine the target environment perception sensor according to the data request.

[0125] Exemplarily, the first information may be identification information of the target environment perception sensor, and the identification information may also directly or indirectly identify the target environment perception sensor. For example, the identification information may be a device identification or a sensor number of the sensor, and a sensor may be uniquely identified based on the sensor number.

[0126] Due to the decoupling of the environmental perception sensor and the upper-layer application, when the application needs to increase or decrease the data requested from the sensor, it only needs to modify the first information in the data request accordingly.

[0127] For example, referring to FIG. 3A , FIG. 3B , and FIG. 3C , the data request therein may directly carry the first information, so that the sensor management device may directly determine the target environment perception sensor based on the data request.

[0128] Furthermore, the data request may also include information related to the first data to instruct the sensor management device to generate the first data. When the data request does not include information related to the first data, it can be understood that the first data is the perception data of the target environment perception sensor itself.

[0129] Referring to Figure 3D, Figure 3D is a schematic diagram of the internal interaction process of another vehicle provided by an embodiment of the present application. When the user uses the driving recorder, the vehicle is in a powered-on high-voltage state. The cockpit domain controller CDC runs the driving recorder application, and the driving recorder application sends a data request to the sensor management device. The sensor management device determines the target environment perception sensor based on the received data request and outputs the first data. The specific determination method is described above and will not be repeated here. In addition, the sensor management device also stores the above-mentioned first data and can store the first data in the vehicle's external memory to increase the storage speed of the first data. The sensor management device also desensitizes the first data and uploads it to the cloud server, and the cloud server stores the desensitized first data. The user can view the desensitized data remotely. The user sends a viewing request to the cloud server, and the cloud server returns the corresponding desensitized data to the user in response to the viewing request, so that the user can remotely view the data recorded by the driving recorder.

[0130] For example, the target environment perception sensor is a front-view camera, a left-view camera, and a right-view camera, or the target environment perception sensor is a front-view camera. The first data is low-frame-rate perception data of the target environment perception sensor. Storing the low-frame-rate perception data can alleviate space pressure on the storage device.

[0131] In a possible implementation manner, the sensor management device is further configured to store perception data of the environment perception sensor corresponding to the first accident when the vehicle has a first accident.

[0132] The above-mentioned environmental perception sensors corresponding to the first accident can be configured according to actual conditions without any special limitation.

[0133] In an embodiment of the present application, when a vehicle has a first accident, the sensor management device can quickly respond and store the perception data of the environmental perception sensor corresponding to the first accident to prevent the loss of perception data when the accident occurs, so as to facilitate subsequent investigation into the cause of the accident.

[0134] Exemplarily, the sensor management device may perform accident detection processing based on the perception data of the target environment perception sensor to monitor whether the vehicle has a first accident. Alternatively, the sensor management device may determine whether the vehicle has a first accident based on accident indication information sent by other modules of the vehicle, where the accident indication information indicates that the vehicle has a first accident. For example, other modules in the vehicle may monitor the Controller Area Network (CAN) bus signals in the vehicle to know various status information of the vehicle, including the above-mentioned accident indication information. The above-mentioned other modules may be MDC, CDC or communication units, etc. For example, when the first accident is a collision accident, the accident indication information may be a collision signal.

[0135] For example, by storing the environmental sensor data corresponding to the first accident in the memory of the sensor management device, data can be written to the memory quickly, preventing the loss of critical data from the first accident in the event of a vehicle power outage. This also prevents the loss of critical data due to thieves removing the vehicle's external memory.

[0136] In one possible implementation, the sensor management device is further configured to, when a first accident occurs on the vehicle, generate video data of the first accident based on perception data from an environmental perception sensor corresponding to the first accident, the video data including location information of the first accident. The sensor management device is further configured to transmit the video data of the first accident to the first device.

[0137] In an embodiment of the present application, when a vehicle has a first accident, the above-mentioned sensor management device will generate video data of the first accident with accident location information, and send the video data to the first device, so that the first device can be informed that the vehicle has had a first accident and quickly respond to the accident. For example, the first device issues an alarm based on the video data of the first accident, and / or the first device pushes the video data of the first accident to relevant users (such as the owner of the vehicle, or the owner's emergency contact, etc.) so that the first accident can be handled in a timely manner to ensure the safety of the vehicle and the driver.

[0138] The sensor management device can obtain the location information of the first accident through the positioning module. Using the video data with location information can ensure that in an emergency, a cloud alarm can be issued and the precise location and on-site video can be uploaded, greatly shortening the rescue time.

[0139] Exemplarily, referring to FIG3D , taking the case where the MDC sends a collision signal to the sensor management device and the first accident is a collision accident as an example, after the sensor management device receives the collision signal indicating the first accident, it stores the perception data of the target environment perception sensor corresponding to the first accident, and generates video data of the first accident based on the perception data of the target environment perception sensor corresponding to the first accident and the location information of the first accident, and outputs the video data of the first accident to the cloud server. In addition, the video data of the first accident can also be data after desensitization processing. For example, the sensor management device can upload the video data of the first accident to the cloud through the communication unit, and the cloud server performs alarm processing based on the video data of the first accident. In addition, the cloud server can also actively push the video data of the first accident to the user so that the user knows that the vehicle has had the first accident and the specific circumstances of the accident.

[0140] Furthermore, in Figure 3D , before the first accident occurs, the first data stored by the vehicle is low-frame-rate perception data from the target environment perception sensor. However, when the vehicle experiences a first accident, the stored perception data from the environment perception sensor corresponding to the first accident may be high-frame-rate perception data, thereby preventing the impact of insufficient clarity on accident handling. This indicates that, in this embodiment of the present application, the sensor management device can output perception data of varying quality based on event levels to meet the needs of different event handling requirements.

[0141] Refer to Figure 3E, which is a schematic diagram of another vehicle internal interaction process provided by an embodiment of the present application. Unlike Figure 3D, after receiving the data request from the driving recorder application, the sensor management device can store the first data and output the first data to the cockpit domain controller CDC, which can store the first data locally. The cockpit domain controller CDC can also desensitize the first data and upload it to the cloud server, which stores the desensitized data for remote user viewing.

[0142] In Figure 3E, the first accident is a collision, and the cockpit domain controller (CDC) sends a collision signal to the sensor management device. After receiving the collision signal, the sensor management device generates and outputs video data of the first accident to the cockpit domain controller (CDC) for accident alerting. The cockpit domain controller (CDC) desensitizes the video data of the first accident and uploads it to the cloud server. The cloud server then links the desensitized data to the police alert. Furthermore, the cloud server can proactively push the desensitized data to users, allowing them to remotely view the desensitized data and be informed of the first accident.

[0143] In a possible implementation, the sensor management device is further configured to perform parking environment monitoring and generate environment monitoring results based on perception data from the target environment perception sensor when the vehicle is powered off.

[0144] In an embodiment of the present application, when the vehicle is powered off, the sensor management device can perform parking environment monitoring and processing and generate environmental monitoring results based on the perception data from the target environment perception sensor because it is independently powered by the first power supply unit. This can not only avoid unnecessary power waste of the vehicle, but also monitor the surrounding environment when the vehicle is powered off.

[0145] In a possible implementation, the sensor management device is further configured to store perception data from the target environment perception sensor when the environment monitoring result indicates that the vehicle has a second accident.

[0146] Among them, the second accident refers to an accident that causes a certain degree of damage to the vehicle, such as smashing the vehicle, killing with the door open, malicious sliding, and collision with the delivery vehicle.

[0147] In an embodiment of the present application, in the event of a second vehicle accident, the sensor management device can rapidly respond by storing the target environment perception sensor's perception data, preventing the loss of perception data at the time of the accident and facilitating subsequent investigations into the cause of the accident. Furthermore, the perception data of the target environment perception sensor can be stored in the sensor management device's memory, facilitating rapid data recording. Furthermore, perception data from a period of time before and after the second accident can be stored in the memory to reduce the amount of stored data.

[0148] In one possible implementation, the sensor management device is further configured to generate video data of the second accident based on the perception data of the target environment perception sensor when the environmental monitoring results indicate that the vehicle has experienced a second accident. The video data of the second accident includes location information of the second accident. The sensor management device is further configured to transmit the video data of the second accident to the first device. The sensor management device may obtain the location information of the second accident via a positioning module.

[0149] In an embodiment of the present application, when a second accident occurs to the vehicle, the above-mentioned sensor management device will generate video data of the second accident with accident location information, and send the video data (for example, through the vehicle's communication unit) to the first device, so that the first device can be informed that a second accident has occurred to the vehicle and quickly respond to the accident. For example, the first device issues an alarm based on the video data of the second accident, and / or the first device pushes the video data of the second accident to relevant users (such as the vehicle owner, or the vehicle owner's emergency contact, etc.) so that the second accident can be handled in a timely manner to ensure the safety of the vehicle and the driver.

[0150] Exemplarily, referring to Figure 3F, Figure 3F is a schematic diagram of the internal interaction process of another vehicle provided by an embodiment of the present application. When the user uses parking monitoring, the parking monitoring function can be turned on through the vehicle's central control. At this time, the cockpit domain controller CDC sends a data request to the sensor management device. In this case, after the cockpit domain controller CDC sends the data request, the user leaves the vehicle and the vehicle can be powered off, that is, the cockpit domain controller CDC can be powered off. Alternatively, the user can also remotely turn on the parking monitoring function through the mobile phone. The cloud server receives the activation request from the mobile phone, and the cloud server sends a data request to the sensor management device through the vehicle's communication unit (such as TBOX). In this case, the data request does not need to go through the cockpit domain controller CDC.

[0151] After the sensor management device receives the data request, since the first power supply unit provides an independent keep-alive power supply, the sensor management device can obtain the perception data of the target environment perception sensor based on the data request, and perform parking environment monitoring based on the perception data of the target environment perception sensor. When the environmental monitoring result indicates that the vehicle has not caused a second accident, the sensor management device directly stores the perception data of the target environment perception sensor in the vehicle's external memory without desensitization. In addition, the sensor management device generates first data based on the data request and the perception data of the target environment perception sensor, and uploads the first data to the cloud server after desensitization, and the cloud server performs cloud data caching. For example, the configuration file corresponding to the application can be determined based on the application information carried in the data request, and the first data can be determined based on the configuration file. Refer to the relevant records in Figure 3B for no further details. For another example, when the data request carries relevant information about the first data, the first data can be determined based on the relevant information about the first data. For another example, when the configuration file or data request does not carry relevant information about the first data, the first data is the perception data of the target environment perception sensor itself.

[0152] When the environmental monitoring results indicate that the vehicle has a second accident, the sensor management device directly stores the perception data of the target environmental perception sensor in the memory without desensitization. For example, the perception data of a period of time before and after the occurrence of the second accident (the specific length of time can be set according to actual conditions and is not limited) can be stored in the memory. In addition, the sensor management device generates and uploads the video data of the second accident to the cloud server to facilitate the cloud server to perform cloud linkage alarm. The cloud server can also push the video data of the second accident to the user to facilitate the user to remotely view the parking monitoring video.

[0153] The video data of the second accident is video data containing the location information of the second accident, generated based on the perception data of the target environment perception sensor. Furthermore, the video data of the second accident is video data containing the location information of the second accident, generated based on the time of occurrence of the second accident and the perception data of the target environment perception sensor. Furthermore, the video data of the second accident may also be data that has undergone desensitization processing.

[0154] The method provided in the embodiments of the present application is described in detail below.

[0155] This application also provides a sensor management method and a data acquisition method. The sensor management method is performed by a sensor management device, while the data acquisition method is performed by a first vehicle-mounted functional module. Referring to FIG4 , FIG4 is a flow chart of a data acquisition method provided in an embodiment of this application. The data acquisition method specifically includes the following steps:

[0156] 401. A first vehicle-mounted functional module sends a data request to a sensor management device.

[0157] The first vehicle-mounted functional module is any one of the multiple vehicle-mounted functional modules of the vehicle described above. The above-mentioned data request is related to the target environment perception sensor. Among them, the specific structural description of the vehicle can be referred to the relevant description of the vehicle embodiment above, and will not be repeated here.

[0158] Accordingly, the sensor management device receives a data request sent by the first vehicle-mounted functional module. In response to the data request, the sensor management device stores or outputs first data related to the perception data from the target environment perception sensor.

[0159] 402. A first vehicle-mounted functional module receives first data from a sensor management device.

[0160] In this embodiment of the present application, because the sensor management device is directly connected to multiple environmental perception sensors, the environmental perception sensors in the vehicle are decoupled from the onboard functional modules, allowing the sensor management device to centrally manage the perception data of the vehicle's environmental perception sensors. Specifically, the sensor management device can respond to a data request from a first onboard functional module and store or output the first data. This allows the vehicle to avoid activating unrelated vehicle modules while processing (storing or outputting) the first data, thereby reducing unnecessary power waste in the vehicle.

[0161] Exemplarily, the above-mentioned data request includes vehicle-mounted application information that triggers the data request in the first vehicle-mounted functional module, and there is a corresponding relationship between the vehicle-mounted application information and the target environment perception sensor.

[0162] For example, the data request includes first information, and the first information is used to indicate the target environment perception sensor. The sensor management device can directly determine the target environment perception sensor according to the data request.

[0163] In a possible implementation, when the multiple vehicle-mounted functional modules include an intelligent driving domain controller and a cockpit domain controller, the sensor management method further includes:

[0164] In response to the first data request sent by the intelligent driving domain controller, the sensor management device stores or outputs the first data.

[0165] In response to the second data request sent by the cockpit domain controller, the sensor management device stores or outputs the first data.

[0166] The first data request and the second data request are both related to the target environment perception sensor.

[0167] In a possible implementation, the sensor management method further includes:

[0168] When a first accident occurs to the vehicle, the sensor management device stores the perception data of the environment perception sensor corresponding to the first accident.

[0169] In a possible implementation, the sensor management method further includes:

[0170] When a first accident occurs to the vehicle, the sensor management device generates video data of the first accident based on perception data of an environment perception sensor corresponding to the first accident, where the video data of the first accident includes location information of the first accident.

[0171] The sensor management device sends the video data of the first accident to the first device.

[0172] In a possible implementation, the sensor management method further includes:

[0173] When the vehicle is powered off, the sensor management device performs parking environment monitoring processing based on the perception data from the target environment perception sensor and generates an environment monitoring result.

[0174] In a possible implementation, the sensor management method further includes:

[0175] When the environmental monitoring result indicates that the vehicle has a second accident, the sensor management device stores the perception data from the target environmental perception sensor.

[0176] In a possible implementation, the sensor management method further includes:

[0177] When the environmental monitoring result indicates that the vehicle has a second accident, the sensor management device generates video data of the second accident based on the perception data of the target environmental perception sensor, where the video data of the second accident includes location information of the second accident.

[0178] The sensor management device transmits the video data of the second accident to the first device.

[0179] In a possible implementation, the data acquisition method further includes:

[0180] The first vehicle-mounted functional module performs parking environment monitoring processing based on the first data and generates an environment monitoring result.

[0181] In a possible implementation, the data acquisition method further includes:

[0182] When the environmental monitoring result indicates that the vehicle has a second accident, the first vehicle-mounted functional module generates video data of the second accident based on the first data, where the video data of the second accident includes location information of the second accident.

[0183] The first vehicle-mounted functional module sends the video data of the second accident to the first device.

[0184] Specifically, the process of environmental monitoring processing in the sensor management method can refer to the relevant records in Figure 3B and will not be described in detail.

[0185] The specific description and beneficial effects of the above-mentioned sensor management method and data acquisition method can be referred to the relevant description of the above vehicle embodiment and will not be repeated here.

[0186] The device provided in this application is described in detail below.

[0187] Figures 5 and 6 are schematic diagrams of the structures of possible devices provided by the embodiments of the present application. Figure 5 is a schematic diagram of the structure of a sensor management device provided by the embodiments of the present application; Figure 6 is a schematic diagram of the structure of a data acquisition device provided by the embodiments of the present application; wherein, the sensor management device shown in Figure 5 can be used to implement the functions of the above-mentioned sensor management method embodiment, and thus can also achieve the beneficial effects possessed by the above-mentioned sensor management method embodiment. In the embodiments of the present application, the sensor management device can be an electronic device, and can also be a module (such as a chip) applied to an electronic device. The data acquisition device shown in Figure 6 can be used to implement the functions of the data acquisition method embodiment shown in Figure 4 above, and thus can also achieve the beneficial effects possessed by the above-mentioned data acquisition method embodiment. In the embodiments of the present application, the data acquisition device can be an electronic device, and can also be a module (such as a chip) applied to an electronic device.

[0188] As shown in Figure 5 , the sensor management device includes a receiving module 510 and a processing module 520. The sensor management device is configured to implement the functions of the aforementioned sensor management method embodiments. Alternatively, the sensor management device may include a module configured to implement any of the functions or operations of the aforementioned sensor management method embodiments. This module may be implemented in whole or in part via software, hardware, firmware, or any combination thereof.

[0189] When the sensor management device is used to implement the functions of the sensor management method embodiment described above, receiving module 510 is configured to receive a data request sent by a first onboard functional module. The first onboard functional module is any one of the multiple onboard functional modules of the vehicle described above. The data request is associated with a target environment perception sensor. Processing module 520 is configured to, in response to the data request, cause the sensor management device to store or output first data. The first data is associated with perception data from the target environment perception sensor.

[0190] In a possible implementation, when the multiple vehicle-mounted functional modules include an intelligent driving domain controller and a cockpit domain controller, the processing module 520 is further configured to:

[0191] In response to a first data request sent by the intelligent driving domain controller, store or output the first data.

[0192] In response to a second data request sent by the cockpit domain controller, the first data is stored or output.

[0193] The first data request and the second data request are both related to the target environment perception sensor.

[0194] In a possible implementation, the processing module 520 is further configured to: when a first accident occurs to the vehicle, store perception data of the environment perception sensor corresponding to the first accident.

[0195] In a possible implementation, referring to FIG5 , the sensor management device further includes a generating module 530 and a sending module 540 .

[0196] The generation module 530 is used to generate video data of the first accident based on the perception data of the environment perception sensor corresponding to the first accident when the vehicle has a first accident, and the video data of the first accident includes location information of the first accident.

[0197] The sending module 540 is configured to send the video data of the first accident to the first device.

[0198] In a possible implementation, the generation module 530 is further configured to: when the vehicle is powered off, perform parking environment monitoring processing based on the perception data from the target environment perception sensor and generate an environment monitoring result.

[0199] In a possible implementation, the processing module 520 is further configured to store the perception data from the target environment perception sensor when the environment monitoring result indicates that the vehicle has a second accident.

[0200] In one possible implementation, the generation module 530 is further configured to generate video data of the second accident based on the perception data of the target environment perception sensor when the environmental monitoring results indicate that the vehicle has experienced a second accident, the video data of the second accident including location information of the second accident. The transmission module 540 is further configured to transmit the video data of the second accident to the first device.

[0201] For the introduction of the above modules, please refer to the description of the sensor management method embodiment, which will not be repeated here.

[0202] As shown in FIG6 , data acquisition device 600 includes a sending module 610 and a receiving module 620. Data acquisition device 600 is used to implement the functions of the data acquisition method embodiment shown in FIG4 . Alternatively, data acquisition device 600 may include a module for implementing any function or operation of the data acquisition method embodiment described above, and the module may be implemented in whole or in part via software, hardware, firmware, or any combination thereof.

[0203] When the data acquisition device 600 is used to implement the functions of the above-described data acquisition method embodiment, the sending module 610 is configured to send a data request to the sensor management device. The data request is associated with a target environment perception sensor. The receiving module 620 is configured to receive first data from the sensor management device. The first data is associated with the perception data from the target environment perception sensor.

[0204] In a possible implementation, referring to Figure 6, the data acquisition device 600 further includes a generation module 630. The generation module 630 is configured to perform parking environment monitoring processing based on the first data and generate an environment monitoring result.

[0205] In a possible implementation, the generation module 630 is further configured to generate video data of the second accident based on the first data when the environmental monitoring result indicates that the vehicle has a second accident, the video data of the second accident including location information of the second accident.

[0206] 6 , the data acquisition apparatus 600 further includes a sending module 640. The sending module 640 is configured to send the video data of the second accident to the first device.

[0207] For the introduction of the above modules, please refer to the description of the aforementioned data acquisition method embodiment, which will not be repeated here.

[0208] Referring to Figure 7, Figure 7 is a schematic diagram of the structure of a communication device provided in an embodiment of the present application; the communication device 700 includes a memory 701, a processor 702, a communication interface 704, and a bus 703. The memory 701, the processor 702, and the communication interface 704 are connected to each other via the bus 703.

[0209] Optionally, the communication device 700 further includes a display screen (not shown), which is connected to the memory 701, the processor 702, and the communication interface 704 via the bus 703. The display screen is used to output information and interact with the user, such as voice output or display output.

[0210] The memory 701 may be a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 701 may store programs. When the program stored in the memory 701 is executed by the processor 702, the processor 702 and the communication interface 704 are used to perform the various steps of the sensor management method or data acquisition method of any embodiment of the present application.

[0211] The processor 702 can adopt a general central processing unit (CPU), a microprocessor, an application specific integrated circuit (ASIC), a graphics processing unit (GPU) or one or more integrated circuits to execute relevant programs to implement the functions required to be performed by the units in the sensor management device or data acquisition device of any embodiment of the present application, or to execute the sensor management method or data acquisition method of any embodiment of the present application.

[0212] The processor 702 may also be an integrated circuit chip with signal processing capabilities. During implementation, the various steps of the sensor management method or data acquisition method of any embodiment of the present application may be completed by hardware integrated logic circuits or software instructions in the processor 702. The aforementioned processor 702 may also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component. The disclosed sensor management method or data acquisition method, steps, and logic block diagrams in the embodiments of the present application may be implemented or executed. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the sensor management method or data acquisition method in conjunction with any embodiment of the present application may be directly implemented and executed by a hardware processor, or by a combination of hardware and software modules in the processor. The software module may be located in a storage medium mature in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or the like. The storage medium is located in the memory 701, and the processor 702 reads the information in the memory 701 and combines its hardware to complete the functions required to be performed by the units included in the sensor management device or data acquisition device of any embodiment of the present application, or executes the sensor management method or data acquisition method of any embodiment of the present application.

[0213] The communication interface 704 uses a transceiver device such as, but not limited to, a transceiver to implement communication between the communication device 700 and other devices or a communication network. For example, the first data can be obtained through the communication interface 704.

[0214] The bus 703 may include a path for transmitting information between the various components of the communication device 700 (for example, the memory 701, the processor 702, the communication interface 704). In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. For example, the apparatus embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interfaces, devices or units, which may be electrical, mechanical or other forms.

[0215] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0216] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0217] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, server or data center to another website, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a read-only memory (ROM), a random access memory (RAM), or a magnetic medium, such as a floppy disk, a hard disk, a tape, a magnetic disk, or an optical medium, such as a digital versatile disc (DVD), or a semiconductor medium, such as a solid state drive (SSD).

[0218] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A vehicle, characterized in that: The vehicle includes a plurality of environmental perception sensors, a sensor management device and a plurality of vehicle-mounted functional modules; Each of the plurality of environment perception sensors is configured to collect data about the surrounding environment of the vehicle and output perception data; The sensor management device is directly connected to the multiple environment perception sensors, and the sensor management device is used to obtain perception data from the multiple environment perception sensors; The sensor management device is also used to respond to a data request sent by a first vehicle-mounted functional module, store or output first data, the first vehicle-mounted functional module is any one of the multiple vehicle-mounted functional modules, the data request is related to the target environment perception sensor, and the first data is related to the perception data from the target environment perception sensor.

2. The vehicle according to claim 1, characterized in that The sensor management device and the multiple vehicle-mounted functional modules are set separately, and the multiple vehicle-mounted functional modules include at least one of the following: an intelligent driving domain controller, a cockpit domain controller or a communication unit, and the communication unit is used to connect the vehicle with the first device.

3. The vehicle according to claim 1 or 2, characterized in that The multiple vehicle-mounted functional modules include an intelligent driving domain controller and a cockpit domain controller; The sensor management device is further configured to respond to a first data request sent by the intelligent driving domain controller and store or output the first data; The sensor management device is further configured to store or output the first data in response to a second data request sent by the cockpit domain controller; The first data request and the second data request are both related to the target environment perception sensor.

4. The vehicle according to any one of claims 1 to 3, characterized in that: The multiple vehicle-mounted functional modules include an intelligent driving domain controller, which is connected to all or part of the multiple environmental perception sensors and obtains perception data from all or part of the sensors.

5. The vehicle according to any one of claims 1 to 4, characterized in that: The vehicle also includes a first power supply unit, which is used to independently power the sensor management device and the multiple environmental perception sensors when the vehicle is powered off. When the vehicle is powered off, at least one of the multiple on-board functional modules is in a powered-off state.

6. The vehicle according to any one of claims 1 to 5, characterized in that: The vehicle further includes a second power supply unit configured to supply power to the vehicle when the vehicle is powered on.

7. The vehicle according to any one of claims 1 to 6, characterized in that: The data request includes vehicle-mounted application information that triggers the data request in the first vehicle-mounted functional module, and the vehicle-mounted application information corresponds to the target environment perception sensor.

8. The vehicle according to any one of claims 1 to 6, characterized in that: The data request includes first information, where the first information is used to indicate the target environment perception sensor.

9. The vehicle according to any one of claims 1 to 8, characterized in that: The sensor management device is further configured to store, when a first accident occurs to the vehicle, the perception data of the environment perception sensor corresponding to the first accident.

10. The vehicle according to any one of claims 1 to 9, characterized in that: The sensor management device is further configured to generate video data of the first accident based on perception data of an environment perception sensor corresponding to the first accident when the vehicle has a first accident, the video data of the first accident including location information of the first accident; The sensor management device is further configured to send the video data of the first accident to the first device.

11. The vehicle according to any one of claims 1 to 10, characterized in that: The sensor management device is also used to perform parking environment monitoring processing and generate environment monitoring results based on the perception data from the target environment perception sensor when the vehicle is powered off.

12. The vehicle according to claim 11, characterized in that The sensor management device is further configured to store the perception data from the target environment perception sensor when the environment monitoring result indicates that the vehicle has a second accident.

13. The vehicle according to claim 11 or 12, characterized in that The sensor management device is further configured to generate video data of the second accident based on the perception data of the target environment perception sensor when the environment monitoring result indicates that the vehicle has a second accident, wherein the video data of the second accident includes location information of the second accident; The sensor management device is further configured to send the video data of the second accident to the first device.

14. A communication system, characterized in that: A vehicle comprising the vehicle according to any one of claims 1-13.

Images