Risk labeling method and device, data processing method and device, vehicle-mounted equipment and product
By receiving driver risk information and location information from anonymous data packets, and marking risk indicators on the electronic rearview mirror, the problem that existing electronic rearview mirrors cannot assess the risk of drivers of vehicles behind is solved, and dynamic display and forward-looking warning of risks are realized.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- SHENZHEN STREAMING VIDEO TECH
- Filing Date
- 2025-12-22
- Publication Date
- 2026-05-05
AI Technical Summary
Existing electronic rearview mirrors only display real-time video streams of vehicles behind, lacking intelligent analysis of the driver's status and unable to identify potential risks. Furthermore, V2X technology does not fully utilize driver physiological data and lacks systematic risk assessment and proactive warnings.
By receiving anonymous data packets containing the driver's risk identification information and location information, risk identification is marked in the electronic rearview mirror image based on the location information. The driver's health data is monitored using V2X communication and wearable devices, and anonymous data packets are generated and displayed in the rearview mirror.
It enables dynamic display of driver risks associated with surrounding vehicles in the electronic rearview mirror, providing forward-looking risk warnings and enhancing the driver's safety perception capabilities.
Smart Images

Figure CN121982142A_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of automotive electronics technology, and in particular relates to a risk labeling method, data processing method, device, vehicle-mounted equipment and product. Background Technology
[0002] Existing electronic rearview mirrors typically capture real-time images of the side or rear of the vehicle using a camera (i.e., electronic rearview mirror images) and transmit these images to an in-vehicle display screen. While this expands the field of view, the content displayed in the electronic rearview mirror images is limited. Summary of the Invention
[0003] This application provides a risk labeling method, data processing method, device, vehicle-mounted equipment, and product that can display risk labeling information of surrounding vehicles in electronic rearview mirror images, solving the problem of limited content displayed in electronic rearview mirror images.
[0004] Firstly, embodiments of this application provide a risk labeling method, including: Receive an anonymous data packet from a first vehicle; the anonymous data packet includes risk identification information of the driver of the first vehicle and the location information of the first vehicle; Based on the location information of the first vehicle, the location information of the first vehicle in the electronic rearview mirror image of the second vehicle is determined; Based on the position information of the first vehicle in the electronic rearview mirror image, the marking position of the risk identification information in the electronic rearview mirror image is determined; The risk identification information is marked at the marked position in the electronic rearview mirror image.
[0005] In this embodiment, by receiving an anonymous data packet from a first vehicle, which includes the risk identification information of the driver of the first vehicle and the location information of the first vehicle, and determining the location information of the first vehicle in the electronic rearview mirror image of the second vehicle based on the location information of the first vehicle, the risk identification information in the electronic rearview mirror image can be determined based on the location information of the first vehicle in the electronic rearview mirror image, and the risk identification information can be marked at the marked position in the electronic rearview mirror image. Thus, the risk identification information of surrounding vehicles (i.e., the first vehicle) can be displayed in the electronic rearview mirror image of the vehicle (i.e., the second vehicle), solving the problem of the single content displayed in the electronic rearview mirror image.
[0006] In some embodiments of the first aspect, determining the position information of the first vehicle in the electronic rearview mirror image of the second vehicle based on the position information of the first vehicle includes: The position information of the first vehicle is converted to the vehicle coordinate system of the second vehicle to obtain the relative position information of the first vehicle; the relative position information of the first vehicle is the position information of the first vehicle relative to the second vehicle. Based on the relative position information of the first vehicle, the distance between the first vehicle and the second vehicle is determined; Determine the distance between each target vehicle in the electronic rearview mirror image and the second vehicle; Based on the distance between the first vehicle and the second vehicle, and the distance between each target vehicle and the second vehicle, the first vehicle is matched with each target vehicle; If there is a vehicle among the target vehicles that matches the first vehicle, then the position information of the vehicle that matches the first vehicle in the electronic rearview mirror image is determined as the position information of the first vehicle in the electronic rearview mirror image.
[0007] In some embodiments of the first aspect, before marking the risk identification information at the marked location in the electronic rearview mirror image, the method further includes: Based on the risk identification information, determine the labeling format of the risk identification information; The step of marking the risk identification information at the marked position in the electronic rearview mirror image includes: Based on the aforementioned labeling format, the risk identification information is labeled at the corresponding labeling position in the electronic rearview mirror image.
[0008] In some embodiments of the first aspect, the anonymous data packet further includes a temporary anonymous identifier, and the risk labeling method further includes: If the first vehicle is detected to have left the communication range of the second vehicle, the data associated with the temporary anonymous identifier is cleared.
[0009] In some embodiments of the first aspect, receiving anonymous data packets from the first vehicle includes: The anonymous data packet is received from the first vehicle via the V2X communication module.
[0010] Secondly, embodiments of this application provide a data processing method, including: Receive health data from the wearable device of the driver of the first vehicle; Based on the health data, the driver's risk identification information is determined; Based on the risk identification information, an anonymous data packet for the first vehicle is generated; The anonymous data packet is broadcast; the anonymous data packet instructs the second vehicle to mark the risk identification information in the electronic rearview mirror image.
[0011] In this embodiment, by receiving health data from the wearable device of the driver of the first vehicle, the driver's risk identification information can be determined based on the health data. Based on the risk identification information, an anonymous data packet of the first vehicle can be generated. By broadcasting the anonymous data packet, the second vehicle that receives the anonymous data packet can be instructed to mark the risk identification information in the electronic rearview mirror image. Thus, the risk identification information of the first vehicle can be displayed in the electronic rearview mirror image of the second vehicle, solving the problem of the single content displayed in the electronic rearview mirror image.
[0012] In some embodiments of the second aspect, the health data includes: the driver's heart rate, heart rate variability, and skin conductance; determining the driver's risk identification information based on the health data includes: Calculate the driver's heart rate score based on the driver's heart rate and the driver's resting heart rate; The driver's heart rate variability score is calculated based on the driver's heart rate variability and baseline values of heart rate variability. The driver's skin conductance response score is calculated based on the driver's skin conductance response and its maximum value. The risk identification information is determined based on the heart rate score, the heart rate variability score, and the skin conductance score.
[0013] In some embodiments of the second aspect, determining the risk identification information based on the heart rate score, the heart rate variability score, and the skin conductance response score includes: The driver's risk score is obtained by weighted summation of the heart rate score, the heart rate variability score, and the skin conductance response score. Based on the risk score, the risk identification information is determined.
[0014] In some embodiments of the second aspect, determining the risk identification information based on the risk score includes: Determine the risk score range to which the risk score belongs; The risk score range is determined as the risk identification information; Alternatively, the risk level corresponding to the risk score range can be determined as the risk identification information.
[0015] In some embodiments of the second aspect, the anonymous data packet further includes a temporary anonymous identifier of the first vehicle; the data processing method further includes: The temporary anonymous identifier is updated periodically.
[0016] In some embodiments of the second aspect, prior to receiving health data from the wearable device of the driver of the first vehicle, the method further includes: When the wearable device is first paired with the first vehicle, an authorization request interface is displayed; the authorization request interface displays authorization options, which indicate that the broadcast of the anonymous data packet is permitted; In response to the selection of the authorization option, the broadcast of the anonymous data packet is permitted.
[0017] Thirdly, embodiments of this application provide a risk labeling device, including: A data packet receiving module is used to receive anonymous data packets from a first vehicle; the anonymous data packets include risk identification information of the driver of the first vehicle. The first determining module is used to determine the position information of the first vehicle in the electronic rearview mirror image of the second vehicle; The second determining module is used to determine the marking position of the risk identification information in the electronic rearview mirror image based on the position information of the first vehicle in the electronic rearview mirror image; The risk labeling module is used to label the risk identification information at the labeling position in the electronic rearview mirror image.
[0018] Fourthly, embodiments of this application provide a data processing apparatus, including: A data receiving module is used to receive health data from the wearable device of the driver of the first vehicle; The risk determination module is used to determine the driver's risk identification information based on the health data; The data packet generation module is used to generate an anonymous data packet for the first vehicle based on the risk identification information; A data packet broadcasting module is used to broadcast the anonymous data packet; the anonymous data packet instructs the second vehicle to mark the risk identification information in the electronic rearview mirror image.
[0019] Fifthly, embodiments of this application provide an in-vehicle device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the in-vehicle device implements the risk labeling method as described in any one of the first aspects above, or implements the data processing method as described in any one of the second aspects above.
[0020] Sixthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a computer, implements the risk labeling method as described in any one of the first aspects above, or implements the data processing method as described in any one of the second aspects above.
[0021] In a seventh aspect, embodiments of this application provide a computer program product, including a computer program that, when run, causes the risk labeling method as described in any one of the first aspects above, or implements the data processing method as described in any one of the second aspects above.
[0022] It is understood that the beneficial effects of the third to seventh aspects mentioned above can be found in the relevant descriptions in the first and second aspects mentioned above, and will not be repeated here. Attached Figure Description
[0023] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0024] Figure 1 This application provides an embodiment of the overall architecture and interaction diagram of an electronic rearview mirror annotation system based on V2X. Figure 2 This is a flowchart illustrating the risk labeling method provided in an embodiment of this application; Figure 3 This is another flowchart illustrating the risk labeling method provided in the embodiments of this application; Figure 4 This is a flowchart illustrating a data processing method provided in an embodiment of this application; Figure 5 This is another schematic flowchart of the data processing method provided in the embodiments of this application; Figure 6 This is a schematic diagram of the risk labeling device provided in the embodiments of this application; Figure 7 This is a schematic diagram of the structure of the data processing apparatus provided in the embodiments of this application; Figure 8 This is a schematic diagram of the structure of the vehicle-mounted device provided in the embodiments of this application. Detailed Implementation
[0025] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.
[0026] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.
[0027] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.
[0028] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.
[0029] References to "one embodiment" or "some embodiments" in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized.
[0030] Current electronic rearview mirrors typically only provide a real-time video stream of vehicles behind, lacking intelligent analysis of the drivers' conditions. For example, existing electronic rearview mirrors capture and display images directly through cameras, which expands the field of view but cannot identify potential risks such as driver fatigue or health abnormalities. Meanwhile, Vehicle-to-Everything (V2X) is a communication technology for vehicles to interact with their external environment. V2X technologies (such as Dedicated Short-Range Communications (DSRC) and Cellular-Vehicle-to-Everything (C-V2X) protocols) are used for basic safety information exchange between vehicles (such as location and speed), but they do not fully utilize driver physiological data. In existing technologies, some solutions monitor the driver's condition through in-vehicle cameras, but cannot assess the risk to drivers of surrounding vehicles and rely on visual analysis, making them susceptible to environmental interference. Furthermore, wearable devices (such as smartwatches) can monitor indicators such as heart rate and stress, but the data is usually limited to personal use and not integrated with vehicle safety systems. Therefore, existing technologies have the drawbacks of electronic rearview mirrors having a single function, only displaying images, lacking risk assessment capabilities, and failing to provide forward-looking risk warnings. They also lack a systematic method to translate the physical condition of surrounding drivers into actionable safety prompts.
[0031] Based on this, embodiments of this application provide a risk labeling method, data processing method, apparatus, vehicle-mounted equipment, and product. In this embodiment, by receiving an anonymous data packet from a first vehicle, which includes risk identification information of the driver of the first vehicle and the location information of the first vehicle, and determining the position of the first vehicle in the electronic rearview mirror image of a second vehicle based on the location information of the first vehicle, the risk identification information can be determined and labeled at the designated position in the electronic rearview mirror image. This allows the risk identification information of surrounding vehicles (i.e., the first vehicle) to be displayed in the electronic rearview mirror image of the second vehicle, solving the problem of limited content displayed in electronic rearview mirror images and addressing the issue in existing technologies where electronic rearview mirrors cannot dynamically assess and display the risk of drivers of vehicles behind.
[0032] To illustrate the technical solution of this application, specific embodiments are described below.
[0033] For example, Figure 1 This diagram illustrates the overall architecture and interaction of a V2X-based electronic rearview mirror annotation system provided in an embodiment of this application. See also... Figure 1As shown, the electronic rearview mirror marking system includes a surrounding vehicle unit and a vehicle unit (i.e., a second vehicle).
[0034] The surrounding vehicle unit includes wearable devices for the drivers of the surrounding vehicles (i.e., the first vehicle), onboard equipment in the surrounding vehicles, and V2X communication modules (i.e.,... Figure 1 (Vehicle-mounted V2X communication module).
[0035] The aforementioned vehicle-mounted equipment can be an Electronic Control Unit (ECU), i.e. Figure 1 The vehicle's onboard ECU.
[0036] The aforementioned wearable devices include, but are not limited to, smartwatches and smart bracelets worn by drivers of surrounding vehicles.
[0037] The aforementioned wearable devices can collect the driver's health data (i.e. Figure 1 The driver's original health data is encrypted and transmitted via Bluetooth to the ECUs of nearby vehicles. Based on the driver's health data, the ECUs of the nearby vehicles determine the driver's risk identification information (such as risk level). Figure 1 The anonymity risk level can be based on the driver's risk level and the temporary anonymity identifiers of surrounding vehicles (i.e., Figure 1 The system uses a temporary ID, timestamp, location information, and motion status (such as speed, acceleration, heading angle) to generate an anonymous data packet, which is then broadcast through the V2X communication module.
[0038] This vehicle unit includes an electronic rearview mirror camera installed in the second vehicle (i.e., Figure 1 The side and rear cameras), V2X communication module (i.e. Figure 1 The vehicle-mounted V2X communication module and vehicle-mounted equipment (i.e. Figure 1 The data processing unit (vehicle ECU) and the electronic rearview mirror display interface.
[0039] The number of electronic rearview mirror cameras can be one or more (i.e., at least two). For example, there are two electronic rearview mirror cameras, which are installed on the left and right rearview mirrors of the vehicle, respectively, and feature high resolution and wide viewing angle.
[0040] Electronic rearview mirror cameras have excellent low-light performance and image stability, enabling them to clearly and stably acquire image information from the sides and rear of the vehicle under various complex environmental conditions (such as nighttime, rainy days, foggy days, etc.) to obtain electronic rearview mirror images.
[0041] It should be noted that when there are multiple electronic rearview mirror cameras, the electronic rearview mirror image in this application embodiment can be an electronic rearview mirror image captured by any one of the electronic rearview mirror cameras.
[0042] An electronic rearview mirror display interface can refer to an electronic display screen used in traditional optical rearview mirrors. It is typically a display screen installed in the traditional rearview mirror position inside the vehicle or near the side A-pillar. By receiving a real-time video stream from the electronic rearview mirror camera (which consists of a series of temporally continuous electronic rearview mirror images), it provides the driver with a wider and clearer field of vision.
[0043] The V2X communication modules in the surrounding vehicle units communicate with the V2X communication modules in the local vehicle unit via a V2X communication network. The V2X communication module in the local vehicle unit receives and filters data (for example, the V2X communication module parses and performs integrity checks on received anonymous data packets, and only processes data from vehicles within a specific rear range (such as 50 to 100 meters)).
[0044] The ECU in this vehicle unit receives anonymous risk data (such as risk labeling information) processed by the V2X communication module, and also receives video streams transmitted from the electronic rearview mirror camera. This video stream consists of a series of temporally continuous electronic rearview mirror images, which are images of the vehicle's side, rear, or rear views captured by the electronic rearview mirror camera. The ECU in this vehicle unit annotates the risk labeling information onto the electronic rearview mirror images and controls the display of the annotated images on the electronic rearview mirror display interface, thereby enabling controlled display and annotation of the risk labeling information.
[0045] Please see Figure 2 , Figure 2 This illustration shows a flowchart of a risk labeling method provided in an embodiment of this application. This risk labeling method can be applied to, for example... Figure 1 The electronic rearview mirror annotation system shown refers to the on-board equipment in the vehicle unit of the second vehicle. By way of example and not limitation, the method includes the following steps: Step 201: Receive an anonymous data packet from the first vehicle; the anonymous data packet includes the risk identification information of the driver of the first vehicle and the location information of the first vehicle.
[0046] The aforementioned anonymous data packet may refer to a data packet that does not involve the real identity information of the first vehicle or the real identity information of the driver of the first vehicle, or a data packet that no receiving device (such as the on-board device of the second vehicle) can reasonably identify the real identity information of the first vehicle or the real identity information of the driver of the first vehicle, either alone or in combination with other information.
[0047] The true identity information of the first vehicle includes, but is not limited to, the vehicle identification number (VIN), license plate number, and vehicle registration information.
[0048] The driver's real identity information includes, but is not limited to, name, ID number, driver's license number, facial recognition information, etc.
[0049] In some embodiments, the on-board equipment of the second vehicle can receive anonymous data packets from the first vehicle via a V2X communication module.
[0050] Specifically, the onboard equipment of the second vehicle can receive anonymous data packets broadcast by the V2X communication module of the first vehicle through its V2X communication module, and parse the anonymous data packets to obtain the data within them. This data includes, for example, the driver's risk identification information of the first vehicle, the first vehicle's temporary anonymous identifier, a timestamp, the first vehicle's location information, and the first vehicle's motion status. These data are interconnected. The timestamp is a point in time; the aforementioned data, such as the first vehicle's location information, motion status, and driver's risk identification information, are all data of the first vehicle at the time corresponding to the timestamp. The first vehicle's location information is its position within its own vehicle coordinate system, specifically Global Positioning System (GPS) location information (latitude, longitude, and altitude).
[0051] Step 202: Based on the location information of the first vehicle, determine the location information of the first vehicle in the electronic rearview mirror image of the second vehicle.
[0052] The aforementioned position information of the first vehicle in the electronic rearview mirror image may refer to the position information of the first vehicle in the image coordinate system of the electronic rearview mirror image.
[0053] When the first vehicle is within the field of view of the electronic rearview mirror camera of the second vehicle, a vehicle matching the first vehicle can usually be found in the electronic rearview mirror image captured by the electronic rearview mirror camera. The position information of this vehicle in the electronic rearview mirror image is the position information of the first vehicle in the electronic rearview mirror image. The vehicle matching the first vehicle can refer to the digital mapping of the first vehicle in the electronic rearview mirror image.
[0054] Step 203: Based on the position information of the first vehicle in the electronic rearview mirror image, determine the marking position of the risk sign information in the electronic rearview mirror image.
[0055] The aforementioned risk identification information can be a risk level or a risk score range, specifically the risk score range to which the driver of the first vehicle belongs. In other words, risk identification information can be represented by either a risk level or a risk score range. Of course, other information can also be used to represent risk identification information, and this application does not limit this.
[0056] The location of the aforementioned risk label information in the electronic rearview mirror image can refer to the position of the risk label information in the image coordinate system of the electronic rearview mirror image.
[0057] In some embodiments, based on the position information of the first vehicle in the electronic rearview mirror image, a position in the electronic rearview mirror image that does not overlap with the position of the first vehicle in the electronic rearview mirror image and whose distance from the first vehicle in the electronic rearview mirror image is within a preset distance range can be determined, and this position is determined as the marked position of the risk identification information in the electronic rearview mirror image. Optionally, the above-mentioned preset distance range can be set according to actual needs or empirical values.
[0058] In this embodiment, based on the position information of the first vehicle in the electronic rearview mirror image, the annotation position of the risk label information in the electronic rearview mirror image is determined. This allows the risk label information to move in real time along with the movement of the first vehicle in the electronic rearview mirror image, providing an immersive and undistracting warning experience. Furthermore, based on the position information of the first vehicle in the electronic rearview mirror image, the annotation position can be set in the electronic rearview mirror image without obstructing the position of the first vehicle (i.e., without obstructing the position of the image of the vehicle matching the first vehicle in the electronic rearview mirror image). This intelligently plans the display position of the annotation, ensuring that key information of the first vehicle (such as the image of the vehicle matching the first vehicle, the distance between the vehicle and the second vehicle, etc.) is not obstructed, and the annotated electronic rearview mirror image is clear and orderly.
[0059] Step 204: Mark the risk identification information at the marked position in the electronic rearview mirror image.
[0060] After the onboard equipment of the second vehicle marks the risk sign information at the marked position in the electronic rearview mirror image, it can display the risk sign information in the electronic rearview mirror image, enabling the driver of the second vehicle to perceive the risk of vehicles to the side and rear in advance.
[0061] In this embodiment, by marking the risk identification information at the marked position in the electronic rearview mirror image, the physical condition of the driver of the vehicle to the side and rear (i.e., the first vehicle) can be transformed into an operable safety prompt, enabling the driver of the second vehicle to perceive the risk of the vehicle to the side and rear in advance. This solves the problem that the existing technology has the disadvantage of electronic rearview mirrors having a single function, only displaying images, lacking risk assessment capabilities, and unable to provide forward-looking risk warnings.
[0062] In this embodiment, by receiving an anonymous data packet from a first vehicle, which includes the risk identification information of the driver of the first vehicle and the location information of the first vehicle, and determining the location information of the first vehicle in the electronic rearview mirror image of the second vehicle based on the location information of the first vehicle, the risk identification information in the electronic rearview mirror image can be determined based on the location information of the first vehicle in the electronic rearview mirror image, and the risk identification information can be marked at the marked position in the electronic rearview mirror image. Thus, the risk identification information of surrounding vehicles (i.e., the first vehicle) can be displayed in the electronic rearview mirror image of the vehicle (i.e., the second vehicle), solving the problem of the single content displayed in the electronic rearview mirror image.
[0063] In some embodiments of this application, the on-board equipment in the second vehicle can be via, for example... Figure 3 Steps 301 to 305 show the determination of the position information of the first vehicle in the electronic rearview mirror image of the second vehicle.
[0064] Step 301: Convert the position information of the first vehicle to the vehicle coordinate system of the second vehicle to obtain the relative position information of the first vehicle.
[0065] The relative position information of the first vehicle refers to the position information of the first vehicle relative to the second vehicle.
[0066] In some embodiments, the location information of the first vehicle can be represented using its World Geodetic System 1984 (WGS84) coordinates (λ, φ), i.e., the location information of the first vehicle can be represented using its WGS84 coordinates (λ, φ). λ represents longitude, and φ represents latitude. When transforming the first vehicle's WGS84 coordinates (λ, φ) to the second vehicle's vehicle coordinate system, a Universal Transverse Mercator (UTM) projection is first performed to convert (λ, φ) into UTM coordinates. Then convert it to the vehicle coordinate system of the second vehicle, and let the UTM coordinates of the second vehicle be... The heading angle is (Rotating clockwise from north), then the relative position information of the first vehicle. The calculation formula is as follows:
[0067]
[0068] in, This represents the UTM coordinates of the first vehicle. The UTM coordinates and heading angle of the second vehicle can be obtained from the GPS module or inertial measurement unit (IMU) of the second vehicle.
[0069] It should be noted that the UTM coordinates and heading angle of the second vehicle are the UTM coordinates and heading angle of the second vehicle at the target time point. This target time point is the time point corresponding to the timestamp in the anonymous data packet.
[0070] Step 302: Determine the distance between the first vehicle and the second vehicle based on the relative position information of the first vehicle.
[0071] In some embodiments, since the relative position information of the first vehicle is located in the vehicle coordinate system of the second vehicle, the on-board equipment of the second vehicle can calculate the distance between the first vehicle and the second vehicle based on the relative position information of the first vehicle. This distance is the actual physical distance between the first vehicle and the second vehicle.
[0072] Step 303: Determine the distance between each target vehicle and the second vehicle in the electronic rearview mirror image.
[0073] The distance between each target vehicle and the second vehicle can refer to the actual physical distance between each target vehicle and the second vehicle.
[0074] In some embodiments, target detection algorithms (such as the YOLOv4 model or a Convolutional Neural Network (CNN)) can be used to detect targets in the electronic rearview mirror image and identify each target vehicle in the image. For any target vehicle, a monocular vision ranging algorithm can be used to estimate the distance between the target vehicle and a second vehicle. The formula for calculating this distance is as follows:
[0075] in, The distance between the target vehicle and the second vehicle. The focal length of the electronic rearview mirror camera used to capture images from the electronic rearview mirror. The height of the electronic rearview mirror camera (the unit can be meters). The y-coordinate of the target vehicle in the electronic rearview mirror image (the unit can be pixels). This represents the y-coordinate of the horizon in the electronic rearview mirror image (the unit can be pixels). The height of the electronic rearview mirror camera mentioned above can refer to the height of the electronic rearview mirror camera above the ground, that is, the height of the electronic rearview mirror camera installed above the ground.
[0076] It should be noted that, for any target vehicle, after detecting the target vehicle from the electronic rearview mirror image, a rectangular box (e.g., a bounding box) surrounding the area where the target vehicle is located can be displayed in the electronic rearview mirror image. The position information of this rectangular box is determined as the position information of the target vehicle in the electronic rearview mirror image. Based on this, for the vehicle that matches the first vehicle among the target vehicles, the position information of the rectangular box surrounding the area where the vehicle is located displayed in the electronic rearview mirror image can be determined as the position information of the first vehicle in the electronic rearview mirror image.
[0077] In some embodiments, a Kalman filter can be used to track target vehicles in an electronic rearview mirror image, and dynamic annotation can be achieved on this basis.
[0078] Step 304: Based on the distance between the first vehicle and the second vehicle, and the distance between each target vehicle and the second vehicle, match the first vehicle with each target vehicle.
[0079] In some embodiments, based on the distance between the first vehicle and the second vehicle, and the distance between each target vehicle and the second vehicle, a nearest neighbor algorithm or a Hungarian algorithm can be used to match the first vehicle with each target vehicle, so as to associate the risk identification information of the driver of the first vehicle with the target vehicles in the electronic rearview mirror image and dynamically label them.
[0080] It should be noted that the second vehicle may receive only one anonymous data packet from the first vehicle, or it may simultaneously receive anonymous data packets from multiple first vehicles. When multiple anonymous data packets from first vehicles are received simultaneously, the position information of each first vehicle can be converted to the vehicle coordinate system of the second vehicle to obtain the relative position information of each first vehicle. Based on the relative position information of each first vehicle, the distance between each first vehicle and the second vehicle is determined, generating a V2X target list that includes the distance between each first vehicle and the second vehicle. Simultaneously, based on the distance between each target vehicle and the second vehicle, a visual target list is generated, which also includes the distance between each target vehicle and the second vehicle. Target matching is performed on the vehicles in the V2X target list and the visual target list to determine the vehicles that match in both lists, i.e., vehicles that represent the same target in both lists.
[0081] Step 305: If there is a vehicle among the target vehicles that matches the first vehicle, then the position information of the vehicle that matches the first vehicle in the electronic rearview mirror image is determined as the position information of the first vehicle in the electronic rearview mirror image.
[0082] Since the vehicle matched with the first vehicle can be digitally mapped in the electronic rearview mirror image of the first vehicle, the position information of the vehicle matched with the first vehicle in the electronic rearview mirror image can be determined as the position information of the first vehicle in the electronic rearview mirror image.
[0083] In some embodiments, if there is no vehicle among the target vehicles that matches the first vehicle, the matching is determined to be unsuccessful. It can be determined that the first vehicle is not within the field of view of the electronic rearview mirror camera, and the risk identification information of the driver of the first vehicle is not marked.
[0084] In some embodiments of this application, before marking the risk identification information at the marked location in the electronic rearview mirror image, the method further includes: Based on the risk identification information, determine the labeling format for the risk identification information; The risk identification information is marked at the designated location in the electronic rearview mirror image, including: Based on the annotation format, risk identification information is marked at the corresponding annotation positions in the electronic rearview mirror image.
[0085] The aforementioned risk signage information can refer to its presentation in the electronic rearview mirror image. For example, risk signage information can be dynamically marked in the electronic rearview mirror image using colors, icons, etc., with different colors and icons corresponding to different risk signage information. It should be noted that different risk signage information corresponds to different marking formats. Based on this, marking the risk signage information at the corresponding marking positions in the electronic rearview mirror image allows different risk signage information to present different visual effects, making it easier for the driver of the second vehicle to accurately identify the risk signage information of the first vehicle. This enables the driver of the second vehicle to anticipate risks in advance and take corresponding defensive driving measures (such as slowing down in advance, maintaining a greater distance, or temporarily changing lanes), shifting from a passive reaction to an active avoidance.
[0086] In one example, risk identification information is used as the risk level. When the risk level is low, the label can be a green semi-transparent box; when the risk level is medium, the label can be a yellow box or an exclamation mark icon (for example, a yellow box with a built-in exclamation mark icon to represent medium risk); when the risk level is high, the label can be a red box, a warning icon, a flashing effect, etc. (for example, a red box with a built-in warning icon and a flashing effect to represent high risk).
[0087] In some embodiments of this application, the anonymous data packet further includes a temporary anonymous identifier; the risk labeling method also includes: If the first vehicle is detected to have moved out of the communication range of the second vehicle, the data associated with the temporary anonymous identifier is cleared.
[0088] The data associated with the temporary anonymous identifier includes, but is not limited to, data in the anonymous data packet other than the temporary anonymous identifier. The communication range of the second vehicle may refer to the communication range of the V2X communication module within the second vehicle.
[0089] The aforementioned temporary anonymous identifier can be a dynamically generated identifier that does not contain the real identity information of the first vehicle and needs to be updated periodically. In V2X communication, it can replace the real identity information of the first vehicle and be used to uniquely identify the first vehicle for a short period of time. By replacing the real identity information of the first vehicle with a temporary anonymous identifier, the real identity of the first vehicle and its driver can be protected, and the periodic updating of the temporary anonymous identifier can prevent long-term tracking of the first vehicle.
[0090] In some embodiments, if no anonymous data packet from the first vehicle is received within M broadcast cycles, it can be determined that the first vehicle has left the communication range of the second vehicle, where M is a positive integer. Optionally, M can be set according to actual needs or empirical values, for example, M can be 3.
[0091] In this embodiment, when the first vehicle leaves the communication range of the second vehicle, all data associated with the temporary anonymous identifier is cleared, which enables automatic cleanup of the memory of the second vehicle's onboard equipment.
[0092] Please see Figure 4 , Figure 4 This illustration shows a flowchart of a data processing method provided in an embodiment of this application. This data processing method can be applied to, for example... Figure 1 The on-board equipment in the surrounding vehicle unit of the electronic rearview mirror annotation system shown is the on-board equipment of the first vehicle. By way of example and not limitation, the method includes the following steps: Step 401: Receive health data from the wearable device of the driver of the first vehicle.
[0093] The aforementioned health data may refer to data that can characterize the physical condition of the driver of the first vehicle.
[0094] In some embodiments, the aforementioned health data includes: the driver's heart rate, heart rate variability, and skin conductance response.
[0095] In a practical application scenario, the driver of the first vehicle can wear a wearable device that can collect the driver's health data and send the driver's health data to the vehicle's onboard equipment, thereby enabling the vehicle's onboard equipment to obtain the driver's health data.
[0096] Step 402: Based on health data, determine the driver's risk identification information.
[0097] In some embodiments, the on-board equipment of the first vehicle can perform a risk assessment of the driver's physical condition based on health data and using a risk assessment algorithm to obtain the driver's risk identification information. Optionally, a risk assessment algorithm can be selected according to actual needs, and this application does not limit it in this regard.
[0098] Step 403: Generate an anonymous data packet for the first vehicle based on the risk identification information.
[0099] In some embodiments, an anonymous data packet can be generated based on data such as risk identification information, timestamps, temporary anonymous identifiers, location information of the first vehicle, and motion status of the first vehicle. That is, the anonymous data packet includes data such as risk identification information, timestamps, temporary anonymous identifiers, location information of the first vehicle, and motion status of the first vehicle. The timestamp can refer to the generation time of the anonymous data packet to ensure temporal consistency of all data in the anonymous data packet.
[0100] In some embodiments, the risk identification information field in an anonymous data packet can be 1 byte.
[0101] To prevent prolonged tracking of the first vehicle, in some embodiments, the temporary anonymous identifier of the first vehicle can be updated periodically. For example, the temporary anonymous identifier can be updated every 5 minutes.
[0102] Step 404: Broadcast an anonymous data packet; the anonymous data packet instructs the second vehicle to mark risk identification information in the electronic rearview mirror image.
[0103] In some embodiments, the on-board equipment of the first vehicle can broadcast anonymous data packets via a V2X communication module. Based on this, the on-board equipment of the first vehicle can adopt the C-V2X or DSRC standard and define a dedicated message format to facilitate the broadcasting of anonymous data packets by the V2X communication module.
[0104] To ensure the integrity and authenticity of anonymous data packets, as well as their confidentiality, the anonymous data packets can be digitally signed and encrypted before being broadcast. Optionally, the digital signature algorithm and encryption algorithm can be selected according to actual needs; this application does not impose any limitations on them. For example, the Elliptic Curve Digital Signature Algorithm (ECDSA) can be used to digitally sign the anonymous data packets, and Advanced Encryption Standard-256 can be used to encrypt them.
[0105] In this embodiment, by receiving health data from the wearable device of the driver of the first vehicle, the driver's risk identification information can be determined based on the health data. Based on the risk identification information, an anonymous data packet of the first vehicle can be generated. By broadcasting the anonymous data packet, the second vehicle that receives the anonymous data packet can be instructed to mark the risk identification information in the electronic rearview mirror image. Thus, the risk identification information of the first vehicle can be displayed in the electronic rearview mirror image of the second vehicle, solving the problem of the single content displayed in the electronic rearview mirror image.
[0106] To protect data privacy, an explicit user authorization mechanism can be provided. Specifically, before receiving health data from the wearable device of the driver of the first vehicle, the following steps are also included: When the wearable device is first paired with the first vehicle, an authorization request interface is displayed; the authorization request interface displays authorization options, which indicate that anonymous data packets can be broadcast. In response to the selection of authorization options, anonymous packets can be broadcast.
[0107] The onboard equipment of the first vehicle will broadcast anonymous data packets only if broadcasting anonymous data packets is permitted.
[0108] It should be noted that the authorization options for anonymous data packets mentioned above are bound to the driver's account of the first vehicle, not the first vehicle itself, to ensure clear permissions when changing drivers.
[0109] In some embodiments, the authorization request interface also displays a non-authorization option, which indicates that broadcasting anonymous data packets is prohibited. When broadcasting anonymous data packets is prohibited, the on-board equipment of the first vehicle does not broadcast anonymous data packets.
[0110] In practical applications, the authorization request interface displays authorization and non-authorization options along with relevant text descriptions. For example, the text might say, "Do you allow anonymous sharing of aggregated health indicators (such as risk levels, not raw health data) for road safety assistance for surrounding vehicles? The raw health data will not leave this vehicle." This comprehensively, clearly, and honestly informs the driver of all the key information regarding authorization. It not only clarifies the user (surrounding vehicles) and purpose (road safety assistance) of the data, but more importantly, it precisely defines the scope of shared data (risk levels, not raw health data) and safety boundaries (raw health data will not leave the vehicle). This successfully establishes the driver's trust before broadcasting anonymous data packets, reducing their concerns about authorization.
[0111] In some embodiments of this application, the health data includes: the driver's heart rate, heart rate variability, and skin conductance; the on-board equipment of the first vehicle can be accessed via, for example... Figure 5 Steps 501 to 504 shown determine the driver's risk identification information.
[0112] Step 501: Calculate the driver's heart rate score based on the driver's heart rate and the driver's resting heart rate.
[0113] The driver's resting heart rate mentioned above can be understood as a reference point for calculating heart rate deviations from the normal value. It can be learned from the driver's historical data or preset according to actual needs or experience, such as 60 bpm or 80 bpm.
[0114] The above heart rate score The calculation formula is as follows:
[0115] in, For the driver's heart rate, This refers to the driver's resting heart rate.
[0116] Step 502: Calculate the driver's heart rate variability score based on the driver's heart rate variability and the baseline value of heart rate variability.
[0117] The baseline value of heart rate variability mentioned above can be understood as the standard value of heart rate variability, used to measure the normal level of heart rate variability. Low heart rate variability in drivers indicates that the driver is under physiological stress or fatigue.
[0118] The baseline values for heart rate variability mentioned above can be learned from the driver's historical data, or they can be preset according to actual needs or experience.
[0119] The above heart rate variability score The calculation formula is as follows:
[0120] in, For driver's heart rate variability, This represents the baseline value for heart rate variability.
[0121] Step 503: Calculate the driver's skin conductance response score based on the driver's skin conductance response and the maximum value of the skin conductance response.
[0122] Among them, the maximum value of the skin conductance response can be preset according to actual needs or experience values. It is used to normalize the driver's skin conductance response. A higher skin conductance response indicates that the driver is in a state of tension.
[0123] The above skin conductance response score The calculation formula is as follows:
[0124] in, For the driver's skin conductance response, This represents the maximum value of the skin conductance response.
[0125] Step 504: Based on heart rate score, heart rate variability score, and skin conductance response score, determine risk identification information.
[0126] In this embodiment, by scoring three key physiological indicators—heart rate, heart rate variability, and skin conductance—a multi-dimensional and in-depth perception of the driver's physiological state can be achieved, accurately identifying the inherent risk state caused by fatigue, stress, emotional excitement, etc. This elevates risk assessment from the "behavioral monitoring" level to the "state warning" level, providing the driver with crucial additional reaction time and significantly improving active safety.
[0127] In some embodiments of this application, risk identification information is determined based on heart rate score, heart rate variability score, and skin conductance response score, including: The driver's risk score is obtained by weighted summation of heart rate score, heart rate variability score, and skin conductance response score. Risk identification information is determined based on risk scoring.
[0128] Optionally, the weights of the three scores—heart rate score, heart rate variability score, and skin conductance response score—can be set according to actual needs or experience. Based on these weights, the three scores are weighted and summed to obtain the driver's risk score. For example, the weights of the three scores could be 0.4, 0.3, and 0.3, respectively.
[0129] The formula for calculating the risk score of the aforementioned drivers is as follows:
[0130] in, Assess the driver's risk score. As the weight of the heart rate score, The weights for the heart rate variability score, The weighting of the skin conductance response score.
[0131] In this embodiment, a weighted summation algorithm is used to transform multi-dimensional physiological indicators into a unified and quantitative risk score, thereby achieving objectivity, standardization, and precision in the risk assessment process. This provides a scientific and reliable basis for determining risk identification information and ensures that different risk conditions receive differentiated and significant warnings.
[0132] In some embodiments, any one of the three scores—heart rate score, heart rate variability score, and skin conductance response score—can be determined as the driver's risk score; alternatively, any two of the three scores can be weighted and summed to obtain the driver's risk score.
[0133] In some embodiments of this application, risk identification information is determined based on risk scoring, including: Determine the risk score range to which the risk score belongs; Risk score ranges are defined as risk identification information; Alternatively, the risk level corresponding to the risk score range can be determined as the risk identification information.
[0134] Different numerical values can be used to represent risk levels. For example, 1 can represent low risk, 2 can represent medium risk, and 3 can represent high risk. Optionally, risk score segments can be divided according to actual needs. For example, the risk score can be divided into three segments: less than or equal to 30, greater than 30 and less than or equal to 70, and greater than 70.
[0135] Optionally, risk levels and corresponding risk score ranges for each risk level can be defined according to actual needs. For example, risk levels can be divided into three levels: low risk, medium risk, and high risk. A risk score range of 30 or less corresponds to low risk, a risk score range of 30 or less than or equal to 70 corresponds to medium risk, and a risk score range of 70 or more corresponds to high risk.
[0136] In this embodiment, defining risk score segments as risk identification information can provide richer granularity of status information while maintaining privacy, enabling risk trend analysis and flexible localized decision-making; defining risk levels as risk identification information can transform complex health data into data units between poles while maintaining privacy, achieving extremely high communication efficiency.
[0137] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0138] Corresponding to the risk labeling method described in the above embodiments, Figure 6 A schematic diagram of the risk labeling device provided in the embodiments of this application is shown. For ease of explanation, only the parts related to the embodiments of this application are shown.
[0139] Reference Figure 6 The risk labeling device includes: The data packet receiving module 601 is used to receive anonymous data packets from the first vehicle; the anonymous data packets include risk identification information of the driver of the first vehicle and the location information of the first vehicle; The first determining module 602 is used to determine the position information of the first vehicle in the electronic rearview mirror image of the second vehicle based on the position information of the first vehicle. The second determining module 603 is used to determine the marking position of the risk identification information in the electronic rearview mirror image based on the position information of the first vehicle in the electronic rearview mirror image; The risk labeling module 604 is used to label the risk identification information at the labeling position in the electronic rearview mirror image.
[0140] In some embodiments, the first determining module 602 is specifically used for: The position information of the first vehicle is converted to the vehicle coordinate system of the second vehicle to obtain the relative position information of the first vehicle; the relative position information of the first vehicle is the position information of the first vehicle relative to the second vehicle. Based on the relative position information of the first vehicle, the distance between the first vehicle and the second vehicle is determined; Determine the distance between each target vehicle in the electronic rearview mirror image and the second vehicle; Based on the distance between the first vehicle and the second vehicle, and the distance between each target vehicle and the second vehicle, the first vehicle is matched with each target vehicle; If there is a vehicle among the target vehicles that matches the first vehicle, then the position information of the vehicle that matches the first vehicle in the electronic rearview mirror image is determined as the position information of the first vehicle in the electronic rearview mirror image.
[0141] In some embodiments, the risk labeling device further includes: The format determination module is used to determine the labeling format of the risk identification information based on the risk identification information; The aforementioned risk labeling module 604 is specifically used for: Based on the aforementioned labeling format, the risk identification information is labeled at the corresponding labeling position in the electronic rearview mirror image.
[0142] In some embodiments, the anonymous data packet further includes a temporary anonymous identifier, and the risk labeling device further includes: The data clearing module is used to clear the data associated with the temporary anonymous identifier if it is detected that the first vehicle has left the communication range of the second vehicle.
[0143] In some embodiments, the data packet receiving module 601 is specifically used for: The anonymous data packet is received from the first vehicle via the V2X communication module.
[0144] Corresponding to the data processing method described in the above embodiments, Figure 7 A schematic diagram of the structure of the data processing apparatus provided in the embodiments of this application is shown. For ease of explanation, only the parts related to the embodiments of this application are shown.
[0145] Reference Figure 7 The data processing device includes: The data receiving module 701 is used to receive health data from the wearable device of the driver of the first vehicle; The risk determination module 702 is used to determine the driver's risk identification information based on the health data; The data packet generation module 703 is used to generate an anonymous data packet for the first vehicle based on the risk identification information; The data packet broadcasting module 704 is used to broadcast the anonymous data packet; the anonymous data packet instructs the second vehicle to mark the risk identification information in the electronic rearview mirror image.
[0146] In some embodiments, the health data includes: the driver's heart rate, heart rate variability, and skin conductance; the risk determination module 702 includes: The first calculation unit is used to calculate the driver's heart rate score based on the driver's heart rate and the driver's resting heart rate; The second calculation unit is used to calculate the driver's heart rate variability score based on the driver's heart rate variability and the baseline value of heart rate variability. The third calculation unit is used to calculate the driver's skin conductance score based on the driver's skin conductance response and the maximum value of the skin conductance response. A risk determination unit is used to determine the risk identification information based on the heart rate score, the heart rate variability score, and the skin conductance response score.
[0147] In some embodiments, the risk determination unit is specifically used for: The driver's risk score is obtained by weighted summation of the heart rate score, the heart rate variability score, and the skin conductance response score. Based on the risk score, the risk identification information is determined.
[0148] In some embodiments, the risk determination unit is specifically used for: Determine the risk score range to which the risk score belongs; The risk score range is determined as the risk identification information; Alternatively, the risk level corresponding to the risk score range can be determined as the risk identification information.
[0149] In some embodiments, the anonymous data packet further includes a temporary anonymous identifier for the first vehicle; the data processing apparatus further includes: A periodic update module is used to periodically update the temporary anonymous identifier.
[0150] In some embodiments, the data processing apparatus further includes: An authorization display module is configured to display an authorization request interface when the wearable device is first matched with the first vehicle; the authorization request interface displays authorization options, and the authorization options indicate whether the anonymous data packet can be broadcast; The select response module is used to allow the broadcast of the anonymous data packet in response to the selection of the authorization option.
[0151] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.
[0152] Figure 8 This is a schematic diagram of the structure of the vehicle-mounted device provided in an embodiment of this application. Figure 8 As shown, the vehicle-mounted device 8 of this embodiment includes: at least one processor 80 ( Figure 8 (Only one is shown in the diagram), memory 81, and computer program 82 stored in said memory 81 and executable on said at least one processor 80, wherein said processor 80 executes said computer program 82 to implement the steps in any of the above method embodiments.
[0153] The vehicle-mounted equipment may include, but is not limited to, a processor 80 and a memory 81. Those skilled in the art will understand that... Figure 8 This is merely an example of vehicle-mounted device 8 and does not constitute a limitation on vehicle-mounted device 8. It may include more or fewer components than shown, or combine certain components, or different components, such as input / output devices, network access devices, etc.
[0154] The processor 80 may be a Central Processing Unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.
[0155] In some embodiments, the memory 81 may be an internal storage unit of the vehicle-mounted device 8, such as a hard drive or memory of the vehicle-mounted device 8. In other embodiments, the memory 81 may be an external storage device of the vehicle-mounted device 8, such as a plug-in hard drive, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the vehicle-mounted device 8. Furthermore, the memory 81 may include both internal and external storage units of the vehicle-mounted device 8. The memory 81 is used to store the operating system, applications, bootloader, data, and other programs, such as the program code of the computer program. The memory 81 can also be used to temporarily store data that has been output or will be output.
[0156] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0157] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include at least: any entity or device capable of carrying the computer program code to a device / vehicle-mounted equipment, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks.
[0158] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0159] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0160] In the embodiments provided in this application, it should be understood that the disclosed devices / vehicle-mounted equipment and methods can be implemented in other ways. For example, the device / vehicle-mounted equipment embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.
[0161] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0162] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.
Claims
1. A risk labeling method, characterized in that, include: Receive an anonymous data packet from a first vehicle; the anonymous data packet includes risk identification information of the driver of the first vehicle and the location information of the first vehicle; Based on the location information of the first vehicle, the location information of the first vehicle in the electronic rearview mirror image of the second vehicle is determined; Based on the position information of the first vehicle in the electronic rearview mirror image, the marking position of the risk identification information in the electronic rearview mirror image is determined; The risk identification information is marked at the marked position in the electronic rearview mirror image.
2. The risk labeling method according to claim 1, characterized in that, Determining the position information of the first vehicle in the electronic rearview mirror image of the second vehicle based on the position information of the first vehicle includes: The position information of the first vehicle is converted to the vehicle coordinate system of the second vehicle to obtain the relative position information of the first vehicle; the relative position information of the first vehicle is the position information of the first vehicle relative to the second vehicle. Based on the relative position information of the first vehicle, the distance between the first vehicle and the second vehicle is determined; Determine the distance between each target vehicle in the electronic rearview mirror image and the second vehicle; Based on the distance between the first vehicle and the second vehicle, and the distance between each target vehicle and the second vehicle, the first vehicle is matched with each target vehicle; If there is a vehicle among the target vehicles that matches the first vehicle, then the position information of the vehicle that matches the first vehicle in the electronic rearview mirror image is determined as the position information of the first vehicle in the electronic rearview mirror image.
3. The risk labeling method according to claim 1, characterized in that, Before marking the risk identification information at the marked location in the electronic rearview mirror image, the method further includes: Based on the risk identification information, determine the labeling format of the risk identification information; The step of marking the risk identification information at the marked position in the electronic rearview mirror image includes: Based on the aforementioned labeling format, the risk identification information is labeled at the corresponding labeling position in the electronic rearview mirror image.
4. The risk labeling method according to any one of claims 1 to 3, characterized in that, The anonymous data packet also includes a temporary anonymous identifier, and the risk labeling method further includes: If the first vehicle is detected to have left the communication range of the second vehicle, the data associated with the temporary anonymous identifier is cleared.
5. The risk labeling method according to any one of claims 1 to 3, characterized in that, The receiving of anonymous data packets from the first vehicle includes: The anonymous data packet is received from the first vehicle via the V2X communication module.
6. A data processing method, characterized in that, include: Receive health data from the wearable device of the driver of the first vehicle; Based on the health data, the driver's risk identification information is determined; Based on the risk identification information, an anonymous data packet for the first vehicle is generated; The anonymous data packet was broadcast. The anonymous data packet instructs the second vehicle to annotate the risk identification information in the electronic rearview mirror image.
7. The data processing method according to claim 6, characterized in that, The health data includes: the driver's heart rate, heart rate variability, and skin conductance; the determination of the driver's risk identification information based on the health data includes: Calculate the driver's heart rate score based on the driver's heart rate and the driver's resting heart rate; The driver's heart rate variability score is calculated based on the driver's heart rate variability and baseline values of heart rate variability. The driver's skin conductance response score is calculated based on the driver's skin conductance response and its maximum value. The risk identification information is determined based on the heart rate score, the heart rate variability score, and the skin conductance score.
8. The data processing method according to claim 7, characterized in that, The determination of the risk identification information based on the heart rate score, the heart rate variability score, and the skin conductance response score includes: The driver's risk score is obtained by weighted summation of the heart rate score, the heart rate variability score, and the skin conductance response score. Based on the risk score, the risk identification information is determined.
9. The data processing method according to claim 8, characterized in that, The process of determining the risk identification information based on the risk score includes: Determine the risk score range to which the risk score belongs; The risk score range is determined as the risk identification information; Alternatively, the risk level corresponding to the risk score range can be determined as the risk identification information.
10. The data processing method according to any one of claims 6 to 9, characterized in that, The anonymous data packet also includes a temporary anonymous identifier for the first vehicle; the data processing method further includes: The temporary anonymous identifier is updated periodically.
11. The data processing method according to any one of claims 6 to 9, characterized in that, Prior to receiving health data from the wearable device of the driver of the first vehicle, the method further includes: When the wearable device is first paired with the first vehicle, an authorization request interface is displayed; the authorization request interface displays authorization options, which indicate that the broadcast of the anonymous data packet is permitted; In response to the selection of the authorization option, the broadcast of the anonymous data packet is permitted.
12. A risk labeling device, characterized in that, include: A data packet receiving module is used to receive anonymous data packets from a first vehicle; the anonymous data packets include risk identification information of the driver of the first vehicle. The first determining module is used to determine the position information of the first vehicle in the electronic rearview mirror image of the second vehicle; The second determining module is used to determine the marking position of the risk identification information in the electronic rearview mirror image based on the position information of the first vehicle in the electronic rearview mirror image; The risk labeling module is used to label the risk identification information at the labeling position in the electronic rearview mirror image.
13. A data processing apparatus, characterized in that, include: A data receiving module is used to receive health data from the wearable device of the driver of the first vehicle; The risk determination module is used to determine the driver's risk identification information based on the health data; The data packet generation module is used to generate an anonymous data packet for the first vehicle based on the risk identification information; A data packet broadcasting module is used to broadcast the anonymous data packet; the anonymous data packet instructs the second vehicle to mark the risk identification information in the electronic rearview mirror image.
14. An in-vehicle device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it causes the vehicle-mounted device to implement the risk labeling method as described in any one of claims 1 to 5, or to implement the data processing method as described in any one of claims 6 to 11.
15. A computer program product, characterized in that, It includes a computer program, which, when run, causes the risk labeling method as described in any one of claims 1 to 5 to be executed, or causes the data processing method as described in any one of claims 6 to 11 to be executed.