Driving video generation method and device, vehicle and storage medium

Abstract

The application provides a driving video generation method and device, a vehicle and a storage medium. The method relates to the field of vehicles, and comprises the following steps: acquiring an initial state of an icon corresponding to target driving information in a vehicle; in response to a target operation of the vehicle, determining a target icon corresponding to the target operation; obtaining an updated state of the icon based on the initial state of the icon and the target icon; and generating a driving video of the vehicle based on the updated state of the icon. According to the method, the driving information in the recorded driving video can be consistent with the actual driving information of the vehicle.

Description

Technical Field

[0001] This application relates to the field of vehicles, and more specifically, to a method, apparatus, vehicle, and storage medium for generating driving videos in the field of vehicles. Background Technology

[0002] Vehicle video dash cams record video and audio of a vehicle's movement, providing evidence in case of traffic accidents. Current technology allows displaying vehicle driving information icons within the dash cam video. However, the driving information icons recorded in the dash cam video may not correspond to the actual driving actions, leading to a discrepancy between the vehicle's actual driving conditions and the recorded video.

[0003] Therefore, how to avoid discrepancies between the driving information recorded in driving videos and the actual driving information of the vehicle is a technical problem that needs to be solved. Summary of the Invention

[0004] This application provides a method, apparatus, vehicle, and storage medium for generating driving videos. The method obtains the updated state of an icon based on its initial state and a target icon; and generates driving videos of the vehicle based on the updated state of the icon. This avoids discrepancies between the driving information in the recorded driving videos and the actual driving information of the vehicle.

[0005] Firstly, a method for generating driving videos is provided, the method comprising:

[0006] Obtain the initial state of the icon corresponding to the target driving information in the vehicle;

[0007] In response to the vehicle's target operation, determine the target icon corresponding to the target operation;

[0008] Based on the initial state of the icon and the target icon, the updated state of the icon is obtained;

[0009] Based on the updated status of the icon, generate driving videos of the vehicle.

[0010] In the embodiments of this application, a target icon corresponding to a target operation is determined, and the updated state of the icon is determined based on the initial state of the target icon and the target icon itself. Since different target operations for a vehicle correspond to different target icons, determining the target icon corresponding to the target operation in response to the vehicle's target operation ensures that the obtained target icon is relatively accurate and can reflect the vehicle's target operation. Furthermore, compared to the prior art which determines the updated state of an icon based on its real-time state, this solution obtains the updated state of the icon based on its initial state and the target icon. Therefore, in the process of obtaining the updated state of the icon, errors in the updated state caused by changes in the real-time state of the icon can be avoided; thus, the problem of inconsistency between the driving information indicated by the icon in the recorded driving video and the actual driving information of the vehicle can be avoided.

[0011] It should be noted that during the process of updating the icon's display status, if the vehicle's bus sends an icon change signal before the update is complete, this signal will interrupt the update process and may cause the icon's current real-time status to change. If the icon's display status is updated based on its current real-time status, the updated icon may indicate driving information that is inconsistent with the vehicle's actual driving information. Therefore, this solution determines the icon's update status based on the acquired initial and target icon states, avoiding updates based on the icon's current real-time status. This prevents inconsistencies between the driving information recorded in the driving video and the vehicle's actual driving information.

[0012] In conjunction with the first aspect, some implementations of the first aspect also include:

[0013] Store the initial state of the icon in the vehicle's target cache area;

[0014] Obtain the initial state of the icon corresponding to the target driving information in the vehicle, including:

[0015] The initial state of the icon is obtained by reading the target cache.

[0016] In one implementation, the initial state of the icons is the state of each icon in response to the target operation.

[0017] In the embodiments of this application, the initial state of the icon is stored in the target cache area, and the initial state of the icon is obtained by reading the target cache area. Since the icon's state may change each time the vehicle responds to a target operation, storing the initial state of the icon in the target cache area ensures that the initial state of the icon before responding to the target operation can be determined through the target cache area. This ensures that the updated state of the icon can be determined based on the read initial state and the target icon.

[0018] In conjunction with the first aspect and the above implementation methods, some implementation methods of the first aspect also include:

[0019] Based on the target operation, determine the transformation rules for the target icon;

[0020] Based on the initial state of the icon and the target icon, the updated state of the icon is obtained, including:

[0021] Determine the initial state of the target icon based on the initial state of the target icon;

[0022] Based on the initial state of the target icon and the transformation rules of the target icon, the initial state of the target icon is updated to obtain the updated state of the icon.

[0023] In the embodiments of this application, the initial state of the icon is updated according to the initial state of the icon and the transformation rules of the target icon to obtain the updated state of the icon. Since the transformation rules of the target icon are different for different operations (e.g., the icon is always on or the icon is flashing), the transformation rules of the target icon are determined according to the target operation, and the initial state of the target icon is updated according to the transformation rules. This ensures that the operation indicated by the updated state of the icon is consistent with the target operation, that is, it ensures that the driving information in the recorded driving video is consistent with the actual driving information of the vehicle.

[0024] In conjunction with the first aspect and the above implementation methods, some implementation methods of the first aspect also include:

[0025] Obtain the initial mapping relationship between vehicle operations and icons;

[0026] In response to a target operation on the vehicle, determine the target icon corresponding to the target operation, including:

[0027] In response to the target operation, the target icon corresponding to the target operation is determined based on the target operation and the first mapping relationship.

[0028] In the embodiments of this application, a target icon corresponding to the target operation is determined based on the target operation and a first mapping relationship. Since the icons corresponding to different vehicle operations are usually different, the target icon is determined according to the target operation and the first mapping relationship to ensure that the obtained target icon is associated with the target operation and that the operation indicated by the target icon is consistent with the target operation.

[0029] In conjunction with the first aspect and the above implementation methods, some implementation methods of the first aspect also include:

[0030] Acquire video data during vehicle operation;

[0031] Based on the icon's update status, generate driving video of the vehicle, including:

[0032] Based on the video data and the update status of the icons, a driving video is generated.

[0033] In the embodiments of this application, a driving video is generated based on the update status of the icon and the video data during the vehicle's driving process, ensuring that the driving video can simultaneously display the video data and the update status of the icon, making the recorded information of the driving video more comprehensive.

[0034] Combining the first aspect and the above implementation methods, in some implementation methods of the first aspect, driving videos are generated based on the update status of video data and icons, including:

[0035] By using on-screen display technology, the update status of icons is overlaid on video data to generate driving videos.

[0036] In the embodiments of this application, the update status of icons is overlaid on video data using On Screen Display (OSD) technology to obtain driving video. This ensures that the update status of icons is displayed in the video data, thereby reflecting video data during vehicle operation through the driving video, and reflecting target operations during vehicle operation through the update status of icons in the driving video.

[0037] Combining the first aspect and the above implementation methods, in some implementation methods of the first aspect, the target driving information corresponding icons include the left turn signal icon and the right turn signal icon;

[0038] In response to a target operation on the vehicle, determine the target icon corresponding to the target operation, including:

[0039] If the target operation is to turn on the hazard lights, in response to the target operation, the target icons are determined to be the left turn signal icon and the right turn signal icon.

[0040] Secondly, a device for generating driving video is provided, the device comprising:

[0041] The acquisition module is used to acquire the initial state of the icon corresponding to the target driving information in the vehicle;

[0042] The processing module is used to respond to the target operation of the vehicle, determine the target icon corresponding to the target operation; obtain the updated state of the icon based on the initial state of the icon and the target icon; and generate the vehicle's driving video based on the updated state of the icon.

[0043] In conjunction with the second aspect, some implementations of the second aspect also include a storage module, which is used to: store the initial state of the icon in the target cache area of ​​the vehicle; the acquisition module is specifically used to: acquire the initial state of the icon by reading the target cache area.

[0044] Combining the second aspect and the above implementation methods, in some implementation methods of the second aspect, the processing module is specifically used to: determine the transformation rules of the target icon based on the target operation; determine the initial state of the target icon based on the initial state of the icon and the target icon; update the initial state of the target icon based on the initial state of the target icon and the transformation rules of the target icon to obtain the updated state of the icon.

[0045] In conjunction with the second aspect and the above implementation methods, in some implementation methods of the second aspect, the acquisition module is further used to: acquire the first mapping relationship between vehicle operation and icon; the processing module is specifically used to: in response to the target operation, determine the target icon corresponding to the target operation based on the target operation and the first mapping relationship.

[0046] In conjunction with the second aspect and the above implementation methods, in some implementation methods of the second aspect, the acquisition module is also used to: acquire video data during vehicle operation; the processing module is specifically used to: generate driving video based on the video data and the update status of the icons.

[0047] Combining the second aspect and the above implementation method, the processing module is specifically used to: generate driving video by overlaying the update status of the icon onto the video data using screen display technology.

[0048] Combining the second aspect and the above implementation methods, in some implementation methods of the second aspect, the target driving information corresponding icons include the left turn signal icon and the right turn signal icon; the processing module is specifically used to: if the target operation is to turn on the hazard lights, in response to the target operation, determine that the target icons are the left turn signal icon and the right turn signal icon.

[0049] Thirdly, a vehicle is provided, including a memory and a processor, the memory for storing executable program code, and the processor for calling and running the executable program code from the memory, causing the vehicle to perform the methods of the first aspect or any possible implementation thereof.

[0050] Fourthly, a computer program product is provided, comprising: computer program code, which, when run on a computer, causes the computer to perform the methods described in the first aspect or any possible implementation thereof.

[0051] Fifthly, a computer-readable storage medium is provided that stores a computer program, which, when executed, implements the method described in the first aspect or any possible implementation thereof. Attached Figure Description

[0052] Figure 1 This is a schematic diagram of a scenario provided in an embodiment of this application;

[0053] Figure 2 This is a schematic flowchart illustrating a method for generating driving video according to an embodiment of this application;

[0054] Figure 3 This is a schematic flowchart illustrating an icon updating method provided in an embodiment of this application;

[0055] Figure 4 This is a schematic flowchart illustrating another method for generating driving video provided in an embodiment of this application;

[0056] Figure 5 This is a schematic diagram of the structure of a vehicle video generation device provided in an embodiment of this application;

[0057] Figure 6 This is a schematic diagram of the structure of a vehicle provided in an embodiment of this application. Detailed Implementation

[0058] The technical solutions in this application will be clearly and thoroughly described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B. "And / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0059] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.

[0060] Vehicle video dash cams record video and audio of a vehicle's driving process, providing evidence for traffic accidents. Existing technology allows for the display of vehicle driving information icons within the dash cam video. Vehicles are typically equipped with various sensors, including but not limited to positioning systems, accelerometers, and gyroscopes, which collect various information about the vehicle's status. The vehicle processes and analyzes the received data through an onboard computer or other devices to obtain analysis results. Using image processing algorithms, these analysis results are overlaid on the video as icons, text, etc., without interfering with the original video content. For example, displaying the current vehicle speed in the dash cam video helps users review speed changes during driving; displaying navigation information includes overlaying maps and navigation instructions, showing the current driving route and turn prompts; and displaying navigation information within the dash cam video.

[0061] For example, Figure 1 This is a schematic diagram of a scenario provided in an embodiment of this application. For example... Figure 1 As shown in scenario 100, the vehicle's driving information icon is displayed in the driving record video; 110 is the video display screen of the driving record video; 120 is the display area of ​​the driving information icon in the video display screen.

[0062] For example, a driving information icon is displayed in display area 120, such as... Figure 1 As shown in 120, the driving information icons from left to right are: left turn signal icon, right turn signal icon, high beam icon, low beam icon, front fog light icon, rear fog light icon, and auto hold icon.

[0063] It should be noted that the driving information icons in display area 120 are illustrative of the driving information icons and their positions, and do not mean that all the driving information icons shown are in the on state (lit state).

[0064] For example, displaying vehicle driving information icons in the dashcam video can better reflect the driver's driving operations during the journey. For instance, when the driver turns on the left turn signal, the left turn signal icon is displayed simultaneously in the dashcam video; when the driver turns on the high beams, the high beam icon is displayed simultaneously in the dashcam video; and when the driver turns on the hazard lights, the vehicle's left and right turn signals flash synchronously or in a cycle.

[0065] It should be noted that the above are examples of the video display screen and driving information icons of the dashcam video, and this application does not make any specific limitations on them.

[0066] For example, in the driving information icons displayed in the dashcam video, the driving information icons recorded in the dashcam video may not be consistent with the driving information icons corresponding to the actual driving operation of the vehicle, which may be due to the problem that the actual driving situation of the vehicle is not synchronized with the video recording.

[0067] For example, if the actual driving operation is to activate the hazard lights, the corresponding driving information icons are the left and right turn signal icons, both of which are illuminated. If, while both the left and right turn signals are illuminated, the vehicle's Controller Area Network (CAN) sends a turn signal change signal, the right turn signal icon status is updated, causing it to turn off. At this time, the corresponding driving information icon will show the left turn signal illuminated and the right turn signal off. That is, when the hazard lights are activated, due to the bus signal change, the driving information icon displays the left turn signal illuminated and the right turn signal off, which is equivalent to the display state when the vehicle's left turn signal is activated. Therefore, there is a problem where the vehicle's driving information icon displays a left turn signal when the driver activates the hazard lights; that is, there is a discrepancy between the vehicle's actual driving situation and the video recording.

[0068] It should be noted that if another icon update signal is detected before the current update process is completed during the updating of driving information icons, problems may occur in the current icon update process, namely, the driving information indicated by the icon may be inconsistent with the actual driving information of the vehicle. The above is an illustrative example using turn signal icons (including the left and right turn signal icons), and this application does not limit this.

[0069] Therefore, how to avoid discrepancies between the driving information recorded in driving videos and the actual driving information of the vehicle is a technical problem that needs to be solved.

[0070] In view of this, this application provides a method, apparatus, vehicle, and storage medium for generating driving videos. Through embodiments of this application, the updated state of an icon is obtained based on its initial state and a target icon; and driving videos of the vehicle are generated based on the updated state of the icon. This avoids discrepancies between the driving information in the recorded driving videos and the actual driving information of the vehicle.

[0071] The following is combined Figures 2 to 4 The flowchart in the document further illustrates the method for generating driving recorder videos provided in the embodiments of this application.

[0072] Figure 2 This is a schematic flowchart illustrating a method for generating driving videos provided in an embodiment of this application.

[0073] For example, Figure 2 The method 200 shown can be performed by a vehicle; or it can be performed by a processor or chip in the vehicle.

[0074] Optionally, Figure 2 The method shown can also be performed by a target device in the vehicle used to record driving video; for example, the target device can be an in-vehicle video driving recorder.

[0075] like Figure 2 As shown, the method 200 for generating driving video includes steps S210 to S240, which are described in detail below.

[0076] S210, Obtain the initial state of the icon corresponding to the target driving information in the vehicle.

[0077] For example, the initial state of the icon corresponding to the target driving information in the vehicle is obtained; wherein, the target driving information includes: vehicle speed, acceleration, engine speed, steering wheel angle, throttle status information, brake status information, light information, windshield wiper status, etc.

[0078] For example, the icons corresponding to the target driving information include: left turn signal icon, right turn signal icon, high beam icon, low beam icon, front fog light icon, rear fog light icon, auto hold icon, and icons corresponding to information such as vehicle speed, acceleration, engine speed, throttle status, and wiper status.

[0079] For example, the vehicle communicates with various components such as the engine, steering wheel, windshield wipers, turn signals, and accelerator via the CAN bus, and determines the working status of each component, thereby determining the initial state of the icon corresponding to the target driving information.

[0080] For example, the initial state of the icon corresponding to the target driving information in the vehicle is the state before the target operation is detected; the initial state of the icon includes an on state (lit state) or a off state (off state).

[0081] In one implementation, the initial state of the icon is stored in the target cache of the vehicle; the initial state of the icon is obtained by reading the target cache.

[0082] Optionally, if the vehicle includes a target device, the target cache can be the target cache of the target device; and the initial state of the icon is stored in the target cache of the target device; wherein the target device is used to record driving video. If the vehicle does not include a target device, the target cache can be the target cache of the vehicle's onboard computer, and the initial state of the icon is stored in the target cache of the onboard computer.

[0083] For example, the initial state of an icon is the state of each icon before the target operation. That is, the initial state is the icon state before each frame of signal update. For instance, if the target operation for a vehicle is to turn on its hazard lights, then before updating the state of the icon corresponding to the hazard lights, the initial state of the icon is stored in the target buffer. The initial state of the icon is obtained by reading the target buffer.

[0084] In the embodiments of this application, the initial state of the icon is stored in the target cache, and the initial state of the icon is obtained by reading the target cache. Since the state of the icon may change each time the vehicle responds to the target operation, storing the initial state of the icon in the target cache ensures that the initial state of the icon before responding to the target operation can be determined through the target cache. This ensures that the updated state of the icon can be determined based on the initial state of the icon and the target icon.

[0085] S220, in response to the vehicle's target operation, determines the target icon corresponding to the target operation.

[0086] For example, in response to a target operation of the vehicle, a target icon corresponding to the target operation is determined; in order to ensure that the target driving information during the vehicle's operation can be reflected through the icon, different target operations usually correspond to different icons; when a target operation of the vehicle is detected, the target icon corresponding to the target operation is determined to ensure that the target driving information during the vehicle's operation can be reflected through the target icon.

[0087] For example, if the target operation is to activate auto hold, the corresponding target icon is the vehicle's auto hold icon; if the target operation is to activate the left turn signal, the corresponding target icon is the left turn signal icon; and if the target operation is to activate the right turn signal, the corresponding target icon is the vehicle's right turn signal icon.

[0088] Optionally, the icons corresponding to the target driving information include the left turn signal icon and the right turn signal icon; if the target operation is to turn on the hazard lights, the target icons are determined to be the left turn signal icon and the right turn signal icon in response to the target operation.

[0089] For example, if the target operation is to turn on the hazard lights, the target icons are the left turn signal icon and the right turn signal icon; when the vehicle's hazard lights are on, the vehicle's left turn signal icon and right turn signal icon are simultaneously lit or flashing.

[0090] In one implementation, the method also includes: obtaining the first mapping relationship between vehicle operations and icons;

[0091] In response to a target operation of the vehicle, a target icon corresponding to the target operation is determined, including: in response to the target operation, determining the target icon corresponding to the target operation based on the target operation and a first mapping relationship.

[0092] For example, to automatically acquire and display corresponding icons based on vehicle operations, a system mapping relationship needs to be established, ensuring that the system can monitor vehicle status in real time, parse operation information, and accurately display target icons. The initial mapping relationship between vehicle operations and icons can be represented using a mapping table, with each vehicle operation associated with a specific icon. Optionally, the initial mapping relationship can be stored using JSON or XML file format.

[0093] For example, a vehicle can obtain the operation data of the target operation of the vehicle through the CAN bus interface; based on the detected target operation, the target icon corresponding to the target operation of the vehicle is found in the mapping table corresponding to the first mapping relationship.

[0094] In the embodiments of this application, a target icon corresponding to the target operation is determined based on the target operation and a first mapping relationship. Since the icons corresponding to different vehicle operations are usually different, the target icon is determined according to the target operation and the first mapping relationship to ensure that the obtained target icon is associated with the target operation and that the operation indicated by the target icon is consistent with the target operation.

[0095] Optionally, the priority order of the icons can be set. If multiple operations occur simultaneously in the vehicle, the icons corresponding to the multiple operations are determined in order of priority.

[0096] It should be noted that when setting the priority order of icons, in order to ensure that icons can be displayed in a reasonable priority order when multiple vehicle operations occur at the same time, and to avoid information overload or the omission of key information, the priority order of icons is set.

[0097] For example, the priority order of icons, from highest to lowest, can include: safety-related icons; icons related to the status of critical vehicle systems (such as emergency safety warning icons, ABS anti-lock braking system activation icons, ESP electronic stability control system activation icons, engine malfunction indicator lights, brake system malfunction icons, low fuel warnings, tire pressure monitoring system warnings, battery charging system malfunctions, and overheating coolant warnings); icons reflecting the driver's current operation (such as hazard lights on, left / right turn signals on, seatbelt unfastened warnings, blind spot monitoring warnings, lane departure warnings, etc.); and icons providing auxiliary information (such as vehicle speed changes, engine speed changes, gear changes, and fuel consumption information lights). When multiple vehicle operations occur simultaneously, the icons corresponding to the operations are determined sequentially according to their priority. If multiple icons are allowed to be displayed simultaneously, but the total number is limited to maintain interface clarity, the icons are arranged from top to bottom or from left to right according to priority, ensuring that high-priority icons are in prominent positions.

[0098] Optionally, similar types of icons can be grouped for display, for example, all alarm icons can be placed in one area and all driving information icons in another area; and a display time window can be set for each icon, which will be automatically hidden or downgraded after a certain period of time.

[0099] S230: Based on the initial state of the icon and the target icon, obtain the updated state of the icon.

[0100] For example, the target icon is the icon corresponding to the vehicle target operation. In response to the target operation, the initial state of the target icon is determined based on the initial state of the icon and the target icon, and the initial state of the icon is updated to obtain the updated state of the icon.

[0101] One implementation also includes: determining the transformation rules of the target icon based on the target operation;

[0102] Based on the initial state of the icon and the target icon, the updated state of the icon is obtained, including: determining the initial state of the target icon based on the initial state of the icon and the target icon; updating the initial state of the target icon based on the initial state of the target icon and the transformation rules of the target icon, and obtaining the updated state of the icon.

[0103] For example, the initial state of the icon is updated based on its initial state and the transformation rules of the target icon, resulting in the updated state of the icon. Since the transformation rules of the target icon differ for different operations, the icon transformation rules corresponding to the target operation are determined based on the target operation. For instance, when the driver activates the left turn signal, the left turn signal icon flashes when the left turn signal is activated and stops when the signal is turned off; when the driver activates the right turn signal, the right turn signal icon flashes when the right turn signal is activated and stops when the signal is turned off; when the driver activates the hazard lights, both the left and right turn signal icons flash simultaneously. When vehicle braking is detected, the brake icon illuminates; when the vehicle speed increases or decreases, the speedometer icon should be updated in real time to reflect the current speed. The speedometer icon can be a dynamic speedometer, with the pointer rotating as the actual vehicle speed changes, and the digital display updating accordingly.

[0104] It should be noted that the above are examples of icon transformation rules. In practical applications, different icon transformation rules can be determined according to the characteristics of the vehicle model and user needs. This application does not limit this.

[0105] In the embodiments of this application, a change rule for the target icon is determined based on the target operation, and the initial state of the target icon is updated according to the change rule. This ensures that the operation indicated by the updated state of the icon is consistent with the target operation, that is, it ensures that the driving information in the recorded driving video is consistent with the actual driving information of the vehicle.

[0106] S240 generates driving videos of the vehicle based on the updated status of the icons.

[0107] For example, by comparing the initial state of the icon with the target icon, it is determined whether the icon needs to be added, removed, or updated, thereby determining the update state of the icon; and the updated icon state is applied to the video frame, that is, displayed at the corresponding display position of the icon in the video screen.

[0108] In one implementation, video data of the vehicle during its driving process is acquired; based on the video data and the update status of the icons, a driving video is generated.

[0109] For example, video data of a vehicle in motion is recorded using a target device; wherein the video data includes forward-view video data and / or surround-view video data of the vehicle. By recording video data from different angles during the vehicle's movement using the target device, more comprehensive video data is ensured to be obtained.

[0110] In the embodiments of this application, a driving video is generated based on the update status of the icon and the video data during the vehicle's driving process, ensuring that the driving video can simultaneously display the video data and the update status of the icon, making the recorded information of the driving video more comprehensive.

[0111] For example, driving videos can be generated by overlaying the update status of icons onto video data using screen display technology.

[0112] For example, On-Screen Display (OSD) is a technology used to overlay text, graphics, and other information directly onto a screen so that users can view and adjust settings or receive important information. OSD data, including updated status icons, is typically stored in a separate frame buffer and then merged with the main video stream before being output to the display.

[0113] In the embodiments of this application, OSD technology is used to overlay the update status of icons onto video data to obtain driving video. This ensures that the update status of icons is displayed in the video data, thereby reflecting the video data during vehicle operation through the driving video, and reflecting the target operations during vehicle operation through the icon update status in the driving video.

[0114] Optionally, when generating a vehicle driving video, the transparency of the icon is determined according to the icon type; the driving video is generated based on the video data, the update status of the icon, and the transparency of the icon.

[0115] For example, when overlaying the update status of icons onto the main video stream of the display screen using OSD technology, different levels of icon transparency can be set. For instance, if the icon is related to alarm information (e.g., engine malfunction icon, low coolant level icon, high oil temperature icon, left brake pad wear icon, and right brake pad wear icon), a lower transparency can be set so that the icon's display content can partially or completely cover the underlying video image; ensuring that the alarm information-related icons are clearly visible and not easily overlooked. If the icon is another type of icon besides alarm information icons (e.g., left turn signal icon, right turn signal icon, high beam icon, low beam icon, front fog light icon, etc.), a higher transparency can be set so that the icon can partially obscure the underlying video image, allowing the underlying video image at the overlapping position of the icon to be seen without affecting the icon's display.

[0116] In one implementation, the icons are positioned appropriately to avoid obscuring key video footage; subtle animation effects are added to key operations to improve the display of icons in the video footage.

[0117] In the above embodiments, a target icon corresponding to the target operation is determined, and the update state of the icon is determined based on the initial state of the target icon and the target icon. During the process of updating the icon's display state, if the vehicle's bus sends an icon change signal before the update is completed, this signal will interrupt the update process and may cause the icon's current real-time state to change. If the icon's display state is updated based on its current real-time state, the driving information indicated by the updated icon may be inconsistent with the vehicle's actual driving information. Therefore, this solution determines the icon's update state based on the acquired initial state and target icon, avoiding updating the icon based on its current real-time state when determining the update state, thereby preventing inconsistencies between the driving information in the recorded driving video and the vehicle's actual driving information.

[0118] For example, in combination Figure 3 To elaborate further, Figure 3 This is a schematic flowchart illustrating an icon updating method provided in an embodiment of this application.

[0119] Figure 3 The method 300 shown can be executed by a vehicle; or it can be executed by a processor or chip in the vehicle.

[0120] Figure 3 The method shown is a method for updating the display state of an icon based on its initial state, including steps S301 to S306. Steps S301 to S306 are described in detail below.

[0121] S301 stores the icon status in the target cache.

[0122] S302, turn on hazard lights and trigger OSD update.

[0123] For example, the target operation of the vehicle is detected. When the target operation is to turn on the hazard lights, the hazard lights signal is activated and triggers an OSD update; where OSD update refers to updating the icons displayed on the screen.

[0124] S303 updates the left turn signal icon based on the stored icon status.

[0125] For example, the state of the left turn signal icon before the hazard lights are turned on is determined by reading the icon state stored in the target cache, and the left turn signal icon is updated according to the state of the left turn signal icon before the hazard lights are turned on.

[0126] S304, Bus turn signal update.

[0127] S305 updates the right turn signal icon based on the stored icon status.

[0128] For example, based on the stored icon states, the state of the right turn signal icon before the hazard lights are turned on is determined, and the left turn signal icon is updated.

[0129] S306, will be updated later.

[0130] For example, if the bus turn signal is updated, the current state of the vehicle's left turn icon or right turn signal icon may change; however, since the right turn signal icon is updated based on the stored icon state, it is not affected by the current state of the left turn signal icon or right turn signal icon.

[0131] For example, initially, the icon status stored in the target buffer is that both the left and right turn signals are off. If the hazard lights are turned on, both the left and right turn signals illuminate. At this point, the bus turn signal is updated, indicating that the right turn signal should be turned on and off. Under the action of the updated bus turn signal, based on the icon status stored in the target buffer, the updated icon display status is that both the left and right turn signals are off; thus solving the problem of inconsistency between the driving information in the driving video and the actual driving information of the vehicle.

[0132] It should be noted that if the display status of an icon is updated based on its real-time status, and the bus sends an icon change signal during the update process, the current real-time status of the icon may change. If the display status of an icon is updated based on its current real-time status, the driving information indicated by the updated icon may be inconsistent with the actual driving information of the vehicle.

[0133] For example, when updating the display state of an icon based on its real-time status, the specific method includes: detecting the vehicle's target operation; when the target operation is to turn on the hazard lights, the hazard lights signal is activated and an OSD update is triggered; wherein, OSD update refers to updating the icons displayed on the screen. The left turn signal icon is updated according to its current state. When the hazard lights are turned on and an OSD update is triggered, the left and right turn signal icons are updated sequentially according to their current states. If, after updating the left turn signal icon, the bus turn signal is updated, causing a change in the current state of either the left or right turn signal icon, and since the current state of the right turn signal icon changes under the action of the overall turn signal update, updating the right turn signal icon based on its current state might result in the updated display state of the left and right turn signals no longer indicating the icon display state corresponding to the hazard light operation.

[0134] For example, initially, both the left and right turn signals are off. If the hazard lights are activated, both the left and right turn signals illuminate. At this point, the bus turn signal updates, indicating that the right turn signal should be activated and deactivated. Under the influence of this bus turn signal update, the icon currently displays the left turn signal illuminated and the right turn signal deactivated. This icon display is consistent with the icon display during a left turn operation. However, in this case, the vehicle is actually using hazard lights, while the icon indicates a left turn, indicating a discrepancy between the driving information in the video and the actual driving information of the vehicle.

[0135] In the embodiments of this application, the method of updating the display state of an icon based on its initial state is based on the stored icon state; therefore, it is not affected by the update of the bus turn signal, thereby enabling the turn signals (including the left turn signal and the right turn signal) to respond correctly to the operation of turning on the hazard lights and to correctly indicate the operation through the turn signals.

[0136] Figure 4 This is a schematic flowchart illustrating a method for generating driving videos provided in an embodiment of this application.

[0137] Figure 4 The method 400 shown can be executed by a vehicle; or it can be executed by a processor or chip in the vehicle.

[0138] like Figure 4 The method 400 for generating driving video shown includes steps S401 to S407, which are described in detail below.

[0139] S401 stores the initial state of the icon corresponding to the target driving information in the vehicle's target cache area.

[0140] For example, the target driving information includes: vehicle speed, acceleration, engine speed, steering wheel angle, throttle status, brake status, light information, and windshield wiper status. The corresponding icons for the target driving information include: left turn signal icon, right turn signal icon, high beam icon, low beam icon, front fog light icon, rear fog light icon, auto hold icon, and icons corresponding to vehicle speed, acceleration, engine speed, throttle status, and windshield wiper status.

[0141] For example, the initial state of the icons is the state of each icon before the target operation. That is, the initial state is the state of the icons before each frame signal update.

[0142] If the vehicle includes a target device, the target cache can be the target cache of the target device; and the initial state of the icon is stored in the target cache of the target device; wherein, the target device is used to record driving video. If the vehicle does not include a target device, the target cache can be the target cache of the vehicle's onboard computer, and the initial state of the icon is stored in the target cache of the onboard computer.

[0143] S402, read the target cache and obtain the initial state of the icon.

[0144] For example, the initial state of the icon can be obtained by reading the target cache.

[0145] Alternatively, the implementation methods of S401 and S402 can be found in [reference needed]. Figure 2 The relevant descriptions of S210 will not be repeated here.

[0146] S403, in response to the vehicle's target operation, determines the target icon corresponding to the target operation.

[0147] For example, a first mapping relationship between vehicle operations and icons is obtained; based on the target operation and the first mapping relationship, the target icon corresponding to the target operation is determined. For example, if the target operation is to turn on the high beams, the corresponding target icon is the vehicle's high beam icon; if the target operation is to turn on auto hold, the corresponding target icon is the vehicle's auto hold icon; if the target operation is to turn on the left turn signal (or turn on the right turn signal), the corresponding target icon is the left turn signal icon (or the right turn signal icon).

[0148] Alternatively, the implementation of S403 can be found in [reference needed]. Figure 2The implementation method of S220 will not be elaborated here.

[0149] S404, Determine the initial state of the target icon based on the initial state of the icon and the target icon.

[0150] For example, the target icon is the icon corresponding to the vehicle target operation. In response to the target operation, the initial state of the target icon is determined based on the initial state of the icon and the target icon.

[0151] S405, Determine the transformation rules of the target icon based on the target operation.

[0152] For example, since the transformation rules of the target icon are different for different operations, the transformation rules of the target icon corresponding to the target operation are determined according to the target operation.

[0153] S406, Based on the initial state of the target icon and the transformation rules, obtain the updated state of the icon.

[0154] For example, the initial state of the target icon is updated according to the transformation rules. It is ensured that the operation indicated by the updated state of the icon is consistent with the target operation, that is, ensuring that the driving information in the recorded driving video is consistent with the actual driving information of the vehicle.

[0155] Alternatively, the implementation methods of S404 to S406 can be found in [reference needed]. Figure 2 The implementation method of S230 will not be elaborated here.

[0156] S407 generates driving videos based on video data and icon update status during vehicle operation.

[0157] For example, video data of a vehicle in motion is recorded using a target device; the video data includes forward-view video data and / or surround-view video data of the vehicle; a driving recording video is generated based on the video data and the update status of icons. It is ensured that the driving video simultaneously displays the update status of both video data and icons, making the recorded information more comprehensive.

[0158] Alternatively, the implementation of S407 can be found in [reference needed]. Figure 2 The implementation method of S240 will not be elaborated here.

[0159] In the embodiments of this application, the initial state of the icon is stored in the target cache to ensure that the initial state of the icon before the target operation can be determined through the target cache. This ensures that the updated state of the icon can be determined based on the read initial state and the target icon. According to the target operation, the change rules of the target icon are determined, and the initial state of the target icon is updated according to the change rules. This ensures that the operation indicated by the updated state of the icon is consistent with the target operation, that is, it ensures that the driving information in the recorded driving video is consistent with the actual driving information of the vehicle. Since the update is performed on the initial state of the target icon, the initial state of the target icon is not affected by signal changes during the update process; therefore, updating the display state of the icon based on its current real-time state is avoided; thus, the problem of inconsistency between the driving information in the recorded driving video and the actual driving information of the vehicle is avoided.

[0160] The above text combined Figures 1 to 4 The method for generating driving videos provided in the embodiments of this application is described in detail below; the following will be combined with Figure 5 and Figure 6 The apparatus embodiments of this application are described in detail below. It should be understood that the apparatus in the embodiments of this application can perform the various methods described in the foregoing embodiments of this application, that is, the specific working processes of the various products described below can be referred to the corresponding processes in the foregoing method embodiments.

[0161] Figure 5 This is a schematic diagram of the structure of a vehicle video generation device provided in an embodiment of this application.

[0162] For example, such as Figure 5 As shown, the driving video generation device 500 includes:

[0163] The acquisition module 510 is used to acquire the initial state of the icon corresponding to the target driving information in the vehicle;

[0164] The processing module 520 is used to respond to the target operation of the vehicle, determine the target icon corresponding to the target operation; obtain the updated state of the icon based on the initial state of the icon and the target icon; and generate the vehicle's driving video based on the updated state of the icon.

[0165] Optionally, as an embodiment, it also includes a storage module, which is used to: store the initial state of the icon in the target cache area of ​​the vehicle; the acquisition module 510 is specifically used to: acquire the initial state of the icon by reading the target cache area.

[0166] Optionally, as an embodiment, the processing module 520 is specifically used to: determine the transformation rules of the target icon based on the target operation; determine the initial state of the target icon based on the initial state of the icon and the target icon; and update the initial state of the target icon based on the initial state of the target icon and the transformation rules of the target icon to obtain the updated state of the icon.

[0167] Optionally, as an embodiment, the acquisition module 510 is further configured to: acquire a first mapping relationship between vehicle operations and icons; the processing module 520 is specifically configured to: in response to a target operation, determine the target icon corresponding to the target operation based on the target operation and the first mapping relationship.

[0168] Optionally, as an embodiment, the acquisition module 510 is further configured to: acquire video data during vehicle operation; the processing module 520 is specifically configured to: generate driving video based on the video data and the update status of the icons.

[0169] Optionally, as an embodiment, the processing module 520 is specifically used to: generate a driving video by overlaying the update status of the icon onto the video data using screen display technology.

[0170] Optionally, as an embodiment, the target driving information corresponding icons include a left turn signal icon and a right turn signal icon; the processing module 520 is specifically used to: if the target operation is to turn on the hazard lights, in response to the target operation, determine that the target icons are the left turn signal icon and the right turn signal icon.

[0171] It should be noted that the aforementioned device for generating driving videos is embodied in the form of functional units. The term "module" here can be implemented in software and / or hardware, without specific limitations.

[0172] For example, a "module" can be a software program, hardware circuit, or a combination of both that implements the above functions. Hardware circuits may include application-specific integrated circuits (ASICs), electronic circuits, processors (e.g., shared processors, proprietary processors, or group processors) and memory for executing one or more software or firmware programs, combined logic circuits, and / or other suitable components that support the described functions.

[0173] Therefore, the units of the various examples described in the embodiments of this application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0174] Figure 6 This is a schematic diagram of the structure of a vehicle provided in an embodiment of this application.

[0175] For example, vehicle 600 includes processor 610, memory 620 and executable program code 630.

[0176] For example, vehicle 600 includes one or more processors 610 that can support vehicle 600 in implementing the method for generating driving video in the method embodiment. Processor 610 can be a general-purpose processor or a special-purpose processor. For example, processor 610 can be a central processing unit (CPU), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, such as discrete gates, transistor logic devices, or discrete hardware components.

[0177] For example, processor 610 can be used to control vehicle 600, execute software programs, and process data from the software programs. Vehicle 600 may also include a communication unit for receiving and transmitting signals.

[0178] For example, the vehicle 600 may include one or more memories 620, on which executable program code 630 is stored. The executable program code 630 can be run by the processor 610 to generate instructions, causing the processor 610 to execute the driving video generation method described in the above method embodiments according to the instructions.

[0179] Optionally, the memory 620 may also store data. Optionally, the processor 610 may also read data stored in the memory 620, which may be stored at the same memory address as the executable program code 630, or the data may be stored at a different memory address than the executable program code 630.

[0180] For example, the processor 610 and memory 620 can be configured separately or integrated together, for example, integrated on a system-on-chip (SOC) of the terminal device.

[0181] For example, the memory 620 can be used to store related programs of the driving video generation method provided in the embodiments of this application. The processor 620 can be used to call the executable program code 630 stored in the memory 620 when controlling the vehicle to execute the driving video generation method of the embodiments of this application; for example, obtaining the initial state of the icon corresponding to the target driving information in the vehicle; determining the target icon corresponding to the target operation in response to the target operation of the vehicle; obtaining the updated state of the icon based on the initial state of the icon and the target icon; and generating the driving video of the vehicle based on the updated state of the icon.

[0182] This application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the driving video generation method of any of the foregoing embodiments.

[0183] The computer-readable storage medium may include, but is not limited to, any type of disk, including floppy disks, optical disks, Digital Video Discs (DVDs), Compact Disc Read-Only Memory (CD-ROM), microdrives, and magneto-optical disks, read-only memory (ROM), random access memory (RAM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), dynamic random access memory (DRAM), video random access memory (VRAM), flash memory devices, magnetic cards or optical cards, nanosystems (including molecular memory ICs), or any type of medium or device suitable for storing instructions and / or data.

[0184] This application also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned related steps to implement a method for generating driving video in the above embodiments.

[0185] In addition, the vehicle provided in the embodiments of this application may specifically be a chip, component or module. The vehicle may include a connected processor and a memory. The memory is used to store instructions. When the vehicle is running, the processor may call and execute the instructions to make the chip execute a driving video generation method in the above embodiments.

[0186] The vehicle, computer-readable storage medium, computer program product, or chip provided in this application are all used to execute the corresponding driving video generation method provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects in the corresponding driving video generation method provided above, and will not be repeated here.

[0187] Through the above description of the embodiments, those skilled in the art will understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0188] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0189] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for generating driving video, characterized in that, The method includes: The initial state of the icon corresponding to the target driving information is stored in the target cache area of ​​the vehicle. The initial state in the target cache area is not affected by the icon change signal. The initial state of the icon is the state before the target operation of the vehicle is detected. The initial state includes an on state or an off state. The icon change signal is used to trigger the real-time state change of the icon. The initial state of the icon is obtained by reading the target cache. In response to a target operation of the vehicle, a target icon corresponding to the target operation is determined; If the vehicle's bus sends an icon change signal before the icon's display state is updated, the updated state of the icon is obtained based on the initial state of the icon and the target icon. Based on the updated status of the icon, a driving video of the vehicle is generated.

2. The method according to claim 1, characterized in that, Also includes: Based on the target operation, determine the transformation rules for the target icon; The step of obtaining the updated state of the icon based on its initial state and the target icon includes: Based on the initial state of the icon and the target icon, determine the initial state of the target icon; Based on the initial state of the target icon and the transformation rules of the target icon, the initial state of the target icon is updated to obtain the updated state of the icon.

3. The method according to claim 1, characterized in that, Also includes: Obtain the first mapping relationship between vehicle operations and the icons; The step of determining the target icon corresponding to the target operation in response to the target operation of the vehicle includes: In response to the target operation, the target icon corresponding to the target operation is determined based on the target operation and the first mapping relationship.

4. The method according to any one of claims 1 to 3, characterized in that, Also includes: Acquire video data during the vehicle's driving process; The step of generating a driving video of the vehicle based on the updated status of the icon includes: The driving video is generated based on the video data and the update status of the icon.

5. The method according to claim 4, characterized in that, The step of generating the driving video based on the video data and the update status of the icon includes: The driving video is generated by overlaying the update status of the icon onto the video data using screen display technology.

6. The method according to any one of claims 1 to 3, characterized in that, The icons corresponding to the target driving information include the left turn signal icon and the right turn signal icon; The step of determining the target icon corresponding to the target operation in response to the target operation of the vehicle includes: If the target operation is to turn on the hazard lights, in response to the target operation, the target icons are determined to be the left turn signal icon and the right turn signal icon.

7. A device for generating driving video, characterized in that, The device includes: The acquisition module is used to store the initial state of the icon corresponding to the target driving information in the target cache area of ​​the vehicle. The initial state in the target cache area is not affected by the icon change signal. The initial state of the icon is the state before the target operation of the vehicle is detected. The initial state includes an on state or an off state. The icon change signal is used to trigger the real-time state change of the icon. The initial state of the icon is obtained by reading the target cache area. The processing module is configured to respond to a target operation of the vehicle, determine the target icon corresponding to the target operation; if the display state of the icon has not been updated, the vehicle's bus sends an icon change signal, and based on the initial state of the icon and the target icon, obtain the updated state of the icon; and based on the updated state of the icon, generate a driving video of the vehicle.

8. A vehicle, characterized in that, The vehicles include: Memory, used to store executable program code; A processor for calling and running the executable program code from the memory, causing the vehicle to perform the method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed, implements the method as described in any one of claims 1 to 6.

Images