Driving video generation method and device, vehicle and storage medium

Abstract

The invention provides a driving video generation method and device, a vehicle and a storage medium, and the method relates to the field of vehicles, and the method comprises the steps: obtaining an initial state of an icon corresponding to target driving information in the vehicle; in response to a target operation of the vehicle, determining a target icon corresponding to the target operation; obtaining an updating state of the icon based on the initial state of the icon and the target icon; and generating a driving video of the vehicle based on the updating state of the icon. The method can prevent the driving information in the recorded driving video from being inconsistent with the actual driving information of the vehicle.

Description

Technical Field

[0001] The present application relates to the field of vehicles, and more specifically, to a method for generating a driving video, a generating device, a vehicle and a storage medium in the field of vehicles. Background Art

[0002] The vehicle video driving recorder can record the video images and sounds of the vehicle's driving process to obtain a driving record video, thereby providing evidence for traffic accidents. In the prior art, the vehicle driving information icon can be displayed in the driving record video. However, the driving information icon recorded in the driving record video may be inconsistent with the driving information icon corresponding to the actual driving operation of the vehicle, resulting in the problem that the actual driving situation of the vehicle is out of sync with the video record.

[0003] Therefore, how to avoid the driving information in the recorded driving video being inconsistent with the actual driving information of the vehicle is a technical problem that needs to be solved at present. Summary of the invention

[0004] The present application provides a driving video generation method, a generation device, a vehicle and a storage medium, wherein the method obtains an updated state of an icon according to an initial state of the icon and a target icon, and generates a driving video of the vehicle according to the updated state of the icon, thereby avoiding inconsistency between driving information in the recorded driving video and actual driving information of the vehicle.

[0005] In a first aspect, a method for generating a driving video is provided, the method comprising:

[0006] Obtaining the initial state of the icon corresponding to the target driving information in the vehicle;

[0007] In response to a target operation of the vehicle, determining a target icon corresponding to the target operation;

[0008] Based on the initial state of the icon and the target icon, the updated state of the icon is obtained;

[0009] Based on the updated status of the icon, a driving video of the vehicle is generated.

[0010] In an embodiment of the present application, a target icon corresponding to a target operation is determined, and an update state of the icon is determined based on the initial state of the target icon and the target icon. Since different target operations of the vehicle correspond to different target icons, the target icon corresponding to the target operation is determined in response to the target operation of the vehicle, ensuring that the obtained target icon is relatively accurate and can reflect the target operation of the vehicle. In addition, compared with the prior art in which the update state of an icon is determined based on the real-time state of the icon, the present solution obtains the update state of the icon based on the initial state of the icon and the target icon. Therefore, in the process of obtaining the update state of the icon, errors in the update state caused by changes in the real-time state of the icon can be avoided, thereby avoiding the problem that the driving information indicated by the icon in the recorded driving video is inconsistent with the actual driving information of the vehicle.

[0011] It should be noted that, during the process of updating the display status of the icon, if the vehicle's bus sends an icon change signal before the update of the icon's display status is completed, the icon change signal will interrupt the process of updating the icon's display status and may cause the current real-time status of the icon to change; if the icon's display status is updated based on the icon's current real-time status, the driving information indicated by the updated icon may be inconsistent with the vehicle's actual driving information. Therefore, this solution determines the icon's update status based on the acquired initial status of the icon and the target icon; avoids updating the icon's display status based on the icon's current real-time status; thereby avoiding the problem of inconsistency between the driving information in the recorded driving video and the vehicle's actual driving information.

[0012] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes:

[0013] storing an initial state of the icon in a target buffer of the vehicle;

[0014] Get the initial state of the icon corresponding to the target driving information in the vehicle, including:

[0015] Get the initial state of the icon by reading the target buffer.

[0016] In one implementation, the initial state of the icon is the state of each icon before responding to the target operation.

[0017] In an embodiment of the present application, the initial state of the icon is stored in the target buffer area, and the initial state of the icon is obtained by reading the target buffer area. Since each time the vehicle responds to a target operation, the state of the icon may change; therefore, the initial state of the icon is stored in the target buffer area to ensure that the initial state of the icon before responding to the target operation can be determined through the target buffer area. Thereby ensuring that the update state of the icon can be determined based on the read initial state and the target icon.

[0018] In combination with the first aspect and the above implementations, in some implementations of the first aspect, the following further includes:

[0019] Based on the target operation, determine the transformation rule of the target icon;

[0020] Based on the initial state of the icon and the target icon, the updated state of the icon is obtained, including:

[0021] Based on the initial state of the icon and the target icon, determining the initial state of the target icon;

[0022] Based on the initial state of the target icon and the transformation rule of the target icon, the initial state of the target icon is updated to obtain an updated state of the icon.

[0023] In the embodiment of the present application, the initial state of the icon is updated according to the initial state of the icon and the transformation rule of the target icon to obtain the updated state of the icon; since the transformation rules of the target icons corresponding to different operations are different (for example, the icon is always on or the icon is flashing, etc.); therefore, according to the target operation, the change rule of the target icon is determined, and the initial state of the target icon is updated according to the transformation rule. Ensure that the operation indicated by the updated state of the icon is consistent with the target operation, that is, ensure that the driving information in the recorded driving video is consistent with the actual driving information of the vehicle.

[0024] In combination with the first aspect and the above implementations, in some implementations of the first aspect, the following further includes:

[0025] Acquire a first mapping relationship between vehicle operations and icons;

[0026] In response to a target operation of the vehicle, determining a target icon corresponding to the target operation includes:

[0027] In response to the target operation, a target icon corresponding to the target operation is determined based on the target operation and the first mapping relationship.

[0028] In an embodiment of the present application, a target icon corresponding to the target operation is determined based on the target operation and the first mapping relationship. Since icons corresponding to different vehicle operations are usually different, the target icon is determined based on the target operation and the first mapping relationship to ensure that the obtained target icon is associated with the target operation and the operation indicated by the target icon is consistent with the target operation.

[0029] In combination with the first aspect and the above implementations, in some implementations of the first aspect, the following further includes:

[0030] Acquire video data during vehicle driving;

[0031] Based on the updated status of the icon, a driving video of the vehicle is generated, including:

[0032] Generate driving video based on the video data and the updated status of the icon.

[0033] In an embodiment of the present application, a driving video is generated based on the update status of the icon and the video data during vehicle driving, ensuring that the video data and the update status of the icon can be displayed simultaneously in the driving video, making the recorded information of the driving video more comprehensive.

[0034] In combination with the first aspect and the above implementations, in some implementations of the first aspect, generating a driving video based on the update status of the video data and the icon includes:

[0035] Through on-screen display technology, the update status of the icon is superimposed on the video data to generate a driving video.

[0036] In the embodiment of the present application, the update status of the icon is superimposed and displayed in the video data through the on-screen display technology (OSD) technology to obtain the driving video. It is ensured that the update status of the icon can be displayed in the video data, so that the driving video reflects the video data of the vehicle during driving, and the icon update status in the driving video reflects the target operation during the vehicle driving.

[0037] In combination with the first aspect and the above implementations, in some implementations of the first aspect, the target driving information corresponding icon includes a left turn signal icon and a right turn signal icon;

[0038] In response to a target operation of the vehicle, determining a target icon corresponding to the target operation includes:

[0039] If the target operation is an operation of turning on the hazard lights, in response to the target operation, the target icons are determined to be a left turn signal icon and a right turn signal icon.

[0040] In a second aspect, a driving video generation device is provided, the device comprising:

[0041] An acquisition module, used to acquire the initial state of an icon corresponding to target driving information in a vehicle;

[0042] The processing module is used to determine the target icon corresponding to the target operation in response to the target operation of the vehicle; obtain the updated state of the icon based on the initial state of the icon and the target icon; and generate the driving video of the vehicle based on the updated state of the icon.

[0043] In combination with the second aspect, in some implementations of the second aspect, a storage module is also included, and the storage module is used to: store the initial state of the icon in the target cache area of ​​the vehicle; the acquisition module is specifically used to: acquire the initial state of the icon by reading the target cache area.

[0044] In combination with the second aspect and the above-mentioned implementation methods, in some implementation methods of the second aspect, the processing module is specifically used to: determine the transformation rule of the target icon based on the target operation; determine the initial state of the target icon based on the initial state of the icon and the target icon; update the initial state of the target icon based on the initial state of the target icon and the transformation rule of the target icon to obtain the updated state of the icon.

[0045] In combination with the second aspect and the above-mentioned implementation methods, in some implementation methods of the second aspect, the acquisition module is also used to: obtain a first mapping relationship between the vehicle operation and the icon; the processing module is specifically used to: in response to the target operation, determine the target icon corresponding to the target operation based on the target operation and the first mapping relationship.

[0046] In combination with the second aspect and the above-mentioned implementation methods, in some implementation methods of the second aspect, the acquisition module is also used to: acquire video data during the vehicle's driving process; the processing module is specifically used to: generate driving video based on the video data and the update status of the icon.

[0047] In combination with the second aspect and the above-mentioned implementation method, the processing module is specifically used to: superimpose and display the update status of the icon on the video data through on-screen display technology to generate a driving video.

[0048] In combination with the second aspect and the above-mentioned implementation methods, in some implementation methods of the second aspect, the icons corresponding to the target driving information include a left turn signal icon and a right turn signal icon; the processing module is specifically used to: if the target operation is to turn on the hazard lights, in response to the target operation, determine that the target icons are the left turn signal icon and the right turn signal icon.

[0049] In a third aspect, a vehicle is provided, comprising a memory and a processor, wherein the memory is used to store executable program code, and the processor is used to call and run the executable program code from the memory, so that the vehicle executes the method in the above-mentioned first aspect or any possible implementation of the first aspect.

[0050] In a fourth aspect, a computer program product is provided, comprising: a computer program code, which, when executed on a computer, enables the computer to execute the method in the first aspect or any possible implementation of the first aspect.

[0051] In a fifth aspect, a computer-readable storage medium is provided, which stores a computer program. When the computer program is executed, the method in the above-mentioned first aspect or any possible implementation manner of the first aspect is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1 This is a schematic diagram of a scenario provided by an embodiment of the present application;

[0053] Figure 2 is a schematic flow chart of a method for generating a driving video provided in an embodiment of the present application;

[0054] Figure 3 is a schematic flow chart of an icon updating method provided in an embodiment of the present application;

[0055] Figure 4 is a schematic flow chart of another method for generating a driving video provided in an embodiment of the present application;

[0056] Figure 5 It is a structural schematic diagram of a driving video generation device provided in an embodiment of the present application;

[0057] Figure 6 It is a structural schematic diagram of a vehicle provided in an embodiment of the present application. DETAILED DESCRIPTION

[0058] The technical solution in the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B: "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0059] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features.

[0060] The vehicle video driving recorder can record the video images and sounds of the vehicle driving process, obtain the driving record video, and thus provide evidence for traffic accidents. In the prior art, the vehicle driving information icon can be displayed in the driving record video. The vehicle is usually equipped with a variety of sensors, including but not limited to positioning systems, accelerometers, gyroscopes, etc., which can collect various information about the vehicle status. The vehicle processes and analyzes the received data through an on-board computer or other equipment to obtain the analysis results. Using the image processing algorithm, the above analysis results are superimposed and displayed on the video in the form of icons, text, etc. without interfering with the original picture content. For example, the current vehicle speed is displayed in the driving record video to help users review the speed changes during driving, and the navigation information is displayed in the driving record video: the map and navigation instructions are superimposed to display the driving route and turning prompts at the time; the navigation information is displayed in the driving record video, etc.

[0061] For example, Figure 1 This is a schematic diagram of a scenario provided by an embodiment of the present application. Figure 1 As shown in the scene 100 in the figure, the driving information icon of the vehicle is displayed in the driving record video; 110 is the video display screen of the driving record video; 120 is the display area of ​​the driving information icon in the video display screen.

[0062] Exemplarily, driving information icons are displayed in the display area 120, such as Figure 1 As shown in 120 , the driving information icons are, from left to right, a left turn signal icon, a right turn signal icon, a high beam icon, a low beam icon, a front fog light icon, a rear fog light icon and an automatic parking icon.

[0063] It should be noted that the driving information icons in the display area 120 are schematic illustrations of the driving information icons and the positions of the driving information icons, which does not mean that the driving information icons shown are all in an on state (lit state).

[0064] For example, by displaying the vehicle's driving information icon in the driving record video, the driver's driving operation during the driving process can be better reflected. For example, when the driver turns on the left turn signal, the icon of the left turn signal is displayed synchronously in the driving record video; when the driver turns on the high beam, the icon of the high beam is displayed synchronously in the driving record video; when the driver turns on the double flash, the left turn signal and the right turn signal of the vehicle flash synchronously or cyclically.

[0065] It should be noted that the above is an example of the video display screen of the driving record video and the driving information icon, and this application does not make any specific limitations on this.

[0066] For example, in the driving information icons displayed in the driving record video, the driving information icons recorded in the driving record video may be inconsistent with the driving information icons corresponding to the actual driving operation of the vehicle, and there may be a problem that the actual driving conditions of the vehicle are not synchronized with the video recording.

[0067] For example, if the actual driving operation of the vehicle is to turn on the hazard lights, the corresponding driving information icons are the icons of the left turn signal and the right turn signal, and both the left turn signal icon and the right turn signal icon are in a lit state. If the left turn signal and the right turn signal are both in a lit state, the vehicle's controller area network bus (CAN) sends a turn signal change signal, and then the right turn signal icon status is updated so that the right turn signal icon is off. At this time, the corresponding driving information icon is that the left turn signal icon is on and the right turn signal icon is off. That is, when the hazard lights are turned on, due to the change in the bus signal, the driving information icon is displayed as the left turn signal icon is on and the right turn signal icon is off, and the icon display state is equivalent to the display state when the vehicle turns on the left turn signal. Therefore, there is a problem that when the driver turns on the hazard lights, the vehicle's driving information icon is displayed as a left turn; that is, there is a problem that the actual driving conditions of the vehicle are not synchronized with the video recording.

[0068] It should be noted that when the icon of driving information is updated, if another icon update signal is detected before the current update process is completed, it may cause problems in the current icon update process, that is, the driving information indicated by the icon is inconsistent with the actual driving information of the vehicle. The above is a schematic explanation using the turn signal icon (including the left turn signal icon and the right turn signal icon) as an example, and this application does not limit this.

[0069] Therefore, how to avoid the driving information in the recorded driving video being inconsistent with the actual driving information of the vehicle is a technical problem that needs to be solved at present.

[0070] In view of this, the present application provides a method, a generating device, a vehicle and a storage medium for generating a driving video; through the embodiments of the present application, the updated state of the icon is obtained according to the initial state of the icon and the target icon; and the driving video of the vehicle is generated according to the updated state of the icon. This avoids the driving information in the recorded driving video being inconsistent with the actual driving information of the vehicle.

[0071] Combine the following Figures 2 to 4 The flowchart in further illustrates the method for generating a driving record video provided in an embodiment of the present application.

[0072] Figure 2 It is a schematic flowchart of a method for generating a driving video provided in an embodiment of the present application.

[0073] For example, Figure 2 The illustrated method 200 may be performed by a vehicle; or may be performed by a processor or chip in a vehicle.

[0074] Optionally, Figure 2 The method shown may also be performed by a target device in a vehicle for recording driving video; for example, the target device may be a vehicle-mounted video driving recorder.

[0075] like Figure 2 As shown, the driving video generation method 200 includes S210 to S240, and S210 to S240 are described in detail below.

[0076] S210, obtaining an initial state of an icon corresponding to target driving information in the vehicle.

[0077] Exemplarily, the initial state of the icon corresponding to the target driving information in the vehicle is obtained; wherein the target driving information includes: vehicle speed, acceleration, engine speed, steering wheel steering angle, throttle status information, brake status information, light information, wiper status, etc.

[0078] Exemplarily, the icons corresponding to the target driving information include: left turn signal icon, right turn signal icon, high beam icon, low beam icon, front fog light icon, rear fog light icon, automatic parking icon, and icons corresponding to information such as vehicle speed, acceleration, engine speed, throttle status and wiper status.

[0079] Exemplarily, the vehicle obtains communication between various components of the vehicle, such as the engine, steering wheel, wipers, turn signals, and accelerator, through the CAN bus, and determines the working status of each component, thereby determining the initial state of the icon corresponding to the target driving information.

[0080] Exemplarily, the initial state of the icon corresponding to the target driving information in the vehicle is the state before the target operation is detected; the initial state of the icon includes an on state (lit state) or an off state (extinguished state).

[0081] In one implementation, the initial state of the icon is stored in a target buffer area of ​​the vehicle; and the initial state of the icon is obtained by reading the target buffer area.

[0082] Optionally, if the vehicle includes a target device, the target cache area may be a target cache area in the target device; and the initial state of the icon is stored in the target cache area of ​​the target device; wherein the target device is used to record driving video. If the vehicle does not include a target device, the target cache area may be a target cache area of ​​an onboard computer in the vehicle, and the initial state of the icon is stored in the target cache area of ​​the onboard computer.

[0083] Exemplarily, the initial state of the icon is the state of each icon before responding to the target operation. That is, the initial state is the state of the icon before each frame signal is updated. For example, if the target operation of the vehicle is to turn on the double flash lights of the vehicle, then before updating the state of the icon corresponding to the double flash lights; the initial state of the icon is stored in the target buffer area. The initial state of the icon is obtained by reading the target buffer area.

[0084] In an embodiment of the present application, the initial state of the icon is stored in the target buffer area, and the initial state of the icon is obtained by reading the target buffer area. Since each time the vehicle responds to a target operation, the state of the icon may change; therefore, the initial state of the icon is stored in the target buffer area to ensure that the initial state of the icon before responding to the target operation can be determined through the target buffer area. Thereby ensuring that the update state of the icon can be determined based on the initial state of the icon and the target icon.

[0085] S220, in response to a target operation of the vehicle, determining a target icon corresponding to the target operation.

[0086] Exemplarily, in response to a target operation of the vehicle, a target icon corresponding to the target operation is determined; in order to ensure that the target driving information during the vehicle's driving process can be reflected through the icon, different target operations usually correspond to different icons; when the vehicle's target operation is detected, the target icon corresponding to the target operation is determined to ensure that the target driving information during the vehicle's driving process can be reflected through the target icon.

[0087] For example, if the target operation is to turn on automatic parking, the corresponding target icon is the vehicle's automatic parking icon; if the target operation is to turn on the left turn signal, the corresponding target icon is the left turn signal icon; if the target operation is to turn on the right turn signal, the corresponding target icon is the vehicle's right turn signal icon.

[0088] Optionally, the icons corresponding to the target driving information include a left turn signal icon and a right turn signal icon; if the target operation is to turn on the hazard lights, in response to the target operation, the target icons are determined to be the left turn signal icon and the right turn signal icon.

[0089] Exemplarily, if the target operation is to turn on the hazard lights, the target icons are the left turn signal icon and the right turn signal icon; when the hazard lights of the vehicle are on, the left turn signal icon and the right turn signal icon of the vehicle are lit at the same time, or flashing at the same time.

[0090] In one implementation, the method further includes: acquiring a first mapping relationship between the vehicle operation and the icon;

[0091] In response to a target operation of the vehicle, determining a target icon corresponding to the target operation includes: in response to the target operation, determining the target icon corresponding to the target operation based on a first mapping relationship between the target operation and the first mapping relationship.

[0092] For example, in order to automatically obtain and display corresponding icons according to vehicle operations, it is necessary to establish a system mapping relationship and ensure that the system can monitor the vehicle status in real time, parse the operation information and accurately display the target icon; the first mapping relationship between the vehicle operation and the icon can be represented by a mapping table, and each vehicle operation is associated with an icon. Optionally, the first mapping relationship can be stored in JSON file format or XML file format.

[0093] Exemplarily, the vehicle may obtain operation data of a target operation of the vehicle through a CAN bus interface; and according to the monitored target operation, search for a target icon corresponding to the target operation of the vehicle in a mapping table corresponding to the first mapping relationship.

[0094] In an embodiment of the present application, a target icon corresponding to the target operation is determined based on the target operation and the first mapping relationship. Since icons corresponding to different vehicle operations are usually different, the target icon is determined based on the target operation and the first mapping relationship to ensure that the obtained target icon is associated with the target operation and the operation indicated by the target icon is consistent with the target operation.

[0095] Optionally, a priority ranking of icons is set, and if multiple operations occur simultaneously in the vehicle, icons corresponding to the multiple operations are determined in sequence according to the priority ranking.

[0096] It should be noted that when setting the priority order of icons, in order to ensure that when multiple vehicle operations occur simultaneously, the icons can be displayed in a reasonable priority order to avoid information overload or key information being ignored, the priority order of icons is set.

[0097] Exemplarily, the priority order of icons from high to low may include: safety-related icons, status of key vehicle systems (such as emergency safety warning icons, ABS anti-lock braking system activation icons, ESP body stability control system activation, engine fault lights, brake system faults, low fuel warnings, tire pressure monitoring system warnings, battery charging system faults, coolant temperature over-high warnings), icons reflecting the driver's current operations (such as hazard lights on, left / right turn signals on, seat belt unfastened warnings, blind spot monitoring warnings, lane departure warnings, etc.); icons that provide auxiliary information (such as vehicle speed changes, engine speed changes, gear changes, fuel consumption information lights). When multiple vehicle operations occur at the same time, the icons corresponding to the multiple operations are determined in sequence according to the priority order. If multiple icons are allowed to be displayed at the same time, but the total number is limited to keep the interface clear, the icons are arranged from top to bottom or from left to right according to priority, ensuring that high-priority icons are located in prominent positions.

[0098] Optionally, icons of similar types can be displayed in groups, such as placing all warning icons in one area and all driving information icons in another area; and a display time window is set for each icon, which will automatically hide or downgrade its display after a certain time.

[0099] S230, obtaining an updated state of the icon based on the initial state of the icon and the target icon.

[0100] Exemplarily, the target icon is an icon corresponding to a target operation of the vehicle. In response to the target operation, the initial state of the target icon is determined according to the initial state of the icon and the target icon, and the initial state of the icon is updated to obtain an updated state of the icon.

[0101] In one implementation, the method further includes: determining a transformation rule of a target icon based on the target operation;

[0102] Based on the initial state of the icon and the target icon, the updated state of the icon is obtained, including: based on the initial state of the icon and the target icon, determining the initial state of the target icon; based on the initial state of the target icon and the transformation rule of the target icon, updating the initial state of the target icon to obtain the updated state of the icon.

[0103] Exemplarily, according to the initial state of the icon and the transformation rule of the target icon, the initial state of the icon is updated to obtain the updated state of the icon; since the transformation rules of the target icons corresponding to different operations are different; therefore, the icon transformation rule corresponding to the target operation is determined according to the target operation. For example, when the driver turns on the left turn signal, the left turn signal icon flashes when the left turn signal is activated and stops after the signal is turned off; when the driver turns on the right turn signal, the right turn signal icon flashes when the right turn signal is activated and stops after the signal is turned off; when the driver turns on the hazard lights, the left turn signal icon and the right turn signal icon flash at the same time. When vehicle braking is detected, the brake icon lights up; when the vehicle speed increases or decreases, the speedometer icon should be updated in real time to reflect the current speed. The icon corresponding to the vehicle speed can be a dynamic speedometer, the pointer rotates as the actual vehicle speed changes, and the digital display is updated accordingly.

[0104] It should be noted that the above is an example of the icon transformation rules. In actual applications, the transformation rules of different icons can be determined according to the characteristics of the vehicle model and user needs, and this application does not limit this.

[0105] In the embodiment of the present application, according to the target operation, the change rule of the target icon is determined, and the initial state of the target icon is updated according to the change rule. It is ensured that the operation indicated by the updated state of the icon is consistent with the target operation, that is, it is ensured that the driving information in the recorded driving video is consistent with the actual driving information of the vehicle.

[0106] S240, generating a driving video of the vehicle based on the update status of the icon.

[0107] Exemplarily, by comparing the initial state of the icon with the target icon, it is determined whether the icon needs to be added, removed or updated, thereby determining the update state of the icon; and applying the updated icon state to the video frame, that is, displaying the corresponding display position of the icon in the video screen.

[0108] In one implementation, video data of a vehicle during driving is acquired; and a driving video is generated based on the video data and an update status of an icon.

[0109] Exemplarily, the target device records video data of the vehicle during driving, wherein the video data includes the vehicle's forward-looking video data and / or the vehicle's surround-looking video data. Since the target device records video data of different angles during the vehicle's driving, it is ensured that more comprehensive video data can be obtained.

[0110] In an embodiment of the present application, a driving video is generated based on the update status of the icon and the video data during vehicle driving, ensuring that the video data and the update status of the icon can be displayed simultaneously in the driving video, making the recorded information of the driving video more comprehensive.

[0111] Exemplarily, the update status of the icon is superimposed and displayed on the video data through on-screen display technology to generate a driving video.

[0112] Exemplary, On Screen Display (OSD) is a technology for overlaying text, graphics, and other information directly onto the screen so that users can view and adjust settings or receive important information. OSD data containing the updated status of icons is usually stored in a separate frame buffer and output to the display after being merged with the main video stream.

[0113] In the embodiment of the present application, the update status of the icon is superimposed and displayed in the video data through the OSD technology to obtain the driving video. It is ensured that the update status of the icon can be displayed in the video data, so that the driving video reflects the video data of the vehicle during driving, and the icon update status in the driving video reflects the target operation during the vehicle driving.

[0114] Optionally, when generating a driving video of the vehicle, the transparency of the icon is determined according to the icon type of the icon; and the driving video is generated based on the video data, the update status of the icon and the transparency of the icon.

[0115] Exemplarily, when the update status of the icon is superimposed on the main video stream of the display screen through OSD technology, different degrees of icon transparency can be set. For example, if the icon is an icon related to the alarm prompt information (for example, an engine failure icon, an icon for low coolant level, an icon for excessive oil temperature, an icon for left shoe wear, and an icon for right shoe wear), a lower transparency can be set so that the display content of the icon can partially or completely cover the underlying video image; ensure that the display of the icons related to the alarm prompt information is more obvious and not easily ignored. If the icon is an icon other than the alarm prompt information icon (for example, a left turn signal icon, a right turn signal icon, a high beam icon, a low beam icon, a front fog light icon, etc.), a higher transparency is set so that the icon can partially block the underlying video image, and the underlying video image overlapping with the icon can be seen without affecting the display of the icon.

[0116] In one implementation, the positions of icons are arranged reasonably to avoid blocking key video images; slight animation effects are added to key operations to improve the display effect of icons in the video images.

[0117] In the above embodiment, the target icon corresponding to the target operation is determined, and the update state of the icon is determined according to the initial state of the target icon and the target icon. Since in the process of updating the display state of the icon to obtain the update state of the icon, if the bus of the vehicle sends an icon change signal before the update of the display state of the icon is completed, the icon change signal will interrupt the process of updating the display state of the icon, and may cause the current real-time state of the icon to change; if the display state of the icon is updated based on the current real-time state of the icon, the driving information indicated by the updated icon may be inconsistent with the actual driving information of the vehicle. Therefore, this scheme determines the update state of the icon according to the initial state of the icon and the target icon obtained; avoids updating the icon according to the current real-time state of the icon when determining the update state of the icon; thereby avoiding the problem of inconsistency between the driving information in the recorded driving video and the actual driving information of the vehicle.

[0118] Exemplary, combined Figure 3 For further explanation, Figure 3 It is a schematic flowchart of an icon updating method provided in an embodiment of the present application.

[0119] Figure 3 The illustrated method 300 may be performed by a vehicle; or may be performed by a processor or chip in a vehicle.

[0120] Figure 3 The method shown is a method for updating the display state of an icon according to the initial state of the icon, including S301 to S306. S301 to S306 are described in detail below.

[0121] S301, storing icon status in a target buffer area.

[0122] S302, turn on the double flash lights and trigger OSD update.

[0123] Exemplarily, a target operation of the vehicle is detected, and when the target operation is to turn on the hazard lights, the signal of the hazard lights is activated and triggers an OSD update; wherein the OSD update refers to updating the icons displayed on the screen.

[0124] S303: Update the left turn signal icon according to the stored icon status.

[0125] Exemplarily, the state of the left turn signal icon before turning on the double flash lights is determined by reading the icon state stored in the target cache area, and the left turn signal icon is updated according to the state of the left turn signal icon before turning on the double flash lights.

[0126] S304, the bus turn signal is updated.

[0127] S305: Update the right turn signal icon according to the stored icon status.

[0128] Exemplarily, based on the stored icon status, the status of the right turn signal icon before turning on the hazard lights is determined, and the left turn signal icon is updated.

[0129] S306, delay and wait for the next update.

[0130] For example, if the bus turn signal is updated, the current state of the vehicle's left turn signal icon or right turn signal icon may change; however, since the right turn signal icon is updated based on the stored icon state, it will not be affected by the current state of the left turn signal icon or the right turn signal icon.

[0131] For example, in the initial state, the icon status stored in the target cache is that the left turn signal is off and the right turn signal is off; if the hazard lights are turned on, the left turn signal is on and the right turn signal is on; at this time, the bus turn signal is updated to indicate that the right turn signal is turned on and the right turn signal is turned off. Under the action of the bus turn signal update, according to the icon status stored in the target cache, the updated icon display status is that the left turn signal is off and the right turn signal is off; that is, the problem of inconsistency between the driving information in the driving video and the actual driving information of the vehicle is solved.

[0132] It should be noted that if the display status of an icon is updated according to the real-time status of the icon, if the bus sends an icon change signal during the icon update process, the current real-time status of the icon may change; if the display status of the icon is updated based on the current real-time status of the icon, the driving information indicated by the updated icon may be inconsistent with the actual driving information of the vehicle.

[0133] Exemplarily, when the display state of an icon is updated according to the real-time state of the icon, the specific method includes: detecting the target operation of the vehicle, and when the target operation is to turn on the double flash lights, the signal of the double flash lights is activated and triggers the OSD update; wherein the OSD update refers to updating the icon displayed on the screen. According to the current state of the left turn signal icon, the left turn signal icon is updated. When the double flash lights are turned on and the OSD update is triggered, the left turn signal icon and the right turn signal icon are updated in sequence according to the current state. If the bus turn signal is updated after the left turn signal icon is updated, the current state of the current left turn signal icon or the right turn signal icon is changed. Since the state of the current right turn signal icon changes under the action of the total turn signal update, if the right turn signal icon is updated according to the current right turn signal icon state, it may cause the updated display state of the left and right turn signals to no longer indicate the icon display state corresponding to the double flash operation.

[0134] For example, in the initial state, the left turn signal is off and the right turn signal is off; if the hazard lights are turned on, the left turn signal is on and the right turn signal is on; at this time, the bus turn signal is updated, indicating that the right turn signal is turned on and the right turn signal is turned off. Under the action of the bus turn signal update, the current display state of the icon is that the left turn signal is on and the right turn signal is off. This icon display state is consistent with the icon display state when the vehicle is turning left. At this time, the actual vehicle is operating the hazard lights, but the icon display state indicates a left turn operation, that is, there is a problem that the driving information in the driving video is inconsistent with the actual driving information of the vehicle.

[0135] In an embodiment of the present application, the method for updating the display status of an icon according to the initial status of the icon is updated based on the stored icon status; therefore, it will not be affected by the update of the bus turn signal, so that the turn signal (including the left turn signal and the right turn signal) can correctly respond to the operation of turning on the double flash lights and correctly indicate the operation through the turn signal.

[0136] Figure 4 It is a schematic flowchart of a method for generating a driving video provided in an embodiment of the present application.

[0137] Figure 4 The illustrated method 400 may be performed by a vehicle; or may be performed by a processor or chip in a vehicle.

[0138] like Figure 4 The driving video generation method 400 shown includes S401 to S407, and S401 to S407 are described in detail below.

[0139] S401, storing an initial state of an icon corresponding to target driving information in a target buffer area of ​​a vehicle.

[0140] Exemplarily, the target driving information includes: vehicle speed, acceleration, engine speed, steering wheel steering angle, throttle status information, brake status information, light information, wiper status, etc. Icons corresponding to the target driving information include: left turn signal icon, right turn signal icon, high beam icon, low beam icon, front fog light icon, rear fog light icon, automatic parking icon, and icons corresponding to information such as vehicle speed, acceleration, engine speed, throttle status, and wiper status.

[0141] Exemplarily, the initial state of the icon is the state of each icon before responding to the target operation, that is, the initial state is the state of the icon before each frame signal is updated.

[0142] If the vehicle includes a target device, the target cache area may be a target cache area in the target device; and the initial state of the icon is stored in the target cache area of ​​the target device; wherein the target device is used to record driving video. If the vehicle does not include a target device, the target cache area may be a target cache area of ​​an onboard computer in the vehicle, and the initial state of the icon is stored in the target cache area of ​​the onboard computer.

[0143] S402, reading the target buffer area to obtain the initial state of the icon.

[0144] Exemplarily, the initial state of the icon is obtained by reading the target buffer area.

[0145] Optionally, the implementation of S401 and S402 can refer to Figure 2 The relevant description of S210 is not repeated here.

[0146] S403, in response to a target operation of the vehicle, determining a target icon corresponding to the target operation.

[0147] Exemplarily, a first mapping relationship between a vehicle operation and an icon is obtained; and a target icon corresponding to the target operation is determined according to the target operation and the first mapping relationship. For example, if the target operation is to turn on the high beam, the corresponding target icon is the high beam icon of the vehicle; if the target operation is to turn on the automatic parking, the corresponding target icon is the automatic parking icon of the vehicle; if the target operation is to turn on the left turn signal (or turn on the right turn signal), the corresponding target icon is the left turn signal icon (right turn signal icon).

[0148] Optionally, the implementation of S403 can refer to Figure 2The implementation method of S220 will not be repeated here.

[0149] S404: Determine the initial state of the target icon according to the initial state of the icon and the target icon.

[0150] Exemplarily, the target icon is an icon corresponding to a target operation of the vehicle, and in response to the target operation, the initial state of the target icon is determined based on the initial state of the icon and the target icon.

[0151] S405: Determine a transformation rule of the target icon according to the target operation.

[0152] Exemplarily, since the transformation rules of the target icons corresponding to different operations are different, the transformation rule of the target icon corresponding to the target operation is determined according to the target operation.

[0153] S406, obtaining an updated state of the icon according to the initial state of the target icon and the transformation rule.

[0154] Exemplarily, the initial state of the target icon is updated according to the transformation rule to ensure that the operation indicated by the updated state of the icon is consistent with the target operation, that is, to ensure that the driving information in the recorded driving video is consistent with the actual driving information of the vehicle.

[0155] Optionally, the implementation of S404 to S406 can refer to Figure 2 The implementation method of S230 will not be described here.

[0156] S407, generating a driving video according to the video data and the updating status of the icon during the driving process of the vehicle.

[0157] Exemplarily, the target device records the video data of the vehicle during driving, wherein the video data includes the vehicle's forward-looking video data and / or the vehicle's surround-looking video data; based on the video data and the update status of the icon, a driving record video is generated. It is ensured that the video data and the update status of the icon can be displayed simultaneously in the driving video, so that the recorded information of the driving video is more comprehensive.

[0158] Optionally, the implementation of S407 can refer to Figure 2 The implementation method of S240 will not be repeated here.

[0159] In an embodiment of the present application, the initial state of the icon is stored in the target buffer area to ensure that the initial state of the icon before responding to the target operation can be determined through the target buffer area. Thereby ensuring that the update state of the icon can be determined based on the read initial state and the target icon. According to the target operation, the change rule of the target icon is determined, and the initial state of the target icon is updated according to the transformation rule. Ensure that the operation indicated by the update state of the icon is consistent with the target operation, that is, ensure that the driving information in the recorded driving video is consistent with the actual driving information of the vehicle. Since the initial state of the target icon is updated, the initial state of the target icon will not be affected by the signal change during the update process; therefore, avoid updating the display state of the icon based on the current real-time state of the icon; thereby avoiding the problem of inconsistency between the driving information in the recorded driving video and the actual driving information of the vehicle.

[0160] Combination of the above Figures 1 to 4 The method for generating a driving video provided by the embodiment of the present application is described in detail; Figure 5 and Figure 6 The device embodiments of the present application are described in detail. It should be understood that the device in the embodiments of the present application can execute the various methods of the aforementioned embodiments of the present application, that is, the specific working processes of the following various products can refer to the corresponding processes in the aforementioned method embodiments.

[0161] Figure 5 It is a structural schematic diagram of a driving video generation device provided in an embodiment of the present application.

[0162] For example, Figure 5 As shown, the driving video generation device 500 includes:

[0163] An acquisition module 510 is used to acquire an initial state of an icon corresponding to target driving information in a vehicle;

[0164] The processing module 520 is used to determine the target icon corresponding to the target operation in response to the target operation of the vehicle; obtain the updated state of the icon based on the initial state of the icon and the target icon; and generate the driving video of the vehicle based on the updated state of the icon.

[0165] Optionally, as an embodiment, it further includes a storage module, which is used to: store the initial state of the icon in the target cache area of ​​the vehicle; the acquisition module 510 is specifically used to: acquire the initial state of the icon by reading the target cache area.

[0166] Optionally, as an embodiment, the processing module 520 is specifically used to: determine the transformation rule of the target icon based on the target operation; determine the initial state of the target icon based on the initial state of the icon and the target icon; update the initial state of the target icon based on the initial state of the target icon and the transformation rule of the target icon to obtain the updated state of the icon.

[0167] Optionally, as an embodiment, the acquisition module 510 is further used to: acquire a first mapping relationship between a vehicle operation and an icon; the processing module 520 is specifically used to: in response to a target operation, determine a target icon corresponding to the target operation based on the target operation and the first mapping relationship.

[0168] Optionally, as an embodiment, the acquisition module 510 is further used to: acquire video data of the vehicle during driving; the processing module 520 is specifically used to: generate driving video based on the video data and the update status of the icon.

[0169] Optionally, as an embodiment, the processing module 520 is specifically used to: superimpose and display the update status of the icon on the video data through on-screen display technology to generate a driving video.

[0170] Optionally, as an embodiment, the icons corresponding to the target driving information include a left turn signal icon and a right turn signal icon; the processing module 520 is specifically used for: if the target operation is to turn on the hazard lights, in response to the target operation, determining that the target icons are the left turn signal icon and the right turn signal icon.

[0171] It should be noted that the above-mentioned driving video generation device is embodied in the form of a functional unit. The term "module" here can be implemented in the form of software and / or hardware, and is not specifically limited to this.

[0172] For example, a "module" may be a software program, a hardware circuit, or a combination of the two that implements the above functions. The hardware circuit may include an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a dedicated processor, or a group processor, etc.) and a memory for executing one or more software or firmware programs, a combined logic circuit, and / or other suitable components that support the described functions.

[0173] Therefore, the units of each example described in the embodiments of the present application can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.

[0174] Figure 6 It is a structural schematic diagram of a vehicle provided in an embodiment of the present application.

[0175] Exemplarily, vehicle 600 includes: a processor 610 , a memory 620 , and executable program code 630 .

[0176] Exemplarily, the vehicle 600 includes one or more processors 610, which can support the vehicle 600 to implement the method for generating a driving video in the method embodiment. The processor 610 can be a general-purpose processor or a special-purpose processor. For example, the processor 610 can be a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, such as discrete gates, transistor logic devices, or discrete hardware components.

[0177] Exemplarily, the processor 610 may be used to control the vehicle 600, execute software programs, and process data of the software programs. The vehicle 600 may also include a communication unit to implement input (reception) and output (transmission) of signals.

[0178] Exemplarily, the vehicle 600 may include one or more memories 620 on which executable program code 630 is stored. The executable program code 630 can be executed by the processor 610 to generate instructions, so that the processor 610 executes the method for generating driving video described in the above method embodiment according to the instructions.

[0179] Optionally, data may be stored in the memory 620. Optionally, the processor 610 may read data stored in the memory 620, which may be stored at the same storage address as the executable program code 630, or may be stored at a different storage address from the executable program code 630.

[0180] Exemplarily, the processor 610 and the memory 620 may be provided separately or integrated together, for example, integrated on a system on chip (SOC) of the terminal device.

[0181] Exemplarily, the memory 620 can be used to store relevant programs of the method for generating a driving video provided in the embodiment of the present application, and the processor 620 can be used to call the executable program code 630 stored in the memory 620 when controlling the vehicle to execute the method for generating a driving video in the embodiment of the present application; for example, obtaining the initial state of the icon corresponding to the target driving information in the vehicle; determining the target icon corresponding to the target operation in response to the target operation of the vehicle; obtaining the update state of the icon based on the initial state of the icon and the target icon; and generating a driving video of the vehicle based on the update state of the icon.

[0182] The present application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method for generating a driving video of any of the aforementioned embodiments.

[0183] Among them, computer-readable storage media may include but are not limited to any type of disk, including floppy disks, optical disks, digital versatile disks (Digital Video Disc, DVD), compact disc read-only memory (Compact Disc Read-Only Memory, CD-ROM), microdrives and magneto-optical disks, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), erasable programmable read-only memory (Erasable Programmable Read-Only Memory, EPROM), electrically erasable programmable read only memory (Electrically Erasable Programmable read only memory, EEPROM), dynamic random access memory (Dynamic Random Access Memory, DRAM), video random access memory (Video Random Access Memory, VRAM), flash memory devices, magnetic cards or optical cards, nanosystems (including molecular memory ICs), or any type of medium or device suitable for storing instructions and / or data.

[0184] The present application also provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the above-mentioned related steps to implement a method for generating a driving video in the above-mentioned embodiment.

[0185] In addition, the vehicle provided in the embodiments of the present application may specifically be a chip, component or module, and the vehicle may include a connected processor and memory; wherein the memory is used to store instructions, and when the vehicle is running, the processor may call and execute instructions so that the chip executes a method for generating a driving video in the above-mentioned embodiments.

[0186] Among them, the vehicle, computer-readable storage medium, computer program product or chip provided in this application are all used to execute the corresponding driving video generation method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding driving video generation method provided above, and will not be repeated here.

[0187] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0188] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0189] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for generating a driving video, characterized in that: The method comprises: Obtaining the initial state of the icon corresponding to the target driving information in the vehicle; In response to a target operation of the vehicle, determining a target icon corresponding to the target operation; Based on the initial state of the icon and the target icon, obtaining an updated state of the icon; Based on the update status of the icon, a driving video of the vehicle is generated.

2. The method according to claim 1, characterized in that Also includes: storing an initial state of the icon in a target buffer of the vehicle; The step of obtaining the initial state of an icon corresponding to target driving information in the vehicle includes: The initial state of the icon is obtained by reading the target buffer area.

3. The method according to claim 1, characterized in that Also includes: Based on the target operation, determining a transformation rule of the target icon; The obtaining the updated state of the icon based on the initial state of the icon and the target icon includes: Based on the initial state of the icon and the target icon, determining the initial state of the target icon; Based on the initial state of the target icon and the transformation rule of the target icon, the initial state of the target icon is updated to obtain the updated state of the icon.

4. The method according to claim 1, characterized in that Also includes: Acquire a first mapping relationship between the vehicle operation and the icon; The step of determining, in response to the target operation of the vehicle, a target icon corresponding to the target operation includes: In response to the target operation, the target icon corresponding to the target operation is determined based on the target operation and the first mapping relationship.

5. The method according to any one of claims 1 to 4, characterized in that Also includes: Acquiring video data of the vehicle during its travel; The generating the driving video of the vehicle based on the update status of the icon comprises: The driving video is generated based on the video data and the update status of the icon.

6. The method according to claim 5, characterized in that The generating the driving video based on the video data and the update status of the icon includes: By using on-screen display technology, the update status of the icon is superimposed and displayed on the video data to generate the driving video.

7. The method according to any one of claims 1 to 4, characterized in that The target driving information corresponding icons include a left turn signal icon and a right turn signal icon; The step of determining, in response to the target operation of the vehicle, a target icon corresponding to the target operation includes: If the target operation is an operation of turning on the hazard lights, in response to the target operation, the target icons are determined to be the left turn signal icon and the right turn signal icon.

8. A driving video generation device, characterized in that: The device comprises: An acquisition module, used to acquire the initial state of an icon corresponding to target driving information in a vehicle; A processing module is used to determine a target icon corresponding to the target operation in response to the target operation of the vehicle; obtain an updated state of the icon based on the initial state of the icon and the target icon; and generate a driving video of the vehicle based on the updated state of the icon.

9. A vehicle, characterized in that: The vehicle comprises: A memory for storing executable program codes; A processor is used to call and run the executable program code from the memory so that the vehicle executes the method as claimed in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed, the method according to any one of claims 1 to 7 is implemented.

Images