Method and device for assisting in driving vehicle, electronic equipment and storage medium

Abstract

The embodiment of the invention discloses a method and device for assisting in driving a vehicle, electronic equipment and a computer readable storage medium, and relates to the technical field of vehicle auxiliary driving, and the method comprises the steps that an environment picture around the vehicle is collected; acquiring current auxiliary driving information of the vehicle; performing synthesis processing on the environment picture and the auxiliary driving information to obtain a driving auxiliary picture; and under the condition that the vehicle is connected with the augmented reality equipment worn by the driving user, the driving assistance picture is sent to the augmented reality equipment to be displayed. Therefore, the driving auxiliary picture is directly presented to the driver through the augmented reality device, the driver can observe necessary information without moving or lowering the head, the driving risk caused by the fact that the driver needs to lower the head to watch a traditional electronic outside rear-view mirror display screen is effectively avoided, and the driving safety is improved.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of vehicle assisted driving technology, and more particularly to a method, device, electronic device, and computer-readable storage medium for assisting in driving a vehicle. Background Art

[0002] With the advancement of intelligent and connected vehicles, assisted driving technology has become an important means of improving driving safety and experience. Traditional assisted driving systems primarily provide information to drivers through devices such as on-board displays and heads-up displays. However, these devices have limited field of view in practical applications, making it difficult to provide drivers with comprehensive environmental awareness. Summary of the Invention

[0003] The embodiments of the present disclosure provide a method, device, electronic device, and computer-readable storage medium for assisting vehicle driving, aiming to solve at least one of the technical problems in the related art to a certain extent.

[0004] In a first aspect, an embodiment of the present disclosure provides a method for assisting vehicle driving, the method comprising:

[0005] Collect environmental images around the vehicle;

[0006] Obtaining current assisted driving information of the vehicle;

[0007] synthesizing the environment image and the driving assistance information to obtain a driving assistance image;

[0008] When a connection is established between the vehicle and the extended reality device worn by the driving user, the driving assistance screen is sent to the extended reality device for display.

[0009] In a second aspect, an embodiment of the present disclosure provides a method for assisting vehicle driving, the method comprising:

[0010] Receive driving assistance images sent by the vehicle;

[0011] The display mode of the driving assistance screen in the extended reality device is controlled according to the user's current head movement angle and movement direction.

[0012] In a third aspect, an embodiment of the present disclosure further provides a device for assisting vehicle driving, the device comprising:

[0013] The acquisition module is used to collect images of the environment around the vehicle;

[0014] An acquisition module, configured to acquire the current assisted driving information of the vehicle;

[0015] a processing module, configured to synthesize the environment image and the assisted driving information to obtain a driving assistance image;

[0016] The sending module is used to send the driving assistance screen to the extended reality device for display when a connection is established between the vehicle and the extended reality device worn by the driving user.

[0017] In a fourth aspect, an embodiment of the present disclosure further provides a device for assisting vehicle driving, the device comprising:

[0018] A receiving module, used to receive the driving assistance screen sent by the vehicle;

[0019] A control module is used to control the display mode of the driving assistance screen in the extended reality device according to the user's current head movement angle and movement direction.

[0020] In a fifth aspect, an embodiment of the present disclosure further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, the steps in the above-mentioned method for assisting vehicle driving are implemented.

[0021] In a sixth aspect, an embodiment of the present disclosure further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method of assisting vehicle driving are implemented.

[0022] In a seventh aspect, embodiments of the present disclosure further provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in various optional implementations of the embodiments of the present disclosure.

[0023] In the disclosed embodiment, the environmental image around the vehicle is first captured to obtain the vehicle's current assisted driving information. The environmental image and the assisted driving information are then synthesized to obtain a driving assistance image. After that, when a connection is established between the vehicle and the extended reality device worn by the driving user, the driving assistance image is sent to the extended reality device for display. Thus, the driving assistance image is presented directly to the driver through the extended reality device, and the driver can observe the necessary information without moving his head or lowering his head. This effectively avoids the driving risks caused by the traditional electronic exterior rearview mirror display screen requiring the driver to lower his head to view, thereby improving driving safety. Since the display content of the extended reality device is only visible to the driver and does not project dynamic video to other spaces in the car, it effectively solves the problem that the traditional electronic exterior rearview mirror display screen continuously displays dynamic video, which may cause discomfort to other passengers in the car, thereby improving the passenger experience.

[0024] In the embodiments of the present disclosure, it should first be understood that the above general description and the following detailed description are merely exemplary and explanatory and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions in the present disclosure, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0026] Figure 1 is a flowchart of a method for assisting vehicle driving provided by the first embodiment of the present disclosure;

[0027] Figure 2 is a flowchart of a method for assisting vehicle driving provided by a second embodiment of the present disclosure;

[0028] Figure 3 This is an architectural diagram of an advanced driver assistance system for an automobile;

[0029] Figure 4 1 is a schematic structural diagram of a device for assisting vehicle driving provided by an embodiment of the present disclosure;

[0030] Figure 5 1 is a schematic structural diagram of a device for assisting vehicle driving provided by an embodiment of the present disclosure;

[0031] Figure 6 It is a structural diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0032] Some embodiments of the present disclosure will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. Various changes, modifications and equivalents of the methods, devices and / or systems described herein will become apparent after understanding the present disclosure. For example, the order of operations described herein is merely an example and is not limited to those orders set forth herein, but may be changed as becomes apparent after understanding the present disclosure, except for operations that must be performed in a specific order. In addition, for the sake of clarity and brevity, descriptions of features known in the art may be omitted.

[0033] The embodiments described in the following examples of the present disclosure do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0034] It should be noted that the order of description of the following embodiments does not limit the priority order of the embodiments.

[0035] Figure 1 1 is a flow chart of a method for assisting vehicle driving provided according to the first embodiment of the present disclosure.

[0036] like Figure 1 As shown, the method is executed by a vehicle and includes:

[0037] Step 101: Collect the environment image around the vehicle.

[0038] Specifically, the vehicle's surroundings are captured using cameras installed at various locations. These cameras can include a front camera, a rear camera, a left camera, and a right camera. The front camera is mounted at the front of the vehicle to capture road conditions in front of the vehicle; the rear camera is mounted at the rear to capture road conditions behind the vehicle; the left camera is mounted on the left side of the vehicle to capture the surroundings on the left side; and the right camera is mounted on the right side of the vehicle to capture the surroundings on the right side. These cameras can be high-definition cameras with a resolution of 1920×1080 pixels or higher to ensure sufficient clarity in the captured surroundings.

[0039] Step 102: Obtain the current assisted driving information of the vehicle.

[0040] Driver assistance information can be any type of data collected, processed, and presented to assist the driver in safely and efficiently driving the vehicle, such as environmental perception information, vehicle status information, navigation and positioning information, etc.

[0041] Environmental perception information includes traffic sign information and obstacle information. Traffic sign information uses sensors such as cameras to identify traffic signs (such as speed limit and no overtaking signs) and lane markings (such as lane lines), allowing vehicles to understand road rules and boundaries. Obstacle information uses radar, cameras, and other devices to perceive the position, speed, and direction of movement of obstacles around the vehicle, such as other vehicles, pedestrians, and animals, providing a basis for functions such as collision avoidance.

[0042] Vehicle status information can include chassis information and driving parameter information. Chassis information, including suspension status, tire pressure, and wheel speed, reflects the vehicle's fundamental driving conditions and aids in stability control. Driving parameter information, including speed, acceleration, steering angle, and engine speed, reflects the vehicle's real-time operating status and is used to control features like adaptive cruise control and lane keeping.

[0043] Among them, navigation and positioning information can include map navigation information and positioning information. Among them, map navigation information provides real-time map data, route planning, destination guidance, etc. to assist drivers in planning their journeys, and also provides geographic information support for advanced assisted driving functions such as automatic lane changing. Positioning information uses satellite positioning systems such as GPS and Beidou and inertial measurement units (IMUs) to accurately determine the vehicle's position and direction of travel. After being collected by vehicle sensors and processed by the system, this information is presented to the driver in an appropriate manner or used for automatic vehicle control.

[0044] As a possible implementation method, obtaining the vehicle's current assisted driving information includes obtaining the vehicle's current map navigation information, chassis information, traffic sign information, and driving parameter information.

[0045] Among them, map navigation information may include current location, destination, navigation route, estimated arrival time and other information, which can be obtained through the vehicle's navigation system.

[0046] Among them, chassis information includes vehicle speed, acceleration, steering wheel angle, braking status and other information, which can be obtained through the vehicle's chassis control system.

[0047] Among them, traffic sign information includes information such as traffic signs on the road, traffic light status, etc. This information can be collected by the vehicle's camera and obtained through image recognition technology.

[0048] Among them, driving parameter information includes vehicle fuel consumption, cruising range, battery power and other information, which can be obtained through relevant sensors of the vehicle.

[0049] Step 103 : synthesize the environment image and the auxiliary driving information to obtain a driving assistance image.

[0050] As a possible implementation method, in the process of synthesizing the environmental screen and the assisted driving information to obtain the driving assistance screen, a first display screen can be generated first based on the assisted driving information. The first display screen may include map navigation information, chassis information, traffic sign information, driving parameter information and other content. Then, based on the first display screen, the environmental screen on the left side of the vehicle and the environmental screen on the right side of the vehicle, and a preset arrangement order, a driving assistance screen is generated. The preset arrangement order can be to place the first display screen in the middle position, the environmental screen on the left side of the vehicle in the left position, and the environmental screen on the right side of the vehicle in the right position. This arrangement method allows the driver to understand the environmental conditions and assisted driving information around the vehicle more intuitively.

[0051] Step 104 : When a connection is established between the vehicle and the extended reality device worn by the driver, the driving assistance screen is sent to the extended reality device for display.

[0052] It should be noted that when a connection is established between the vehicle and the extended reality device worn by the driver, the driving assistance screen can be sent to the extended reality device for display. The extended reality device can be a head-mounted display device, such as AR glasses or VR helmets. The connection between the vehicle and the extended reality device can be established via the Universal Serial Bus Type-C interface; or via the embedded DisplayPort (eDP) or the Gigabit Multimedia Serial Link (GMSL).

[0053] When connecting to an extended reality device via a Universal Serial Bus (USB) Type-C port, the high-speed data transmission capability of the Type-C port can be leveraged to achieve real-time transmission of driver assistance images. The Type-C port supports data transmission rates of up to 10Gbps or higher, meeting the needs of high-definition video transmission.

[0054] When connecting to an extended reality device via the embedded display port (eDP), the low power consumption and high-resolution support of the eDP interface can be utilized to achieve high-quality display of the driving assistance screen. The eDP interface supports resolutions up to 4K or higher, providing a clearer visual experience.

[0055] When connecting to an extended reality device via Gigabit Multimedia Serial Link (GMSL), the long-distance transmission capability and anti-interference capabilities of GMSL can be leveraged to achieve stable transmission of driver assistance images. GMSL supports transmission distances of up to 15 meters or more, adapting to various wiring requirements within the vehicle.

[0056] Optionally, a connection can be established between the vehicle and the user's worn extended reality device via wireless (e.g., Wi-Fi, Bluetooth, etc.) or wired means. The generated driving assistance images are transmitted via this connection channel to the extended reality device, where they are presented using the device's display hardware, allowing the user to obtain driving assistance information within the extended reality scene.

[0057] As an example, an extended reality device could be AR glasses, using binocular full-color displays to deliver a realistic visual experience. To balance wearability and performance, MicroLED (micro-light-emitting diode) display technology can be used, offering excellent brightness and contrast. Each MicroLED pixel can independently control brightness and color, providing clear, vibrant images in varying ambient light conditions.

[0058] Optionally, optical waveguide technology can be used to transmit the displayed image to the user's eyes through a special optical structure, eliminating the need for traditional complex optical lens systems, thereby achieving a lighter and thinner glasses design. This is very important for improving user comfort and convenience, especially during long driving. Thin AR glasses will not place excessive burden on the user.

[0059] An optional 3DOF (3-degree-of-freedom) camera can be used to sense eyewear posture, enabling accurate display of driver assistance information tailored to the user's viewing angle and assisting with environmental awareness. The platform uses chips such as AR2 or AR1, high-performance chips designed specifically for augmented reality applications. These chips boast powerful graphics processing capabilities, enabling rapid processing and rendering of complex driver assistance screens.

[0060] In the embodiments of the present disclosure, first, the environment picture around the vehicle is collected to obtain the current auxiliary driving information of the vehicle, then the environment picture and the auxiliary driving information are synthesized to obtain a driving assistance picture, and then the driving assistance picture is sent to the extended reality device worn by the driver for display in the case that the vehicle and the extended reality device are connected. Thus, the driving assistance picture is directly presented to the driver through the extended reality device, and the driver can observe the necessary information without moving the head or looking down, effectively avoiding the driving risk caused by the driver looking down to watch the display screen of the traditional electronic outside rearview mirror, and improving the driving safety. Since the display content of the extended reality device is only visible to the driver, no dynamic video is projected to other spaces in the vehicle, effectively solving the problem that the continuous display of dynamic video by the display screen of the traditional electronic outside rearview mirror may cause discomfort of other passengers in the vehicle, and improving the passenger experience. The present application integrates the functions of the electronic outside rearview mirror display screen and the head-up display (HUD) into one extended reality device, reducing the space occupation of the whole vehicle and simplifying the layout of the facilities in the vehicle. By controlling the display mode of the driving assistance picture according to the moving angle and moving direction of the user's head, a three-curtain display effect is realized, and the driver can flexibly view different information by moving the line of sight, without adjusting the seat to adapt to the fixed position of the HUD, thereby improving the use convenience.

[0061] Figure 2 is a flowchart of a method for assisting driving of a vehicle according to a second embodiment of the present disclosure.

[0062] As shown in Figure 2 , the method is performed by an extended reality device, and includes:

[0063] Step 201, receiving a driving assistance picture sent by a vehicle.

[0064] Optionally, the extended reality device can be a head-mounted display device, such as AR glasses, VR helmet, etc. The extended reality device receives the driving assistance picture through the connection established with the vehicle. Such connection can be a connection established through a universal serial bus Type-C interface, a connection established through an embedded display port eDP, or a connection established through a gigabit multimedia serial link GMSL. The driving assistance picture contains the environment picture around the vehicle and the current auxiliary driving information of the vehicle. The environment picture is collected by the camera installed at different positions of the vehicle, including the road conditions in front of, behind, left side and right side of the vehicle. The auxiliary driving information includes map navigation information, chassis information, traffic sign information and driving parameter information, etc. The extended reality device detects the moving angle and moving direction of the user's head through the built-in sensors such as gyroscope, accelerometer, etc. According to the detected moving angle and moving direction of the head, the extended reality device controls the display mode of the driving assistance picture in the device.

[0065] Step 202: Control the display mode of the driving assistance screen in the extended reality device according to the user's current head movement angle and movement direction.

[0066] Specifically, in the process of controlling the display mode of the driving assistance screen in the extended reality device according to the user's current head movement angle and movement direction, when the head movement angle and movement direction meet the first condition, the environmental screen on the left side of the vehicle can be displayed based on the driving assistance screen.

[0067] The first condition can be that the user's head turns left by more than a certain angle, for example, more than 30 degrees. When the user's head turns left by more than 30 degrees, the extended reality device will display the surrounding image of the left side of the vehicle, allowing the user to clearly see the situation on the left side of the vehicle, helping the user make correct judgments when changing lanes, turning, and other operations.

[0068] Optionally, the right side of the vehicle can be displayed based on the driving assistance screen if the head movement angle and direction meet a second condition. The second condition can be that the user's head has turned to the right by more than a certain angle, for example, more than 30 degrees. When the user's head turns to the right by more than 30 degrees, the extended reality device will display the right side of the vehicle, allowing the user to clearly see the situation on the right side of the vehicle, which also helps the user make correct decisions when changing lanes, turning, and other operations.

[0069] Optionally, a first display screen may be displayed based on the driving assistance screen when the head movement angle and direction meet a third condition. The first display screen is used to display auxiliary driving information. The third condition may be that the user's head is kept forward or moves up and down. When the user's head is kept forward or moves up and down, the extended reality device will display the first display screen, allowing the user to view auxiliary driving information such as map navigation information, chassis information, traffic sign information, and driving parameter information, helping the user understand the vehicle status and surrounding traffic conditions.

[0070] In the disclosed embodiment, the extended reality device first receives the driving assistance screen transmitted by the vehicle. It then controls how the driving assistance screen is displayed on the extended reality device based on the user's current head movement angle and direction. Users can switch between different display contents with simple head movements, eliminating manual operation and improving driving safety and convenience. Furthermore, the display content of the extended reality device automatically adjusts based on the user's needs, providing a more personalized driving experience.

[0071] Figure 3This is an architecture diagram of an advanced driver assistance system (ADAS) system. The following describes each component: The SoC (System on a Chip) is the core of the system and contains multiple driver modules. The SensorDriver (Sensor Driver) processes sensor data and connects to cameras via GMSL and to the GPS (Global Positioning System) and IMU (Inertial Measurement Unit) via UART (Universal Asynchronous Receiver / Transmitter). The ChassisDriver (Chassis Driver) interacts with the vehicle chassis. The ScenarioModel (Scenario Model) is used for scenario modeling and analysis.

[0072] The MCU (microcontroller unit) communicates with other modules via the CanBridge, connecting to the car chassis to enable transmission and interaction of low-level vehicle control commands. Communication interface: CAN (Controller Area Network) is used for communication between the MCU and the ADAS system. GMSL is used to transmit camera data, and UART is used for serial communication between devices. The Perception module processes data from sensors and provides environmental perception information to the system, making it a key step in enabling ADAS functionality. Online NavMapService (online navigation map service) provides map data support, combining perception information to assist in driving decisions.

[0073] The AR HUD app (augmented reality head-up display) is based on the AR Engine (augmented reality engine), OpenGL (graphics library), and DisplayDriver (display driver). It outputs relevant information to the Display Hardware (display hardware) and displays it to the driver through the PGUHW (optical processing unit hardware). HUD settings can be adjusted through the IVI (in-vehicle infotainment system). HUDBridge serves as a bridge connecting different modules and HUD-related functions.

[0074] To facilitate better implementation of the vehicle assisted driving method disclosed herein, the present disclosure also provides a vehicle assisted driving device based on the aforementioned vehicle assisted driving method. The meanings of the terms herein are the same as those in the aforementioned vehicle assisted driving method. For specific implementation details, please refer to the description in the method embodiment.

[0075] See also Figure 4 , Figure 4 : is a schematic structural diagram of a vehicle driving assistance device provided by an embodiment of the present disclosure. The vehicle driving assistance device 400 includes:

[0076] The acquisition module 410 is used to acquire images of the environment around the vehicle;

[0077] An acquisition module 420 is configured to acquire the current assisted driving information of the vehicle;

[0078] a processing module 430 for synthesizing the environment image and the auxiliary driving information to obtain a driving assistance image;

[0079] The sending module 440 is used to send the driving assistance screen to the extended reality device for display when a connection is established between the vehicle and the extended reality device worn by the driving user.

[0080] Optionally, the acquisition module 420 is specifically configured to:

[0081] Obtain the vehicle's current map navigation information, chassis information, traffic sign information, and driving parameter information.

[0082] Optionally, the device further includes:

[0083] A first connection module, configured to establish a connection with the extended reality device via a universal serial bus Type-C interface;

[0084] A second connection module, configured to establish a connection with the extended reality device via an embedded display port eDP;

[0085] The third connection module is used to establish a connection with the extended reality device through a gigabit multimedia serial link GMSL.

[0086] Optionally, the processing module 430 is specifically configured to:

[0087] generating a first display screen according to the assisted driving information;

[0088] The driving assistance screen is generated according to the first display screen, the environment screen on the left side of the vehicle, the environment screen on the right side of the vehicle, and a preset arrangement order.

[0089] In the disclosed embodiment, the environmental image around the vehicle is first captured to obtain the vehicle's current assisted driving information. The environmental image and the assisted driving information are then synthesized to obtain a driving assistance image. After that, when a connection is established between the vehicle and the extended reality device worn by the driver, the driving assistance image is sent to the extended reality device for display. Thus, the driving assistance image is presented directly to the driver through the extended reality device, and the driver can observe the necessary information without moving his head or lowering his head. This effectively avoids the driving risks caused by the traditional electronic exterior rearview mirror display screen requiring the driver to lower his head to view, thereby improving driving safety. Since the display content of the extended reality device is only visible to the driver and does not project dynamic video to other spaces in the vehicle, it effectively solves the problem that the traditional electronic exterior rearview mirror display screen continuously displays dynamic video, which may cause discomfort to other passengers in the vehicle, thereby improving the passenger experience. The present invention integrates the functions of two sets of facilities, the electronic exterior rearview mirror display screen and the head-up display, into one extended reality device, reducing the space occupied by the entire vehicle and simplifying the layout of the facilities in the vehicle. By controlling the display mode of the driving assistance screen according to the user's head movement angle and direction, a three-screen display effect is achieved. The driver can flexibly view different information by moving his eyes, without having to adjust the seat to adapt to the fixed position of the HUD, which improves the convenience of use.

[0090] See also Figure 5 , Figure 5 : is a schematic structural diagram of a vehicle driving assistance device provided by an embodiment of the present disclosure. The vehicle driving assistance device 500 includes:

[0091] Receiving module 510, for receiving the driving assistance screen sent by the vehicle;

[0092] The control module 520 is used to control the display mode of the driving assistance screen in the extended reality device according to the user's current head movement angle and movement direction.

[0093] Optionally, the control module 520 is specifically configured to:

[0094] When the head movement angle and movement direction meet the first condition, displaying the environment picture on the left side of the vehicle based on the driving assistance picture;

[0095] When the head movement angle and movement direction meet a second condition, displaying an environment image on the right side of the vehicle based on the driving assistance image;

[0096] When the head movement angle and the movement direction meet a third condition, a first display screen is displayed based on the driving assistance screen, where the first display screen is used to display the driving assistance information.

[0097] In the embodiments of the present disclosure, the extended reality device first receives the driving assistance picture sent by the vehicle, and then can control the display mode of the driving assistance picture in the extended reality device according to the current head movement angle and movement direction of the user. The user can switch different display contents through simple head movement, without manual operation, thereby improving the safety and convenience of driving. At the same time, the display content of the extended reality device is automatically adjusted according to the user's needs, providing a more personalized driving experience.

[0098] In addition, the present disclosure also provides an electronic device, such as Figure 6 As shown in FIG. 1, a structural schematic diagram of an electronic device related to the present disclosure is shown, in particular:

[0099] The electronic device can include a processor 601 with one or more processing cores, a memory 602 with one or more computer readable storage media, a power supply 603, an input unit 604, and the like. Those skilled in the art can understand that Figure 6 The structure of the electronic device shown in FIG. 1 does not constitute a limitation on the electronic device, and can include more or fewer components than shown, or combine certain components, or different component arrangements. Among them:

[0100] The processor 601 is the control center of the electronic device, which connects all parts of the electronic device through various interfaces and lines, executes various functions of the electronic device and processes data by running or executing software programs and / or modules stored in the memory 602, and calling data stored in the memory 602, thereby overall monitoring the electronic device. Optionally, the processor 601 can include one or more processing cores; preferably, the processor 601 can integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 601.

[0101] The memory 602 can be used to store software programs and modules, and the processor 601 executes various functions and data processing by running the software programs and modules stored in the memory 602. The memory 602 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), etc.; the data storage area can store data created according to the use of the electronic device, etc. In addition, the memory 602 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state memory device. Accordingly, the memory 602 can also include a memory controller to provide access for the processor 601 to the memory 602.

[0102] The electronic device also includes a power supply 603 for supplying power to various components. Preferably, the power supply 603 can be logically connected to the processor 601 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The power supply 603 can also include one or more DC or AC power supplies, a recharging system, a power supply device debugging circuit, a power converter or inverter, a power status indicator, and other arbitrary components.

[0103] The electronic device may further include an input unit 604, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0104] Although not shown, the electronic device may further include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 601 in the electronic device will load the executable files corresponding to one or more application processes into the memory 602 according to the following instructions, and the processor 601 will run the application stored in the memory 602, thereby implementing the steps of any of the methods for assisted vehicle driving provided in the embodiments of the present disclosure.

[0105] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0106] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0107] To this end, the present disclosure provides a computer-readable storage medium having a computer program stored thereon. The computer program can be loaded by a processor to execute the steps in any one of the methods for assisting vehicle driving provided by the present disclosure.

[0108] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0109] The computer-readable storage medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0110] Since the instructions stored in the computer-readable storage medium can execute the steps in any of the methods for assisting vehicle driving provided by the present disclosure, the beneficial effects that can be achieved by any of the methods for assisting vehicle driving provided by the present disclosure can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0111] The above is a detailed introduction to the method, device, electronic device and computer-readable storage medium for assisting vehicle driving provided by the present disclosure. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core ideas. At the same time, for those skilled in the art, according to the ideas of the present invention, there may be changes in the specific implementation methods and application scopes. In summary, the contents of this specification should not be understood as limiting the present invention.

Claims

1. A method for assisting vehicle driving, characterized in that: Applied in a vehicle, the method comprises: Collect environmental images around the vehicle; Obtaining current assisted driving information of the vehicle; synthesizing the environment image and the auxiliary driving information to obtain a driving assistance image; When a connection is established between the vehicle and the extended reality device worn by the driving user, the driving assistance screen is sent to the extended reality device for display.

2. The method according to claim 1, characterized in that The obtaining of the current assisted driving information of the vehicle includes: Obtain the vehicle's current map navigation information, chassis information, traffic sign information, and driving parameter information.

3. The method according to claim 1, characterized in that Also includes: Establishing a connection with the extended reality device via a universal serial bus Type-C interface; or, Establishing a connection with the extended reality device via the embedded display port eDP; or, A connection is established with the extended reality device via a Gigabit Multimedia Serial Link (GMSL).

4. The method according to claim 1, wherein The synthesizing process of the environment image and the auxiliary driving information to obtain the driving assistance image includes: generating a first display screen according to the assisted driving information; The driving assistance screen is generated according to the first display screen, the environment screen on the left side of the vehicle, the environment screen on the right side of the vehicle, and a preset arrangement order.

5. A method for assisting vehicle driving, characterized in that: Applied to an extended reality device, the method includes: Receive driving assistance images sent by the vehicle; The display mode of the driving assistance screen in the extended reality device is controlled according to the user's current head movement angle and movement direction.

6. The method according to claim 5, characterized in that The controlling the display mode of the driving assistance screen in the extended reality device according to the current head movement angle of the user includes: When the head movement angle and movement direction meet the first condition, displaying the environment picture on the left side of the vehicle based on the driving assistance picture; When the head movement angle and movement direction meet a second condition, displaying an environment image on the right side of the vehicle based on the driving assistance image; When the head movement angle and the movement direction meet a third condition, a first display screen is displayed based on the driving assistance screen, where the first display screen is used to display the driving assistance information.

7. A device for assisting vehicle driving, characterized in that: include: The acquisition module is used to collect images of the environment around the vehicle; An acquisition module, configured to acquire the current assisted driving information of the vehicle; a processing module, configured to synthesize the environment image and the assisted driving information to obtain a driving assistance image; The sending module is used to send the driving assistance screen to the extended reality device for display when a connection is established between the vehicle and the extended reality device worn by the driving user.

8. A device for assisting vehicle driving, characterized in that: include: A receiving module, used to receive the driving assistance screen sent by the vehicle; A control module is used to control the display mode of the driving assistance screen in the extended reality device according to the user's current head movement angle and movement direction.

9. An electronic device, characterized in that: The method comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps in the method according to any one of claims 1 to 4 or 5 to 6 are implemented.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the method according to any one of claims 1 to 4 or 5 to 6.

Images