Driving perspective switching method and device, vehicle and storage medium
By simulating the passenger's perspective using VR technology, correcting the VR image in real time, and switching to the driver's perspective, the problem of reduced safety and experience caused by poor driver adaptation to the steering wheel position is solved, thus improving both safety and experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- CHERY AUTOMOBILE CO LTD
- Filing Date
- 2023-09-07
- Publication Date
- 2026-07-10
AI Technical Summary
The reduced driving safety and experience caused by drivers adapting to different steering wheel positions is particularly noticeable when driving in different countries.
By simulating the passenger's perspective using VR technology, real-time image data is obtained to correct the initial VR image, enabling the switching of the driver's perspective to the passenger's perspective. The camera and data processing module are used to adjust the image differences in real time and update the VR map data simultaneously.
It improves the driver's driving safety and experience, ensuring that the driver can drive safely in different steering wheel positions.
Smart Images
Figure CN117274456B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of vehicle technology, and in particular to a driving perspective switching method, device, vehicle, and storage medium. Background Technology
[0002] The driver's seat position varies from country to country; some countries have left-hand drive, while others have right-hand drive. Drivers need to adapt to the different vehicle types used in those countries, and some even require a different driver's license, which can be inconvenient. Drivers may be unaccustomed to different steering wheels, potentially leading to safety hazards and reducing overall driver safety.
[0003] Related technologies utilize VR (Virtual Reality) technology to display panoramic images of the surrounding road environment, achieving an immersive effect. The viewing angle of the displayed image can be adjusted according to the movement and displacement to achieve flexible switching of the viewing angle. However, the impact of different driving positions on the driver's driving habits and driving safety has not been considered. Summary of the Invention
[0004] This application provides a driving perspective switching method, device, vehicle, and storage medium to solve problems in the related art, such as reduced driving experience and potential safety hazards when the driver's driver's seat does not conform to their driving habits.
[0005] The first aspect of this application provides a driving perspective switching method, including the following steps: acquiring virtual reality (VR) map image data and a real-time image from the passenger's perspective; generating an initial VR image from the passenger's perspective based on the VR map image data; correcting the initial VR image based on the real-time image to obtain a final VR image, and displaying the final VR image from the driver's perspective to switch the driver's perspective to the passenger's perspective.
[0006] Optionally, in one embodiment of this application, the step of correcting the initial VR image based on the real-time image to obtain the final VR image includes: identifying the difference between the initial VR image and the real-time image; and superimposing the difference onto the initial VR image to obtain the final VR image.
[0007] Optionally, in one embodiment of this application, generating the initial VR image from the passenger's perspective based on the VR map image data includes: obtaining the current position of the vehicle; and obtaining the initial VR image corresponding to the current position from the VR map image data.
[0008] Optionally, in one embodiment of this application, before acquiring the image from the passenger's perspective, the process includes: identifying the driver's driving perspective switching command; and executing the driving perspective switching process according to the driving perspective switching command.
[0009] Optionally, in one embodiment of this application, after correcting the initial VR image based on the real-time image to obtain the final VR image, the method further includes: updating VR map image data based on the final VR image; and synchronously updating the VR map image data to the cloud.
[0010] A second aspect of this application provides a driving perspective switching device, comprising: an acquisition module for acquiring virtual reality (VR) map image data and a real-time image from the perspective of a passenger; a generation module for generating an initial VR image from the perspective of the passenger based on the VR map image data; and a switching module for correcting the initial VR image based on the real-time image to obtain a final VR image, and displaying the final VR image from the perspective of the driver to switch the driver's perspective to the perspective of the passenger.
[0011] Optionally, in one embodiment of this application, the switching module is further configured to: identify the differences between the initial VR image and the real-time image; and superimpose the differences onto the initial VR image to obtain the final VR image.
[0012] Optionally, in one embodiment of this application, the generation module is further configured to: obtain the current location of the vehicle; and obtain an initial VR image corresponding to the current location from the VR map image data.
[0013] Optionally, in one embodiment of this application, the driving perspective switching device further includes: a recognition module, used to recognize the driver's driving perspective switching command before acquiring the image from the passenger's perspective; and to execute the driving perspective switching process according to the driving perspective switching command.
[0014] Optionally, in one embodiment of this application, the driving perspective switching device further includes: an update module, used to update VR map image data according to the final VR image obtained by correcting the initial VR image according to the real-time image; and synchronously update the VR map image data to the cloud.
[0015] A third aspect of this application provides a vehicle, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to perform the driving perspective switching method as described in the above embodiments.
[0016] A fourth aspect of this application provides a computer-readable storage medium having a computer program stored thereon that is executed by a processor to perform the driving perspective switching method as described in the above embodiments.
[0017] Therefore, this application has at least the following beneficial effects:
[0018] This application embodiment can use VR technology to create a virtual driving (passenger) view environment that the driver is accustomed to, and transmit it to the driver. The driver can drive using the environment from the passenger's perspective, which can ensure driving safety while improving the driver's driving experience. This solves the technical problem in related technologies where the driver's seat does not conform to their driving habits, resulting in a reduced driving experience and, in severe cases, potentially leading to driving safety issues.
[0019] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description
[0020] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:
[0021] Figure 1 This is a flowchart of a driving perspective switching method provided according to an embodiment of this application;
[0022] Figure 2 This is a flowchart of a driving perspective switching method according to an embodiment of this application;
[0023] Figure 3 This is an example diagram of a driving perspective switching device provided according to an embodiment of this application;
[0024] Figure 4 This is a structural schematic diagram of a vehicle provided according to an embodiment of this application. Detailed Implementation
[0025] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.
[0026] The driving perspective switching method, device, vehicle, and storage medium of this application are described below with reference to the accompanying drawings. Addressing the issue mentioned in the background art that drivers may experience safety risks due to unfamiliarity with different steering wheel positions, this application provides a driving perspective switching method. This method uses VR technology to simulate a VR image viewed from the passenger seat, switching the driver's perspective to the passenger's view. This facilitates driver adaptation to vehicles with different steering wheel positions and improves driving safety. Therefore, it solves the problems in related technologies where a driver's driving experience is reduced or even seriously compromised when the driver's seat does not match their driving habits.
[0027] Specifically, Figure 1 This is a flowchart illustrating a driving perspective switching method provided in an embodiment of this application.
[0028] like Figure 1 As shown, the driving perspective switching method includes the following steps:
[0029] In step S101, virtual reality (VR) map image data and real-time images from the co-pilot's perspective are acquired.
[0030] The VR map image data includes map data such as the environment and roads around the vehicle; real-time images can be obtained through in-vehicle cameras, etc.
[0031] It should be noted that the camera needs to be installed in a position that does not obstruct the driver's view from the passenger side.
[0032] In this embodiment of the application, before acquiring the image from the passenger's perspective, the process includes: recognizing the driver's driving perspective switching command; and executing the driving perspective switching process according to the driving perspective switching command.
[0033] It is understood that, before acquiring the image from the passenger's perspective, this application embodiment can identify the driver's driving perspective switching command, determine whether to execute the driving perspective switching process based on the driving perspective switching command, if the driver's command is not to switch the driving perspective, the driver drives in the normal driver's perspective, if the driver's command is to switch the driving perspective, the driving perspective switching process is executed.
[0034] In step S102, an initial VR image from the co-driver's perspective is generated based on the VR map image data.
[0035] It is understood that, according to the embodiments of this application, an initial VR image from the perspective of the co-driver can be generated based on VR map image data, and an initial VR image simulating the perspective of the co-driver can be generated in advance.
[0036] In this embodiment of the application, generating an initial VR image from the passenger's perspective based on VR map image data includes: obtaining the current position of the vehicle; and obtaining the initial VR image corresponding to the current position from the VR map image data.
[0037] It is understood that, in this embodiment of the application, the initial VR image of the current passenger position can be obtained from the VR map image data by acquiring the current position of the vehicle.
[0038] In step S103, the final VR image is obtained by correcting the initial VR image based on the real-time image and is displayed in the driver's view to switch the driver's view to the passenger's view.
[0039] It is understood that the embodiments of this application can use the real-time image obtained by the camera from the perspective of the passenger to correct the initial VR image to obtain the final VR image, and then transmit the final VR image to the driver to display the final VR image in the perspective of the driver, so as to switch the perspective of the driver to the perspective of the passenger.
[0040] It should be noted that the final VR image can be displayed on the navigation system or on the in-vehicle display terminal for the driver to view.
[0041] In this embodiment of the application, the process of correcting an initial VR image based on a real-time image to obtain a final VR image includes: identifying the differences between the initial VR image and the real-time image; and superimposing the differences onto the initial VR image to obtain the final VR image.
[0042] It is understood that the embodiments of this application can compare the initial VR image with the real-time image, identify the differences between the initial VR image and the real-time image, that is, identify the differences between the map data of the initial VR image in the passenger seat and the map data of the real-time image, and superimpose the differences onto the map data of the initial VR image to obtain the final VR image.
[0043] Specifically, in this embodiment of the application, the real-time image acquired by the camera can be transmitted to the real-time data processing module. The real-time data processing module quickly processes the real-time image information to adjust information that is inconsistent with the initial VR image, that is, to correct the initial VR image using the data of the latest real-time image captured by the camera.
[0044] In this embodiment of the application, after correcting the initial VR image based on the real-time image to obtain the final VR image, the method further includes: updating the VR map image data based on the final VR image; and synchronously updating the VR map image data to the cloud.
[0045] It is understood that, after obtaining the final VR image, the embodiments of this application can use the final VR image to update the VR map image data, synchronously update the VR map image data to the cloud, and correct the overall background VR map image data so that, when the vehicle is connected to the Internet, the cloud will synchronously update the latest VR map data to the vehicle for the driver's use.
[0046] The following specific example illustrates the process of switching driving perspectives, using the display of VR images on a navigation system as an example. Figure 2 As shown, it includes:
[0047] Step 1: Install camera A in the passenger seat position without affecting the driver's view;
[0048] Step 2: The navigation system acquires the original passenger-side map data, simulates the passenger-side data information in advance to form VR data, and the navigation system converts it into the initial passenger-side VR image;
[0049] Step 3: Vehicle camera A acquires real-time images and transmits them to the real-time data processing module;
[0050] Step 4: The real-time data processing module compares the real-time image map data captured by the camera in the real-time data module with the initial VR map image data of the passenger seat, corrects the inconsistencies between the two in real time, obtains the corrected latest VR image of the passenger seat, and transmits the latest VR image to the driver.
[0051] Step 5: Upload the latest VR image, corrected in Step 4, to the cloud to correct the overall background VR map image data;
[0052] Step 6: When the vehicle-mounted device is connected to the internet, the cloud will synchronize and update the latest VR map image data to the vehicle-mounted device.
[0053] According to the driving perspective switching method proposed in the embodiments of this application, a virtual driving position (passenger seat) perspective environment familiar to the driver can be established through VR technology and transmitted to the driver. The driver can drive using the environment under the passenger seat perspective, which can ensure the safety of the driver while improving the driver's safe driving experience.
[0054] Next, the driving perspective switching device proposed according to the embodiments of this application is described with reference to the accompanying drawings.
[0055] Figure 3 This is a block diagram of a driving perspective switching device according to an embodiment of this application.
[0056] like Figure 3As shown, the driving perspective switching device 10 includes: an acquisition module 100, a generation module 200, and a switching module 300.
[0057] The acquisition module 100 is used to acquire virtual reality (VR) map image data and real-time images from the passenger's perspective; the generation module 200 is used to generate an initial VR image from the passenger's perspective based on the VR map image data; and the switching module 300 is used to correct the initial VR image based on the real-time image and display the final VR image from the driver's perspective to switch the driver's perspective to the passenger's perspective.
[0058] In this embodiment, the switching module 300 is further configured to: identify the differences between the initial VR image and the real-time image; and superimpose the differences onto the initial VR image to obtain the final VR image.
[0059] In this embodiment of the application, the generation module 200 is further configured to: obtain the current location of the vehicle; and obtain the initial VR image corresponding to the current location from the VR map image data.
[0060] In this embodiment of the application, the device 10 further includes an identification module.
[0061] The recognition module is used to recognize the driver's driving perspective switching command before acquiring the image from the passenger's perspective; and to execute the driving perspective switching process according to the driving perspective switching command.
[0062] In this embodiment of the application, the apparatus 10 further includes an update module.
[0063] The update module is used to update the VR map image data based on the final VR image obtained by correcting the initial VR image based on the real-time image; and to synchronously update the VR map image data to the cloud.
[0064] It should be noted that the foregoing explanation of the driving perspective switching method embodiment also applies to the driving perspective switching device of this embodiment, and will not be repeated here.
[0065] According to the driving perspective switching device proposed in the embodiments of this application, a virtual driving position (passenger seat) perspective environment familiar to the driver can be established through VR technology and transmitted to the driver. The driver can drive using the environment under the passenger seat perspective, which can ensure the safety of the driver while improving the driver's driving experience.
[0066] Figure 4 A schematic diagram of the structure of a vehicle provided in an embodiment of this application. The vehicle may include:
[0067] The memory 401, the processor 402, and the computer program stored on the memory 401 and capable of running on the processor 402.
[0068] When the processor 402 executes the program, it implements the driving perspective switching method provided in the above embodiments.
[0069] Furthermore, the vehicle also includes:
[0070] Communication interface 403 is used for communication between memory 401 and processor 402.
[0071] The memory 401 is used to store computer programs that can run on the processor 402.
[0072] The memory 401 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.
[0073] If the memory 401, processor 402, and communication interface 403 are implemented independently, then the communication interface 403, memory 401, and processor 402 can be interconnected via a bus to complete communication between them. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be divided into address buses, data buses, control buses, etc. For ease of representation, Figure 4 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.
[0074] Optionally, in a specific implementation, if the memory 401, processor 402, and communication interface 403 are integrated on a single chip, then the memory 401, processor 402, and communication interface 403 can communicate with each other through an internal interface.
[0075] Processor 402 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this application.
[0076] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the driving perspective switching method described above.
[0077] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.
[0078] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise explicitly specified.
[0079] Any process or method described in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or N executable instructions for implementing custom logic functions or processes, and the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as should be understood by those skilled in the art to which embodiments of this application pertain.
[0080] It should be understood that the various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented using any one or more of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.
[0081] Those skilled in the art will understand that all or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.
Claims
1. A method for switching driving perspectives, characterized in that, Includes the following steps: Acquire virtual reality (VR) map image data and real-time images from the co-pilot's perspective; Generate the initial VR image from the co-driver's perspective based on the VR map image data; The final VR image is obtained by correcting the initial VR image based on the real-time image and is displayed in the driver's view to switch the driver's view to the passenger's view.
2. The method according to claim 1, characterized in that, The step of correcting the initial VR image based on the real-time image to obtain the final VR image includes: Identify the differences between the initial VR image and the real-time image; The difference is superimposed onto the initial VR image to obtain the final VR image.
3. The method according to claim 1, characterized in that, The step of generating the initial VR image from the co-driver's perspective based on the VR map image data includes: Get the vehicle's current location; Obtain the initial VR image corresponding to the current location from the VR map image data.
4. The method according to claim 1, characterized in that, Before acquiring the image from the passenger's perspective, the following is included: Recognize the driver's command to switch driving perspective; The driving perspective switching process is executed according to the driving perspective switching command.
5. The method according to claim 1, characterized in that, After correcting the initial VR image based on the real-time image to obtain the final VR image, the process further includes: Update the VR map image data based on the final VR image; The VR map image data is updated synchronously to the cloud.
6. A driving perspective switching device, characterized in that, include: The acquisition module is used to acquire virtual reality (VR) map image data and real-time images from the co-pilot's perspective; The generation module is used to generate an initial VR image from the co-driver's perspective based on the VR map image data; The switching module is used to correct the initial VR image based on the real-time image to obtain the final VR image, and to display the final VR image in the driver's view to switch the driver's view to the passenger's view.
7. The apparatus according to claim 6, characterized in that, The switching module is further used for: Identify the differences between the initial VR image and the real-time image; The difference is superimposed onto the initial VR image to obtain the final VR image.
8. The apparatus according to claim 6, characterized in that, The generation module is further used for: Get the vehicle's current location; Obtain the initial VR image corresponding to the current location from the VR map image data.
9. A vehicle, characterized in that, include: A memory, a processor, and a computer program stored in the memory and executable on the processor, the processor executing the program to implement the driving perspective switching method as described in any one of claims 1-5.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that, The program is executed by the processor to implement the driving perspective switching method as described in any one of claims 1-5.