VR (Virtual Reality) 360-degree video system for vehicle tourist

Abstract

The invention provides a VR (Virtual Reality) vehicle view 360-degree video system, which comprises a 360-degree panoramic camera, a VR (Virtual Reality) vehicle view 360-degree video server, a VR (Virtual Reality) vehicle view 360-degree video server, a VR (Virtual Reality) vehicle view 360-degree video server and a VR (Virtual Reality) vehicle view 360-degree video server, an OpenCV processor, the OpenCV processor is electrically connected with the 360-degree panoramic camera, and the OpenCV processor is used for video processing; a krphano module, wherein the krphano module is electrically connected with the 360-degree panoramic camera; the automatic Selenium browser is electrically connected with the krphano module, the automatic Selenium browser is electrically connected with the krphano module, and the automatic Selenium browser is used for browsing; the PyAutoGUI module is electrically connected with the Selenium automatic browser, and the PyAutoGUI module is electrically connected with the Selenium automatic browser; the server is electrically connected with the OpenCV processor; and the VR player is electrically connected with the OpenCV processor, and the VR player is electrically connected with the OpenCV processor. And the product display and marketing level is improved, so that the requirements and expectations of consumers are better met.

Description

Technical Field

[0001] The present invention relates to the technical field of VR vehicle tour 360° video systems, and it is a VR vehicle tour 360° video system. Background Art

[0002] With the rapid development of technology, especially the continuous breakthroughs in the fields of artificial intelligence, machine vision, and the Internet of Things, VR video technology has gradually become an important research direction in the automotive technology field. This technology captures omnidirectional images of the vehicle body and its surrounding environment through high-definition cameras, and through image processing and video encoding, generates 360° panoramic videos that can be downloaded or watched online by users.

[0003] Currently, the domestic and foreign counterparts have all explored VR video technology, but the technical levels and application effects are uneven. In the domestic market, although some manufacturers have launched related products, there is still much room for improvement in image stitching accuracy, video encoding efficiency, and user experience. In the foreign market, some well-known brands have launched relatively mature products, but they are expensive and have problems with local adaptation. Therefore, researching and developing VR video technology with independent intellectual property rights and high cost performance is of great significance for improving the domestic automotive technology level and meeting market demands.

[0004] Detailed analysis of the disadvantages of having only pictures but no videos for cars:

[0005] 1) Limitation in unclear detail display of static images: VR videos can clearly display the detailed parts of a car, such as interior materials, seat comfort, and storage space, while traditional videos or pictures may not provide clear enough detail display, leading to doubts for users during the purchase decision-making process;

[0006] 2) Intuitive function demonstration lacking: VR videos can simulate various function operations of a car, such as intelligent driving assistance systems and in-vehicle entertainment systems. This intuitive demonstration method helps users better understand the functions and performance of the car. Without VR videos for car displays, users may misunderstand or overlook these functions;

[0007] 3) Backward interactive technology: With the continuous development and popularization of virtual reality technology, more and more industries are applying VR technology for product display and marketing. If the automotive industry still adheres to traditional display methods, it may be regarded as backward in technology;

[0008] 4) Missing market opportunities: VR technology has brought new market opportunities to the automotive industry, such as online car purchases and virtual test drives. Automobile brands lacking VR videos may miss these market opportunities and thus lose their competitive advantages;

[0009] Based on the above-mentioned many drawbacks, these drawbacks not only affect the user experience and marketing effect, but also limit the product display effect and the trend of technological development. Summary of the Invention

[0010] The present invention aims to solve the technical problems of unclear detail display of static images: VR videos can clearly display the detailed parts of a car, such as interior materials, seat comfort, and storage space, while traditional videos or pictures may not provide clear enough detail display, resulting in doubts for users during the purchase decision-making process; unintuitive function demonstration: VR videos can simulate various function operations of a car, such as intelligent driving assistance systems and in-vehicle entertainment systems. This intuitive demonstration method helps users better understand the functions and performance of the car. Without VR videos for car display, users may misunderstand or overlook these functions; backward interactive technology: With the continuous development and popularization of virtual reality technology, more and more industries are applying VR technology for product display and marketing. If the automotive industry still adheres to traditional display methods, it may be regarded as technologically backward and miss market opportunities: VR technology brings new market opportunities to the automotive industry, such as online car purchase and virtual test drive. Automobile brands lacking VR videos may miss these market opportunities and thus lose their competitive advantages, and provides a VR car tour 360° video system.

[0011] The present invention solves the above technical problems through the following technical solutions:

[0012] The present invention provides a VR car tour 360° video system, and the VR car tour 360° video system includes:

[0013] A 360-degree panoramic camera, which is used to capture all-round videos of the car and its surrounding environment and take panoramic roaming pictures;

[0014] An OpenCV processor, which is electrically connected to the 360-degree panoramic camera and is used for video processing;

[0015] A krpano module, which is electrically connected to the 360-degree panoramic camera and is used for processing panoramic roaming pictures;

[0016] A Selenium automated browser, which is electrically connected to the krpano module and is used for browsing;

[0017] A PyAutoGUI module, which is electrically connected to the Selenium automated browser and is used for screen recording;

[0018] A server, which is electrically connected to an OpenCV processor;

[0019] A VR player, which is electrically connected to the OpenCV processor. The VR player is used to play the synthesized panoramic video.

[0020] Furthermore, the VR player can be one of a VR helmet and VR glasses. The VR player is used to play the synthesized panoramic video and provide an immersive browsing experience.

[0021] Furthermore, the server can be set to trigger the panoramic function with a turn signal. When the turn signal is on, the image on the corresponding side will appear on the screen. It can also be set to trigger the function of automatically switching to the top-down large image with a radar. When reversing very close to an obstacle, the screen will directly display the top-down image of the vehicle's tail, so that the driver can intuitively see the distance between the vehicle's tail and the obstacle.

[0022] Furthermore, the server includes a permission verification module, a log recording module, and a nacos unified configuration module. The permission verification module, the log recording module, and the nacos unified configuration module are electrically connected to the processor.

[0023] Furthermore, the server manages materials in a cloud storage manner, supports the upload and high-speed download of large files, and uses the DfsClient provided by operation and maintenance for the unified file upload method, with low maintenance costs, high development efficiency, and stronger reusability.

[0024] Furthermore, the nacos unified configuration module enables centralized management of configuration files, making it convenient to modify and adjust configuration files.

[0025] Furthermore, the log recording module uses AOP, and new modules and functions can be quickly connected to the log system.

[0026] Furthermore, the processor is electrically connected to a memory and a display. The display can adjust the brightness, contrast, and saturation parameters of the display screen according to personal preferences.

[0027] Furthermore, the memory has a storage function and can store panoramic images during vehicle driving. The driver can view and analyze previous driving situations through the playback function afterwards, providing strong guarantee for driving safety.

[0028] Further, the Selenium automated browser is a complete set of Web application testing tool sets, used for automating the testing of Web applications, and can also be used as a crawler tool. It supports multiple programming languages, such as Python, Java, C#, and can run directly in the browser, simulating the real operations of users. WebDriver is a set of standard API protocols proposed by Selenium, and WC uses it as a recommended standard to describe the operation instructions for the UI interface, enabling the client to operate different browsers using the same functions.

[0029] Based on the common knowledge in the art, the above preferred conditions can be combined arbitrarily to obtain various preferred embodiments of the present invention.

[0030] The positive and progressive effects of the present invention are as follows:

[0031] The proposed VR car tour 360° video system uses VR video technology to improve the product display and marketing level, so as to better meet the needs and expectations of consumers, aiming at the lack of real-time nature, insufficient information richness, poor user experience and technical limitations in the consumer's car experience.

[0032] In order to improve the performance and user experience of viewing car pictures, in the future, the web display form of car pictures should gradually develop from static pictures to videos, realizing a more rich and interactive VR vision.

[0033] Through the panoramic car pictures uploaded manually, use the krpano tool to process the 360-degree panoramic roaming pictures, operate through the Selenium automated browser, perform screen recording with PyAutoGUI, and process the video with OpenCV to realize the automatic recording of the web content of the VR roaming pictures processed by the krpano tool, record and process them into high-quality videos, and magnify each car part to access the audio explanation of the video manual. The whole set of car explanation videos is recorded, greatly improving the experience of customers watching, browsing and downloading. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present application.

[0035] Figure 1 It is a system diagram of the VR car tour 360° video system of the present invention.

[0036] Figure 2 It is a schematic diagram of the server of the VR car tour 360° video system of the present invention.

[0037] Figure 3 This is a flowchart of the VR vehicle tour 360° video acquisition method for the VR vehicle tour 360° video system of the present invention. Detailed implementation mode

[0038] In order to enable those skilled in the art to better understand the solutions of this application, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of this application.

[0039] It should be noted that, without conflict, the embodiments in this application and the features in the embodiments can be combined with each other.

[0040] Embodiment:

[0041] As Figures 1-3 shown, the VR vehicle tour 360° video system includes:

[0042] A 360-degree panoramic camera 1, which is used to capture the omnidirectional video of the vehicle and its surrounding environment and take 360-degree panoramic roaming pictures;

[0043] An OpenCV processor 2, which is electrically connected to the 360-degree panoramic camera 1 and is used for video processing;

[0044] A krpano module 4, which is electrically connected to the 360-degree panoramic camera 1 and is used for processing 360-degree panoramic roaming pictures;

[0045] A Selenium automated browser 5, which is electrically connected to the krpano module 4 and is used for browsing;

[0046] A PyAutoGUI module 6, which is electrically connected to the Selenium automated browser 5 and is used for screen recording;

[0047] A server 7, which is electrically connected to the OpenCV processor 2;

[0048] A VR player 3, which is electrically connected to an OpenCV processor 2. The VR player 3 is used to play the synthesized 360-degree panoramic video.

[0049] Improve the product display and marketing level to better meet the needs and expectations of consumers. Regarding the lack of real-time nature, insufficient information richness, poor user experience, and technical limitations in the consumer car experience; to improve the performance and user experience of viewing car pictures, in the future, the web display form of car pictures should gradually develop from static pictures to videos, achieving a more rich and interactive VR vision; through manually uploaded car panoramic pictures, use the krpano tool to process 360-degree panoramic roaming pictures, operate through the Selenium automated browser 5, perform screen recording with PyAutoGUI, and process videos with OpenCV to automatically record the VR roaming pictures processed by the krpano tool on the web page, record and process them into high-quality videos, and magnify and access the video instruction audio explanations for each car component. After the entire set of car explanation videos is recorded, the viewing, browsing, and downloading experience of customers is greatly improved.

[0050] Furthermore, the VR player 3 can be one of a VR helmet or VR glasses. The VR player 3 is used to play the synthesized 360-degree panoramic video and provide an immersive browsing experience.

[0051] Furthermore, the server 7 can set the turn signal to trigger the panoramic function. When the turn signal is on, the image on the corresponding side will appear on the screen. It can also set the radar to trigger the panoramic automatic switching to the top-down large image function. When reversing very close to an obstacle, the screen will directly display the top-down image of the rear of the vehicle so that the driver can intuitively see the distance between the rear of the vehicle and the obstacle.

[0052] Furthermore, the server 7 includes a permission verification module 8, a log recording module 9, and a nacos unified configuration module 10. The permission verification module, the log recording module 9, and the nacos unified configuration module 10 are electrically connected to the processor.

[0053] Furthermore, the server 7 manages materials in a cloud storage manner, supports the upload and high-speed download of large files, uses the DfsClient provided by the operation and maintenance for the unified file upload method, with low maintenance costs, high development efficiency, and stronger reusability.

[0054] Furthermore, the nacos unified configuration module 10 enables centralized management of configuration files, making the modification and adjustment of configuration files convenient.

[0055] Further, the log recording module 9 uses AOP, enabling quick access to the log system for newly added modules and functions.

[0056] Further, the processor is electrically connected to the memory 11 and the display 12, and the display 12 can adjust the brightness, contrast, and saturation parameters of the display screen according to personal preferences.

[0057] Further, the memory 11 has a storage function and can store panoramic images during vehicle driving. The driver can view and analyze previous driving situations through the playback function afterwards, providing strong guarantee for driving safety.

[0058] Further, the Selenium automated browser 5 is a complete set of Web application test tool sets, used for testing Web application programs automatically and can also be used as a crawler tool. It supports multiple programming languages such as Python, Java, and C#, and can run directly in the browser to simulate real operations of users. WebDriver is a set of standard API protocols proposed by Selenium, which is recommended by W3C and used to describe operation instructions for the UI interface, enabling the client to operate different browsers with the same functions.

[0059] The circuits, electronic components, and modules involved are all prior arts, which can be fully realized by those skilled in the art without further elaboration. The content protected by this application does not involve improvements to software and methods either.

[0060] The present invention is not limited to the above embodiments. No matter what changes are made in its shape or structure, they all fall within the protection scope of the present invention. The protection scope of the present invention is defined by the appended claims. Those skilled in the art can make various changes or modifications to these embodiments without departing from the principle and essence of the present invention, but these changes and modifications all fall within the protection scope of the present invention.

Claims

1. A VR car tour 360° video system, characterized in that: The VR car tour 360° video system includes: A 360-degree panoramic camera (1), the 360-degree panoramic camera (1) is used to capture all-round video of the car and its surroundings, and take 360-degree panoramic roaming pictures; An OpenCV processor (2), the OpenCV processor (2) being electrically connected to the 360-degree panoramic camera (1), and the OpenCV processor (2) being used for video processing; A krpano module (4), the krpano module (4) being electrically connected to the 360-degree panoramic camera (1), and the krpano module (4) being used for processing 360-degree panoramic roaming pictures; A Selenium automated browser (5), the Selenium automated browser (5) being electrically connected to the krpano module (4), and the Selenium automated browser (5) being used for browsing; A PyAutoGUI module (6), the PyAutoGUI module (6) being electrically connected to the Selenium automated browser (5), and the PyAutoGUI module (6) being used for screen recording; A server (7), wherein the server (7) is electrically connected to the OpenCV processor (2); A VR player (3), the VR player (3) is electrically connected to an OpenCV processor (2), the VR player (3) is electrically connected to an OpenCV processor (2), and the VR player (3) is used to play the synthesized 360-degree panoramic video.

2. The VR car tour 360° video system according to claim 1, characterized in that: The VR player (3) may be a VR helmet or VR glasses, and the VR player (3) is used to play the synthesized 360-degree panoramic video and provide an immersive browsing experience.

3. The VR car tour 360° video system according to claim 1, characterized in that: The server (7) can be configured with a turn signal to trigger a panoramic function. When the turn signal is turned on, the image of the corresponding side will appear on the screen. A radar can also be configured to trigger a panoramic automatic switch to a large overhead view. When the vehicle is backing up very close to an obstacle, the screen will directly display a bird's-eye view image of the rear of the vehicle, so that the driver can intuitively see the distance between the rear of the vehicle and the obstacle.

4. The VR car tour 360° video system according to claim 1, characterized in that: The server (7) comprises an authority verification module (8), a log recording module (9) and a nacos unified configuration module (10), and the authority verification module, the log recording module (9) and the nacos unified configuration module (10) are electrically connected to the processor.

5. The VR car tour 360° video system according to claim 1, characterized in that: The server (7) package adopts a cloud storage method to manage materials, supports uploading and high-speed downloading of ultra-large files, and uses the DfsClient provided by the operation and maintenance to unify the file uploading method, with low maintenance cost, high development efficiency and stronger reusability.

6. The VR car tour 360° video system according to claim 1, characterized in that: The nacos unified configuration module (10) enables centralized management of configuration files, making modification and adjustment of configuration files convenient.

7. The VR car tour 360° video system according to claim 1, characterized in that: The logging module (9) uses AOP, so that newly added modules and functions can be quickly connected to the logging system.

8. The VR car tour 360° video system according to claim 1, characterized in that: The processor is electrically connected to the memory (11) and the display (12); the display (12) can adjust the brightness, contrast and saturation parameters of the display image according to personal preference.

9. The VR car tour 360° video system according to claim 1, characterized in that: The memory (11) has a storage function and can store panoramic images during the vehicle's driving process. The driver can review and analyze previous driving conditions through a playback function afterwards, thereby providing a strong guarantee for driving safety.

10. The VR car tour 360° video system according to claim 1, characterized in that: The Selenium automated browser (5) is a complete set of Web application testing tools, which is used to automate the testing of Web applications and can also be used as a crawler tool. It supports multiple programming languages, such as Python, Java, and C#, and can be directly run in the browser to simulate the user's real operation. WebDriver is a set of standard API protocols proposed by Selenium. W3C uses it as a recommended standard for describing operation instructions for the UI interface, so that the client can operate different browsers using the same function.

Images