Imitated live-action picture generation method and device, equipment and storage medium

Abstract

The invention discloses a simulation real scene picture generation method and device, equipment and a storage medium. The method comprises the steps that the real-time driving speed and real-time position information of a vehicle are acquired; screening out scenic spot information matched with the real-time position information and the real-time driving speed from a pre-constructed scenic spot information base; multi-dimensional information and the scenic spot information are fused, and a multi-dimensional staggered imitated real scene picture is constructed; and according to the real-time driving speed, adjusting the visual angle range and the landscape change speed of the simulated real-scene picture, and generating the simulated real-scene picture matched with the vehicle driving state. According to the invention, passengers can dynamically appreciate outdoor scenery changes closely related to the driving route in all directions in the vehicle, the travel experience is greatly enriched, and the interestingness is enhanced.

Description

Technical Field

[0001] The present application relates to the field of virtual reality technology, and in particular to a method, device, equipment and storage medium for generating simulated real scene images. Background Art

[0002] With the rapid development of smart transportation and smart travel, the optimization of the riding experience has become an important topic. For every passenger, their journey is naturally divided into different stages with time and destination as nodes. However, due to the limitation of physical space, passengers often cannot directly appreciate the changes in outdoor scenery between two different driving routes with their naked eyes. This limitation in experience has weakened the richness and fun of the trip to a certain extent.

[0003] Specifically, the traditional way of riding can only allow passengers to passively accept the scenery along the way, without the flexibility to choose and experience according to personal preferences or travel destinations. Even if the vehicle has a high level of autonomous driving function, which can reduce the driver's operating burden, the visual experience of passengers is still limited by the actual driving route and the location of the vehicle.

[0004] Therefore, how to provide a technical means to enrich the riding experience and enhance the fun of travel without changing the physical movement mode of passengers has become a technical problem that needs to be solved urgently. Summary of the invention

[0005] The main purpose of this application is to provide a method, device, equipment and storage medium for generating simulated real-life scenes, aiming to solve the technical problem of how to enrich the riding experience and enhance the fun of travel without changing the physical movement mode of the passengers.

[0006] To achieve the above-mentioned purpose, the present application provides a method for generating a simulated real scene image, and the method for generating a simulated real scene image comprises the following steps:

[0007] Obtain the real-time speed and real-time location information of the vehicle;

[0008] Filtering out scenic spot information matching the real-time location information and the real-time driving speed from a pre-built scenic spot information database;

[0009] The multi-dimensional information is integrated with the scenic spot information to construct a multi-dimensional interlaced simulated real scene picture;

[0010] The viewing angle range and the speed of landscape change of the simulated real scene picture are adjusted according to the real-time driving speed to generate a simulated real scene picture matching the driving state of the vehicle.

[0011] In one embodiment, the step of obtaining the real-time driving speed and real-time location information of the vehicle includes: obtaining GPS data, real-time mileage data and map information;

[0012] Determine the real-time location information of the vehicle based on GPS data, or real-time mileage data and map information;

[0013] The real-time driving speed of the vehicle is calculated according to the real-time mileage data.

[0014] In one embodiment, the step of determining the real-time location information of the vehicle based on GPS data, or real-time mileage data and map information includes:

[0015] When the GPS signal is stable, the real-time location information of the vehicle is extracted from the GPS data;

[0016] When the GPS signal is unstable, the real-time mileage data and the map information are matched and fused to locate the real-time position of the vehicle.

[0017] In one embodiment, the step of fusing the multi-dimensional information with the scenic spot information to construct a multi-dimensional interlaced simulated real scene picture includes:

[0018] Constructing the three-dimensional scene of the simulated real scene picture according to the scenic spot information;

[0019] According to the time information, simulating weather conditions in different time periods in the three-dimensional scene;

[0020] According to the event information, an event scene is inserted into the simulated real scene picture.

[0021] In one embodiment, the step of adjusting the viewing angle range and the speed of landscape change of the simulated real scene according to the real-time driving speed to generate a simulated real scene matching the driving state of the vehicle includes:

[0022] Inputting the real-time driving speed into a pre-established mapping relationship to obtain a real-time viewing angle range;

[0023] Based on the real-time driving speed, calculating the target moving distance between each frame in the simulated real scene picture;

[0024] Based on the real-time viewing angle range and the target moving distance, the viewing angle parameters in the rendering engine are set and the moving speed of the objects in the scene is adjusted through the animation control engine to generate a simulated real scene picture matching the driving state of the vehicle.

[0025] In one embodiment, before the step of obtaining the real-time driving speed and real-time location information of the vehicle, the step further includes:

[0026] Scenic spot materials within a preset time are collected, and the pre-processed scenic spot materials are annotated according to the scenic spot location and time information to construct a scenic spot information database.

[0027] In one embodiment, after the step of adjusting the viewing angle range and the speed of landscape change of the simulated real scene according to the real-time driving speed to generate a simulated real scene matching the driving state of the vehicle, the step further includes:

[0028] The music playing is automatically adjusted according to the playing progress and scene changes of the simulated real scene picture.

[0029] In addition, to achieve the above-mentioned purpose, the present application also provides a simulated real scene image generation device, the simulated real scene image generation device comprising:

[0030] A real-time data acquisition module is used to obtain the real-time driving speed and real-time location information of the vehicle;

[0031] A scenic spot information matching module, used to filter out scenic spot information matching the real-time location information and the real-time driving speed from a pre-built scenic spot information library;

[0032] A multi-dimensional information fusion module, used to fuse the multi-dimensional information with the scenic spot information to construct a multi-dimensional interlaced simulated real scene picture;

[0033] The adjustment module is used to adjust the viewing angle range and the landscape change speed of the simulated real scene picture according to the real-time driving speed, so as to generate a simulated real scene picture matching the driving state of the vehicle.

[0034] In addition, to achieve the above-mentioned purpose, the present application also provides a terminal device, which includes a memory, a processor, and a simulated real-scene image generation program stored in the memory and executable on the processor, and when the simulated real-scene image generation program is executed by the processor, the steps of the simulated real-scene image generation method as described above are implemented.

[0035] In addition, to achieve the above-mentioned purpose, the present application also provides a computer-readable storage medium, on which a simulated real-scene image generation program is stored. When the simulated real-scene image generation program is executed by a processor, the steps of the simulated real-scene image generation method as described above are implemented.

[0036] One or more technical solutions proposed in this application have at least the following technical effects:

[0037] This application selects matching scenic spot information from a pre-constructed scenic spot information library based on real-time location information and real-time driving speed. This screening method enables passengers to receive scenic spot information that is closely related to their current driving route. By integrating multi-dimensional information with scenic spot information, a multi-dimensional interlaced simulated real-life scene is constructed, providing passengers with a more realistic and vivid travel environment. The viewing angle range and landscape change speed of the simulated real-life scene are adjusted according to the real-time driving speed to generate a simulated real-life scene that matches the vehicle's driving status. This dynamic adaptability ensures the synchronization of the picture with the vehicle's driving status, reduces the situation where the picture lags behind or advances, and further enhances the passengers' sense of immersion and experience quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 This is a flow chart of a first exemplary embodiment of a method for generating a simulated real scene image of the present application;

[0039] Figure 2 This is a flow chart of a second exemplary embodiment of the method for generating a simulated real scene image of the present application;

[0040] Figure 3 A flowchart of a third exemplary embodiment of the method for generating a simulated real scene image of the present application;

[0041] Figure 4 This is a schematic diagram of the module structure of the device for generating a simulated real scene image according to an embodiment of the present application;

[0042] Figure 5 Schematic diagram of the device structure of the hardware operating environment involved in the method for generating simulated real-life scenes in the embodiment of the present application.

[0043] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0044] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0045] The present application actually takes into account that for each passenger, due to the limitation of physical space, the passenger is often unable to directly appreciate the changes in outdoor scenery between two different driving routes with the naked eye. This limitation in experience weakens the richness and fun of the trip to a certain extent.

[0046] Based on this, the embodiment of the present application proposes a solution: obtaining the real-time driving speed and real-time location information of the vehicle; filtering out the scenic spot information that matches the real-time location information and the real-time driving speed from a pre-constructed scenic spot information library; fusing the multi-dimensional information with the scenic spot information to construct a multi-dimensional interlaced simulated real scene picture; adjusting the viewing angle range and landscape change speed of the simulated real scene picture according to the real-time driving speed to generate a simulated real scene picture that matches the driving state of the vehicle. The present application obtains the real-time driving speed and real-time location information of the vehicle, and filters out the matching scenic spot information from a pre-constructed scenic spot information library, and then fuses this information with the multi-dimensional information to construct a simulated real scene picture, and dynamically adjusts the picture according to the real-time driving speed, so that passengers can fully and dynamically appreciate the changes in outdoor scenery closely related to the driving route in the car, which greatly enriches the travel experience and enhances the fun.

[0047] Specifically, the following are the detailed steps of the first exemplary embodiment of the method for generating a simulated real scene image of the present application:

[0048] Reference Figure 1 , Figure 1 This is a flow chart of the first exemplary embodiment of the method for generating a simulated real scene image of the present application. In this embodiment, the method for generating a simulated real scene image includes steps S10 to S40:

[0049] Step S10, obtaining the real-time driving speed and real-time location information of the vehicle;

[0050] Specifically, the GPS sensor installed on the vehicle can be used to obtain the real-time location information of the vehicle, the odometer sensor can be used to collect the real-time mileage data of the vehicle, and the real-time mileage data can be used to calculate the driving speed.

[0051] In a feasible implementation, step S10 may include steps S11 to S13:

[0052] Step S11, obtaining GPS data, real-time mileage data and map information;

[0053] Step S12, determining the real-time location information of the vehicle according to GPS data, or real-time mileage data and map information;

[0054] In a feasible implementation, step S12 may include steps S121 to S122:

[0055] Step S121, when the GPS signal is stable, extracting the real-time location information of the vehicle from the GPS data;

[0056] Step S122, when the GPS signal is unstable, the real-time mileage data and the map information are matched and integrated to locate the real-time position of the vehicle.

[0057] Specifically, when the GPS signal is stable, the real-time location information of the vehicle is directly obtained using the GPS sensor. GPS calculates the latitude and longitude coordinates of the vehicle by receiving signals from satellites. These coordinate data are the basis for vehicle positioning, and they can be accurate to a few meters or even smaller. When the GPS signal is stable, it means that the vehicle is located in an open area, and there are no tall buildings or natural obstacles blocking the reception of GPS signals. For example, if the vehicle is driving on a city street, the GPS sensor will show which street the vehicle is on, and can even be accurate to the lane.

[0058] In the case of unstable GPS signals, the real-time location of the vehicle is determined by combining real-time mileage data and pre-loaded map information. When the vehicle enters a tunnel, near tall buildings, or other areas where GPS signals are difficult to cover, GPS positioning may be inaccurate or temporarily ineffective. In this case, the vehicle's odometer sensor can be used to calculate the vehicle's movement distance and direction since the last time the GPS signal was stable, that is, mileage data. Then, this mileage data is matched and fused with the pre-loaded map information. Map information includes the layout, shape, and direction of the road. The vehicle's movement trajectory can be simulated on the map based on the vehicle's movement distance and direction, thereby estimating the vehicle's current location. For example, if the vehicle travels 500 meters along a straight road after the GPS signal is lost, the vehicle's position can be updated to the corresponding point on this road based on the road information on the map.

[0059] Step S13, calculating the real-time driving speed of the vehicle according to the real-time mileage data.

[0060] Specifically, the vehicle's mileage sensors or wheel speed sensors continuously monitor the rotation of the wheels. These sensors can provide information about the frequency and distance of wheel rotation, which is used to calculate the vehicle's driving speed. The mileage data is usually output in the form of pulses, each pulse representing a certain angle or distance of wheel rotation.

[0061] In order to calculate the real-time driving speed, the total distance the wheels rotate in a specific time interval needs to be recorded. This can be achieved by setting a timer in the vehicle's onboard computer system, which triggers the speed calculation at the end of a preset time interval (for example, 1 second).

[0062] An initial mileage data is recorded at the beginning of the time interval, and a final mileage data is recorded at the end of the time interval. By calculating the difference between these two data points, the total distance traveled by the vehicle during the time interval can be obtained. This distance is then divided by the time interval (in hours) to obtain the vehicle's real-time speed.

[0063] For example, if the vehicle's odometer records 100 pulses in 1 second, and each pulse represents 0.01 km, then the vehicle travels 1 km in this second. Converting this distance to hours, that is, 1 km / 3600 seconds, the result is 0.000277778 km / second, or approximately 1 km / hour. In this way, the vehicle's driving speed can be updated in real time and used for subsequent simulation and adjustment of the real scene.

[0064] In practical applications, this speed calculation method needs to take into account various factors that may affect the measurement accuracy, such as tire wear, road conditions, sensor errors, etc. In order to improve the accuracy of the measurement, a variety of sensor data fusion technology can be used, such as combining the data of the inertial measurement unit (IMU) to correct and optimize the speed calculation results. In this way, accurate and reliable real-time driving speed data can be provided.

[0065] Step S20, filtering out scenic spot information matching the real-time location information and the real-time driving speed from a pre-built scenic spot information database;

[0066] First, load the pre-built attraction information library. The attraction information library contains attraction location information, attraction materials, attraction descriptions and tags. The attraction location information includes the latitude and longitude coordinates of the attraction, the location, surrounding road information, etc. The attraction materials include high-definition videos and pictures associated with each attraction. The attraction descriptions and tags contain detailed descriptions and classification tags of the attractions, which help to understand the characteristics and attributes of the attractions.

[0067] Next, the scenic spot information database is screened based on the real-time location information and real-time driving speed of the vehicle. First, based on the real-time location (latitude and longitude) of the vehicle, the scenic spot information database is searched for scenic spots within a certain range around the vehicle. This range can be set according to actual conditions. For example, it can be set to an area of ​​5 kilometers, 10 kilometers or more around the current location of the vehicle. The distance between each scenic spot and the current location of the vehicle is calculated, and then the scenic spots within the set range are screened. In order to improve the matching accuracy, the driving direction of the vehicle can also be considered to further narrow the search range.

[0068] After the scenic spots are screened out based on the location information, the real-time driving speed of the vehicle is further considered. When driving at high speed, those scenic spots with wide views and fast-moving landscapes can be screened out; while when driving at low speed or parking, those scenic spots with delicate landscapes suitable for close-up viewing can be screened out. Therefore, the selected scenic spots are further screened and sorted according to the real-time driving speed of the vehicle.

[0069] Specifically, a speed threshold can be set, such as 60 km / h. For vehicles traveling at speeds exceeding this threshold, priority is given to those attractions suitable for quick viewing, such as natural scenery and landmark buildings along the way; while for vehicles traveling at a slower speed, priority is given to those attractions that require more time to understand and appreciate in depth, such as historical and cultural sites and museums.

[0070] After screening out one or more attractions that match the current position and speed, the user's needs are considered and the attraction that best suits the current situation and user's needs is finally selected. Content is extracted from the attraction information library to generate a simulated real scene.

[0071] Step S30, integrating the multi-dimensional information with the scenic spot information to construct a multi-dimensional interlaced simulated real scene picture;

[0072] In a feasible implementation, step S30 may include steps S31 to S33:

[0073] Step S31, constructing the three-dimensional scene of the simulated real scene picture according to the scenic spot information;

[0074] Step S32, simulating weather conditions in different time periods in the three-dimensional scene according to the time information;

[0075] Step S33: inserting an event scene into the simulated real scene picture according to the event information.

[0076] Specifically, based on the selected scenic spots, the corresponding scenic spot information is extracted from the scenic spot information database, including topographic maps, architectural drawings, plant species, etc. Then, a professional 3D modeling software, such as Autodesk 3ds Max or Blender, is used to create a 3D model of the scenic spot based on the corresponding scenic spot data.

[0077] When constructing a 3D scene, you need to consider the realism and level of detail of the scene. For example, for natural landscapes such as mountains and rivers, you need to simulate their terrain and water flow dynamics; for buildings, you need to accurately restore their appearance and internal structure. In addition, you need to give each element in the scene appropriate materials and textures to enhance the visual effect. After the 3D scene is constructed, images or animations are generated through rendering technology.

[0078] Furthermore, weather conditions in different time periods are simulated in the constructed three-dimensional scene. This step needs to be achieved by combining time information and meteorological data using the environmental simulation tools in the three-dimensional modeling software. First, according to the climate characteristics of the location of the scenic spot, typical weather conditions in different time periods (such as morning, noon, and evening) are collected, including lighting, sky color, cloud distribution, etc. Then, the corresponding ambient light source is set in the three-dimensional scene to simulate the position and intensity of the sun, as well as the brightness and color of the sky. Next, atmospheric effects such as clouds and fog are added to simulate actual weather changes.

[0079] In order to improve the accuracy of the simulation, real-time meteorological data can be introduced to make the weather conditions in the scene change synchronously with the actual weather. In addition, the realism of the scene can be further enhanced by adding dynamic effects, such as wind and raindrops. Through these detailed simulations, the simulated real scene can present different visual effects at different time periods, providing passengers with a richer and more realistic visual experience.

[0080] Furthermore, event scenes are inserted into the simulated real scene. The purpose of this step is to add storytelling and cultural background to the scenic spot based on historical events or specific activities. First, it is necessary to collect information about historical events, festivals, folk activities, etc. related to the scenic spot. Then, using 3D modeling technology, create models and animations related to these events, such as historical figures, festival decorations, performance scenes, etc.

[0081] When inserting an event scene, you need to consider the scene's temporal and spatial background and cultural characteristics to ensure that it is in harmony with the environment and atmosphere of the attraction. For example, if it is the anniversary of a historical event, you can recreate the characters and scenes of the time in the scene; if it is a traditional festival, you can display the festival's celebrations and characteristic decorations. In addition, you can further enrich the expressiveness of the event scene by adding elements such as sound effects and dialogues.

[0082] After the event scene is built, it needs to be integrated with the 3D scene to ensure a natural and smooth transition between scenes. The event scene can be coordinated with the surrounding environment by adjusting the scene's lighting, color and other parameters. At the same time, you can also add interactive functions, such as clicking on an element to learn more information, to enhance passengers' sense of participation and experience.

[0083] For example, it is necessary to build a simulated real scene for a famous historical and cultural city. Based on the pre-collected topographic map, architectural drawings, plant species and other information of the city, a 3D model of the city is created using 3D modeling software, including landmark buildings and natural landscapes such as city walls, ancient towers, and rivers. Then, according to the climate characteristics of the city, the weather conditions of different time periods are simulated, such as morning mist, clear sky at noon, and sunset afterglow in the evening. Further, using the pre-collected historical events and festival celebrations related to the city, corresponding 3D models and animations are created, such as ancient markets, festival lanterns, and folk performances. Finally, according to the real-time driving speed of the vehicle, the viewing angle range and landscape change speed of the simulated real scene are adjusted, so that passengers can experience dynamic visual effects that match the actual environment during driving. Through such an implementation process, not only a realistic virtual tourism experience is provided to passengers, but also they can gain a deeper understanding of the history and culture of the city during their journey.

[0084] Step S40, adjusting the viewing angle range and the speed of landscape change of the simulated real scene picture according to the real-time driving speed, and generating a simulated real scene picture matching the driving state of the vehicle.

[0085] In a feasible implementation, step S40 may include steps S41 to S43:

[0086] Step S41, inputting the real-time driving speed into a pre-established mapping relationship to obtain a real-time viewing angle range;

[0087] It should be noted that the mapping relationship between the real-time driving speed and the real-time viewing angle range is obtained by defining the change rules of the viewing angle range at different speeds, and the mapping relationship can be expressed by a mapping formula. This usually involves the study of human visual perception and the investigation of the viewing angle range expected by passengers at different vehicle speeds. For example, when driving at low speeds, passengers may want to see a wider viewing angle to observe the surrounding environment; while at high speeds, the viewing angle may be appropriately narrowed to reduce the overload of visual information and improve passenger comfort.

[0088] Then, the mapping formula is used to obtain the viewing range. This formula can be a simple linear function or a more complex nonlinear model, depending on the relationship between viewing range and speed.

[0089] For example, the mapping formula can be expressed as:

[0090] FOV=k×v+b

[0091] in:

[0092] FOV is the field of view (unit: degree);

[0093] v is the real-time speed of the vehicle (unit: km / h or m / s);

[0094] k is the slope of the mapping relationship, which indicates the degree of influence of speed change on the viewing angle range;

[0095] b is the intercept of the mapping relationship, which represents the default viewing angle range when the vehicle is stationary.

[0096] Or it can be expressed as:

[0097] FOV = a × log (v + c) + d

[0098] It can also be expressed as:

[0099] FOV = a × v 2 +b×v+c

[0100] in:

[0101] a, b, and c are coefficients obtained by fitting the experimental data;

[0102] log represents a logarithmic function, which is used to simulate the situation where the viewing angle changes little within a certain speed range and changes greatly at high speeds.

[0103] In practical applications, other factors may need to be considered, such as road type, weather conditions, and passengers' personal preferences, to further optimize the mapping relationship.

[0104] Step S42, calculating the target moving distance between each frame in the simulated real scene picture based on the real-time driving speed;

[0105] Specifically, we first need to determine the frame rate of the simulated real-life scene, that is, the number of updates per second. Common frame rates are 30 frames per second or 60 frames per second. The choice of frame rate affects the smoothness of the picture and the complexity of the calculation. The higher the frame rate, the smoother the picture, but the greater the demand for computing resources.

[0106] Next, calculate the distance the vehicle should simulate traveling in each frame based on the vehicle's real-time speed. This distance can be obtained by multiplying the vehicle's speed (in meters per second) by the frame time (that is, 1 divided by the frame rate in seconds). For example, if the vehicle is traveling at a speed of 120 kilometers per hour (about 33.33 meters per second) and the frame rate is 30 frames per second, then the target moving distance per frame is 33.33 meters per second * (1 / 30) seconds ≈ 1.11 meters.

[0107] After calculating the target movement distance for each frame, this distance is applied in the 3D scene that simulates the real scene. This involves adjusting the position of the camera in the 3D modeling software to simulate the movement of the vehicle. At the same time, other objects in the scene, such as trees, buildings, etc., also need to be moved or transformed accordingly according to this distance to maintain the coherence and realism of the picture.

[0108] In addition, it is also necessary to consider the different road conditions that the vehicle may encounter during driving, such as curves, uphill and downhill, etc. These road conditions will affect the vehicle's driving trajectory and line of sight. Therefore, when calculating the target moving distance, it is also necessary to combine the vehicle's driving trajectory and line of sight to adjust the camera's position and viewing angle accordingly.

[0109] For example, it is assumed that a simulated real scene picture is being designed for a vehicle traveling on a city street. The real-time position and speed of the vehicle are obtained through GPS and mileage data. According to this information, relevant scenic spot information is screened out from the scenic spot information library. A three-dimensional scene of the simulated real scene picture is constructed, and the weather conditions at the current time are simulated, and relevant event scenes are inserted. The viewing angle range is determined according to the real-time driving speed of the vehicle. Now, in step S42, the target moving distance between each frame is calculated. Assuming that the vehicle travels at a speed of 40 kilometers per hour (about 11.11 meters per second) and the frame rate is 30 frames per second, then the target moving distance of each frame is 11.11 meters per second * (1 / 30) seconds ≈ 0.37 meters. In the three-dimensional scene, the position of the camera needs to be adjusted according to this distance to simulate the straight-line driving of the vehicle. If the vehicle needs to turn, the moving trajectory of the camera needs to be adjusted according to the radius and angle of the turn to ensure the smooth transition of the picture during the turn. Through such an implementation process, passengers can experience the simulated real scene picture matching the actual driving state in the car, which enhances the immersion and realism of the ride.

[0110] Step S43, based on the real-time viewing angle range and the target moving distance, the viewing angle parameters in the rendering engine are set through the animation control engine and the moving speed of the objects in the scene is adjusted to generate a simulated real scene picture matching the vehicle driving state.

[0111] Specifically, the animation control engine adjusts the viewing angle parameters in the rendering engine according to the real-time viewing angle range obtained in step S41 to ensure that the scene seen by the passenger is consistent with the actual driving direction and speed of the vehicle. For example, if the vehicle is driving fast on a highway, the viewing angle range should be narrowed to simulate the visual compression feeling when driving at high speed; while when driving slowly on a city street, the viewing angle range will be wider to show more of the surrounding environment.

[0112] Next, based on the target moving distance, the animation control engine will adjust the movement speed of the objects in the scene. This includes all scene elements such as the vehicle itself, roads, buildings, trees, etc. The movement speed of each object needs to match the actual speed of the vehicle to maintain the continuity and authenticity of the picture. For example, if the vehicle is traveling at a speed of 60 km / h, the trees and buildings in the scene should also move backwards at the corresponding speed to simulate the effect of the vehicle moving forward.

[0113] In addition, dynamic changes in the scene, such as weather changes, light and shadow effects, etc., can also be taken into account. These dynamic effects need to be coordinated with the vehicle's driving speed and viewing angle range to provide a richer and more realistic visual experience. For example, when the vehicle is driving fast, the changes in light and shadow may be more obvious to enhance the sense of speed; while when driving slowly, the changes in light and shadow may be softer to provide a more comfortable visual experience.

[0114] For example, if a vehicle is passing a sharp turn, not only does the viewing angle need to be adjusted to simulate the vehicle's turning, but the moving speed of trees and buildings in the scene also needs to be adjusted according to the vehicle's speed to maintain the continuity of the picture. At the same time, the light and shadow effects can also be adjusted according to the vehicle's speed to enhance the passengers' sense of immersion.

[0115] For further information, please refer to Figure 2 , Figure 2 This is a flow chart of a second exemplary embodiment of the method for generating a simulated real scene image of the present application. In the second exemplary embodiment, before step S10: obtaining the real-time driving speed and real-time position information of the vehicle, step S01 is also included:

[0116] Step S01 , collecting scenic spot materials within a preset time, and marking the pre-processed scenic spot materials according to the scenic spot location and time information, so as to construct a scenic spot information database.

[0117] Specifically, determine the time range for collecting scenic spot materials. This time range can be different time periods of the day, different seasons of the year, or even specific events or festivals. After determining the time range, you can use a variety of equipment and technologies to collect materials, including but not limited to drones, high-definition cameras, panoramic cameras, etc. These devices are able to work in different weather conditions and lighting conditions to ensure that high-quality visual materials can be obtained.

[0118] During the collection process, it is necessary to pay attention to multiple aspects of the scenic spot, such as natural landscapes, architectural features, cultural activities, etc. For each scenic spot, it is necessary to shoot from multiple angles and distances to capture its overall appearance and details. In addition, it is also necessary to record the specific time, date, weather conditions, etc. when shooting, which is crucial for subsequent material annotation and scene simulation.

[0119] After the material collection is completed, the next step is to pre-process the material. Pre-processing may include image cropping, correction, color adjustment, etc. to ensure that the quality of the material meets the standards. The pre-processed material will be annotated, and the annotated content includes but is not limited to the name of the attraction, geographical location, shooting time, weather conditions, special events, etc. This annotated information will be associated with the material file to form structured data for subsequent retrieval and use.

[0120] Suppose you are building an attraction information database for a national park. You need to use drones and high-definition cameras to shoot the main attractions in the park in four seasons, spring, summer, autumn and winter, as well as different time periods such as sunrise, noon and sunset. Additional shooting can also be done during special events, such as music festivals and art exhibitions. After the shooting is completed, the material is pre-processed to ensure image quality. Next, each picture or video is annotated to record the specific location, time, season, weather and other information of the shooting. This information will be stored in a database, and each attraction will have a unique identifier to facilitate rapid retrieval and data matching in subsequent steps.

[0121] Through this implementation process, a rich scenic spot information library can be built, which contains not only the visual information of the scenic spot, but also the metadata related to time and space. This information library is the basis for the generation of simulated real-life scenes, ensuring that in the subsequent steps, the scenic spot information and visual content that match the vehicle can be quickly and accurately provided according to the real-time position and speed of the vehicle.

[0122] For further information, please refer to Figure 3 , Figure 3 The flowchart of the third exemplary embodiment of the method for generating a simulated real scene image of the present application is shown in FIG. 1 . In the third exemplary embodiment of the present application, step S40: adjusting the viewing angle range and the speed of landscape change of the simulated real scene image according to the real-time driving speed to generate a simulated real scene image matching the driving state of the vehicle further includes step S50:

[0123] Step S50, automatically adjusting the music playback according to the playback progress and scene changes of the simulated real scene picture.

[0124] Specifically, music is first pre-designed and selected for different attractions and scenes. The music should match the atmosphere and emotion of the scene. For example, for a tranquil lake, peaceful, soothing music may be selected; while for a busy city street, music with a stronger rhythm and more active feeling may be selected. The choice of music should take into account the cultural background and the preferences of passengers.

[0125] Next, the music player system automatically switches the music according to the progress of the simulated scene and the scene changes. This can be achieved by setting timestamps or event triggers in the music player software. For example, when the simulated scene shows a lake, the music player system will play the pre-selected peaceful music at the same time as the lake scene starts.

[0126] In addition, the volume and tempo of the music can also be adjusted according to the vehicle's speed and the dynamic changes of the scene. For example, when the vehicle accelerates or decelerates, the tempo of the music can be accelerated or slowed down accordingly to simulate the relationship between sound and speed in the real world. The volume of the music can also be adjusted according to the noisiness of the scene to maintain the comfort of passengers.

[0127] In addition, the music playback system allows passengers to perform a certain degree of customization based on their personal preferences, such as selecting different music styles or adjusting the volume.

[0128] In addition, the present application also proposes a simulated real scene image generation device, the simulated real scene image generation device comprising:

[0129] A real-time data acquisition module 10 is used to acquire the real-time driving speed and real-time position information of the vehicle;

[0130] A scenic spot information matching module 20 is used to filter out scenic spot information that matches the real-time location information and the real-time driving speed from a pre-built scenic spot information database;

[0131] A multi-dimensional information fusion module 30 is used to fuse the multi-dimensional information with the scenic spot information to construct a multi-dimensional interlaced simulated real scene picture;

[0132] The adjustment module 40 is used to adjust the viewing angle range and the landscape change speed of the simulated real scene picture according to the real-time driving speed, so as to generate a simulated real scene picture matching the driving state of the vehicle.

[0133] The simulated real scene image generation device provided by the present application adopts the simulated real scene image generation method in the above embodiment, aiming to solve the technical problem of how to enrich the riding experience and enhance the fun of travel without changing the physical movement mode of the passengers. Compared with the prior art, the beneficial effects of the simulated real scene image generation device provided by the present application are the same as the beneficial effects of the simulated real scene image generation method provided by the above embodiment, and the other technical features in the simulated real scene image generation device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0134] The present application provides a simulated real-scene image generation device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the simulated real-scene image generation method in the above-mentioned embodiment 1.

[0135] The simulated real scene image generating device in the embodiments of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., as well as fixed terminals such as digital TVs, desktop computers, etc. Figure 5 The simulated real scene image generation device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0136] like Figure 5 As shown, the simulated real scene picture generation device may include a processing device 1001 (such as a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. Various programs and data required for the operation of the simulated real scene picture generation device are also stored in the RAM 1004. The processing device 1001, the ROM 1002 and the RAM 1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems may be connected to the I / O interface 1006: input devices 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 1003 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 1009. The communication device 1009 may allow the simulated reality scene image generation device to communicate wirelessly or wired with other devices to exchange data. Although the simulated reality scene image generation device with various systems is shown in the figure, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems may be implemented or have instead.

[0137] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0138] The simulated real scene picture generation device provided by the present application adopts the simulated real scene picture generation method in the above embodiment, aiming to solve the technical problem of how to enrich the riding experience and enhance the fun of travel without changing the physical movement mode of the passengers. Compared with the prior art, the beneficial effects of the simulated real scene picture generation device provided by the present application are the same as the beneficial effects of the simulated real scene picture generation method provided by the above embodiment, and the other technical features in the simulated real scene picture generation device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0139] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0140] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0141] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the method for generating a simulated real scene image in the above-mentioned embodiment.

[0142] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.

[0143] The computer-readable storage medium may be included in the simulated reality scene image generation device; or may exist independently without being assembled into the simulated reality scene image generation device.

[0144] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0145] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0146] The modules involved in the embodiments described in the present application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0147] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned method for generating simulated real scenes, and aims to solve the technical problem of how to enrich the riding experience and enhance the fun of travel without changing the physical movement mode of the passengers. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the method for generating simulated real scenes provided by the above-mentioned embodiments, and will not be repeated here.

[0148] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned method for generating a simulated real scene image when executed by a processor.

[0149] The computer program product provided by this application aims to solve the technical problem of how to enrich the riding experience and enhance the fun of travel without changing the physical movement mode of the passengers. Compared with the prior art, the beneficial effects of the computer program product provided by this application are the same as the beneficial effects of the method for generating simulated real scene images provided by the above embodiment, and will not be repeated here.

[0150] Compared with the prior art, the method, device, equipment, medium and computer product for generating a simulated real scene picture proposed in the embodiment of the present application extracts the business feature information of the target business, performs data standardization processing on the business feature information to obtain standard feature data, performs hash processing on the standard feature data to obtain unique feature data, performs numerical processing and splicing processing on the unique feature data to obtain the first business feature value, accumulates the first business feature value of the target business to obtain the target business feature value, and finally compares the target business feature value with the feature value set to obtain the simulated real scene picture generation result. Compared with the traditional method of identifying repeated businesses by generating a unique key value or a continuous serial number for each business, it is more efficient, flexible and reliable. Based on the solution of the present application, the business of complex scenes is finally converted into a comparison of two numbers through a series of simple transformations, so that the comparison process is very intuitive and efficient. The system only needs to simply compare whether the two values ​​are equal to quickly determine whether the two businesses are exactly the same.

[0151] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0152] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0153] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.

[0154] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for generating a simulated real scene image, characterized in that: The method for generating simulated real scene pictures comprises: Obtain the real-time speed and real-time location information of the vehicle; Filtering out scenic spot information matching the real-time location information and the real-time driving speed from a pre-built scenic spot information database; The multi-dimensional information is integrated with the scenic spot information to construct a multi-dimensional interlaced simulated real scene picture; The viewing angle range and the speed of landscape change of the simulated real scene picture are adjusted according to the real-time driving speed to generate a simulated real scene picture matching the driving state of the vehicle.

2. The method for generating a simulated real scene image according to claim 1, wherein: The step of obtaining the real-time driving speed and real-time position information of the vehicle comprises: Get GPS data, real-time mileage data, and map information; Determine the real-time location information of the vehicle based on GPS data, or real-time mileage data and map information; The real-time driving speed of the vehicle is calculated according to the real-time mileage data.

3. The method for generating a simulated real scene image according to claim 2, wherein: The step of determining the real-time location information of the vehicle according to GPS data, or real-time mileage data and map information comprises: When the GPS signal is stable, the real-time location information of the vehicle is extracted from the GPS data; When the GPS signal is unstable, the real-time mileage data and the map information are matched and fused to locate the real-time position of the vehicle.

4. The method for generating a simulated real scene image according to claim 1, wherein: The step of fusing the multi-dimensional information with the scenic spot information to construct a multi-dimensional interlaced simulated real scene picture comprises: Constructing the three-dimensional scene of the simulated real scene picture according to the scenic spot information; According to the time information, simulating weather conditions in different time periods in the three-dimensional scene; According to the event information, an event scene is inserted into the simulated real scene picture.

5. The method for generating a simulated real scene image according to claim 1, wherein: The step of adjusting the viewing angle range and the landscape change speed of the simulated real scene picture according to the real-time driving speed to generate a simulated real scene picture matching the driving state of the vehicle comprises: Inputting the real-time driving speed into a pre-established mapping relationship to obtain a real-time viewing angle range; Based on the real-time driving speed, calculating the target moving distance between each frame in the simulated real scene picture; Based on the real-time viewing angle range and the target moving distance, the viewing angle parameters in the rendering engine are set and the moving speed of the objects in the scene is adjusted through the animation control engine to generate a simulated real scene picture matching the vehicle driving state.

6. The method for generating a simulated real scene image according to claim 1, wherein: The step of obtaining the real-time speed and real-time position information of the vehicle also includes: Scenic spot materials within a preset time are collected, and the pre-processed scenic spot materials are annotated according to the scenic spot location and time information to construct a scenic spot information database.

7. The method for generating a simulated real scene image according to claim 1, wherein: After the step of adjusting the viewing angle range and the landscape change speed of the simulated real scene picture according to the real-time driving speed to generate the simulated real scene picture matching the driving state of the vehicle, the step further includes: The music playing is automatically adjusted according to the playing progress and scene changes of the simulated real scene picture.

8. A device for generating simulated real scene images, characterized in that: The device comprises: A real-time data acquisition module is used to obtain the real-time driving speed and real-time location information of the vehicle; A scenic spot information matching module, used to filter out scenic spot information matching the real-time location information and the real-time driving speed from a pre-built scenic spot information library; A multi-dimensional information fusion module, used to fuse the multi-dimensional information with the scenic spot information to construct a multi-dimensional interlaced simulated real scene picture; The adjustment module is used to adjust the viewing angle range and the landscape change speed of the simulated real scene picture according to the real-time driving speed, so as to generate a simulated real scene picture matching the driving state of the vehicle.

9. A device for generating simulated real scene images, characterized in that: The device comprises: a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the method for generating a simulated real scene image according to any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the method for generating a simulated real scene image according to any one of claims 1 to 7 are implemented.

Images