Vehicle control method and device, vehicle and storage medium

Abstract

The invention provides a vehicle control method and device, a vehicle and a storage medium. The method comprises the following steps: in response to a scene recording instruction, starting an image acquisition device and a sound acquisition device, and acquiring an image and sound of a current environment; wherein the image acquisition equipment and the sound acquisition equipment are image acquisition equipment and sound acquisition equipment which are arranged at different positions on a vehicle; and acquiring configuration parameters of a plurality of screens in the vehicle, and processing the image and the sound according to the configuration parameters so as to generate video and audio materials which are respectively adaptive to the plurality of screens and are used for copying the current environment. According to the application, multi-angle scenery and sound collection can be realized, the effect of three-dimensionally restoring the scene is achieved through multiple screens, and the immersive experience feeling is improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a vehicle control method, device, vehicle and storage medium. Background Art

[0002] As automobile technology continues to improve, more and more people use cars as their preferred means of transportation. In recent years, people have higher and higher requirements for cars. In order to enhance the user's driving experience, the concept of vehicle scenario mode has been proposed. This mode aims to provide a more personalized and comfortable riding experience by adjusting the in-car environment.

[0003] As self-driving tours become increasingly popular, nap mode and meditation mode have been proposed. These modes usually preset specific audio and video content or manually edited materials to create a quiet atmosphere for users. Currently, when users want to record a favorite scene and use it as a personalized nap mode or meditation mode, they usually use additional audio and video acquisition equipment to capture it and then import it into the car system.

[0004] In the process of implementing the embodiments of the present application, it is found that the prior art has at least the following problems:

[0005] The stereo surround effect of audio and video captured by external audio and video acquisition equipment is not good, which affects the immersive experience of the vehicle scene mode. Summary of the invention

[0006] The embodiments of the present application provide a vehicle control method, device, vehicle and storage medium to solve the problem that the stereo surround effect of audio and video captured by external audio and video capture equipment is poor, which affects the immersive experience effect of the vehicle scene mode.

[0007] In a first aspect, an embodiment of the present application provides a vehicle control method, including:

[0008] In response to the scene recording instruction, the image acquisition device and the sound acquisition device are started to acquire images and sounds of the current environment; wherein the image acquisition device and the sound acquisition device are image acquisition devices and sound acquisition devices installed at multiple different positions on the vehicle;

[0009] The configuration parameters of the multiple screens in the vehicle are obtained, and the image and sound are processed according to the configuration parameters to generate audio-visual materials that replicate the current environment and are respectively adapted to the multiple screens.

[0010] In a possible implementation, the configuration parameters include the number of screens, screen resolution, and screen distribution positions;

[0011] The processing of the image and sound according to the configuration parameters includes:

[0012] Based on the acquisition time of the image and the sound, matching and splicing the image and the sound to obtain a first audio and video;

[0013] According to the number of screens and the screen resolution, the first audio and video are stretched and segmented, and the segmentation edges are transitioned to obtain the second audio and video;

[0014] Based on the acquisition positions of the image and sound, the screen distribution positions, and the second audio and video, audio and video materials that replicate the current environment and are respectively adapted to the multiple screens are generated.

[0015] In a possible implementation, the generating of audio-visual materials that replicate the current environment and are adapted to the multiple screens respectively based on the acquisition positions of the image and sound, the screen distribution positions, and the second audio and video includes:

[0016] Determining an optimal splicing order of the multiple screens based on the acquisition positions of the images and sounds and the distribution positions of the screens;

[0017] According to the optimal splicing order, the audio and video at each moment in the second audio and video are divided respectively to obtain audio and video materials that replicate the current environment and are adapted to the multiple screens respectively.

[0018] In a possible implementation manner, before the image and sound are processed according to the configuration parameters, the method further includes:

[0019] Acquiring meteorological condition information of the current environment;

[0020] Motion effect enhancement information is generated according to the meteorological condition information, and the image and sound are enhanced according to the motion effect enhancement information.

[0021] In one possible implementation, the meteorological condition information includes: the meteorological condition information includes: different levels of rain, different levels of haze, different levels of snow, strong winds, cloudy, overcast, sunny, daytime, dawn, dusk or night; the image motion effect enhancement information includes: raindrops, snowflakes, clouds, fog, sunshine, fallen leaves, sunset or moonlight.

[0022] In a possible implementation, after starting the image acquisition device and the sound acquisition device to acquire the image and sound of the current environment, the method further includes:

[0023] If the image does not meet the preset image requirements and / or the sound does not meet the preset sound requirements, generating a window opening and / or door opening prompt;

[0024] If a window opening instruction is obtained, the vehicle window is controlled to open based on the window opening instruction, and / or, if a door opening instruction is obtained, the vehicle door is controlled to open based on the door opening instruction, and the step of collecting images and sounds of the current environment is re-executed.

[0025] In a possible implementation manner, after the image and sound are processed according to the configuration parameters, the method further includes:

[0026] Generate scene naming prompts;

[0027] If the scene naming information is obtained, the scene naming information and the audio-visual material are packaged and stored, so that the audio-visual material can be called and played through a scene start instruction; wherein the scene start instruction carries the scene naming information.

[0028] In a possible implementation manner, before the image and sound are processed according to the configuration parameters, the method further includes:

[0029] Generate ambient sound effects based on ambient sound information;

[0030] Correspondingly, when the scene naming information and the audio-visual material are packaged and stored, the ambient sound effect is packaged and stored synchronously.

[0031] In a possible implementation, the scene recording instruction is generated according to a user control voice, control gesture or control option selection operation.

[0032] In a possible implementation, the method further includes: according to a predetermined duration or a recording end instruction, turning off the image acquisition device and the sound acquisition device, and ending the acquisition of images and sounds of the current environment.

[0033] In a second aspect, an embodiment of the present application provides a vehicle control device, including:

[0034] A control module, configured to start an image acquisition device and a sound acquisition device in response to a scene recording instruction, and to acquire images and sounds of a current environment; wherein the image acquisition device and the sound acquisition device are image acquisition devices and sound acquisition devices installed at multiple different positions on the vehicle;

[0035] The audio and video processing module is used to obtain the configuration parameters of the multiple screens in the vehicle, and process the image and sound according to the configuration parameters to generate audio and video materials that replicate the current environment and are respectively adapted to the multiple screens.

[0036] In a third aspect, an embodiment of the present application provides a vehicle, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps of the method described in the first aspect or any possible implementation of the first aspect are implemented.

[0037] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the steps of the method described in the first aspect or any possible implementation method of the first aspect.

[0038] The embodiment of the present application provides a vehicle control method, device, vehicle and storage medium. When a scene recording instruction is received, an image acquisition device and a sound acquisition device are started to capture the image and sound of the current environment. Among them, the image acquisition device and the sound acquisition device are installed at multiple different positions on the vehicle to ensure the comprehensiveness and multi-angle of the acquisition. The image and sound acquisition is carried out by the vehicle-mounted equipment, and the cumbersome import operation of the external audio and video acquisition device information is successfully avoided, thereby improving the acquisition efficiency. In addition, based on the layout of the image acquisition device and the sound acquisition device distributed in multiple different positions, the scenery and sound acquisition of multiple angles are realized, and the effect of three-dimensional restoration of the scene is achieved, bringing a more immersive experience to the user. After collecting the image and sound, the configuration parameters of multiple screens in the vehicle are further obtained, and the collected audio and video materials are processed according to these parameters to generate audio and video materials that are adapted to the multiple screens and reproduce the current environment. This process not only meets the user's demand for wide-angle scenery playback, but also helps to create a surround audio-visual effect and enhance the user's fun of riding. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0040] Figure 1 is a flow chart of an implementation of a vehicle control method provided by an embodiment of the present application;

[0041] Figure 2 is a flow chart of an implementation of a vehicle control method provided by another embodiment of the present application;

[0042] Figure 3 is a structural schematic diagram of a vehicle control device provided by an embodiment of the present application;

[0043] Figure 4is a structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0044] Figure 5 It is a schematic diagram of the structure of a vehicle provided in one embodiment of the present application. DETAILED DESCRIPTION

[0045] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0046] The terms "first", "second", etc. in the specification and claims of the embodiments of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the embodiments of the present application described here. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions.

[0047] Unless otherwise specified, the term "plurality" means two or more. The character " / " indicates that the objects before and after are in an "or" relationship. For example, A / B means: A or B. The term "and / or" is a description of the association relationship between objects, indicating that there can be three relationships. For example, A and / or B means: A or B, or, A and B.

[0048] The words used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and claims, unless the context clearly indicates, the singular forms of "a", "an" and "the" are intended to include the plural forms as well. Similarly, the term "and / or" as used in this application refers to any and all possible combinations of one or more associated listings. In addition, when used in this application, the term "comprise" and its variants "comprises" and / or including (comprising) refer to the existence of stated features, wholes, steps, operations, elements, and / or components, but do not exclude the existence or addition of one or more other features, wholes, steps, operations, elements, components and / or these groups. In the absence of more restrictions, the elements defined by the statement "including one..." do not exclude the existence of other identical elements in the process, method or device including the elements.

[0049] In this application, each embodiment may focus on the differences from other embodiments, and the same or similar parts between the embodiments may refer to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, then the relevant parts may refer to the description of the method part.

[0050] In response to the needs of users to customize scenes, when importing audio and video from audio and video acquisition devices into the system, the import process is cumbersome, and a single lens often cannot fully capture multi-angle and wide-angle views. Therefore, the embodiment of the present application aims to propose a new scene construction scheme, that is, to utilize multiple cameras commonly equipped in intelligent driving systems. These cameras face different directions and can capture and fuse scenes from various angles in real time. This scene construction scheme not only greatly enhances the user's immersive experience, but also eliminates cumbersome external import operations.

[0051] In order to make the purpose, technical solutions and advantages of the present application clearer, specific embodiments will be described below in conjunction with the accompanying drawings.

[0052] Figure 1 is a flow chart of the implementation of the vehicle control method provided by an embodiment of the present application, such as Figure 1 As shown, the method comprises the following steps:

[0053] S101, in response to a scene recording instruction, start an image acquisition device and a sound acquisition device to acquire images and sounds of the current environment; wherein the image acquisition device and the sound acquisition device are image acquisition devices and sound acquisition devices installed at multiple different positions on the vehicle.

[0054] S102, obtaining configuration parameters of multiple screens in the vehicle, and processing images and sounds according to the configuration parameters to generate audio-visual materials that replicate the current environment and are adapted to the multiple screens respectively.

[0055] In the vehicle system, the image acquisition equipment includes cameras installed in different parts of the vehicle, such as the dashcam on the front windshield, the reversing camera at the rear of the vehicle, and the surveillance cameras that may be located on both sides of the vehicle body. These cameras can provide a 360-degree full-view to help users understand the situation around the vehicle. The sound acquisition equipment includes microphone devices distributed inside and outside the car, which can capture sound information inside and outside the car, such as external ambient sound and subtle echoes inside the car.

[0056] The executor of each embodiment of the present application is a vehicle system. When receiving a specific scene recording instruction, the vehicle system can start the image acquisition device and sound acquisition device installed at different positions of the vehicle to comprehensively capture the image information and audio information in the current environment.

[0057] In addition, the vehicle computer system also has the ability to manage multiple screens, and can read and identify the configuration parameters of each screen. Based on these parameters, the collected images and sounds are processed and adjusted to generate audio and video materials that restore the current environment and distribute them to each screen. This achieves an accurate reproduction of the vehicle's surrounding environment, allowing passengers to feel as if they are in a real scene, enjoying an immersive audio-visual experience, and improving the overall user satisfaction and riding pleasure.

[0058] In addition, it should be noted that in the embodiment of the present application, the multiple screens are displayed in linkage, and the image information presented on each screen has its own characteristics and complements each other to jointly construct a three-dimensional and rich scene display effect to enhance the visual impact and allow passengers to enjoy a more diverse and three-dimensional visual effect during the ride.

[0059] In this embodiment, when a scene recording instruction is received, the image acquisition device and the sound acquisition device are started to capture the image and sound of the current environment. Among them, the image acquisition device and the sound acquisition device are installed at multiple different positions on the vehicle to ensure the comprehensiveness and multi-angle nature of the acquisition. The image and sound acquisition is carried out by the vehicle-mounted equipment, which successfully avoids the cumbersome import operation of the external audio and video acquisition device information, thereby improving the acquisition efficiency. In addition, based on the layout of the image acquisition device and the sound acquisition device distributed in multiple different positions, the multi-angle scenery and sound acquisition is realized, and the effect of three-dimensional restoration of the scene is achieved, bringing a more immersive experience to the user. After collecting the image and sound, the configuration parameters of the multiple screens in the vehicle are further obtained, and the collected audio and video materials are processed according to these parameters to generate audio and video materials that replicate the current environment and are adapted to multiple screens respectively. This process not only meets the user's demand for wide-angle scenery playback, but also helps to create a surround audio-visual effect and enhance the user's fun of riding.

[0060] In different embodiments, in step S101, different methods are used to obtain the scene recording instruction to meet various recording requirements of the user. Optionally, the scene recording instruction is generated according to the user's control voice, control gesture or control option selection operation.

[0061] In actual practice, users can start the scene recording function by selecting control options through the touch screen, physical buttons or other input devices. This method provides an intuitive operation interface and allows users to set different recording modes according to their personal preferences. For example, an obvious recording button can be set on the screen, and users can start recording by simply touching the button; or a dedicated recording switch can be integrated on the multi-function steering wheel for quick operation by the driver.

[0062] When the user is driving and likes the surrounding environment very much, in order to avoid selecting control options through touch screens or other input devices, which may affect driving safety, the user can start the image acquisition device and the sound acquisition device to collect images and sounds of the current environment through verbal instructions, such as "start scene recording" or "open scene recording". When the user is on a call or for other reasons and cannot use voice commands, the user can start the image acquisition device and the sound acquisition device to collect images and sounds of the current environment through gesture instructions, such as opening the palm, sliding the palm or waving the palm in front of the vehicle's main control screen.

[0063] In this embodiment, by combining the above-mentioned multiple input methods, the system can flexibly respond to the personalized needs of different users. Whether through voice, gestures or options on the screen, it can ensure that users can easily start the scene recording function in any situation, so as not to miss every moment worth recording.

[0064] In this application example, the focus is on building a nap mode and a meditation mode. Among them, the nap mode is a mode carefully designed for the vehicle rest environment, allowing users to instantly immerse themselves in nature, relax in the sea, forest, and by the fire, and enjoy a high-quality nap experience accompanied by a sleep-aiding story. The meditation mode cleverly integrates professional meditation courses into daily travel. It is developed based on a scientific mindfulness system and is closely integrated with the rest and travel scenes in the car. It only takes 5 to 15 minutes to bring significant decompression and charging effects to the body and mind. Therefore, on the basis of meeting the needs of the mode, avoid taking up too much storage space, and the duration of the audio and video materials that replicate the current environment should not be too long.

[0065] In a possible implementation, after starting the image acquisition device and the sound acquisition device to acquire the image and sound of the current environment, it also includes: according to a predetermined duration or a recording end instruction, shutting down the image acquisition device and the sound acquisition device to end acquiring the image and sound of the current environment.

[0066] Optionally, the preset duration can be set according to actual conditions, such as determining the duration range of image and sound collection corresponding to the current environment according to the duration range of image and sound collection corresponding to different environments, for example, 5 minutes to 15 minutes. The duration range of image and sound collection corresponding to different environments can be determined by the average value of the duration of image and sound collection of multiple users in different environments.

[0067] In step S102, in order to enhance the effect of reproducing the audio-visual material of the current environment, it is necessary to process the image and sound based on the specific parameters of the screen.

[0068] In a possible implementation, the configuration parameters include the number of screens, screen resolution, and screen distribution positions;

[0069] Process images and sounds according to configuration parameters, including:

[0070] Based on the acquisition time of the image and the sound, matching and splicing the image and the sound to obtain the first audio and video;

[0071] According to the number of screens and the screen resolution, the first audio and video are stretched and split, and the split edges are transitioned to obtain the second audio and video;

[0072] Based on the acquisition positions of the images and sounds, the screen distribution positions, and the second audio and video, audio and video materials that replicate the current environment and are adapted to multiple screens are generated.

[0073] First, according to the acquisition time of the image and sound, accurate matching and splicing are performed to ensure that the images acquired by each image acquisition device can be seamlessly connected, and at the same time, the sounds collected by each sound acquisition device can be synchronized. It is worth noting that since different image acquisition devices may repeatedly capture the same visual area during the acquisition process, when performing image matching and splicing, special attention should be paid to the smoothing of the splicing to eliminate possible visual faults and ensure the smoothness and coherence of the overall image.

[0074] Later, when multiple screens are configured in the car, the resolution, size and distribution position of each screen will be different. When replicating the environment, choosing the appropriate number of screens according to actual needs can not only improve the display effect, but also meet the diverse display needs. In addition, screen resolution is a key factor in determining image clarity. A high-resolution screen can show more details, making the audience feel as if they are in a real scene. At the same time, screens with different screen resolutions may require different image processing strategies to ensure that when multiple screens are displayed in conjunction, they can present a consistent and harmonious visual effect.

[0075] Depending on the number of screens and screen resolutions, it is necessary to stretch and split the first audio and video. During the stretching process, the aspect ratio of the image is maintained to avoid deformation or distortion. Stretching ensures that the video can seamlessly cover all screens and avoid unnecessary black or white edges on any screen, thereby improving the viewing experience. When splitting, it is necessary to accurately divide the screen according to its specific distribution position to ensure that each screen can obtain complete image information. In addition, the transition processing of the split edge is also crucial, which can effectively eliminate the stiffness caused by the split and make the overall picture more harmonious and unified.

[0076] The first audio and video includes images and sounds collected by image acquisition devices and sound acquisition devices at multiple different positions, while the second audio and video includes images and sounds to be played on screens at different positions.

[0077] In this embodiment, through a series of processing processes such as splicing, stretching and splitting of images and sounds, it is ensured that when multiple screens are displayed in linkage, a consistent and harmonious visual effect can be presented, thereby improving the visual experience.

[0078] In a possible implementation, based on the image and sound acquisition positions, the screen distribution positions, and the second audio and video, audio and video materials that replicate the current environment and are adapted to multiple screens are generated, including:

[0079] Determine the best splicing order of multiple screens based on the image and sound acquisition locations, as well as the screen distribution locations;

[0080] According to the best splicing order, the audio and video at each moment in the second audio and video are divided respectively to obtain audio and video materials that replicate the current environment and are adapted to multiple screens.

[0081] In the above embodiment, the requirement that the screen is equipped with a speaker is met. In other embodiments, the speakers are distributed in different positions in the cabin, and the audio needs to be divided according to the number of speakers. This meets the requirement that one speaker plays the audio collected by one or more microphones.

[0082] The above introduces the basic processing process of images and sounds of the information collected by the image acquisition device and the sound acquisition device. In order to enhance the restoration effect, image and sound enhancement processing will also be performed.

[0083] In a possible implementation, before the image and sound are processed according to the configuration parameters, the method further includes:

[0084] Get the current weather conditions information;

[0085] Motion effect enhancement information is generated according to the meteorological condition information, and the image and sound are enhanced according to the motion effect enhancement information.

[0086] Optionally, meteorological condition information includes: meteorological condition information includes: different levels of rain, different levels of haze, different levels of snow, strong wind, cloudy, overcast, sunny, daytime, dawn, dusk or night; image motion enhancement information includes: raindrops, snowflakes, clouds, fog, sunshine, fallen leaves, sunset or moonlight.

[0087] In the specific implementation process, the system obtains the meteorological conditions information of the current environment before processing the image and sound according to the configuration parameters. After obtaining these meteorological conditions information, the vehicle system will generate motion enhancement information based on these data, which can simulate various weather conditions in the real world, ensure that the subsequent image and sound processing is closer to the actual environment, and provide a more realistic user experience. For example: when the user issues a scene recording command on a rainy day, there is image noise or sound noise when recording video and sound through the image acquisition device and the sound acquisition device. The video and sound need to be enhanced according to the meteorological conditions information of the current environment to eliminate or reduce these noises; when the rain is light on rainy days, raindrop motion effects or sound effects can be added; when it snows, the effect of falling snowflakes can be added; when it is cloudy or overcast, the brightness and contrast of the image can be adjusted to simulate the atmosphere of a cloudy day to enhance the user's sense of immersion.

[0088] Among them, obtaining meteorological condition information can be achieved in a variety of ways, such as identifying and obtaining images and sounds collected by vehicle-mounted image acquisition equipment and sound acquisition equipment, or obtaining through integrated sensors, weather station data interfaces, or third-party meteorological service APIs.

[0089] In this embodiment, motion effect enhancement information is generated based on the meteorological condition information of the current environment, and the image and sound are enhanced based on the motion effect enhancement information. This can simulate various weather conditions in the real world, make the image and sound processing closer to the actual environment, provide a more realistic user experience, and enhance the user's sense of immersion.

[0090] In another possible implementation, before the image and sound are processed according to the configuration parameters, the method further includes: generating an ambient sound effect according to the ambient sound information.

[0091] Ambient sound can reveal features of the vehicle's surroundings that are not directly displayed in the images captured by the image acquisition device, such as the hustle and bustle of the city, the gentle hum of the breeze, the rhythm of the waves lapping the beach, and the harmonious movement of birdsong and flowers in the forest. However, these background sounds are often weakened or even filtered out when the microphone is used for sound collection. Therefore, in order to enhance the sense of atmosphere, ambient sound effects are added to adapt to the environment to achieve the best auditory experience.

[0092] Optionally, when the ambient sound includes the sound of waves, a preset sound effect of waves hitting the beach is obtained; when the ambient sound includes the sound of birds singing, a preset sound effect of birds singing is obtained; when the ambient sound includes the sound of vehicle horns, a preset sound effect of city noise is obtained.

[0093] In this embodiment, ambient sound effects are generated based on ambient sound information to make the scene more realistic, vivid, and interesting.

[0094] In a possible implementation, before the image and sound are processed according to the configuration parameters, the method further includes:

[0095] Get the current weather conditions information;

[0096] Motion effect enhancement information is generated according to meteorological condition information, ambient sound effects are generated according to ambient sound information, and image and sound are enhanced according to the motion effect enhancement information and ambient sound effects.

[0097] In this embodiment, the dynamic effect enhancement information is generated by weather condition information and the ambient sound effect is generated according to the ambient sound information, so as to realize the dual enhancement processing of image and sound. It not only greatly improves the comfort and pleasure of driving and riding, but also effectively relieves driving fatigue, making people feel more relaxed and comfortable during the journey.

[0098] In a possible implementation, before generating the motion effect enhancement information according to the meteorological condition information, the method further includes:

[0099] Obtaining setting information of a motion effect enhancement scheme; wherein the setting information of the motion effect enhancement scheme includes: the status of an automated enhancement function and a custom enhancement scheme;

[0100] When the state of the automation enhancement function is off, a motion enhancement request message is generated, and when a motion enhancement confirmation message is received, an operation of generating motion enhancement information according to the meteorological condition information is performed;

[0101] When the state of the automatic enhancement function is turned on, an operation of generating dynamic effect enhancement information according to the meteorological condition information is performed;

[0102] When a custom enhancement scheme exists, the motion effect enhancement information is generated according to the custom enhancement scheme information corresponding to the meteorological condition information; otherwise, the motion effect enhancement information is generated according to the preset enhancement scheme information corresponding to the meteorological condition information.

[0103] The system can also provide personalized motion enhancement solutions based on the specific needs of users. For example, users can choose to increase the effect of sunlight dappling on sunny days, or increase the effect of moonlight at night, or increase the size and density of raindrops on rainy days. This personalized setting can be adjusted through the user interface to meet the needs of different users.

[0104] Based on the above embodiments, the user feedback mechanism of the system is also necessary to ensure that the processing results meet the user's needs. Once the processing results fail to meet the user's expectations, the user can easily re-record, or enhance and optimize the processing results according to personal needs, thereby improving the user experience.

[0105] In a possible implementation, after the image and sound are processed according to the configuration parameters, the method further includes:

[0106] Control each screen to play the processed image, control the vehicle speakers to play the processed sound, and generate preview result confirmation request information;

[0107] When confirmation feedback information of the preview result is obtained, the processed image and sound are saved as audio-visual materials automatically in the scene mode.

[0108] In this embodiment, after the image and sound are processed according to the configuration parameters, the processed image and sound are played to facilitate the user to preview, thereby ensuring that the environment replication effect meets the user's needs.

[0109] In a possible implementation, after starting the image acquisition device and the sound acquisition device to acquire the image and sound of the current environment, the method further includes:

[0110] If the image does not meet the preset image requirements and / or the sound does not meet the preset sound requirements, a prompt to open the window and / or the door is generated;

[0111] If a window opening instruction is obtained, the vehicle window is controlled to open based on the window opening instruction, and / or, if a door opening instruction is obtained, the vehicle door is controlled to open based on the door opening instruction, and the step of collecting images and sounds of the current environment is re-executed.

[0112] In the actual implementation process, after the image acquisition device and the sound acquisition device are started to collect the image and sound information in the current environment, the vehicle system analyzes the collected data. If it is found that these data do not meet the pre-set standards, for example, the image is too blurry or the light is insufficient, the sound has too much noise or the volume is too low, the vehicle system generates a suggestive prompt to remind the user to improve the current environmental conditions to achieve better collection results. Optionally, the prompt is to suggest the user to open the window or door to increase the entry of natural light or improve ventilation, thereby improving image quality and audio quality.

[0113] Before starting the image acquisition device and the sound acquisition device, or during the acquisition process of the image acquisition device and the sound acquisition device, the user can select the control option through voice commands, touch screens, physical buttons or other input devices to issue window opening commands or door opening commands. When the vehicle system receives a window opening command or a door opening command, it controls the window opening or door opening accordingly. During the acquisition process of the image acquisition device and the sound acquisition device, when a window opening command or a door opening command is obtained, the image and sound acquisition are restarted to avoid inconsistent acquisition information during the acquisition process, which affects the user experience.

[0114] In this specific implementation, when it is detected that the image does not meet the preset image standard or the sound does not meet the preset sound requirement, the system will automatically generate a prompt message to open the window or door. Subsequently, once the command to open the window or door is received, the system will execute the step of collecting the current environment image and sound again. This process constitutes a closed-loop control mechanism to ensure that the data collected each time is of high quality and meets the user experience requirements.

[0115] During the implementation process, in order to facilitate the reuse and reproduction of audio and video materials, images and sounds can be packaged and stored.

[0116] In a possible implementation, after the image and sound are processed according to the configuration parameters, the method further includes:

[0117] Generate scene naming prompts;

[0118] If the scene naming information is obtained, the scene naming information and the audio-visual material are packaged and stored, so that the audio-visual material can be called and played through a scene start instruction; wherein the scene start instruction carries the scene naming information.

[0119] After image processing and sound optimization, scene naming prompts are generated to attach personalized labels to audio and video materials, making it easier for users to enable scene mode again later. At the same time, the system packages scene naming information with audio and video materials for storage, making the management of audio and video materials clear and organized, and allowing the corresponding audio and video materials to be quickly called and played.

[0120] Figure 2 is a flow chart of the implementation of the vehicle control method provided by an embodiment of the present application, such as Figure 2 As shown, the method comprises the following steps:

[0121] S201, in response to a scene recording instruction, starting an image acquisition device and a sound acquisition device to acquire images and sounds of a current environment; wherein the image acquisition device and the sound acquisition device are image acquisition devices and sound acquisition devices installed at multiple different positions on the vehicle;

[0122] S202, determining whether there is an image that does not meet the preset image requirements and a sound that does not meet the preset sound requirements, if there is an image that does not meet the preset image requirements and / or a sound that does not meet the preset sound requirements, executing step S203, otherwise executing step S204;

[0123] S203, generating a window opening and / or door opening prompt to obtain an image and sound that meets a preset image requirement or a preset sound requirement;

[0124] S204, obtaining meteorological condition information of the current environment, generating motion effect enhancement information according to the meteorological condition information, and performing enhancement processing on the image and sound according to the motion effect enhancement information;

[0125] S205, obtaining configuration parameters of multiple screens in the vehicle, and processing images and sounds according to the configuration parameters to generate audio-visual materials that replicate the current environment and are adapted to the multiple screens respectively;

[0126] S206, generating a scene naming prompt;

[0127] S207, when the scene naming information is obtained, the scene naming information and the audio-visual material are packaged and stored, so that the audio-visual material can be called and played through a scene start instruction; wherein the scene start instruction carries the scene naming information.

[0128] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0129] The following is an embodiment of the device of the present application. For details not described in detail, please refer to the corresponding method embodiment described above.

[0130] Figure 3 is a schematic diagram of the structure of a vehicle control device provided by an embodiment of the present application, such as Figure 3 For the sake of convenience, only the parts related to the embodiment of the present application are shown. Figure 3 As shown, the device comprises:

[0131] The control module 301 is used to start the image acquisition device and the sound acquisition device in response to the scene recording instruction to acquire the image and sound of the current environment; wherein the image acquisition device and the sound acquisition device are image acquisition devices and sound acquisition devices installed at multiple different positions on the vehicle;

[0132] The audio and video processing module 302 is used to obtain configuration parameters of multiple screens in the vehicle, and process images and sounds according to the configuration parameters to generate audio and video materials that replicate the current environment and are adapted to the multiple screens respectively.

[0133] In a possible implementation, the configuration parameters include the number of screens, screen resolution, and screen distribution positions;

[0134] The audio and video processing module 302 is specifically used for:

[0135] Based on the acquisition time of the image and the sound, matching and splicing the image and the sound to obtain the first audio and video;

[0136] According to the number of screens and the screen resolution, the first audio and video are stretched and split, and the split edges are transitioned to obtain the second audio and video;

[0137] Based on the acquisition positions of the images and sounds, the screen distribution positions, and the second audio and video, audio and video materials that replicate the current environment and are adapted to multiple screens are generated.

[0138] In a possible implementation, the audio and video processing module 302 is specifically configured to:

[0139] Determine the best splicing order of multiple screens based on the image and sound acquisition locations, as well as the screen distribution locations;

[0140] According to the best splicing order, the audio and video at each moment in the second audio and video are divided respectively to obtain audio and video materials that replicate the current environment and are adapted to multiple screens.

[0141] In a possible implementation, the audio and video processing module 302 is further configured to:

[0142] Get the current weather conditions information;

[0143] Motion effect enhancement information is generated according to the meteorological condition information, and the image and sound are enhanced according to the motion effect enhancement information.

[0144] In one possible implementation, meteorological condition information includes: meteorological condition information includes: different levels of rain, different levels of haze, different levels of snow, strong winds, cloudy, overcast, sunny, daytime, dawn, dusk or night; image motion enhancement information includes: raindrops, snowflakes, clouds, fog, sunshine, fallen leaves, sunset or moonlight.

[0145] In a possible implementation, the control module 301 is further configured to generate a window opening and / or door opening prompt after starting the image acquisition device and the sound acquisition device to acquire the image and sound of the current environment, if the image does not meet the preset image requirement and / or the sound does not meet the preset sound requirement;

[0146] If a window opening instruction is obtained, the vehicle window is controlled to open based on the window opening instruction, and / or, if a door opening instruction is obtained, the vehicle door is controlled to open based on the door opening instruction, and the step of collecting images and sounds of the current environment is re-executed.

[0147] In a possible implementation, the control module 301 is further configured to:

[0148] Generate scene naming prompts;

[0149] If the scene naming information is obtained, the scene naming information and the audio-visual material are packaged and stored, so that the audio-visual material can be called and played through a scene start instruction; wherein the scene start instruction carries the scene naming information.

[0150] In a possible implementation, the audio and video processing module 302 is further used to generate an ambient sound effect according to the ambient sound information;

[0151] Correspondingly, the control module is used to package and store the ambience sound effects synchronously when the scene naming information and the audio-visual materials are packaged and stored.

[0152] In a possible implementation, the scene recording instruction is generated according to a user control voice, control gesture, or control option selection operation.

[0153] In a possible implementation, the control module 301 is further configured to shut down the image acquisition device and the sound acquisition device according to a predetermined duration or a recording end instruction, and terminate the acquisition of images and sounds of the current environment.

[0154] In this embodiment, when a scene recording instruction is received, the image acquisition device and the sound acquisition device are started to capture the image and sound of the current environment. Among them, the image acquisition device and the sound acquisition device are installed at multiple different positions on the vehicle to ensure the comprehensiveness and multi-angle nature of the acquisition. The image and sound acquisition is carried out by the vehicle-mounted equipment, which successfully avoids the cumbersome import operation of the external audio and video acquisition device information, thereby improving the acquisition efficiency. In addition, based on the layout of the image acquisition device and the sound acquisition device distributed in multiple different positions, the multi-angle scenery and sound acquisition is realized, and the effect of three-dimensional restoration of the scene is achieved, bringing a more immersive experience to the user. After collecting the image and sound, the configuration parameters of the multiple screens in the vehicle are further obtained, and the collected audio and video materials are processed according to these parameters to generate audio and video materials that replicate the current environment and are adapted to multiple screens respectively. This process not only meets the user's demand for wide-angle scenery playback, but also helps to create a surround audio-visual effect and enhance the user's fun of riding.

[0155] Figure 4 Schematic diagram of the structure of an electronic device provided by an embodiment of the present application. Figure 4 As shown, the electronic device 4 of this embodiment includes: a processor 40, a memory 41, and a computer program 42 stored in the memory 41 and executable on the processor 40. When the processor 40 executes the computer program 42, the steps in the above-mentioned vehicle control method embodiments are implemented, such as Figure 1 Alternatively, when the processor 40 executes the computer program 42, the functions of the modules / units in the above-mentioned device embodiments are realized, for example Figure 3 The functions of each module are shown.

[0156] Exemplarily, the computer program 42 may be divided into one or more modules / units, which are stored in the memory 41 and executed by the processor 40 to complete the present application. The one or more modules / units may be a series of computer program instruction segments that can complete specific functions, and the instruction segments are used to describe the execution process of the computer program 42 in the electronic device 4. For example, the computer program 42 may be divided into Figure 3 The modules shown.

[0157] The electronic device 4 may be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server. The electronic device 4 may include, but is not limited to, a processor 40 and a memory 41. Those skilled in the art will appreciate that Figure 4 It is only an example of the electronic device 4 and does not constitute a limitation of the electronic device 4. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the electronic device may also include input and output devices, network access devices, buses, etc.

[0158] The processor 40 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0159] The memory 41 may be an internal storage unit of the electronic device 4, such as a hard disk or memory of the electronic device 4. The memory 41 may also be an external storage device of the electronic device 4, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the electronic device 4. Further, the memory 41 may also include both an internal storage unit and an external storage device of the electronic device 4. The memory 41 is used to store the computer program and other programs and data required by the electronic device. The memory 41 may also be used to temporarily store data that has been output or is to be output.

[0160] The present application also provides a vehicle, such as Figure 5 As shown, the vehicle 5 includes the aforementioned electronic device 4 .

[0161] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0162] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0163] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed in this application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0164] In the embodiments provided in the present application, it should be understood that the disclosed devices / electronic devices and methods can be implemented in other ways. For example, the device / electronic device embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0165] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0166] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0167] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned vehicle control method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device that can carry the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc.

[0168] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A vehicle control method, characterized in that: include: In response to the scene recording instruction, the image acquisition device and the sound acquisition device are started to acquire images and sounds of the current environment; wherein the image acquisition device and the sound acquisition device are image acquisition devices and sound acquisition devices installed at multiple different positions on the vehicle; The configuration parameters of the multiple screens in the vehicle are obtained, and the image and sound are processed according to the configuration parameters to generate audio-visual materials that replicate the current environment and are respectively adapted to the multiple screens.

2. The vehicle control method according to claim 1, characterized in that: The configuration parameters include the number of screens, screen resolution and screen distribution positions; The processing of the image and sound according to the configuration parameters includes: Based on the acquisition time of the image and the sound, matching and splicing the image and the sound to obtain a first audio and video; According to the number of screens and the screen resolution, the first audio and video are stretched and segmented, and the segmentation edges are transitioned to obtain the second audio and video; Based on the acquisition positions of the image and sound, the screen distribution positions, and the second audio and video, audio and video materials that replicate the current environment and are respectively adapted to the multiple screens are generated.

3. The vehicle control method according to claim 2, characterized in that: The step of generating audio-visual materials that replicate the current environment and are adapted to the multiple screens respectively based on the acquisition positions of the image and the sound, the screen distribution positions, and the second audio and video includes: Determining an optimal splicing order of the multiple screens based on the acquisition positions of the images and sounds and the distribution positions of the screens; According to the optimal splicing order, the audio and video at each moment in the second audio and video are divided respectively to obtain audio and video materials that replicate the current environment and are adapted to the multiple screens respectively.

4. The vehicle control method according to any one of claims 1 to 3, characterized in that: Before the image and sound are processed according to the configuration parameters, the method further includes: Acquiring meteorological condition information of the current environment; Motion effect enhancement information is generated according to the meteorological condition information, and the image and sound are enhanced according to the motion effect enhancement information.

5. The vehicle control method according to any one of claims 1 to 3, characterized in that: After the image acquisition device and the sound acquisition device are started to acquire the image and sound of the current environment, the method further includes: If the image does not meet the preset image requirements and / or the sound does not meet the preset sound requirements, generating a window opening and / or door opening prompt; If a window opening instruction is obtained, the vehicle window is controlled to open based on the window opening instruction, and / or, if a door opening instruction is obtained, the vehicle door is controlled to open based on the door opening instruction, and the step of collecting images and sounds of the current environment is re-executed.

6. The vehicle control method according to any one of claims 1 to 3, characterized in that: After the image and sound are processed according to the configuration parameters, the method further includes: Generate scene naming prompts; If the scene naming information is obtained, the scene naming information and the audio-visual material are packaged and stored, so that the audio-visual material can be called and played through a scene start instruction; wherein the scene start instruction carries the scene naming information.

7. The vehicle control method according to any one of claims 1 to 3, characterized in that: The scene recording instruction is generated according to a user control voice, control gesture or control option selection operation.

8. A vehicle control device, characterized in that: include: A control module, configured to start an image acquisition device and a sound acquisition device in response to a scene recording instruction, and to acquire images and sounds of a current environment; wherein the image acquisition device and the sound acquisition device are image acquisition devices and sound acquisition devices installed at multiple different positions on the vehicle; The audio and video processing module is used to obtain the configuration parameters of the multiple screens in the vehicle, and process the image and sound according to the configuration parameters to generate audio and video materials that replicate the current environment and are respectively adapted to the multiple screens.

9. A vehicle comprising a memory, a processor, and a computer program stored in the memory and capable of running on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method as claimed in any one of claims 1 to 7 are implemented.

Images