Vehicle image acquisition method, storage medium, electronic device, and program product

Abstract

The present disclosure relates to a vehicle image acquisition method, a storage medium, an electronic device and a program product, and relates to the technical field of vehicle control. The method comprises: in response to a triggered image acquisition instruction, controlling a target image sensor deployed on a vehicle to perform an image acquisition operation to obtain initial image data; and performing image processing on the initial image data based on a shooting mode indicated by the image acquisition instruction to obtain target media data. The present disclosure can capture and record images through the camera of the vehicle while the user is driving the vehicle, and can perform corresponding processing on the captured image data, thereby ensuring the safety of the vehicle while capturing media data that can truly capture the highlights of the journey.

Description

Technical Field

[0001] This disclosure relates to the field of vehicle control technology, and in particular to a vehicle image acquisition method, storage medium, electronic device, and program product. Background Technology

[0002] In related technologies, when wonderful moments occur during users' lives or travels, users generally choose to record and share these moments by taking photos, recording videos, or live streaming using their mobile phones, cameras, or other handheld devices.

[0003] When users are traveling by car, if they experience such wonderful moments while driving, recording these moments with a mobile phone or other handheld device may affect driving safety. However, if they do not record them, these wonderful moments will be missed, causing regret for the user.

[0004] Currently, it is possible to obtain photos of exciting moments through dashcam footage. However, dashcam footage may not fully capture the exciting moments, and the image quality of dashcams is often poor, making it difficult to accurately reproduce the exciting moments. Summary of the Invention

[0005] To address the aforementioned technical issues, this disclosure provides a vehicle image acquisition method, storage medium, electronic device, and program product, which can capture and record images using the vehicle's camera while the user is driving, and process the captured image data accordingly. This allows for the capture of media data that accurately recreates memorable moments during the journey while ensuring vehicle driving safety.

[0006] In a first aspect, this disclosure provides a method for acquiring vehicle images, the method comprising: In response to the triggered image acquisition command, the target image sensor deployed on the vehicle is controlled to perform image acquisition operations to obtain initial image data; Image processing is performed on the initial image data based on the shooting mode indicated by the image acquisition command to obtain the target media data.

[0007] Optionally, in some embodiments of this disclosure, after processing the initial image data based on the shooting mode corresponding to the image acquisition command to obtain the target media data, the method further includes: Output target media data.

[0008] In some embodiments of this disclosure, optionally, image processing is performed on the initial image data based on the shooting mode indicated by the image acquisition command to obtain target media data, including: The initial image data is processed according to the target image processing operation corresponding to the shooting mode to obtain the target media data.

[0009] In some embodiments of this disclosure, optionally, when the shooting mode includes a photo mode, the target image processing operation includes a first image processing operation and / or a second image processing operation; and / or, when the shooting mode includes a live streaming mode, the target image processing operation includes a third image processing operation and / or a fourth image processing operation; wherein: The first image processing operation includes: performing image enhancement processing on the reference image data in the initial image data that meets the set clarity requirements to obtain the target media data; The second image processing operation includes: based on the shooting time of the initial image data, fusing at least two frames of initial image data to obtain dynamic image data as target media data; The third image processing operation includes: performing image correction processing on the initial image data to obtain the target media data; The fourth image processing operation includes: stitching together at least two initial image data acquired by different image sensors to obtain target media data.

[0010] In some embodiments of this disclosure, optionally, a target image sensor deployed on the vehicle is controlled to perform an image acquisition operation to obtain initial image data, including: The target image sensor is controlled to perform image acquisition operations according to the target acquisition mode to obtain initial image data. The target acquisition mode is associated with the shooting mode indicated by the image acquisition command.

[0011] In some embodiments of this disclosure, the image acquisition command may optionally be triggered by user operation input and / or user voice input received by the human-machine interaction module deployed in the vehicle.

[0012] Optionally, in some embodiments of this disclosure, the method further includes: In response to an image acquisition command, at least two shooting function icons are displayed through the shooting control interface; In response to the selection input for a target function identifier among at least two shooting function identifiers, the target shooting mode corresponding to the target function identifier is determined as the shooting mode indicated by the image acquisition command.

[0013] Optionally, in some embodiments of this disclosure, when the image acquisition command indicates a shooting mode including a photo mode, the initial image data includes at least two frames of image data; and / or When the image acquisition command indicates a shooting mode including live mode, the initial image data includes live video stream data.

[0014] In some embodiments of this disclosure, optionally, the target media data is output, including: Based on the network connection quality information between the vehicle and the target device, the target quality parameters of the target media data are adjusted. Output the adjusted target media data.

[0015] In some embodiments of this disclosure, optionally, the target media data is output, including: Upload the target media data to the target server; and / or, Share target media data via the target application; and / or, Sending target media data to a target terminal connected to the vehicle's communication network; and / or, Store target media data.

[0016] In some embodiments of this disclosure, optionally, before controlling a target image sensor deployed on a vehicle to perform an image acquisition operation, the method further includes: In response to an image acquisition command, the sensor identifier of at least one image sensor is displayed on the image sensor display interface; In response to a selection input indicating at least one target sensor identifier from the displayed sensor identifiers, the image sensor corresponding to the target sensor identifier is determined as the target image sensor.

[0017] In some embodiments of this disclosure, optionally, determining the image sensor corresponding to the target sensor identifier as the target image sensor includes: The image sensor corresponding to the target sensor identifier is identified as the initial image sensor; The initial image sensor that meets the sensor configuration requirements corresponding to the shooting mode is determined as the target image sensor.

[0018] Secondly, embodiments of this disclosure provide a vehicle image acquisition device, which includes: The control module is used to control the target image sensor deployed on the vehicle to perform image acquisition operations in response to the triggered image acquisition command, so as to obtain initial image data; The processing module is used to process the initial image data based on the shooting mode indicated by the image acquisition command to obtain the target media data.

[0019] Thirdly, embodiments of this disclosure provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the vehicle image acquisition method as provided in the first aspect.

[0020] Fourthly, embodiments of this disclosure provide an electronic device including a processor and a memory, the memory being used to store a computer program, and the processor being configured to execute the computer program to implement the vehicle image acquisition method as provided in the first aspect.

[0021] Fifthly, embodiments of this disclosure provide a computer program product, which includes a computer program or instructions that, when executed by a processor, implement the vehicle image acquisition method as provided in the first aspect.

[0022] Sixthly, embodiments of this disclosure provide a vehicle, including: Such as the electronic equipment provided in the fourth aspect.

[0023] The technical solution provided in this disclosure has the following advantages compared with the prior art: The vehicle image acquisition method, storage medium, electronic device, and program product provided in this disclosure allow users to control target image sensors deployed on the vehicle to perform corresponding image acquisition operations, such as taking photos, recording videos, or live streaming, while the user is driving or riding in the vehicle. After obtaining the initial image data, the vehicle's image processing system performs corresponding image processing on the initial image data according to the shooting mode indicated by the image acquisition command, thereby obtaining processed target media data. This disclosure allows for the capture of memorable moments during a driving journey using image sensors such as cameras deployed on the vehicle without interfering with normal driving operations, and the processing of the captured image data, enabling the capture of media data that accurately recreates the memorable moments of the journey while ensuring vehicle driving safety. Attached Figure Description

[0024] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0025] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0026] Figure 1 A flowchart illustrating a vehicle image acquisition method according to some embodiments of the present disclosure is shown; Figure 2 The control flowchart of the vehicle photography mode according to some embodiments of this disclosure is shown; Figure 3 A schematic diagram illustrating the data flow in a vehicle's camera mode according to some embodiments of this disclosure is shown; Figure 4 The control flowchart of a vehicle live streaming mode according to some embodiments of this disclosure is shown; Figure 5 A schematic diagram illustrating the data flow of a vehicle in live streaming mode according to some embodiments of this disclosure is shown; Figure 6 A structural block diagram of a vehicle image acquisition device according to some embodiments of the present disclosure is shown. Detailed Implementation

[0027] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the solutions disclosed herein will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.

[0028] Numerous specific details are set forth in the following description in order to provide a full understanding of this disclosure, but this disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some, and not all, of the embodiments of this disclosure.

[0029] Some of the nouns or terms that appear in the description of the embodiments of this disclosure shall be interpreted as follows: AI: Artificial Intelligence.

[0030] APP: Application.

[0031] Before describing the embodiments of this disclosure in detail, the technical background involved in this disclosure will be described here so that those skilled in the art can have a clearer understanding of the embodiments of this disclosure.

[0032] In related technologies, with the development of multimedia technology, recording and sharing life through photos, videos, or live streams has become an indispensable part of people's lives. Especially when traveling, when wonderful moments occur, such as rainbows after rain, scenic views outside the car window, or fleeting beauty like sunlight shining through clouds, users generally choose to record them using handheld devices such as mobile phones and cameras.

[0033] When a user is driving, they need to concentrate on operating the vehicle. If they are distracted by taking photos with a handheld device, it will greatly affect driving safety. If the user chooses to stop and take photos when it is safe to do so, they may miss these wonderful moments.

[0034] Some vehicles are equipped with dashcams or other cameras, but the footage captured by dashcams is of poor quality and cannot perfectly reproduce exciting moments.

[0035] To address the aforementioned issues, this disclosure provides a vehicle image acquisition method, wherein the vehicle includes at least one image sensor, exemplarily a camera.

[0036] For example, Figure 1 Flowcharts of vehicle image acquisition methods according to some embodiments of this disclosure are shown, such as... Figure 1 As shown, the method includes: S102, in response to the triggered image acquisition command, controls the target image sensor deployed on the vehicle to perform image acquisition operation and obtain initial image data.

[0037] In this embodiment of the disclosure, for example, the image acquisition command can be triggered by the user in the vehicle through voice. For example, the user says "take a picture", and the vehicle's voice recognition system collects the user's voice and performs voice recognition on the user's voice data to obtain the image acquisition command.

[0038] For example, the image acquisition command may be triggered by a button on the multifunction steering wheel, a switch on the vehicle's central control panel, or a touch control on the vehicle's infotainment screen.

[0039] The vehicle includes at least one image sensor. Exemplarily, the image sensor includes a front-view camera, side-view cameras, and a rear-view camera. Exemplarily, the image sensor also includes an in-vehicle camera, such as the camera of a dashcam.

[0040] The image acquisition command indicates a shooting mode, such as photo shooting mode, video recording mode, and live streaming mode.

[0041] For example, taking the photo shooting mode as an example, the user can specify the area to be photographed by the vehicle. For instance, if the user requests to take a photo of the front of the vehicle, the vehicle's dashcam camera and front-view camera can be identified as the target image sensors.

[0042] For example, there can be multiple target image sensors; that is, when executing the image acquisition command, two or more image sensors can be controlled to perform image acquisition operations simultaneously. After the shooting is completed, the multiple photos can be stitched together to obtain a wide-angle or panoramic photo.

[0043] For example, the vehicle's image capture system calls the target image sensor and controls the target image sensor to perform image acquisition operations.

[0044] For example, before accessing the target image sensor, the image acquisition system first determines whether the target image sensor is available. In some scenarios, the target image sensor may be occupied by other vehicle functions, such as driver assistance features. If the target image sensor is occupied, the image acquisition system outputs a corresponding prompt. If the target image sensor is not occupied, the image acquisition system controls the target image sensor to perform image acquisition operations.

[0045] For example, the data captured by the target image sensor is the initial image data. For example, the initial image data can be image data, video data, or video stream data.

[0046] S104 processes the initial image data based on the shooting mode indicated by the image acquisition command to obtain the target media data.

[0047] In this embodiment of the disclosure, the shooting modes include, for example, a photo mode and a live streaming mode. After initial image data is captured, the initial image data is processed accordingly based on the shooting mode indicated by the image acquisition command.

[0048] For example, if the shooting mode is photo mode, the corresponding data processing includes image enhancement processing, image filtering processing, and image compositing processing.

[0049] For example, if the shooting mode is live streaming mode, the corresponding data processing includes video correction processing, video splicing processing, and video post-processing.

[0050] This embodiment of the disclosure allows users to control target image sensors deployed in the vehicle to perform corresponding image acquisition operations, such as taking photos, recording videos, or live streaming, by issuing image acquisition commands while the user is driving or riding in the vehicle. After obtaining the initial image data, the vehicle's image processing system performs corresponding image processing on the initial image data according to the shooting mode indicated by the image acquisition command, thereby obtaining processed target media data. This embodiment of the disclosure can capture exciting moments during a driving journey using image sensors such as cameras deployed in the vehicle without interfering with normal driving operations, and can process the captured image data accordingly, enabling the capture of media data that can realistically reproduce the exciting moments of the journey while ensuring vehicle driving safety.

[0051] In some embodiments of this disclosure, optionally, after processing the initial image data based on the shooting mode corresponding to the image acquisition command to obtain the target media data, the method further includes: outputting the target media data.

[0052] In this embodiment of the disclosure, after processing the target media data, the target media data is output based on the output method corresponding to the shooting mode.

[0053] For example, outputting target media data can be done by displaying the target media data on the vehicle's infotainment screen.

[0054] For example, outputting target media data can be done by sending the target media data to the target terminal, such as sending it to the user's mobile phone for storage or display.

[0055] For example, outputting target media data can be achieved by uploading the target media data to a cloud server, and then saving or sharing the target media data through the cloud server.

[0056] For example, the output target media data may be stored in the vehicle's storage medium.

[0057] For example, the output target media data can be shared through a specific application, such as a social application.

[0058] For example, the output target media data can be the target media data broadcast live through a live streaming platform.

[0059] The embodiments disclosed herein can output image data collected by image sensors such as cameras deployed in the vehicle during driving, enabling the sharing and saving of wonderful moments during the journey.

[0060] In some embodiments of this disclosure, optionally, image processing is performed on the initial image data based on the shooting mode indicated by the image acquisition command to obtain target media data, including: The initial image data is processed according to the target image processing operation corresponding to the shooting mode to obtain the target media data.

[0061] In this embodiment of the disclosure, when processing the initial image data obtained by capture, a corresponding target image processing operation is determined based on the shooting mode indicated by the received image acquisition command. The initial image data is then processed using this target image processing operation.

[0062] For example, when the shooting mode is photo mode, the target image processing operation is to enhance the image of the captured photo, such as improving the sharpness of the captured photo, correcting the exposure and color of the captured photo, etc.

[0063] For example, when the shooting mode is live streaming mode, the target image processing operation is to perform image correction on the video stream captured for live streaming, or to stitch together video streams captured by multiple different image sensors to obtain a wide-angle video stream, etc.

[0064] This embodiment of the disclosure determines the corresponding image processing operation based on the shooting mode selected by the user. That is, targeted image processing operations are performed on the initial image data collected under different shooting modes. This ensures that the final output target media data always meets the image quality requirements of different shooting modes, thereby improving the recording quality of recording wonderful moments during the journey through the vehicle.

[0065] In some embodiments of this disclosure, optionally, when the shooting mode includes a photo mode, the target image processing operation includes a first image processing operation and / or a second image processing operation; and / or, when the shooting mode includes a live streaming mode, the target image processing operation includes a third image processing operation and / or a fourth image processing operation; wherein: The first image processing operation includes: performing image enhancement processing on the reference image data in the initial image data that meets the set clarity requirements to obtain the target media data; The second image processing operation includes: based on the shooting time of the initial image data, fusing at least two frames of initial image data to obtain dynamic image data as target media data; The third image processing operation includes: performing image correction processing on the initial image data to obtain the target media data; The fourth image processing operation includes: stitching together at least two initial image data acquired by different image sensors to obtain target media data.

[0066] In this embodiment of the disclosure, the shooting modes include a photo mode and a live streaming mode. The target image processing operation corresponding to the photo mode includes one or a combination of a first image processing operation and a second image processing operation. The target processing operation corresponding to the live streaming mode includes one or a combination of a third image processing operation and a fourth processing operation.

[0067] For example, the first image processing operation performs image enhancement processing on the reference image data in the initial image data that meets the set sharpness requirements. Since the vehicle is in motion, the image sensor mounted on the vehicle is also moving relative to the scenery outside the vehicle. Taking photos during motion may result in problems such as defocusing and motion blur. Therefore, in the shooting mode, the target image sensor can be controlled to perform a continuous shooting operation within a target time period, capturing multiple photos as initial image data. From these multiple photos in the initial media data, the photo with the highest sharpness, most reasonable exposure, and best composition is selected as the reference image data, and image enhancement processing is performed on the reference image data to obtain the target media data.

[0068] For example, the target time period can be set to a range of 1 second to 5 seconds.

[0069] For example, the target time period is 2 seconds.

[0070] For example, when performing a burst shooting operation, a burst shooting speed of N photos per second can be used. Where 2 ≤ N ≤ 120.

[0071] For example, image enhancement processing includes sharpness enhancement, multi-image compositing, exposure enhancement, sensitivity enhancement, color enhancement, etc.

[0072] By enhancing the images of at least two initial frames captured, clear, color-accurate, and well-displayed target media data can be obtained.

[0073] For example, after capturing multiple initial photo data, an AI-based algorithm model is used to identify the sharpness of each initial photo data, resulting in a sharpness score for each initial photo data. This sharpness score is used to measure the sharpness of each initial photo data. The higher the score, the higher the sharpness of the photo.

[0074] Based on the clarity of multiple initial photo data, the initial photo data with the highest clarity is selected as the baseline photo data.

[0075] When performing image enhancement processing, image enhancement is performed on the benchmark photo data with the highest clarity, such as color enhancement, clarity enhancement, or HDR processing, to obtain target media data that balances image clarity and image performance.

[0076] By taking multiple photos in burst mode and then enhancing the images based on these photos, the image quality of the photos captured by the vehicle during the photo acquisition process can be improved, thus more realistically recording the wonderful moments during the drive.

[0077] For example, the second image processing operation includes fusing the initial image data according to the capture time of at least two frames to obtain dynamic image data.

[0078] For example, in photo mode, the target image sensor performs a burst shooting operation, obtaining N initial photo data. These initial photo data are then sorted according to the chronological order of their shooting time to obtain a photo sequence ordered by shooting time.

[0079] Based on the sorted photo sequence, the N initial photo data are fused to obtain the target media data of dynamic image data.

[0080] For example, dynamic image data can be video frame sequence data.

[0081] For example, animated image data can be image data in GIF format.

[0082] For example, the animated image data can be image data in APNG format.

[0083] By fusing multiple frames of raw photo data based on shooting time, dynamic image data is obtained, which can enrich the display effect of target media data and increase the interest of images taken from vehicles.

[0084] For example, the third image processing operation is to perform image correction on the initial image data obtained by the target image sensor in live streaming mode.

[0085] Among them, some of the image sensors deployed on the vehicle are special wide-angle image sensors or fisheye image sensors, so the images they capture may have certain image distortion.

[0086] In response, after obtaining the initial image data, the initial image data is corrected according to the correction algorithm corresponding to the target image sensor that captured the initial image data, and the corrected initial image data is obtained. In this way, effective correction of image distortion can be achieved.

[0087] For example, the third image processing operation is to stitch together initial image data acquired by at least two different image sensors in live streaming mode.

[0088] For example, in live streaming mode, the vehicle can simultaneously capture video streams using two or more target image sensors to obtain multiple initial image data streams. After capturing multiple media data streams, the data streams can be stitched together based on the positional relationships of the external environment captured by these media data streams, thereby obtaining wide-angle multi-channel media data with a wider field of view.

[0089] For example, suppose two initial image data streams are captured by the vehicle's left and right front cameras, respectively. The fields of view of the left and right front cameras overlap to some extent. Content detection is performed on the initial image data captured by the left and right front cameras to identify objects simultaneously captured by both cameras. Based on the object's position in the initial image data, the two initial image data streams are stitched together to obtain a wide-angle target image data with a wider field of view.

[0090] The embodiments of this disclosure can perform corresponding image processing on the initial image data obtained from shooting according to different shooting modes, thus ensuring that the output target media data matches the shooting mode indicated by the user and improving the shooting quality.

[0091] In some embodiments of this disclosure, optionally, a target image sensor deployed on the vehicle is controlled to perform an image acquisition operation to obtain initial image data, including: The target image sensor is controlled to perform image acquisition operations according to the target acquisition mode to obtain initial image data. The target acquisition mode is associated with the shooting mode indicated by the image acquisition command.

[0092] In this embodiment of the disclosure, the target acquisition mode for controlling the image sensor to perform image acquisition operations varies depending on the shooting mode indicated by the image acquisition command.

[0093] For example, if the shooting mode is a still image mode, then the target acquisition mode is a burst mode. By controlling the target image sensor to perform burst shooting within the target time period, the number of initial image data obtained is increased, thereby mitigating problems such as defocusing and inaccurate exposure caused by vehicle movement, and thus increasing the probability of obtaining sufficiently clear initial image data with more accurate exposure and color.

[0094] For example, if the shooting mode is live streaming mode, then the target acquisition mode is recording mode. The target image sensor is controlled to record a video stream, and the video stream is processed in real time, such as image correction processing or frame-by-frame stitching processing. The processed video stream is pushed to the target device, so that the user holding the target device can watch the scenery captured by the vehicle in real time, realizing the "sharing" of the same scenery with the vehicle driver or passengers.

[0095] This disclosure embodiment controls the target image sensor to perform image acquisition operations according to different target acquisition modes based on different shooting modes, thereby ensuring that the acquired initial image data meets the requirements of the shooting mode indicated by the user.

[0096] In some embodiments of this disclosure, the image acquisition command may optionally be triggered by user operation input and / or user voice input received by the human-machine interaction module deployed in the vehicle.

[0097] In this embodiment of the disclosure, for example, the human-machine interaction module can be a vehicle-mounted system, an in-vehicle smart terminal, or a terminal device that establishes a control communication connection with the vehicle.

[0098] For example, vehicle users can trigger image acquisition commands by inputting user actions and / or voice input into the human-machine interaction module.

[0099] For example, when a user says "start live streaming," the vehicle's voice recognition system collects the user's voice, performs voice recognition on the user's voice data, obtains the image acquisition command, and determines the shooting mode to be live streaming mode.

[0100] For example, users can input their actions by pressing buttons on the multi-function steering wheel, pressing switches on the vehicle's central control panel, or using the vehicle's touchscreen, thereby triggering image acquisition commands. For instance, after a user presses the "take a photo" control, the human-machine interface module receives the image acquisition command and determines the shooting mode to be photo mode.

[0101] The embodiments disclosed herein enable vehicle users to freely choose the method of triggering image acquisition commands, thereby reducing interference with the user's normal driving behavior and ensuring driving safety while recording the scenery during the journey through the vehicle.

[0102] Optionally, in some embodiments of this disclosure, the method further includes: In response to an image acquisition command, at least two shooting function icons are displayed through the shooting control interface; In response to the selection input for a target function identifier among at least two shooting function identifiers, the target shooting mode corresponding to the target function identifier is determined as the shooting mode indicated by the image acquisition command.

[0103] In this embodiment of the disclosure, for example, after receiving an image acquisition command, a shooting control interface is displayed on the vehicle's display screen, and the shooting control interface displays shooting function icons corresponding to different shooting modes.

[0104] For example, the shooting function identifier includes the shooting function identifier for photo mode and the shooting function identifier for live streaming mode.

[0105] Users can select target function icons by touching the touchscreen, controlling the smart steering wheel, controlling the touchpad, or controlling other interactive controls. After receiving the selection input, the system will determine the target shooting mode corresponding to the selected target function icon as the shooting mode indicated by the image acquisition command.

[0106] For example, the shooting control interface includes shooting function icons for photo mode and live streaming mode. When a user selects the photo mode shooting function icon via touch, the image acquisition command indicates that the shooting mode is photo mode.

[0107] This embodiment of the disclosure can display the vehicle's shooting functions to the user through the shooting control interface. The user can freely select the target shooting mode in the shooting control interface, thereby increasing the freedom to capture wonderful moments through the vehicle.

[0108] Optionally, in some embodiments of this disclosure, when the image acquisition command indicates a shooting mode including a photo mode, the initial image data includes at least two frames of image data; and / or When the image acquisition command indicates a shooting mode including live mode, the initial image data includes live video stream data.

[0109] In this embodiment of the disclosure, exemplarily, in photo mode, the target image sensor is controlled to perform a burst shooting operation, thereby capturing at least two frames of image data. Since the vehicle is in motion, the image sensor mounted on the vehicle is also moving relative to the surrounding scenery. Taking photos while in motion may result in issues such as defocusing and motion blur. Therefore, in photo mode, by controlling the target image sensor to perform a burst shooting operation within a target time period to obtain two or more frames of image data, a greater selection space is provided, thus laying the foundation for subsequent image enhancement processing.

[0110] For example, in live streaming mode, the target image sensor is controlled to perform continuous shooting operations to obtain a video stream. In some implementations, in live streaming mode, the vehicle calls two or more target image sensors to simultaneously perform shooting operations to obtain multiple initial image data, each of which is a video stream, and the shooting time of these video streams is synchronized.

[0111] This disclosure embodiment controls the target image sensor to collect different initial image data according to different shooting modes, so that the shooting result can always match the shooting mode indicated by the user, thereby enriching the ways to record wonderful moments on the road by vehicle.

[0112] In some embodiments of this disclosure, optionally, the target media data is output, including: Based on the network connection quality information between the vehicle and the target device, the target quality parameters of the target media data are adjusted. Output the adjusted target media data.

[0113] In this embodiment of the disclosure, the target device may, for example, be a terminal device that communicates with the vehicle, such as a mobile phone or tablet computer. The target device may also be a live streaming platform.

[0114] Taking the target device as a live streaming platform as an example, after obtaining the target media data, the target media data is sent to the target device. The target device performs secondary encoding on the target media data to obtain the live video stream and pushes it to each live streaming client, thereby realizing the live streaming of the vehicle's journey.

[0115] The vehicle connects to the target device via its onboard Wi-Fi. During the live stream, the vehicle monitors the live stream status in real time, including network status checks, to determine the quality of the network connection between the vehicle and the target device.

[0116] After obtaining network connection quality information, the processing parameters for encoding the target media data are adjusted based on the network connection quality information, that is, the target bitrate is changed during encoding.

[0117] Specifically, a higher target bitrate during encoding results in a larger target media data stream size and requires more network bandwidth to send the target media data to the target device. Conversely, a lower target bitrate results in a smaller target media data stream size and requires less network bandwidth to send the target media data to the target device.

[0118] For example, the better the network connection quality, the higher the target bitrate when encoding the target image. The worse the network connection quality, the lower the target bitrate when encoding the target image.

[0119] This embodiment of the disclosure dynamically judges the network quality during the live broadcast and dynamically adjusts the processing parameters during encoding according to the real-time changes in network quality, thereby achieving dynamic matching between picture quality and network quality and ensuring live broadcast efficiency.

[0120] In some embodiments of this disclosure, optionally, the target media data is output, including: Upload the target media data to the target server; and / or, Share target media data via the target application; and / or, Sending target media data to a target terminal connected to the vehicle's communication network; and / or, Store target media data.

[0121] In this embodiment of the disclosure, exemplarily, when the target media data is a photograph, the method for outputting the target media data includes uploading it to a target server. Exemplarily, the target server can be a sharing server or a cloud storage server.

[0122] For example, when the target media data is a photo, the method of outputting the target media data also includes sharing the target media data through a target application. For example, the target application can be a social media application. Sharing the target media data through the target application can be sending a "log" or sending the target media data to social media friends.

[0123] For example, when the target media data is a photograph, the method for outputting the target media data further includes sending it to a target terminal that is communicatively connected to the vehicle. The target terminal can be a mobile phone, a smart wearable device, a laptop computer, a PDA, an in-vehicle infotainment system of another vehicle, or other terminal equipment.

[0124] For example, the target media data can also be stored in the vehicle's own storage device.

[0125] For example, during live streaming, the target media data is a live video stream. The method for outputting the target media data is to push the data stream corresponding to the target media data to the target server and / or the target terminal. In this case, the target server is a live streaming server, and the target terminal can be a mobile phone, tablet, smart screen, or other similar device.

[0126] Taking pushing a video stream to a live streaming server as an example, after the target media data stream is received by the live streaming server, the live streaming server performs secondary encoding on the target media data stream before pushing it to each live streaming client for playback.

[0127] The embodiments disclosed herein can realize a variety of different ways of outputting target media data, thereby enriching the application scenarios when capturing images based on vehicles.

[0128] In some embodiments of this disclosure, optionally, before controlling a target image sensor deployed on a vehicle to perform an image acquisition operation, the method further includes: In response to an image acquisition command, the sensor identifier of at least one image sensor is displayed on the image sensor display interface; In response to a selection input indicating at least one target sensor identifier from the displayed sensor identifiers, the image sensor corresponding to the target sensor identifier is determined as the target image sensor.

[0129] In this embodiment of the disclosure, for example, after receiving an image acquisition command, an image sensor display interface is displayed on the vehicle's display screen, which shows the sensor identifier of the image sensor that is currently available.

[0130] For example, the sensor identifier can be the name of the vehicle camera, such as "dashcam camera", "front-view camera" or "rear-view camera".

[0131] For example, the sensor identifier can also be an icon corresponding to an in-vehicle camera.

[0132] Users can select one or more primary sensor identifiers as the image sensors they wish to invoke by choosing input in the image sensor display interface.

[0133] This disclosure embodiment can display available image sensors to the user through an image sensor display interface. The user can freely select the image sensor they wish to use to capture target media data, thereby increasing the freedom of capturing exciting moments through a vehicle.

[0134] In some embodiments of this disclosure, optionally, determining the image sensor corresponding to the target sensor identifier as the target image sensor includes: The image sensor corresponding to the target sensor identifier is identified as the initial image sensor; The initial image sensor that meets the sensor configuration requirements corresponding to the shooting mode is determined as the target image sensor.

[0135] In this embodiment of the disclosure, after receiving the user's selection input, the system determines whether the initial target image sensor meets the sensor configuration requirements corresponding to the image mode.

[0136] For example, when the shooting mode is live mode and the user selects at least two frames from the first image sensor, the system determines whether the two first image sensors selected by the user can be used simultaneously. If the two first image sensors can be used simultaneously, then the two first image sensors selected by the user are determined as the target image sensors.

[0137] For example, the photo mode may require selecting a front-view camera; if the user selects an interior-view camera, it is determined that the sensor configuration requirements are not met.

[0138] For example, after the user selects the initial target image sensor, it is determined whether the initial target image sensor is already in use. If so, it is determined that the sensor configuration requirements are not met.

[0139] This embodiment of the disclosure determines whether the image sensor selected by the user meets the configuration requirements corresponding to the shooting mode, thereby avoiding the inability of the image sensor selected by the user to complete the shooting operation of the indicated shooting mode, and thus improving the shooting success rate.

[0140] For example, Figure 2 The control flowchart of the vehicle photography mode of some embodiments of this disclosure is shown, such as Figure 2 As shown, it includes: S202, enter photo mode; S204, Determine if the vehicle has a usable onboard camera; if yes, proceed to step 206, otherwise end. S206, call the vehicle camera to take N raw photo data in a row; S208: Perform quality assessment and sharpness comparison on N original photo data, select the benchmark photo data with the highest sharpness for image enhancement, and generate optimized target media data; S210, outputs target media data.

[0141] For example, the output target media data includes uploading to a cloud server, sharing to a social media app, transmitting to a target terminal device, and storing in a storage device locally in the vehicle.

[0142] For example, Figure 3This illustration shows a data flow diagram of a vehicle in camera mode according to some embodiments of the present disclosure, such as... Figure 3 As shown, after the user triggers the photo-taking command, the vehicle's infotainment system performs permission checks and function routing, then activates the target camera. The target camera in the camera group returns multiple image data. The vehicle's infotainment system uses an AI processing engine to evaluate the image quality, and the AI ​​processing engine returns a sharpness comparison result. Based on the sharpness comparison result, the vehicle's infotainment system selects the best image. The AI ​​processing engine optimizes the best image and returns the optimized result. The vehicle's infotainment system then outputs the optimized image according to the user's selected method.

[0143] For example, Figure 4 The control flowchart of the vehicle live streaming mode of some embodiments of this disclosure is shown, such as Figure 4 As shown, it includes: S402, enter live streaming mode; S404 displays available cameras via a selection interface; S406, determine whether the camera selected by the user is available; if yes, proceed to S408, otherwise return to S404; S408, calls the camera to capture a video stream; S410 generates wide-angle video based on video stream; S412 encodes wide-angle video and uploads it to the live streaming platform; S414 monitors the live stream status and dynamically adjusts the live stream quality. S416 stops streaming and releases resources after detecting that a user has stopped the live stream.

[0144] For example, Figure 5 This illustration shows a data flow diagram of a vehicle in live streaming mode according to some embodiments of this disclosure, such as... Figure 5 As shown, after a user starts a live stream, the vehicle's infotainment client selects a camera, initializes multi-channel acquisition, and the camera management module returns a video stream. The vehicle's infotainment client then calls the video processing module to perform wide-angle video synthesis, including image stitching, distortion correction, and encoding compression. The video processing module returns the synthesized video. The vehicle's infotainment client pushes the stream to the live streaming platform and continues the live stream. During this time, the live streaming platform returns a live streaming status, and the vehicle's infotainment client performs network status detection and adapts the image quality based on the detection results. After the user stops the live stream, the vehicle's infotainment client stops pushing the stream to the live streaming platform.

[0145] In some embodiments of this disclosure, a vehicle image acquisition device is also provided. Figure 6 Structural block diagrams of vehicle image acquisition devices according to some embodiments of the present disclosure are shown, such as... Figure 6 As shown, the vehicle image acquisition device 600 includes a control module 602 and a processing module 600.

[0146] The control module 602 is used to control the target image sensor deployed on the vehicle to perform image acquisition operations in response to the triggered image acquisition command, so as to obtain initial image data; The processing module 604 is used to process the initial image data based on the shooting mode indicated by the image acquisition command to obtain the target media data.

[0147] This embodiment of the disclosure allows users to control target image sensors deployed in the vehicle to perform corresponding image acquisition operations, such as taking photos, recording videos, or live streaming, by issuing image acquisition commands while the user is driving or riding in the vehicle. After obtaining the initial image data, the vehicle's image processing system performs corresponding image processing on the initial image data according to the shooting mode indicated by the image acquisition command, thereby obtaining processed target media data. This embodiment of the disclosure can capture exciting moments during a driving journey using image sensors such as cameras deployed in the vehicle without interfering with normal driving operations, and can process the captured image data accordingly, enabling the capture of media data that can realistically reproduce the exciting moments of the journey while ensuring vehicle driving safety.

[0148] In some embodiments of this disclosure, a computer-readable storage medium is also provided, on which a computer program is stored, which, when executed by a processor, implements the vehicle image acquisition method provided in any of the above embodiments.

[0149] In some embodiments of this disclosure, an electronic device is also provided, including a processor and a memory, the memory for storing a computer program, and the processor configured to execute the computer program to implement the vehicle image acquisition method provided in any of the above embodiments.

[0150] In some embodiments of this disclosure, a computer program product is also provided, which includes a computer program or instructions that, when executed by a processor, implement the vehicle image acquisition method provided in any of the above embodiments.

[0151] In some embodiments of this disclosure, a vehicle is also provided, comprising: The electronic device provided in any of the above embodiments.

[0152] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0153] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0154] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0155] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0156] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0157] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of the units are not, in some cases, intended to limit the specific unit.

[0158] The functions described above in this document can be performed at least in part by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.

[0159] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0160] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0161] The above description is merely a specific embodiment of this disclosure, enabling those skilled in the art to understand or implement it. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this disclosure. Therefore, this disclosure is not to be limited to the embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for acquiring vehicle images, characterized in that, The method includes: In response to the triggered image acquisition command, the target image sensor deployed on the vehicle is controlled to perform image acquisition operations to obtain initial image data; Based on the shooting mode indicated by the image acquisition command, the initial image data is processed to obtain target media data.

2. The method according to claim 1, characterized in that, After processing the initial image data based on the shooting mode corresponding to the image acquisition command to obtain the target media data, the method further includes: Output the target media data.

3. The method according to claim 1, characterized in that, The image processing of the initial image data based on the shooting mode indicated by the image acquisition command to obtain target media data includes: The initial image data is processed according to the target image processing operation corresponding to the shooting mode to obtain the target media data.

4. The method according to claim 3, characterized in that, When the shooting mode includes a photo mode, the target image processing operation includes a first image processing operation and / or a second image processing operation; and / or, when the shooting mode includes a live streaming mode, the target image processing operation includes a third image processing operation and / or a fourth image processing operation; wherein: The first image processing operation includes: performing image enhancement processing on the reference image data in the initial image data whose sharpness meets the set sharpness requirements to obtain the target media data; The second image processing operation includes: based on the shooting time of the initial image data, fusing at least two frames of the initial image data to obtain dynamic image data as the target media data; The third image processing operation includes: performing image correction processing on the initial image data to obtain the target media data; The fourth image processing operation includes: stitching together at least two initial image data acquired by different image sensors to obtain the target media data.

5. The method according to claim 1, characterized in that, The target image sensor deployed on the control vehicle performs an image acquisition operation to obtain initial image data, including: The target image sensor is controlled to perform image acquisition operations according to the target acquisition mode to obtain the initial image data. The target acquisition mode is associated with the shooting mode indicated by the image acquisition command.

6. The method according to claim 1, characterized in that, The image acquisition command is triggered by user operation input and / or user voice input received by the human-machine interaction module deployed in the vehicle.

7. The method according to claim 1 or 6, characterized in that, The method further includes: In response to the image acquisition command, at least two shooting function icons are displayed through the shooting control interface; In response to the selection input for a target function identifier among at least two of the shooting function identifiers, the target shooting mode corresponding to the target function identifier is determined as the shooting mode indicated by the image acquisition command.

8. The method according to any one of claims 1 to 6, characterized in that, When the image acquisition command indicates a shooting mode including a photo mode, the initial image data includes at least two frames of image data; and / or When the shooting mode indicated by the image acquisition command includes live streaming mode, the initial image data includes live video stream data.

9. The method according to claim 2, characterized in that, Output the target media data, including: Based on the network connection quality information between the vehicle and the target device, the target quality parameters of the target media data are adjusted; Output the adjusted target media data.

10. The method according to claim 2, characterized in that, The output of the target media data includes: Upload the target media data to the target server; and / or, Share the target media data via the target application; and / or, Send the target media data to a target terminal that is communicatively connected to the vehicle; and / or, Store the target media data.

11. The method according to any one of claims 1 to 6, characterized in that, Before the target image sensor deployed on the control vehicle performs image acquisition operations, the method further includes: In response to the image acquisition command, the sensor identifier of at least one of the image sensors is displayed through the image sensor display interface; In response to a selection input indicating at least one target sensor identifier from the displayed sensor identifiers, the image sensor corresponding to the target sensor identifier is determined as the target image sensor.

12. The method according to claim 11, characterized in that, The step of determining the image sensor corresponding to the target sensor identifier as the target image sensor includes: The image sensor corresponding to the target sensor identifier is identified as the initial image sensor; The initial image sensor that meets the sensor configuration requirements corresponding to the shooting mode is determined as the target image sensor.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1-12.

14. An electronic device comprising a processor and a memory, characterized in that, The memory is used to store a computer program, and the processor is configured to execute the computer program to implement the method as described in any one of claims 1 to 10.

15. A computer program product, said computer program product comprising a computer program or instructions, characterized in that, When the computer program or instructions are executed by a processor, they implement the method as described in any one of claims 1 to 10.

Images