Method, device and system for controlling vehicle camera to generate video

Abstract

Provided are a method, device and system for controlling a vehicle camera to generate a video, the method comprising: acquiring driving information of a vehicle and preset matching information, the driving information comprising at least driving direction information and brake state information of the vehicle, the preset matching information comprising first matching information, and the first matching information comprising first matching information; the first matching information limits the matching relation between the driving direction information and / or the braking state information of the vehicle and the started corresponding vehicle camera; and according to the first matching information, based on the driving direction information and / or the brake state information of the vehicle, selecting to start a corresponding vehicle camera in a plurality of vehicle cameras to shoot the outside or the inside of the vehicle so as to generate a video. Therefore, the shooting camera can be automatically adjusted according to the driving direction and / or the braking state, so that the shooting modes of the driving video are increased, the shooting requirements of a user in diversified directions are met, and the driving video with richer content is provided for the user.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicle shooting, and in particular to a method, device and system for controlling a vehicle camera to generate a video, a corresponding electronic device, a computer readable storage medium and a vehicle. BACKGROUND

[0002] With the rapid development of vehicle technology, the functions of vehicles are increasing. On the basis of meeting the daily travel needs, many entertainment functions are added, which greatly improves the experience of driving and riding.

[0003] Controlling a vehicle camera to shoot the scenery during driving into a video and sharing it has become a way for users to share their lives. The existing vehicle video shooting method usually uses a front camera or a camera selected manually by the user to shoot in a single direction. Although it can capture the scenery on one side of the vehicle, it ignores the images in other directions around the vehicle during driving. In this way, the single shooting method cannot meet the user's shooting needs in different directions during driving.

[0004] Therefore, there is a need for an improved scheme for controlling vehicle camera shooting. SUMMARY

[0005] In view of this, the present application provides a method, device and system for controlling a vehicle camera to generate a video, a corresponding electronic device, a computer readable storage medium and a vehicle.

[0006] In a first aspect, the present application provides a method for controlling a vehicle camera to generate a video, the method comprising:

[0007] obtaining driving information of the vehicle and preset matching information, wherein the driving information at least includes driving direction information and brake state information of the vehicle, and the preset matching information includes first matching information, the first matching information defining a matching relationship between the driving direction information and / or the brake state information of the vehicle and the corresponding vehicle camera enabled; and

[0008] controlling, according to the first matching information, the corresponding vehicle camera enabled among the plurality of vehicle cameras to shoot the outside or inside of the vehicle based on the driving direction information and / or the brake state information of the vehicle to generate a video.

[0009] In an embodiment, the driving information further includes driving speed information of the vehicle, and the preset matching information includes second matching information, wherein the second matching information defines a matching relationship between the driving speed information of the vehicle and the corresponding shooting mode enabled, and the method further comprises: controlling, according to the second matching information, the corresponding shooting mode among the plurality of shooting modes of the corresponding vehicle camera based on the driving speed information of the vehicle.

[0010] In one embodiment, the method further comprises: acquiring facial recognition information of an in-vehicle vehicle user; determining a direction of interest of the vehicle user based on the facial recognition information; and additionally selecting to activate a vehicle camera having a shooting direction consistent with the direction of interest of the vehicle user when the direction of interest of the vehicle user is inconsistent with a shooting direction of a corresponding vehicle camera selected to be activated.

[0011] In one embodiment, the first matching information defines a matching relationship between driving direction information and / or brake state information of the vehicle and activation of a corresponding vehicle camera in the following manner:

[0012] activating a left-side camera of the vehicle when the driving direction of the vehicle is a right-turn direction;

[0013] activating a right-side camera of the vehicle when the driving direction of the vehicle is a left-turn direction;

[0014] activating a rear-side camera of the vehicle when the driving direction of the vehicle is a reverse direction;

[0015] activating a front-side camera of the vehicle when the driving direction of the vehicle is a forward direction; or

[0016] activating an in-vehicle camera of the vehicle when the vehicle is in a brake state.

[0017] In one embodiment, the second matching information defines a matching relationship between driving speed information of the vehicle and activation of a corresponding shooting mode in the following manner:

[0018] activating a time-lapse shooting mode when the driving state is an acceleration driving state;

[0019] activating a slow-motion shooting mode when the driving state is a deceleration driving state;

[0020] activating an A-times shooting mode when the driving state is a high-speed driving state, A being greater than 1;

[0021] activating a B-times shooting mode when the driving state is a medium-speed driving state, B being greater than 1 and less than A;

[0022] activating a normal shooting mode when the driving state is a low-speed driving state; or

[0023] activating a freeze shooting mode when the driving state is a brake state.

[0024] In one embodiment, the method further comprises: after obtaining an operation instruction of generating a panoramic video, controlling to enter a panoramic generation mode; in the panoramic generation mode, enabling at least all vehicle exterior cameras to capture videos of the outside of the vehicle to generate a plurality of videos; and stitching the plurality of videos into a panoramic video by a video stitching algorithm.

[0025] In a second aspect, the present application provides a device for controlling a vehicle camera to generate a video, the device comprising: an information obtaining module configured to obtain driving information of the vehicle and preset matching information, wherein the driving information at least comprises driving direction information and brake state information of the vehicle, and the preset matching information comprises first matching information, the first matching information defining a matching relationship between the driving direction information and / or brake state information of the vehicle and enabling a corresponding vehicle camera; and a video generation control module configured to control, according to the first matching information, a corresponding vehicle camera among a plurality of vehicle cameras to capture the outside or inside of the vehicle to generate a video based on the driving direction information and / or brake state information of the vehicle.

[0026] In one embodiment, the driving information further comprises driving speed information of the vehicle, and the preset matching information comprises second matching information, wherein the second matching information defines a matching relationship between the driving speed information of the vehicle and enabling a corresponding capturing mode, and the device further comprises: a capturing mode enabling module configured to select, according to the second matching information, a corresponding capturing mode among a plurality of capturing modes of the corresponding vehicle camera based on the driving speed information of the vehicle.

[0027] In one embodiment, the device further comprises: a face recognition information obtaining module configured to obtain face recognition information of a vehicle user in the vehicle; a direction of interest determining module configured to determine a direction of interest of the vehicle user based on the face recognition information; and wherein the video generation control module is further configured to additionally select to enable a vehicle camera having a capturing direction consistent with the direction of interest of the vehicle user when the direction of interest of the vehicle user is inconsistent with a capturing direction of the selected enabled corresponding vehicle camera.

[0028] In one embodiment, the video generation control module is further configured to: after obtaining an operation instruction of generating a panoramic video, control to enter a panoramic generation mode; wherein in the panoramic generation mode, at least all vehicle exterior cameras are enabled to capture videos of the outside of the vehicle to generate a plurality of videos; and the device further comprises a video stitching module configured to stitch the plurality of videos into a panoramic video by a video stitching algorithm.

[0029] In a third aspect, the present application provides a system for controlling a vehicle camera to generate a video, which can include a cloud platform and the apparatus for controlling a vehicle camera to generate a video as described herein.

[0030] In a fourth aspect, the present application provides an electronic device, which can include a processor and a memory storing computer program instructions, wherein the computer program instructions, when executed by the processor, implement the steps of the method for controlling a vehicle camera to generate a video as described herein.

[0031] In a fifth aspect, the present application provides a computer-readable storage medium, which stores computer-executable programs, wherein the computer-executable programs, when executed by a processor, implement the steps of the method for controlling a vehicle camera to generate a video as described herein.

[0032] In a sixth aspect, the present application provides a vehicle, which can include a plurality of vehicle cameras and the apparatus for controlling a vehicle camera to generate a video as described herein.

[0033] The method, apparatus, system, corresponding electronic device, computer-readable storage medium and vehicle for controlling a vehicle camera to generate a video provided by the present application have at least the following beneficial effects: through the pre-set matching information and the mechanism of intelligently selecting a camera, the camera that is enabled to shoot can be automatically selected according to the driving direction information and / or brake state information of the vehicle during driving, so as to increase the driving video shooting mode while ensuring driving safety, meet the shooting needs of users in diversified directions, and provide users with driving videos with more abundant content. According to different driving state and brake state information, the camera with a suitable direction is enabled, so as to ensure that the generated video content pays more attention to the environmental images or human images with large state changes in the driving process, so that the generated video is more vivid and has shareability. BRIEF DESCRIPTION OF DRAWINGS

[0034] In order to more clearly illustrate the specific embodiments of the present application, the specific embodiments are further introduced below in combination with the drawings.

[0035] Figure 1 A structural schematic diagram of a system for controlling a vehicle camera to generate a video according to an embodiment of the present application is shown;

[0036] Figure 2 A schematic diagram of a position of a vehicle external camera according to an embodiment of the present application is shown;

[0037] Figure 3 A flowchart of a method for controlling a vehicle camera to generate a video according to an embodiment of the present application is shown;

[0038] Figure 4 Fig. 1 shows a structural schematic diagram of an apparatus for controlling a vehicle camera to generate a video according to an embodiment of the present application;

[0039] Figure 5 Fig. 2 shows a structural schematic diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0040] In order to make the above and other features and advantages of the present application more clearly understood, the present application will be further described below with reference to the attached drawings. It should be understood that the specific embodiments given herein are by way of example only and are not intended to limit the present application.

[0041] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. It will be apparent, however, to one skilled in the art that the present application can be practiced without the specific details. In other instances, well-known steps or operations have not been described in detail in order to avoid obscuring the present application.

[0042] Figure 1 Fig. 3 shows a structural schematic diagram of a system for controlling a vehicle camera to generate a video according to an embodiment of the present application. As shown in Fig. 3, the system for controlling a vehicle camera to generate a video 100 can include a cloud platform 110 and an apparatus for controlling a vehicle camera to generate a video 120. Preferably, the system can further include a plurality of vehicle cameras 130. Figure 1

[0043] The cloud platform 110 can be referred to as a cloud computing platform, and can provide a variety of remote services for vehicle users. In one embodiment, the cloud platform 110 is in data communication with the apparatus for controlling a vehicle camera to generate a video 120 through a communication network. The cloud platform 110 can be configured to receive and store videos captured by the vehicle cameras and processed videos processed subsequently.

[0044] In one embodiment, the cloud platform 110 can be further configured to store preset matching information and send the matching information to the apparatus for controlling a vehicle camera to generate a video 120. The matching information can include default matching information and personalized matching information. Both the default matching information and the personalized matching information can include first matching information and second matching information, as described in more detail below.

[0045] The apparatus for controlling a vehicle camera to generate a video 120 is connected to the vehicle cameras 130, and can control the turning on and off of the plurality of vehicle cameras and the capturing mode of each vehicle camera.

[0046] ​The device 120 for controlling vehicle camera to generate video performs any one of the steps of the method for controlling vehicle camera to generate video provided herein, thereby increasing the shooting mode of driving video by intelligently enabling vehicle cameras matching vehicle driving information, and can shoot scenery in different directions during driving, obtain driving video with more abundant content, and solve the problem that a single shooting mode cannot meet the shooting demand of users in different directions.

[0047] The plurality of vehicle cameras 130 can include vehicle interior cameras and vehicle exterior cameras located at different positions outside the vehicle. Figure 2 An embodiment of the present application provides a schematic diagram of the positions of vehicle exterior cameras. Figure 2 As shown, the vehicle exterior cameras can at least include a vehicle front camera, a vehicle left camera, a vehicle right camera, and a vehicle rear camera. In addition, the vehicle exterior cameras can further include a top camera and a bottom camera.

[0048] It should be noted that the vehicle exterior cameras are not limited to the positions as shown in Figure 2 and there can be more than one vehicle camera on each side of the vehicle.

[0049] In some embodiments, as shown in Figure 1 the system 100 for controlling vehicle camera to generate video can further include a user terminal 140. The user terminal 140 can generate personalized matching information according to the setting operation of the vehicle user in the application program or the webpage, and synchronize to the device 120 for controlling vehicle camera to generate video and the cloud platform 110.

[0050] The user terminal 140 can receive the video generated by the vehicle camera. The user terminal 140 can also cut the original video into processed video according to the video template of interest to the user.

[0051] It should be noted that the original video and the processed video can be displayed not only on the display screen of the vehicle terminal, but also on the user terminal 140. The user terminal 140 can be an electronic device such as a mobile phone, a tablet computer, a notebook computer, a smart wearable device, etc.

[0052] In some embodiments, the device 120 for controlling vehicle camera to generate video or the user terminal 140 can share the original video and / or the processed video to the Internet through the sharing operation of the user. The sharing operation can be a page operation, a voice operation, etc. In this way, the video sharing to the outside increases the social behavior.

[0053] Another aspect of the present application provides a method for controlling vehicle camera to generate video, which can be applied to the device 120 for controlling vehicle camera to generate video as shown in Figure 1The device 120 for controlling a vehicle camera to generate a video. Figure 3 A flowchart of a method for controlling a vehicle camera to generate a video is shown. Figure 3 The method for controlling a vehicle camera to generate a video can include the following steps.

[0054] S31, obtaining driving information of the vehicle and preset matching information.

[0055] The "driving information" referred to herein can be a collection of various information related to the driving process of the vehicle, and can include but is not limited to driving real-time information and driving prediction information. The driving real-time information can reflect the real-time driving situation of the vehicle during the driving process. The driving prediction information can reflect the future driving situation of the vehicle during the driving process.

[0056] In one embodiment, the driving information at least includes driving direction information and brake state information of the vehicle. The brake state information reflects the braking situation of the vehicle. In the embodiment of the present application, the brake state information can include brake state real-time information and brake state prediction information. The brake state real-time information can reflect whether the vehicle is currently in a brake state. The brake state prediction information can reflect whether the vehicle will be in a brake state in the future.

[0057] The driving direction information describes the driving trajectory and driving direction of the vehicle on the road. In the embodiment of the present application, the driving direction information can include driving direction real-time information and driving direction prediction information. The driving direction real-time information can reflect the actual driving direction and driving trajectory of the vehicle at present. The driving direction prediction information can reflect the future driving trajectory and driving direction of the vehicle.

[0058] It should be noted that the driving prediction information can be obtained based on comprehensive analysis of the driving real-time information of the vehicle, road conditions, traffic conditions and other information.

[0059] In addition, the "preset matching information" referred to herein can be pre-stored in the cloud platform 110 or pre-stored in the device 120 for controlling a vehicle camera to generate a video.

[0060] The preset matching information can be a rule condition set for the purpose of shooting a video with rich content or a video expected by a user during driving. In one embodiment, the preset matching information can include first matching information. The first matching information defines the matching relationship between the driving direction information and / or brake state information of the vehicle and the corresponding vehicle camera enabled. Specifically, the driving direction of the vehicle can include but is not limited to left turn direction, right turn direction, reverse direction, forward direction and other driving directions.

[0061] S32, according to the first matching information, based on the driving direction information and / or the brake state information of the vehicle, selecting to enable a corresponding vehicle camera in the plurality of vehicle cameras to capture the outside or inside of the vehicle to generate a video.

[0062] In an embodiment of the present application, the device 120 for controlling the vehicle camera to generate a video finds the corresponding vehicle camera in the first matching information according to the driving direction information and / or the brake state information of the vehicle. According to the finding result, the device 120 for controlling the vehicle camera to generate a video selects and enables the corresponding vehicle camera. Once the corresponding vehicle camera is enabled, the corresponding vehicle camera captures the outside or inside environment of the vehicle at the corresponding position.

[0063] It should be noted that when the driving information of the vehicle does not change, the device 120 for controlling the vehicle camera to generate a video can not switch the vehicle camera. When the driving information of the vehicle changes, the device 120 for controlling the vehicle camera to generate a video switches the vehicle camera. In addition, when the vehicle is parked, the vehicle camera can stop capturing.

[0064] In some embodiments, the above S32 step can be performed as selecting to enable a corresponding vehicle camera in the plurality of vehicle cameras according to the first matching information, based on the real-time driving direction information and / or the real-time brake state information of the vehicle.

[0065] Specifically, the device 120 for controlling the vehicle camera to generate a video acquires the real-time driving direction information and the real-time brake state information of the current driving area of the vehicle. According to the first matching information, based on the real-time driving direction information and / or the real-time brake state information, a corresponding camera is accurately selected to be enabled to capture the outside or inside of the vehicle to generate a video.

[0066] For example, when the vehicle enters a left turn lane, the real-time driving direction information indicates to turn left, the device 120 for controlling the vehicle camera to generate a video selects to enable the vehicle right side camera corresponding to the left turn direction, so that the scenery of the lane can be better recorded in real time.

[0067] In some embodiments, the first matching information defines the matching relationship between the driving direction information and / or the brake state information of the vehicle and the corresponding vehicle camera to be enabled as follows: when the driving direction of the vehicle is a right turn direction, the left side camera of the vehicle is enabled; when the driving direction of the vehicle is a left turn direction, the right side camera of the vehicle is enabled; when the driving direction of the vehicle is a reverse direction, the rear side camera of the vehicle is enabled; when the driving direction of the vehicle is a forward direction, the front side camera of the vehicle is enabled; or when the vehicle is in a brake state, the inboard camera of the vehicle is enabled.

[0068] Specifically, when the driving direction information indicates that the vehicle is driving in a right-turn direction, the first matching information indicates to enable the left-side camera of the vehicle. Since the user of the vehicle pays great attention to the left-side road condition when right-turning, in order to meet the user's attention point when the vehicle is right-turning, the device enables the left-side camera of the vehicle to take pictures so as to capture the picture of the area.

[0069] When the driving direction information indicates that the vehicle is driving in a left-turn direction, the first matching information indicates to enable the right-side camera of the vehicle. Since the user of the vehicle pays great attention to the right-side road condition when left-turning, in order to meet the user's attention point when the vehicle is left-turning, the device enables the right-side camera of the vehicle to take pictures so as to capture the picture of the area.

[0070] When the driving direction information indicates that the vehicle is driving in a reverse direction, in order to better observe the situation behind the vehicle, the first matching information indicates to enable the rear-side camera of the vehicle.

[0071] When the driving direction information indicates that the vehicle is driving in a forward direction, in order to better observe the situation in front of the vehicle, the first matching information indicates to enable the front-side camera of the vehicle.

[0072] When the brake state information indicates a brake state, the first matching information indicates to enable the in-vehicle camera of the vehicle so as to capture the state of the user inside the vehicle in the brake state.

[0073] In the above embodiments, through the limitation of the first matching information, the enabled camera can meet the needs of different driving scenes and brake scenes, and the user of the vehicle can obtain the most interesting view of the outside or inside of the vehicle. Of course, the first matching information can also be set differently according to user preferences.

[0074] In some embodiments, the above S32 step can be performed as selecting in advance, according to the first matching information, a corresponding vehicle camera among the plurality of vehicle cameras to take pictures of the outside or inside of the vehicle to generate a video based on the driving direction prediction information and / or the brake state prediction information of the vehicle.

[0075] Specifically, the device 120 for controlling the vehicle camera to generate a video acquires driving direction prediction information and / or brake state prediction information of a next driving area that the vehicle is about to enter. According to the first matching information, a corresponding camera is selected in advance to take pictures of the outside or inside of the vehicle to generate a video based on the driving direction prediction information and / or the brake state prediction information. In this way, not only the environment on the future road can be better captured, but also important brake processes or accident scenes can be comprehensively captured at critical moments.

[0076] For example, when the vehicle is about to enter a left turn lane, the driving direction prediction information indicates that a left turn is about to be made, the device 120 for controlling the vehicle camera to generate a video selects to enable the vehicle camera corresponding to the left turn direction in advance, so that the road conditions and obstacles in the turn can be better captured.

[0077] When the braking state prediction information indicates that a braking state will occur in the future, the device 120 for controlling the vehicle camera to generate a video selects to enable the vehicle camera corresponding to the braking state in advance, so as to comprehensively record the braking process and possible collision.

[0078] For example, in a complete driving trip, the speed of the vehicle will change. In combination with the change in vehicle speed, the recording speed of the vehicle camera is changed, which can increase the excitement of the video and improve the interest of the video. In some embodiments, the driving information further includes driving speed information of the vehicle. The preset matching information includes not only the first matching information, but also second matching information. The second matching information defines a matching relationship between the driving speed information of the vehicle and the corresponding shooting mode enabled.

[0079] The "driving speed information" herein can include a vehicle driving speed and a speed change state. The vehicle driving speed can be a real-time driving speed or a predicted driving speed. The real-time driving speed can reflect the real-time vehicle speed and the real-time vehicle speed change. The predicted driving speed can reflect the vehicle speed and the vehicle speed change in a future period of time. The vehicle speed change state can be reflected by acceleration, for example, when the acceleration is positive, the vehicle is in an acceleration state, and when the acceleration is negative, the vehicle is in a deceleration state.

[0080] The shooting mode of each vehicle camera can include multiple parameter setting items such as frame rate, resolution, viewing angle, and exposure. Different setting parameters can produce different shooting modes.

[0081] The method for controlling the vehicle camera to generate a video can further include: based on the driving speed information of the vehicle, selecting a corresponding shooting mode in multiple shooting modes of the corresponding vehicle camera according to the second matching information.

[0082] The "multiple shooting modes" referred to herein can include a high-speed shooting mode, a medium-speed shooting mode, a low-speed shooting mode, a braking shooting mode, an acceleration shooting mode, and a deceleration shooting mode. Each shooting mode corresponds to a vehicle driving speed or a speed change state. The multiple shooting modes can meet the shooting needs in different vehicle speed scenarios.

[0083] The corresponding shooting mode can be a shooting mode matched with the driving speed information of the vehicle. The multiple shooting modes can include all shooting modes in the second matching information. The corresponding shooting mode can be one of the multiple shooting modes.

[0084] In one embodiment of the present application, when the corresponding vehicle camera is selected based on the driving direction information and / or the brake state information of the vehicle according to the first matching information, the device 120 for controlling the vehicle camera to generate a video can search for the corresponding shooting mode corresponding to the vehicle in the second matching information according to the driving speed information of the vehicle. According to the search result, the corresponding shooting mode of the corresponding camera is enabled to shoot the outside or inside of the vehicle to generate a video.

[0085] In the above embodiment, by enabling the corresponding shooting mode of the corresponding camera to shoot to generate a video, the vehicle can adopt a suitable shooting mode for shooting in different vehicle speed scenarios, thereby forming a video with different styles, thereby enhancing the video interest and improving the exciting degree of the video.

[0086] In one embodiment, the device 120 for controlling the vehicle camera to generate a video selects the corresponding shooting mode of the corresponding vehicle camera from a plurality of shooting modes based on the real-time driving speed of the vehicle according to the second matching information. In this way, the device 120 for controlling the vehicle camera to generate a video can adjust the shooting mode of the camera in real time according to the driving speed or speed change of the vehicle, ensuring that high-quality video recording can be obtained in any scenario.

[0087] In another embodiment, the device 120 for controlling the vehicle camera to generate a video selects the corresponding shooting mode of the corresponding vehicle camera from a plurality of shooting modes in advance based on the predicted driving speed of the vehicle according to the second matching information. In this way, the shooting mode is selected in advance based on the predicted driving speed, which can respond to the vehicle state in advance, so that the device 120 for controlling the vehicle camera to generate a video can be more proactive and intelligent to adapt to different driving scenarios and needs.

[0088] In some embodiments, the second matching information defines the matching relationship between the driving speed information of the vehicle and the corresponding shooting mode by: when the driving state is acceleration driving, the delay shooting mode is enabled; when the driving state is deceleration driving, the slow motion shooting mode is enabled; when the driving state is high-speed driving, the A times shooting mode is enabled, A is greater than 1; when the driving state is medium-speed driving, the B times shooting mode is enabled, B is greater than 1 and less than A; when the driving state is low-speed driving, the normal shooting mode is enabled; or when the driving state is brake state, the freeze shooting mode is enabled.

[0089] Specifically, for example, when the driving speed information of the vehicle indicates that the vehicle is in an accelerating driving state, the second matching information indicates to enable a time-lapse shooting mode. In the time-lapse shooting mode, the camera shoots at a slower frame rate so as to present a dynamic effect in the accelerating process when the subsequent video is played, enabling the user to more clearly feel the change in speed.

[0090] For example, when the driving speed information of the vehicle indicates that the vehicle is in a decelerating driving state, the second matching information indicates to enable a slow-motion shooting mode. In the slow-motion shooting mode, the subtle actions and changes in the decelerating process can be captured by increasing the frame rate, so that the video picture is more delicate.

[0091] For example, when the driving speed information of the vehicle indicates that the vehicle is in a high-speed driving state, the second matching information indicates to enable an A times shooting mode greater than 1. In the A times shooting mode, the camera shoots at a high-speed frame rate higher than the normal frame rate, so as to present a fast and smooth picture when the subsequent video is played. In an embodiment, the A times can be, for example, 1.5 times.

[0092] For example, when the driving speed information of the vehicle indicates that the vehicle is in a medium-speed driving state, the second matching information indicates to enable a B times shooting mode greater than 1 and less than A. In the B times shooting mode, the camera shoots at a medium-speed frame rate between the high-speed and the normal. In this way, the shot video can retain certain details without making the video content too lengthy.

[0093] For example, when the driving speed information of the vehicle indicates that the vehicle is in a high-speed driving state, the second matching information indicates to enable a normal shooting mode. In the normal shooting mode, the camera shoots at a standard frame rate, and the shot can truly reflect the scene and details when the vehicle is in a low-speed driving state.

[0094] For example, when the driving speed information of the vehicle indicates that the vehicle is in a braking state, the second matching information indicates to enable a freeze shooting mode. In the freeze shooting mode, the camera quickly captures the picture at the braking moment and freezes, so as to record the in-vehicle conditions and the surrounding environment in detail.

[0095] In the above embodiments, by further limiting the second matching information, the device can intelligently select and adjust the shooting mode according to different driving states, thereby providing the user with video content with various styles.

[0096] In order to make the shooting mode of the vehicle camera more in line with the user's needs. In some embodiments, the device 120 for controlling the vehicle camera to generate a video can also modify the corresponding vehicle camera and / or the corresponding shooting mode according to a user modification operation. The user modification operation can be a page operation or a voice operation.

[0097] In some embodiments, the method for controlling the vehicle camera to generate a video further comprises: obtaining facial recognition information of the vehicle user in the vehicle; determining a direction of interest of the vehicle user based on the facial recognition information; and additionally selecting to activate a vehicle camera having a shooting direction consistent with the direction of interest when the direction of interest is inconsistent with a shooting direction of a corresponding vehicle camera that is selected to be activated.

[0098] The facial recognition information of the vehicle user in the embodiments of the present application can be obtained through facial recognition technology. Specifically, the in-vehicle camera is activated to obtain a facial image of the vehicle user in the vehicle, and the facial recognition information of the vehicle user is obtained by recognizing the facial image through facial recognition software. It should be noted that the facial recognition software can be installed on the vehicle terminal or on the cloud platform.

[0099] The direction of interest of the vehicle user can be the direction mainly focused on in a certain period of time or a certain distance. The direction of interest of the vehicle user can be inferred from the facial recognition information.

[0100] In one embodiment, the facial recognition information of the vehicle user can include, but is not limited to, facial features, head movements, eye movements, and the like of the vehicle user.

[0101] Specifically, during driving, the device 120 for controlling the vehicle camera to generate a video can determine the direction of interest of the vehicle user by capturing and analyzing the facial features, head movements, eye movements, and the like of the user. After determining the direction of interest of the vehicle user, the device 120 for controlling the vehicle camera to generate a video checks whether the shooting direction of the vehicle camera that is selected to be activated is consistent with the direction of interest. In the case where the shooting direction of the vehicle camera that is selected to be activated is inconsistent with the direction of interest, a vehicle camera having a shooting direction consistent with the direction of interest is additionally selected to be activated to generate a video. In this way, the video content captured can be more consistent with the actual focus of the user, and the user experience is improved. By combining facial recognition information and driving information, the device can more comprehensively understand the vehicle state and the user state, so as to make a shooting mode selection more consistent with the user's expectation, which helps to improve the video quality and provide more personalized and considerate services for the user.

[0102] It should be noted that the above shooting mode requires the user to enable the facial recognition function option. The user can enable it through page operation or voice operation through the vehicle terminal or the user terminal 140.

[0103] The device 120 for controlling vehicle cameras to generate videos can not only adjust the shooting mode according to the vehicle driving information, but also has the function of generating panoramic videos. In some embodiments, the method for controlling vehicle cameras to generate videos further comprises: after obtaining the operation instruction of generating panoramic videos, entering the panoramic generation mode; in the panoramic generation mode, at least all vehicle exterior cameras are enabled to shoot videos of the vehicle exterior to generate multiple videos; and the multiple videos are spliced into a panoramic video by a video splicing algorithm.

[0104] In an embodiment of the present application, when the device 120 for controlling vehicle cameras to generate videos receives the operation instruction of generating panoramic videos during driving, it enters the panoramic generation mode. In the panoramic generation mode, the device 120 for controlling vehicle cameras to generate videos enables each vehicle exterior camera to shoot videos. Each camera generates an independent video, wherein each video captures the picture of the direction of the vehicle exterior. The device 120 for controlling vehicle cameras to generate videos splices the multiple videos into a panoramic video by a video splicing algorithm. Each frame of the panoramic video can be a coherent and complete picture spliced seamlessly from the videos.

[0105] In the above embodiment, by generating a panoramic video that comprehensively displays the environment outside the vehicle, the device 120 for controlling vehicle cameras to generate videos can provide the user with a wider field of view and help the user better record the scenery around the vehicle.

[0106] In an embodiment, in the panoramic generation mode, the device 120 for controlling vehicle cameras to generate videos can also enable the vehicle interior camera to shoot videos. In this way, the environment in the vehicle during driving can be recorded.

[0107] In addition, in the panoramic generation mode, at least all vehicle exterior cameras can be enabled to shoot videos of the vehicle exterior according to the corresponding shooting mode to generate multiple videos.

[0108] Specifically, after determining the shooting mode, the device 120 for controlling vehicle cameras to generate videos enables each vehicle camera to shoot videos according to the corresponding shooting mode, so as to ensure that each video meets the requirements of panoramic video generation while being adapted to various vehicle speed scenarios. This not only helps to improve the overall quality of the panoramic video, but also ensures that the connection and fusion between the videos are more natural and smooth.

[0109] In another aspect, the present application provides a device for controlling vehicle cameras to generate videos, which can be located at the vehicle end or at the cloud platform. Figure 4 FIG. 1 shows a structural schematic diagram of a device for controlling vehicle cameras to generate videos according to an embodiment of the present application. Figure 4As shown, the apparatus 400 can include the following modules:

[0110] An information obtaining module 410 configured to obtain driving information of the vehicle and preset matching information, wherein the driving information at least includes driving direction information and brake state information of the vehicle, and the preset matching information includes first matching information, the first matching information defining a matching relationship between the driving direction and / or brake state information of the vehicle and the corresponding vehicle camera.

[0111] A video generation control module 420 configured to select, according to the first matching information, a corresponding vehicle camera among the plurality of vehicle cameras to capture the outside or inside of the vehicle based on the driving direction and / or brake state information of the vehicle to generate a video.

[0112] In some embodiments, the driving information further includes driving speed information of the vehicle, and the preset matching information includes second matching information, wherein the second matching information defines a matching relationship between the driving speed information of the vehicle and a corresponding capturing mode, and the apparatus 400 further includes a capturing mode enabling module configured to select, according to the second matching information, a corresponding capturing mode among a plurality of capturing modes of the corresponding vehicle camera based on the driving speed information of the vehicle.

[0113] In some embodiments, the apparatus 400 further includes the following modules:

[0114] A face recognition information obtaining module configured to obtain face recognition information of a vehicle user in the vehicle; and

[0115] A direction of interest determining module configured to determine a direction of interest of the vehicle user based on the face recognition information.

[0116] The video generation control module is further configured to additionally select a vehicle camera having a capturing direction consistent with the direction of interest when the direction of interest is inconsistent with a capturing direction of the selected and enabled corresponding vehicle camera.

[0117] In some embodiments, the video generation control module is further configured to:

[0118] After obtaining an operation instruction to generate a panoramic video, control enters a panoramic generation mode;

[0119] In the panoramic generation mode, all vehicle exterior cameras are enabled to capture the outside of the vehicle to generate a plurality of videos.

[0120] The apparatus further comprises a video stitching module configured to stitch the plurality of videos into a panoramic video by a video stitching algorithm.

[0121] It should be understood that the specific features, operations and details described herein before with respect to the method of the present application can be similarly applied to the apparatus and system of the present application, or vice versa. In addition, each step of the method of the present application described above can be performed by a corresponding component or unit of the apparatus or system of the present application.

[0122] It should be understood that each module / unit of the apparatus of the present application can be implemented in whole or in part by software, hardware, firmware, or a combination thereof. Each module / unit can be embedded in a processor of the electronic device in hardware or firmware form, or independent of the processor, or stored in a memory of the electronic device in software form to be invoked by the processor to perform the operations of each module / unit. Each module / unit can be implemented as an independent component or module, or two or more modules / units can be implemented as a single component or module.

[0123] In yet another aspect of the present application, an electronic device is provided. Figure 5 A structural schematic diagram of an electronic device according to an embodiment of the present application is shown in FIG. 1. Figure 5 As shown, the electronic device 50 comprises a processor 51 and a memory 52 storing computer program instructions. When the processor 51 executes the computer program instructions, each step of the method for controlling a vehicle camera to generate a video described above is implemented. The electronic device 50 can be a server, a vehicle terminal, or any other electronic device with necessary computing and / or processing capability in a broad sense.

[0124] In an embodiment, the electronic device 50 can comprise a processor, a memory, a network interface, a communication interface, etc. connected by a system bus. The processor of the electronic device 50 can be configured to provide necessary computing, processing and / or control capability. The memory of the electronic device 50 can comprise a non-volatile storage medium and an internal memory. The non-volatile storage medium can store an operating system, a computer program, etc. The internal memory can provide an environment for running of the operating system and the computer program in the non-volatile storage medium. The network interface and the communication interface of the electronic device 50 can be configured to connect and communicate with external devices through a network. The computer program, when executed by the processor, performs the steps of the method for controlling a vehicle camera to generate a video of the present application.

[0125] In yet another aspect of the present application, a computer readable storage medium is provided, and the computer readable storage medium stores a computer executable program, wherein the computer executable program, when executed by a processor, implements the steps of the method for controlling a vehicle camera to generate a video described herein.

[0126] In yet another aspect, the present application provides a vehicle that can include a plurality of vehicle cameras and an apparatus for controlling video generation by the vehicle cameras according to the present application.

[0127] Those skilled in the art will appreciate that the steps of the methods of the present application can be directed to relevant hardware, such as electronic device 50 or a processor, by a computer program, which can be stored in a non-transitory computer-readable storage medium, which when executed causes the steps of the present application to be performed. Any reference herein to a memory, storage or other medium can include non-volatile or volatile storage, as the case can be. Examples of non-volatile storage include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, magnetic tape, floppy disk, magneto-optical data storage device, optical data storage device, hard disk, solid-state disk, and so forth. Examples of volatile storage include random-access memory (RAM), external cache memory, and so forth.

[0128] The technical features described above can be combined arbitrarily. Although not all possible combinations of the technical features are described, any combination of the technical features should be considered as encompassed by the present specification, as long as such a combination does not result in a contradiction.

[0129] Finally, it should be noted that the above-described embodiments are merely intended to illustrate the technical solutions of the present application, but not to limit the same; even though the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacements to some or all of the technical features; and such modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for controlling a vehicle camera to generate a video, characterized in that: The method comprises: obtaining driving information of a vehicle and preset matching information, wherein the driving information at least comprises driving direction information and brake state information of the vehicle, and the preset matching information comprises first matching information, the first matching information defining a matching relationship between the driving direction information and / or the brake state information of the vehicle and a corresponding vehicle camera enabled; and controlling, according to the first matching information, the corresponding vehicle camera enabled among a plurality of vehicle cameras to capture an outside or inside of the vehicle based on the driving direction information and / or the brake state information of the vehicle to generate a video.

2. The method of claim 1, wherein, The driving information further comprises driving speed information of the vehicle, and the preset matching information comprises second matching information, wherein the second matching information defines a matching relationship between the driving speed information of the vehicle and a corresponding shooting mode enabled, and the method further comprises: controlling, according to the second matching information, the corresponding shooting mode enabled among a plurality of shooting modes of the corresponding vehicle camera based on the driving speed information of the vehicle.

3. The method of claim 1, wherein, The method further comprises: obtaining face recognition information of a vehicle user inside the vehicle; determining a direction of interest of the vehicle user based on the face recognition information; and when the direction of interest of the vehicle user is inconsistent with a shooting direction of the corresponding vehicle camera enabled, additionally selecting a vehicle camera enabled having a shooting direction consistent with the direction of interest of the vehicle user.

4. The method of claim 1, wherein, The first matching information defines the matching relationship between the driving direction information and / or the brake state information of the vehicle and the corresponding vehicle camera enabled in the following manner: when the driving direction of the vehicle is a right-turn direction, a left-side vehicle camera is enabled; when the driving direction of the vehicle is a left-turn direction, a right-side vehicle camera is enabled; when the driving direction of the vehicle is a reverse direction, a rear-side vehicle camera is enabled; when the driving direction of the vehicle is a forward direction, a front-side vehicle camera is enabled; or when the vehicle is in a brake state, an in-vehicle camera is enabled. The second matching information defines the matching relationship between the driving speed information of the vehicle and the corresponding shooting mode enabled in the following manner:

5. The method of claim 2, wherein, when the driving state is an acceleration driving state, a time-lapse shooting mode is enabled; when the driving state is a deceleration driving state, a slow-motion shooting mode is enabled; when the driving state is a high-speed driving state, an A-times shooting mode is enabled, wherein A is greater than 1; when the driving state is a medium-speed driving state, a B-times shooting mode is enabled, wherein B is greater than 1 and less than A; when the driving state is a low-speed driving state, a normal shooting mode is enabled; or when the driving state is a brake state, a freeze shooting mode is enabled. The method further comprises:

6. The method according to any one of claims 1 to 5, characterized in that, after obtaining an operation instruction to generate a panoramic video, controlling to enter a panoramic generation mode; in the panoramic generation mode, enabling all vehicle exterior cameras to capture an outside of the vehicle to generate a plurality of videos; and splicing the plurality of videos into a panoramic video through a video splicing algorithm. The device comprises:

7. A device for controlling a vehicle camera to generate video, characterized in that: ​ an information obtaining module configured to obtain driving information of the vehicle and preset matching information, wherein the driving information at least includes driving direction information and brake state information of the vehicle, and the preset matching information includes first matching information, the first matching information defining a matching relationship between the driving direction information and / or the brake state information of the vehicle and enabling a corresponding vehicle camera; and a video generation control module configured to control, according to the first matching information, the corresponding vehicle camera among the plurality of vehicle cameras to capture the outside or inside of the vehicle based on the driving direction information and / or the brake state information of the vehicle to generate a video.

8. The apparatus of claim 7, wherein, The driving information further includes driving speed information of the vehicle, and the preset matching information includes second matching information, wherein the second matching information defines a matching relationship between the driving speed information of the vehicle and enabling a corresponding capturing mode, and the device further comprises: a capturing mode enabling module configured to select, according to the second matching information, a corresponding capturing mode among a plurality of capturing modes of the corresponding vehicle camera based on the driving speed information of the vehicle.

9. The apparatus of claim 7, wherein, The device further comprises: a face recognition information obtaining module configured to obtain face recognition information of a vehicle user in the vehicle; and a user interested direction determining module configured to determine an interested direction of the vehicle user based on the face recognition information. The video generation control module is further configured to additionally select a vehicle camera having a capturing direction consistent with the interested direction of the vehicle user when the interested direction of the vehicle user is inconsistent with a capturing direction of the selected enabled corresponding vehicle camera.

10. The apparatus of claim 7, wherein, The first matching information defines the matching relationship between the driving direction information and / or the brake state information of the vehicle and enabling the corresponding vehicle camera in the following manner: when the driving direction of the vehicle is a right-turn direction, enabling a left-side camera of the vehicle; when the driving direction of the vehicle is a left-turn direction, enabling a right-side camera of the vehicle; when the driving direction of the vehicle is a reverse direction, enabling a rear-side camera of the vehicle; when the driving direction of the vehicle is a forward direction, enabling a front-side camera of the vehicle; or when the vehicle is in a brake state, enabling an in-vehicle camera of the vehicle. The second matching information defines the matching relationship between the driving speed information of the vehicle and enabling the corresponding capturing mode in the following manner:

11. The apparatus of claim 8, wherein, when the driving state is an acceleration driving state, enabling a time-lapse capturing mode; when the driving state is a deceleration driving state, enabling a slow-motion capturing mode; when the driving state is a high-speed driving state, enabling an A-times speed capturing mode, wherein A is greater than 1; when the driving state is a medium-speed driving state, enabling a B-times speed capturing mode, wherein B is greater than 1 and less than A; when the driving state is a low-speed driving state, enabling a normal capturing mode; or when the driving state is a brake state, enabling a freeze-frame capturing mode.

12. The device of any one of claims 7-11, wherein the video generation control module is further configured to: ​ ​ After obtaining the operation instruction of generating the panoramic video, the control enters a panoramic generation mode, wherein in the panoramic generation mode, at least all vehicle exterior cameras are enabled to capture videos of the vehicle exterior to generate a plurality of videos; and The device further comprises a video stitching module configured to stitch the plurality of videos into a panoramic video by a video stitching algorithm.

13. A system for controlling video generation by a vehicle camera, the system comprising: The system at least comprises a cloud platform and the device for controlling vehicle cameras to generate videos according to any one of claims 7-12.

14. An electronic device, comprising: The electronic device comprises a processor and a memory storing computer program instructions, wherein the computer program instructions, when executed by the processor, implement the steps of the method for controlling vehicle cameras to generate videos according to any one of claims 1-6.

15. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer executable programs, wherein the computer executable programs, when executed by a processor, implement the steps of the method for controlling vehicle cameras to generate videos according to any one of claims 1-6.

16. A vehicle characterized by comprising: The system at least comprises a cloud platform and the device for controlling vehicle cameras to generate videos according to any one of claims 7-12. The electronic device comprises a processor and a memory storing computer program instructions, wherein the computer program instructions, when executed by the processor, implement the steps of the method for controlling vehicle cameras to generate videos according to any one of claims 1-6. The computer readable storage medium stores computer executable programs, wherein the computer executable programs, when executed by a processor, implement the steps of the method for controlling vehicle cameras to generate videos according to any one of claims 1-6. The system at least comprises a cloud platform and the device for controlling vehicle cameras to generate videos according to any one of claims 7-12.

Images