Electronic device for assisting driving to record images, image processing method and storage medium

Abstract

The invention discloses an electronic device for assisting driving to record images and an image processing method. In the electronic device, a panoramic photography unit is arranged on a traffic vehicle and is used for capturing an initial film, a positioning unit detects the real-time position of the traffic vehicle, a database stores scenic spot information including a plurality of scenic spot positions, and an intelligent processing unit receives the initial film and sends the initial film to the traffic vehicle. The user image and the scenic spot image to be locked at the scenic spot position are identified by artificial intelligence, the real-time position is received, the advancing direction is judged, the scenic spot information is read, and the view finding range of the traffic carrier entering the scenic spot position is judged according to the real-time position and the advancing direction; a time period within the viewing range is captured from the initial movie, and a recorded movie is cut according to the time period. The invention further provides a nonvolatile computer readable storage medium of the image processing method.

Description

Technical Field

[0001] The present application relates to a technology for assisting driving in recording images, and more particularly to an electronic device for assisting driving in recording images, an image processing method, and a non-volatile computer-readable storage medium. Background Art

[0002] Existing motorcycle riding experience services usually use general cameras (e.g., they can only shoot the front and rear driving route perspectives) for manual shooting or fixed route shooting. This method not only has limited shooting angles, but also cannot meet the recording needs of different riders. When a vehicle passes a scenic spot on the lane, due to the speed, road conditions, on-site conditions, and the rider's hands need to be focused on the motorcycle handlebars, the rider cannot manually shoot to freely record the passing scenery.

[0003] In addition, the existing motorcycle riding experience service uses a 360-degree panoramic camera mounted on a transportation vehicle to shoot. Although this method can obtain more shooting angles, such as shooting the scenery on both sides or behind the motorcycle, when using a 360-degree panoramic camera to shoot panoramic video images, the rider needs to post-edit the images after shooting. If the rider does not have the ability to post-edit the images, the obtained shooting images will be relatively bland.

[0004] Therefore, how to solve the above-mentioned problems of the prior art is the main focus of this application. Summary of the invention

[0005] To solve the above problems, the inventor provides an electronic device for assisting driving in recording images, an image processing method and a non-volatile computer-readable storage medium, which can automatically capture images during the riding process according to the user's pre-settings, and generate the best recorded video through artificial intelligence processing, thereby providing a more personalized riding experience service.

[0006] To achieve the above-mentioned purpose, the present application provides an electronic device for assisting driving and recording images, which is suitable for assisting users to record images during the use of a transportation vehicle, including: a panoramic camera unit, which is installed on the transportation vehicle to capture an initial video, and the initial video presents a panoramic image of the location of the transportation vehicle; a positioning unit, which is used to detect the real-time location of the transportation vehicle; a database, which stores scenic spot information, and the scenic spot information includes a plurality of scenic spot locations; and an intelligent processing unit, which is electrically connected to the panoramic camera unit to receive the initial video, and recognizes the user image and the scenic spot image to be locked at the scenic spot location by artificial intelligence; the intelligent processing unit is electrically connected to the positioning unit to receive the real-time location and determine the direction of travel; the intelligent processing unit is also electrically connected to the database to read the scenic spot information, and the intelligent processing unit determines the framing range of the transportation vehicle entering the scenic spot location according to the real-time location and the direction of travel, so as to capture the time period when the transportation vehicle is in the framing range from the initial video, and cut out a recorded video with the user image and the scenic spot image as the composition theme according to the time period.

[0007] In one embodiment, the intelligent processing unit includes an image capture module, which captures a first image area where the user image is located and a second image area where the scenic spot image is located from the initial video. The recorded video is a composite image that locks the first image area and the second image area, and only includes the user image when using the transportation vehicle and the scenic spot image.

[0008] In one embodiment, the intelligent processing unit includes an image post-production module, and the image post-production module automatically performs image post-production on the recorded video using artificial intelligence, and the image post-production includes scaling, position balancing and / or clutter removal.

[0009] In one embodiment, when the transportation vehicle enters the framing range and the user leaves the transportation vehicle, the image capture module uses artificial intelligence to identify the scenic spot image to be locked in the initial video, and simultaneously identifies and tracks the user image. When the user is in the framing position relative to the scenic spot image and meets the composition theme, the image corresponding to the current time in the initial video is automatically framed and a selected group photo is captured.

[0010] The present application further provides an electronic device for assisting driving in recording images, which is suitable for assisting users in recording images during the use of a transportation vehicle, comprising: a surround-view camera unit, which is installed on the transportation vehicle to capture an initial video, wherein the initial video presents a surround-view image of the location of the transportation vehicle; a positioning unit, which is used to detect the real-time location of the user when using the transportation vehicle; a database, which stores solar information, wherein the solar information includes sunrise time and / or sunset time; and an intelligent processing unit, which is electrically connected to the surround-view camera unit to receive the initial video, and recognizes the user image and the solar image of the sunrise and / or sunset by artificial intelligence; the intelligent processing unit is electrically connected to the positioning unit to receive the real-time location of the transportation vehicle and determine the direction of travel, and the intelligent processing unit is also electrically connected to the database to read the solar information, and the intelligent processing unit captures a time period of the time range from the initial video within the time range of the sunrise time and / or the sunset time according to the real-time location and the direction of travel of the transportation vehicle, and cuts out a recording video with the user image and the solar image as the theme according to the time period.

[0011] In one embodiment, the intelligent processing unit includes an image capture module, which captures a first image area where the user image is located and a second image area where the sun is located from the initial video. The recorded video is an image synthesis of the first image area and the second image area locked, and only includes the user image when using the transportation vehicle and the sun image.

[0012] In one embodiment, the intelligent processing unit includes an image post-production module, and the image post-production module automatically performs image post-production on the recorded video using artificial intelligence, and the image post-production includes scaling, position balancing and / or clutter removal.

[0013] In one embodiment, the solar information includes the position of the sun defined by an elevation angle and an azimuth angle, and the intelligent processing unit calculates the position of the sun in the initial video to obtain an image of the sun based on the elevation angle and the azimuth angle of the sun position within the time range of the sunrise time and / or the sunset time.

[0014] In one embodiment, the intelligent processing unit identifies the position of the sun in the initial video according to the brightness in the initial video within the time range of the sunrise time and / or the sunset time to obtain an image of the sun.

[0015] The present application further provides an image processing method for recording images for assisting driving, which is executed by an electronic device reading an executable code, and is suitable for assisting users in recording images during the use of a transportation vehicle, and includes the following steps: image capture: capturing an initial video, wherein the initial video presents a panoramic image of the location of the transportation vehicle; detection and positioning: detecting the real-time location of the transportation vehicle and determining the direction of travel; image recognition: using artificial intelligence to recognize the user image, and reading the scenic spot information of the scenic spot location from a database to identify the scenic spot image to be locked at the scenic spot location; and generating a recorded video: judging the framing range of the transportation vehicle entering the scenic spot location based on the real-time location and the direction of travel, to capture the time period when the transportation vehicle is in the framing range from the initial video, and cutting out a recorded video with the user image and the scenic spot image as the composition theme based on the time period.

[0016] In one embodiment, in the step of generating a recorded video, a first image area where the user image is located is captured from the initial video, and a second image area where the scenic spot image is located is captured. The recorded video is an image synthesis of the first image area and the second image area locked, and only includes the user image when using the transportation vehicle, and the scenic spot image.

[0017] In one embodiment, when the transportation vehicle enters the framing range and the user leaves the transportation vehicle, the image recognition step includes using artificial intelligence to identify the scenic spot image to be locked in the initial video, and simultaneously identifying and tracking the user image. When the user is in a framing position relative to the scenic spot image and meets the composition theme, the image corresponding to the current time in the initial video is automatically framed and a selected group photo is captured.

[0018] The present application further provides an image processing method for recording images for assisting driving, which is executed by an electronic device reading an executable code, and is suitable for assisting users in recording images during the use of a transportation vehicle, and includes the following steps: image capture: capturing an initial video, wherein the initial video presents a panoramic image of the location of the transportation vehicle; detection and positioning: detecting the real-time location of the transportation vehicle and determining the direction of travel; image recognition: using artificial intelligence to recognize user images, and reading solar information including sunrise time and / or sunset time from a database to recognize the solar image of the sun at sunrise and / or sunset; and generating a recorded video: within the time range of the sunrise time and / or the sunset time, capturing a time period of the time range from the initial video, and cutting out a recorded video with the user image and the solar image as the theme according to the time period.

[0019] In one embodiment, in the step of generating a recorded video, a first image area where the user image is located and a second image area where the sun is located are captured from the initial video. The recorded video is a composite image that locks the first image area and the second image area, and only includes the user image when using the transportation vehicle and the sun image.

[0020] In one embodiment, the solar information includes the solar position defined by an elevation angle and an azimuth angle. In the image recognition step, within the time range of the sunrise time and / or the sunset time, the position of the sun in the initial video is calculated based on the elevation angle and the azimuth angle of the solar position to obtain an image of the sun.

[0021] In one embodiment, in the image recognition step, within the time range of the sunrise time and / or the sunset time, the position of the sun in the initial video is identified according to the brightness in the initial video to obtain an image of the sun.

[0022] The present application further provides a non-volatile computer-readable storage medium for the above method, which stores a plurality of executable code programs, so that an electronic device reads the executable code and executes the above method.

[0023] Thus, the electronic device of the present application can meet the recording needs of different users by executing the image processing method, and can freely record the scenery passed by the user according to the default scenic spot information, thereby providing the user with personalized riding experience services, and automatically post-produce the recorded video with artificial intelligence through the image post-production module, so as to achieve the effect of obtaining a more complete and rich best picture. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to further understand the features and technical contents of this application, please refer to the following detailed description and drawings of this application. It should be understood that the drawings provided are only for reference and description, and are not used to limit this application.

[0025] Figure 1 It is a system block diagram of an electronic device for assisting driving and recording images according to a specific embodiment of the present application.

[0026] Figure 2 It is a flowchart of the image processing method of the assisted driving recorded image according to a specific embodiment of the present application.

[0027] Figure 3a to Figure 3b It is a schematic diagram of the configuration and shooting of the electronic device and the transportation vehicle of the present application.

[0028] Figure 4It is a schematic diagram of the viewing range of a transportation vehicle passing through a scenic spot according to the first embodiment of the present application.

[0029] Figure 5 It is a schematic diagram of an initial video captured by the electronic device when a transportation vehicle enters the viewing range according to the first embodiment of the present application.

[0030] Figure 6a to Figure 6b It is a schematic diagram of a recording video cut out by an electronic device according to the first embodiment of the present application with a user image and a scenic spot image as the composition theme.

[0031] Figures 7a to 7c Shown is a schematic diagram of a selected group photo generated by an electronic device according to the second embodiment of the present application.

[0032] Figure 8a to Figure 8b It is a schematic diagram of a recording video of the rising sun cut out by the electronic device according to the third embodiment of the present application, which takes the user image and the sun image as the composition subjects.

[0033] Figure 9a to Figure 9b This is another schematic diagram of the electronic device cutting out a recorded video with the user image and the sun image as the composition subjects and the sun setting in the third embodiment of the present application.

[0034] Figure 10a to Figure 10b This is another schematic diagram of the electronic device according to the third embodiment of the present application cutting out a recorded video with the user image and the sun image as the composition subject and the sun rising.

[0035] Figure 11a to Figure 11b This is another schematic diagram of the electronic device according to the third embodiment of the present application cutting out a recorded video with the user image and the sun image as the composition subject and the sun setting. DETAILED DESCRIPTION

[0036] In order to fully understand the purpose, features and effects of the present application, the present application is described in detail by referring to the following specific embodiments and the accompanying drawings. The description is as follows:

[0037] Please refer to Figures 1 to 11b , the present application provides an electronic device 100 for assisting driving in recording images, an image processing method 200, and a non-volatile computer-readable storage medium. The transportation vehicle T described below is mainly illustrated by a land vehicle (car and / or motorcycle), but the present application is not limited to this. Furthermore, the electronic device 100 of the present application has a transmission function for transmitting the recorded video 10 to the outside, and can transmit the recorded video 10 to the terminal device 300. Furthermore, the transportation vehicles T referred to in the following embodiments are all equipped with an electronic device 100 and capable of executing the image processing method 200.

[0038] The terminal device 300 may be a device that can communicate with the electronic device 100 via the Internet in a wired or wireless manner, such as a smart phone, a tablet computer, or a laptop computer. The terminal device 300 is equipped with an application 301, and the terminal device 300 executes the application 301 to communicate with the electronic device 100. When the terminal device 300 executes the application 301, a user interface 302 is provided, and a user can execute the above-mentioned image processing method 200 through the user interface 302.

[0039] The electronic device 100 is suitable for assisting the user to record images during the use of the transportation vehicle T (including taking photos when getting off the vehicle, not limited to when driving), and includes a surround-view camera unit 1, a positioning unit 2, a database 3, and an intelligent processing unit 4. Figure 3a , 3b As shown, the panoramic photography unit 1 is, for example, a fisheye camera capable of 360-degree panoramic photography, and has a telescopic component 12 with adjustable height (see FIG. Figure 3a ) and is installed on the faucet T1 of the transportation vehicle T (but not limited to this, it can also be installed at the rear of the vehicle). The telescopic component 12 can be used to increase the height of the lens of the surround-view camera unit 1, and can change the viewing angle position of the surround-view camera unit 1 and the height of the scene being photographed. The user can adjust the lens height through the telescopic component 12 when needed. The surround-view camera unit 1 is installed on the transportation vehicle T to capture the initial video 11 (see Figure 5 ). The initial video 11 is the original data (Raw Data) and the initial video 11 presents a panoramic image of the location of the transportation vehicle T. The positioning unit 2 is used to detect the real-time location 21 of the transportation vehicle T. The database 3 stores scenic spot information 31, and the scenic spot information 31 includes multiple scenic spot locations (such as a user's default scenic spot list). The database 3 and the intelligent processing unit 4 can be located locally or in the cloud. The database 3 can be a cloud database and / or a local database, and the intelligent processing unit 4 can be a cloud server and / or a local server. Here, the database 3 and the intelligent processing unit 4 are located in the cloud as an example, but the present application is not limited to this.

[0040] The positioning unit 2 is, for example, a global positioning system (GPS) that can obtain direction and speed, but the present application is not limited thereto. The positioning unit 2 also includes, for example, a six-axis sensor, an electric motor output sensor, a (steering column) steering sensor, and a wireless communication module (5G) (used to assist GPS). The six-axis sensor is used to determine the driving direction and speed of the vehicle. The electric motor output sensor is used to determine the acceleration of the vehicle. The steering column steering sensor is used to determine the steering angle of the vehicle. The wireless communication module is used to transmit images and data to a cloud database.

[0041] The intelligent processing unit 4 is electrically connected to the panoramic photography unit 1 to receive the initial video 11, and uses artificial intelligence (AI) to identify the user image UI in the initial video 11 (for example, using AI to identify the user's image), and identifies the scenic spot image IM to be locked at the scenic spot position P1 (for example, the image of Yushan). The intelligent processing unit 4 is electrically connected to the positioning unit 2 to receive the real-time position 21 and determine the direction of travel. The intelligent processing unit 4 is also electrically connected to the database 3 to read the scenic spot information 31, and determines the traffic vehicle T entering the viewing range R1 of the scenic spot position P1 according to the real-time position 21 and the direction of travel (see Figure 4 ), to capture the time period when the vehicle T is in the viewing range R1 from the initial video 11 (see Figure 5 ), and cut out a recording video 10 with the user image UI and the scenic spot image IM as the composition theme according to the time period (see Figure 6a , or for example, selected videos of the user riding and popular attractions), and transmit the recorded video 10 to the terminal device 300 for the user to watch. It should be noted that the way to cut out the recorded video 10 can be obtained by executing the executable code by the intelligent processing unit 4, and there is no restriction that it must be processed by artificial intelligence.

[0042] The intelligent processing unit 4 includes an image capture module 41, an image post-production module 42, and an operation interface module 43. The image capture module 41 captures the first image area Ia1 where the user image UI is located, and the second image area Ia2 where the scenic spot image IM is located from the initial video 11. The recorded video 10 is a composite image that locks the first image area Ia1 and the second image area Ia2, and only includes the user image UI when using the transportation vehicle T, and the scenic spot image IM. The image post-production module 42 automatically performs image post-production on the recorded video 10 using artificial intelligence, and the image post-production includes scaling, position balance (such as Figure 6a-6b ) and / or noise removal to produce Figure 6b The recorded video 10 is shown. The operation interface module 43 is used to provide consumers with the ability to activate / subscribe / view personalized riding experience services and vehicle control.

[0043] like Figure 2As shown, the image processing method 200 includes image capture: the panoramic photography unit 1 captures the initial video 11 (step S11); detection and positioning: the positioning unit 2 detects the real-time position 21 of the transportation vehicle T and determines the direction of travel (step S12); image recognition: the intelligent processing unit 4 recognizes the user image UI with artificial intelligence, and reads the scenic spot information 31 of the scenic spot position from the database 3 to identify the scenic spot image IM to be locked at the scenic spot position P1 (step S13); and generates a recorded video: the intelligent processing unit 4 determines the viewing range R1 of the transportation vehicle T entering the scenic spot position P1 according to the real-time position 21 and the direction of travel, so as to capture the time period when the transportation vehicle T is in the viewing range R1 from the initial video 11, and cuts out the recorded video 10 with the user image UI and the scenic spot image IM as the composition theme according to the time period (step S14). The image processing method 200 is executed by the electronic device 100 reading a plurality of executable codes. In one embodiment, the plurality of executable codes may be stored in a non-volatile computer-readable storage medium, so that the electronic device 100 reads the executable codes from the non-volatile computer-readable storage medium and then executes the operation of generating the recorded video 10.

[0044] According to the above-mentioned implementation mode of the present application, the specific embodiments are described below:

[0045] like Figure 4 , Figure 5 , Figure 6a , Figure 6b As shown, it is a schematic diagram of the electronic device 100 executing the image processing method 200 to generate a recorded video 10 according to the first embodiment of the present application. The panoramic photography unit 1 captures the initial video 11, and the intelligent processing unit 4 determines whether the transportation vehicle T enters the viewing range R1 of the scenic spot position P1 according to the real-time position 21 and the direction of travel. Then, when it is determined to be yes (for example, the real-time position 21 meets the scenic spot position P1 in the scenic spot information 31 set by the user, and the direction of travel is towards this scenic spot position P1), the image capture module 41 captures the time period (the preset time period set by the user) when the transportation vehicle T is in the viewing range R1 from the initial video 11, and cuts out the recorded video 10 with the user image UI and the scenic spot image IM as the composition theme from the time period of the initial video 11. Specifically, the above-mentioned action is that the intelligent processing unit 4 recognizes the user image UI and the scenic spot image IM to be locked at the scenic spot position P1 by artificial intelligence, and then the image capture module 41 captures the first image area Ia1 where the user image UI is located and the second image area Ia2 where the scenic spot image IM is located from the initial video 11, and generates a composite image based on the images of the first image area Ia1 and the second image area Ia2 (see Figure 6a) as the recorded video 10. Finally, the image post-production module 42 automatically performs image post-production on the recorded video 10 using artificial intelligence, for example Figure 6a The recorded film 10 shown is moved upward to produce the following Figure 6b The post-processed recorded video 10 shown in the figure can provide users with a more complete and rich best picture framing. In addition, the image processing method 200 determines whether to perform video capture based on the scenic spot information 31 pre-set by different users, so as to meet the recording needs of different users and provide users with personalized riding experience services.

[0046] like Figure 7a , Figure 7b , Figure 7c As shown, the electronic device of the second embodiment of the present application (see Figure 1 ) performs the image processing method 200 (see Figure 2 ) is a schematic diagram of generating a selected group photo 112. The panoramic photography unit 1 captures the initial video 11, and the intelligent processing unit 4 determines whether the transportation vehicle T enters the framing range R1 of the scenic spot position P1 according to the real-time position 21 and the direction of travel. Then, when it is determined to be yes and the user leaves the transportation vehicle T (for example, the intelligent processing unit 4 recognizes that the user leaves the transportation vehicle T in the initial video 11 using artificial intelligence), the image capture module 41 recognizes the scenic spot image IM to be locked in the initial video 11 through artificial intelligence, and simultaneously recognizes and tracks the user image UI. When the user is in the framing position relative to the scenic spot image IM and meets the composition theme, the image corresponding to the current time in the initial video 11 is automatically framed and the selected group photo 112 (such as a selected video or photo of the user getting off the bus and taking a photo with the scenic spot) is captured.

[0047] It should be noted that the image capture module 41 can automatically recognize the user's face through artificial intelligence (for example, using a deep learning model), and according to the area where the user is standing and the relative position to the scenic spot, the intelligent processing unit 4 calculates the best framing angle to control the panoramic photography unit 1 to shoot, so that the selected group photo 112 captured by the image capture module 41 from the initial video 11 has the best framing. In addition, if there are too many passers-by or other objects unrelated to the user himself or the scenic spot in the background of the initial video 11, the image post-production module 42 will automatically perform image post-production on the image corresponding to the current time in the initial video 11 with artificial intelligence, and the image post-production includes optimizing the image quality and removing clutter, so that the selected group photo 112 has the best picture, thereby providing users with a richer scenic spot fixed-point shooting and group photo experience service.

[0048] The configuration of the electronic device of the third embodiment of the present application is Figure 1 The electronic device 100 is the same as that of FIG. Figure 1. The third embodiment is similar to the first embodiment, and the difference between the electronic device 100 of the third embodiment and the first embodiment is that the positioning unit 2 is used to detect the real-time position 21 of the user when using the transportation vehicle T. The database 3 stores solar information (not shown), and the solar information includes sunrise time and / or sunset time. The intelligent processing unit 4 receives the initial video 11, and uses artificial intelligence to identify the user image UI (i.e., user image), and the solar image Si of the sunrise and / or sunset. The intelligent processing unit 4 is electrically connected to the database 3 to read the solar information, and according to the real-time position 21 and the direction of travel of the transportation vehicle T, within the time range of the sunrise time and / or sunset time (i.e., the process time of sunrise and / or sunset), the time period of this time range is captured from the initial video 11, and a recording video 10 with the user image UI and the solar image Si as the theme is cut out according to this time period. The recording video 10 is a selected video of the user riding and sunrise / sunset.

[0049] like Figure 2 As shown, the electronic device 100 of the third embodiment of the present application executes the image processing method 200 to generate the recording video 10, including image capture: the panoramic photography unit 1 captures the initial video 11 (step S11); detection and positioning: the positioning unit 2 detects the real-time position 21 of the traffic vehicle T and determines the direction of travel (step S12); image recognition: the intelligent processing unit 4 recognizes the user image UI with artificial intelligence, and reads the sun information including the sunrise time and / or sunset time from the database 3 to recognize the sun image Si at sunrise and / or sunset (step S13); and generates the recording video: the intelligent processing unit 4 captures the time period of the time range from the initial video 11 within the time range of the sunrise time and / or sunset time, and cuts out the recording video 10 with the user image UI and the sun image Si as the theme according to the time period (step S14).

[0050] According to the above-mentioned implementation mode of the present application, the specific embodiments are described below:

[0051] like Figure 8a , 8b As shown, the electronic device 100 of the third embodiment of the present application (see Figure 1 ) performs the image processing method 200 (see Figure 2 ) is a schematic diagram of generating a recording film 10. In the third embodiment and the first embodiment, similar component names or terms are used in Figure 8a , 8bThe same symbols are used to represent them. The panoramic photography unit 1 captures the initial video 11, and the positioning unit 2 detects the real-time position 21 of the traffic vehicle T and determines the direction of travel (such as determining the driving direction and speed of the traffic vehicle T through the global positioning system, and using a six-axis sensor to make the driving direction and speed more accurate). Then, the intelligent processing unit 4 uses artificial intelligence to recognize the user image UI in the initial video 11, and recognizes that the sun is the sun image Si at sunrise based on the sun information. In detail, the sun information includes the sun position defined by the elevation angle and the azimuth angle, which is the sun rising position. The intelligent processing unit 4 calculates the position of the sun in the initial video 11 within the time range of the sunrise time based on the elevation angle and the azimuth angle of the sun position to obtain the sun image Si at the time of sun rising. Then, the intelligent processing unit 4 captures a time period of the time range from the initial video 11 within the time range of sunrise time according to the real-time position 21 and the travel direction (from south to north) of the transportation vehicle T. The image capture module 41 captures the first image area Ia1 where the user image UI is located and the second image area Ia2 where the sun image Si is located from the initial video 11 during the time period, and performs image synthesis based on the images of the first image area Ia1 and the second image area Ia2 (see FIG. Figure 8b ) as the recording video 10, so that the recording video 10 only includes the user image UI when using the transportation vehicle T (including Figure 8a and Figure 8b The road, trees and mountains shown), and the sunrise sun image Si (including Figure 8a and Figure 8b Finally, the image post-production module 42 automatically performs image post-production on the recorded video 10 using artificial intelligence, and the image post-production includes scaling, position balancing and / or clutter removal, so that the user can obtain a more complete and rich best picture framing.

[0052] like Figure 9a , 9b As shown, the electronic device 100 of the third embodiment of the present application (see Figure 1 ) performs the image processing method 200 (see Figure 2 ) is another schematic diagram of generating the recording video 10. Figure 9a , 9b and Figure 8a , 8bThe difference is that the sun information includes the sun position defined by the elevation angle and the azimuth angle, which is the sun setting position. The intelligent processing unit 4 calculates the sun position in the initial video 11 within the time range of sunset time according to the elevation angle and the azimuth angle of the sun position to obtain the sun image Si when the sun sets. Then, the intelligent processing unit 4 captures the time period of the time range from the initial video 11 within the time range of sunset time according to the real-time position 21 and the direction of travel (from north to south) of the transportation vehicle T, and then the image capture module 41 cuts out the recording video 10 with the user image UI and the sun image Si (sunset) as the theme from the time period, which can be used for the image post-production module 42 to perform image post-production processing.

[0053] It should be noted that the method by which the intelligent processing unit 4 obtains the solar image Si is not limited to based on solar information. In other embodiments, the intelligent processing unit 4 may identify the position of the sun in the initial video 11 according to the brightness in the initial video 11 (e.g., the sun may be identified by the brightness in the image) within the time range of sunrise or sunset to obtain the solar image Si.

[0054] like Fig.10a , 10b As shown, the electronic device 100 of the third embodiment of the present application (see Figure 1 ) performs the image processing method 200 (see Figure 2 ) is another schematic diagram of generating a recorded video 10. The positioning unit 2 detects the real-time position 21 of the vehicle T and determines the travel direction (such as determining the driving direction and speed of the vehicle T through a six-axis sensor) as from west to east towards the sunrise. At this time, the image capture module 41 cuts out the recorded video 10 with the user image UI and the sun image Si as the theme from the said time period, the user image UI is located at the bottom of the recorded video 10, and the sun image Si is located at the top of the recorded video 10. Fig.11a , 11b As shown, the electronic device 100 of the third embodiment of the present application (see Figure 1 ) performs the image processing method 200 (see Figure 2 ) is another schematic diagram of generating a recorded video 10. The positioning unit 2 detects the real-time position 21 of the vehicle T and determines that the moving direction is from east to west towards the sunset. At this time, the image capture module 41 cuts out the recorded video 10 with the user image UI and the sun image Si as the theme from the time period, the user image UI is located at the upper part of the recorded video 10, and the sun image Si is located at the lower part of the recorded video 10. In this way, the user can further understand the positional relationship between himself and the sun through the recorded video 10.

[0055] It is not difficult to find from the above description that the feature of the present application is that when the user is driving the transportation vehicle T, through the execution of the electronic device 100 of the present application and the image processing method 200, a recording video 10 can be automatically captured from the initial video 11. For example, in the scenario of riding the transportation vehicle T passing the scenic spot location P1 as described in the first embodiment, the process of the user passing the scenic spot location P1 can be automatically cut out from the initial video 11 according to the scenic spot information 31 pre-set by the user to obtain a recording video 10 with the user image UI and the scenic spot image IM as the composition theme; or in the scenario of sunrise and sunset as described in the third embodiment, the sun image Si can be obtained according to the sun information or the image brightness information, and the user image UI and the sun image Si are locked in the initial video 11, and the recording video 10 is automatically cut out, thereby recording the process of the user riding the transportation vehicle T accompanied by the sun rising or setting. Therefore, the recording video 10 is automatically generated by the electronic device 100 executing the image processing method 200. The user does not need to edit and post-produce the initial video 11 by himself. The user can meet the needs of riding recording during the riding experience, so as to provide personalized services for the user's riding experience recording.

[0056] In addition, as described in the first, second and third embodiments, the image post-production module 42 automatically performs image post-production on the recorded video 10 using artificial intelligence, so that the user can obtain a more complete and rich best picture.

[0057] Furthermore, the electronic device 100 of the present application executes the image processing method 200, and in the scenario where the user leaves the transportation vehicle T as described in the second embodiment, the intelligent processing unit 4 can also calculate the best framing angle between the user and the scenic spot, and then automatically frame the image corresponding to the current time in the initial video 11, so that the image capture module 41 captures the selected group photo 112 with the best framing from the initial video 11. Therefore, when the user leaves the transportation vehicle T and wants to take a fixed-point photo at the scenic spot, the electronic device 100 and the image processing method 200 of the present application can automatically provide a group photo experience service with rich composition.

[0058] The present application has been described above with preferred embodiments, but it should be understood by those skilled in the art that the embodiments are only used to describe the present application and should not be interpreted as limiting the scope of the present application. It should be noted that any changes and substitutions equivalent to the embodiments should be included in the scope of the present application. Therefore, the scope of protection of the present application shall be based on the scope defined in the claims.

Claims

1. An electronic device for assisting driving and recording images, suitable for assisting a user in recording images during the use of a transportation vehicle, characterized in that: include: A surround camera unit installed on the transport vehicle for capturing an initial video, wherein the initial video presents a surround image of the location of the transport vehicle; A positioning unit, which is used to detect the real-time position of the vehicle; A database storing scenic spot information, wherein the scenic spot information includes a plurality of scenic spot locations; as well as An intelligent processing unit is electrically connected to the surround-view photography unit to receive the initial video, and recognizes the user image and the scenic spot image to be locked at the scenic spot location by artificial intelligence; the intelligent processing unit is electrically connected to the positioning unit to receive the real-time position and determine the direction of travel; the intelligent processing unit is also electrically connected to the database to read the scenic spot information, and the intelligent processing unit determines the viewing range of the transportation vehicle entering the scenic spot location according to the real-time position and the direction of travel, so as to capture the time period when the transportation vehicle is in the viewing range from the initial video, and cut out a recording video with the user image and the scenic spot image as the composition theme according to the time period.

2. The electronic device for assisting driving and recording images according to claim 1, characterized in that: The intelligent processing unit includes an image capture module, which captures a first image area where the user image is located and a second image area where the scenic spot image is located from the initial video. The recorded video is a composite image that locks the first image area and the second image area, and only includes the user image when using the transportation vehicle and the scenic spot image.

3. The electronic device for assisting driving and recording images according to claim 2, characterized in that: The intelligent processing unit includes an image post-production module, and the image post-production module automatically performs image post-production on the recorded video using artificial intelligence. The image post-production includes scaling, position balancing and / or clutter removal.

4. The electronic device for assisting driving and recording images according to claim 1, characterized in that: When the vehicle enters the framing range and the user leaves the vehicle, the image capture module uses artificial intelligence to identify the image of the scenic spot to be locked in the initial video, and simultaneously identifies and tracks the user image. When the user is in the framing position relative to the scenic spot image and meets the composition theme, the image corresponding to the current time in the initial video is automatically framed and a selected group photo is captured.

5. An electronic device for assisting driving and recording images, suitable for assisting users in recording images during the use of a transportation vehicle, characterized in that: include: A surround camera unit installed on the transport vehicle for capturing an initial video, wherein the initial video presents a surround image of the location of the transport vehicle; A positioning unit, which is used to detect the real-time position of the user when using the transportation vehicle; A database storing solar information, wherein the solar information includes sunrise time and / or sunset time; as well as An intelligent processing unit is electrically connected to the surround-view photography unit to receive the initial video, and uses artificial intelligence to recognize the user image and the sun image of sunrise and / or sunset; the intelligent processing unit is electrically connected to the positioning unit to receive the real-time position of the transportation vehicle and determine the direction of travel, and the intelligent processing unit is also electrically connected to the database to read the sun information. The intelligent processing unit captures the time period of the time range from the initial video within the time range of the sunrise time and / or the sunset time according to the real-time position of the transportation vehicle and the direction of travel, and cuts out a recording video with the user image and the sun image as the theme according to the time period.

6. The electronic device for assisting driving and recording images according to claim 5, characterized in that: The intelligent processing unit includes an image capture module, which captures a first image area where the user image is located and a second image area where the sun is located from the initial video. The recorded video is an image synthesis that locks the first image area and the second image area, and only includes the user image when using the transportation vehicle and the sun image.

7. The electronic device for assisting driving and recording images according to claim 6, characterized in that: The intelligent processing unit includes an image post-production module, and the image post-production module automatically performs image post-production on the recorded video using artificial intelligence. The image post-production includes scaling, position balancing and / or clutter removal.

8. The electronic device for assisting driving and recording images according to claim 5, characterized in that: The solar information includes the solar position defined by an elevation angle and an azimuth angle. The intelligent processing unit calculates the position of the sun in the initial video within the time range of the sunrise time and / or the sunset time based on the elevation angle and the azimuth angle of the solar position to obtain an image of the sun.

9. The electronic device for assisting driving and recording images according to claim 5, characterized in that: The intelligent processing unit identifies the position of the sun in the initial video according to the brightness in the initial video within the time range of the sunrise time and / or the sunset time to obtain an image of the sun.

10. An image processing method for assisting driving recording images, which is executed by an electronic device reading an executable code, and is suitable for assisting a user to record images during the use of a transportation vehicle, characterized in that: The following steps are involved: Image capture: capturing an initial video, wherein the initial video presents a panoramic image of the location of the transportation vehicle; Detection and positioning: detect the real-time position of the vehicle and determine the direction of travel; Image recognition: using artificial intelligence to recognize the user's image and read the scenic spot information of the scenic spot location from the database to identify the scenic spot image to be locked at the scenic spot location; as well as Generate a recorded video: determine the viewing range of the vehicle entering the scenic spot based on the real-time position and the direction of travel, capture the time period when the vehicle is in the viewing range from the initial video, and cut out a recorded video with the user image and the scenic spot image as the composition theme based on the time period.

11. The image processing method according to claim 10, characterized in that: In the step of generating the recorded video, the first image area where the user image is located is captured from the initial video, and the second image area where the scenic spot image is located is captured. The recorded video is an image synthesis of the first image area and the second image area, and only includes the user image when using the transportation vehicle, and the scenic spot image.

12. The image processing method according to claim 11, characterized in that: When the transportation vehicle enters the framing range and the user leaves the transportation vehicle, the image recognition step includes using artificial intelligence to identify the image of the scenic spot to be locked in the initial video, and simultaneously identifying and tracking the user image. When the user is in the framing position relative to the scenic spot image and meets the composition theme, the image corresponding to the current time in the initial video is automatically framed and a selected group photo is captured.

13. An image processing method for assisting driving recording images, which is executed by an electronic device reading an executable code, and is suitable for assisting a user to record images during the use of a transportation vehicle, characterized in that: The following steps are involved: Image capture: capturing an initial video, wherein the initial video presents a panoramic image of the location of the transportation vehicle; Detection and positioning: detect the real-time position of the vehicle and determine the direction of travel; Image recognition: using artificial intelligence to recognize user images and read solar information including sunrise time and / or sunset time from a database to recognize solar images of the sun at sunrise and / or sunset; and Generate a recorded video: within the time range of the sunrise time and / or the sunset time, extract a time period of the time range from the initial video, and cut out a recorded video with the user image and the sun image as the theme according to the time period.

14. The image processing method according to claim 13, characterized in that: In the step of generating the recorded video, a first image area where the user image is located and a second image area where the sun is located are captured from the initial video. The recorded video is a composite image that locks the first image area and the second image area, and only includes the user image when using the transportation vehicle and the sun image.

15. The image processing method according to claim 13, characterized in that: The solar information includes the solar position defined by an elevation angle and an azimuth angle. In the image recognition step, within the time range of the sunrise time and / or the sunset time, the position of the sun in the initial video is calculated based on the elevation angle and the azimuth angle of the solar position to obtain an image of the sun.

16. The image processing method according to claim 13, characterized in that: In the image recognition step, within the time range of the sunrise time and / or the sunset time, the position of the sun in the initial video is recognized according to the brightness in the initial video to obtain an image of the sun.

17. A non-volatile computer-readable storage medium, characterized in that: The program stores a plurality of executable codes, so that the electronic device reads the executable codes and executes the method according to claim 10 or 13.

Images