Vehicle-mounted terminal and image capture method

Abstract

The present disclosure provides a vehicle-mounted terminal and an image capture method, for use in controlling a photography region of a vehicle-mounted terminal by means of a mobile terminal, and using a camera unit of the vehicle-mounted terminal to photograph a scene corresponding to the photography region, thereby providing a convenient and easy-to-operate vehicle-mounted terminal capture function. The vehicle-mounted terminal comprises a display unit and a control circuit. The control circuit comprises a processor and a memory. The memory is used for storing a program executable by the processor. The processor is used for reading the program in the memory and executing the following steps: on the basis of a video frame collected by at least one camera unit, generating an original video frame (2300); receiving region information sent by a mobile terminal, the region information representing at least a portion of an original image region corresponding to the original video frame, and the mobile terminal being communicationally connected to the vehicle-mounted terminal (2301); and determining a first target image on the basis of the region information (2302).

Description

Vehicle terminal and image shooting method TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of human-computer interaction, and in particular to a vehicle terminal and an image shooting method. BACKGROUND

[0002] The intelligent vehicle terminal has multiple functions, including but not limited to shooting function, vehicle communication, vehicle remote control, vehicle diagnosis and fault detection, energy management, driving assistance system, vehicle networking service, etc. The shooting function of the vehicle intelligent terminal mainly includes GPS navigation, voice recognition and voice control, reversing image and video monitoring, driving record, etc. These functions provide drivers with more convenient and safe driving experience by integrating advanced technologies.

[0003] The reversing image and video monitoring can capture the situation around the vehicle through the cameras installed on the front, back and sides of the vehicle, helping the driver to avoid collision when reversing or parking, and improving the driving safety. The driving record can record the video and sound during the vehicle driving process, which is used for accident evidence and safety monitoring, and provides evidence for handling traffic accidents. In addition, some high-end vehicle intelligent terminals also support face recognition, abnormal behavior detection and other advanced functions.

[0004] However, the above functions mainly provide the convenience of driving and enhance the driving safety. However, there may be a need to shoot the scenery outside the vehicle when driving the vehicle. Usually, when encountering beautiful scenery that needs to be photographed, the user needs to get off the vehicle and use the mobile phone to take pictures. When encountering a situation that cannot be stopped during driving, it cannot meet the better shooting needs, which affects the driving experience of the user.

[0005] SUMMARY

[0006] The present disclosure provides a vehicle terminal and an image shooting method, which are used to control the shooting area of the vehicle terminal by the mobile terminal, shoot the scene corresponding to the shooting area by the camera unit of the vehicle terminal, and provide convenient and easy-to-operate shooting function of the vehicle terminal.

[0007] In a first aspect, the embodiments of the present disclosure provide a vehicle terminal, which comprises a display unit and a control circuit, wherein:

[0008] The control circuit comprises a processor and a memory, the memory is used to store programs executable by the processor, and the processor is used to read the programs in the memory and perform the following steps:

[0009] According to the video frame collected by at least one camera unit, an original video frame is generated;

[0010] receive area information sent by a mobile terminal, the area information indicating at least part of an original picture area corresponding to an original video frame, the mobile terminal having a communication connection with the vehicle-mounted terminal;

[0011] determine a first target image according to the area information.

[0012] In a second aspect, the embodiments of the present disclosure provide a vehicle-mounted terminal, comprising a display unit and a control circuit, wherein:

[0013] The control circuit comprises a processor and a memory, the memory being configured to store programs executable by the processor, and the processor being configured to read the programs in the memory and perform the following steps:

[0014] generate an original video frame according to a video frame collected by at least one camera unit;

[0015] receive area information sent by a mobile terminal, the area information indicating at least part of an original picture area corresponding to an original video frame, the mobile terminal having a communication connection with the vehicle-mounted terminal;

[0016] determine a target video frame in the original video frame according to the area information;

[0017] send the target video frame to the mobile terminal, for the mobile terminal to determine a second target image according to the target video frame.

[0018] In a third aspect, the embodiments of the present disclosure provide a mobile terminal, comprising a processor and a memory, the memory being configured to store programs executable by the processor, and the processor being configured to read the programs in the memory and perform the following steps:

[0019] determine area information of an original video frame generated by a vehicle-mounted terminal, the area information indicating at least part of an original picture area corresponding to the original video frame, the mobile terminal having a communication connection with the vehicle-mounted terminal;

[0020] send the area information to the vehicle-mounted terminal, for the vehicle-mounted terminal to determine a target video frame in the original video frame according to the area information;

[0021] receive a target video frame sent by the vehicle-mounted terminal, and determine a target image according to the target video frame.

[0022] In a fourth aspect, the embodiments of the present disclosure provide a vehicle-mounted terminal, comprising a display unit and a control circuit, wherein:

[0023] The control circuit includes a processor and a memory for storing a program executable by the processor, the processor being configured to read the program in the memory and perform the following steps:

[0024] According to the at least one camera unit, a first image is acquired, and a pose of a target object in the first image is determined;

[0025] According to the pose of the target object, a view angle is determined;

[0026] According to the video frame captured by the camera unit of the view angle, an original video frame is generated;

[0027] According to the original video frame, a target image is determined.

[0028] In a fifth aspect, an image capturing method is provided, and the method includes:

[0029] According to the video frame captured by the at least one camera unit, an original video frame is generated;

[0030] Receiving area information sent by a mobile terminal, the area information indicating at least part of an original picture area corresponding to the original video frame, the mobile terminal being in communication connection with the vehicle-mounted terminal;

[0031] According to the area information, a first target image is determined.

[0032] In a sixth aspect, another image capturing method is provided, and the method includes:

[0033] According to the video frame captured by the at least one camera unit, an original video frame is generated;

[0034] Receiving area information sent by a mobile terminal, the area information indicating at least part of an original picture area corresponding to the original video frame, the mobile terminal being in communication connection with the vehicle-mounted terminal;

[0035] According to the area information, a target video frame in the original video frame is determined;

[0036] The target video frame is sent to the mobile terminal, for the mobile terminal to determine a second target image according to the target video frame.

[0037] In a seventh aspect, another image capturing method is provided, and the method includes:

[0038] Determining area information of an original video frame generated by a vehicle-mounted terminal, the area information indicating at least part of an original picture area corresponding to the original video frame, the mobile terminal being in communication connection with the vehicle-mounted terminal;

[0039] send the region information to the vehicle terminal, so that the vehicle terminal determines a target video frame in the original video frame according to the region information;

[0040] receive the target video frame sent by the vehicle terminal, and determine a target image according to the target video frame.

[0041] In an eighth aspect, another image capturing method is provided, which includes:

[0042] collecting a first image according to at least one camera unit, and determining a posture of a target object in the first image;

[0043] determining a view angle according to the posture of the target object;

[0044] generating an original video frame according to a video frame collected by the camera unit of the view angle;

[0045] determining a target image according to the original video frame.

[0046] In a ninth aspect, an image capturing apparatus is also provided, which includes:

[0047] an original video unit configured to generate an original video frame according to a video frame collected by at least one camera unit;

[0048] a region receiving unit configured to receive region information sent by a mobile terminal, the region information indicating at least part of an original picture region corresponding to the original video frame, and the mobile terminal being in communication connection with the vehicle terminal;

[0049] an image determining unit configured to determine a first target image according to the region information.

[0050] In a tenth aspect, an image capturing apparatus is also provided, which includes:

[0051] an original video unit configured to generate an original video frame according to a video frame collected by at least one camera unit;

[0052] a region receiving unit configured to receive region information sent by a mobile terminal, the region information indicating at least part of an original picture region corresponding to the original video frame, and the mobile terminal being in communication connection with the vehicle terminal;

[0053] a video determining unit configured to determine a target video frame in the original video frame according to the region information;

[0054] a video sending unit configured to send the target video frame to the mobile terminal, so that the mobile terminal determines a second target image according to the target video frame.

[0055] In a eleventh aspect, the embodiments of the present disclosure further provide a non-transitory computer storage medium, having stored thereon a computer program, which, when executed by a processor, causes the steps of the method of any one of the fifth aspect to the eighth aspect to be implemented.

[0056] In a twelfth aspect, the present disclosure provides a computer program product, comprising: computer program code which, when run on a computer, causes the computer to perform the method of any one of the fifth aspect to the eighth aspect.

[0057] These and other aspects of the present disclosure will become more apparent from the following description of embodiments. BRIEF DESCRIPTION OF DRAWINGS

[0058] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following will briefly introduce the drawings needed to be used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and for those skilled in the art, other drawings can also be obtained from these drawings without creative labor.

[0059] FIG. 1 is a schematic diagram of a vehicle terminal according to an embodiment of the present disclosure;

[0060] FIG. 2 is a schematic diagram of a vehicle camera unit position according to an embodiment of the present disclosure;

[0061] FIGS. 3A-3B are schematic diagrams of video frames captured by a camera unit in different positions according to an embodiment of the present disclosure;

[0062] FIG. 4 is a schematic diagram of a display unit according to an embodiment of the present disclosure;

[0063] FIG. 5 is a schematic diagram of a display unit displaying original video frames according to an embodiment of the present disclosure;

[0064] FIG. 6 is a flowchart of displaying original video frames in real time according to an embodiment of the present disclosure;

[0065] FIGS. 7A-7E are schematic diagrams of a user selecting a photographing area on a mobile terminal according to an embodiment of the present disclosure;

[0066] FIG. 8 is a flowchart of a full-scene preview local photographing according to an embodiment of the present disclosure;

[0067] FIGS. 9A-9C are schematic diagrams of a sub-area drag interface according to an embodiment of the present disclosure;

[0068] FIG. 10 is a flowchart of a mobile terminal local dynamic preview display scheme according to an embodiment of the present disclosure;

[0069] FIGS. 11A-11B are diagrams of a zoom preview display interface of a mobile terminal according to an embodiment of the present disclosure;

[0070] FIGS. 12A-12E are diagrams of a preview display interface of a vehicle-mounted terminal according to an embodiment of the present disclosure;

[0071] FIG. 13 is a flowchart of a technology for synchronizing a face rotation direction with a camera direction according to an embodiment of the present disclosure;

[0072] FIG. 14 is a flowchart of a method for controlling photographing using a mobile phone according to an embodiment of the present disclosure;

[0073] FIG. 15 is a flowchart of a method for fusing a mobile terminal photographing screen with a vehicle-mounted terminal photographing screen according to an embodiment of the present disclosure;

[0074] FIGS. 16A-16B are diagrams of an operation interface for synthesizing a photographing scene with a person according to an embodiment of the present disclosure;

[0075] FIG. 17 is a flowchart of a method for fusing a person inside a vehicle with a scene outside the vehicle according to an embodiment of the present disclosure;

[0076] FIG. 18 is a diagram of a screen for displaying a video frame in real time according to an embodiment of the present disclosure;

[0077] FIG. 19 is a flowchart of a method for connecting a mobile terminal to a vehicle-mounted terminal according to an embodiment of the present disclosure;

[0078] FIG. 20 is a diagram of a vehicle-mounted terminal according to an embodiment of the present disclosure;

[0079] FIG. 21 is a diagram of a mobile terminal according to an embodiment of the present disclosure;

[0080] FIG. 22 is a diagram of a vehicle-mounted terminal according to an embodiment of the present disclosure;

[0081] FIG. 23 is a flowchart of an image photographing method according to an embodiment of the present disclosure;

[0082] FIG. 24 is a flowchart of an image photographing method according to an embodiment of the present disclosure;

[0083] FIG. 25 is a flowchart of an image photographing method according to an embodiment of the present disclosure;

[0084] FIG. 26 is a flowchart of an image photographing method according to an embodiment of the present disclosure;

[0085] FIG. 27 is a diagram of an apparatus for an image photographing method according to an embodiment of the present disclosure;

[0086] FIG. 28 is a schematic diagram of an image shooting method device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0087] In order to make the purposes, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail below with reference to the drawings. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the present disclosure.

[0088] In the embodiments of the present disclosure, the term "and / or" describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B can mean that A exists alone, A and B exist together, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after it.

[0089] The application scenarios described in the embodiments of the present disclosure are used to more clearly illustrate the technical solutions of the embodiments of the present disclosure, and do not constitute a limitation on the technical solutions provided by the embodiments of the present disclosure. A person of ordinary skill in the art can know that, as new application scenarios appear, the technical solutions provided by the embodiments of the present disclosure are also applicable to similar technical problems. In the description of the present disclosure, unless otherwise specified, the meaning of "multiple" is two or more.

[0090] Before introducing the vehicle-mounted terminal image shooting method provided by the embodiments of the present disclosure, in order to facilitate understanding, first, the technical background of the embodiments of the present disclosure is introduced in detail.

[0091] The intelligent vehicle-mounted terminal has multiple functions, including but not limited to shooting function, vehicle-mounted communication, vehicle remote control, vehicle diagnosis and fault detection, energy management, driving assistance system, vehicle networking service, etc. The shooting function of the vehicle-mounted intelligent terminal mainly includes GPS navigation, voice recognition and voice control, reversing image and video monitoring, driving record, etc. These functions provide drivers with more convenient and safe driving experience by integrating advanced technologies.

[0092] The reversing image and video monitoring can capture the situation around the vehicle through the cameras installed on the front, back and sides of the vehicle, helping the driver to avoid collision when reversing or parking, and improving the driving safety. The driving record can record the video and sound during the vehicle driving process, which is used for accident evidence and safety monitoring, and provides evidence for handling traffic accidents. In addition, some high-end intelligent vehicle-mounted terminals also support face recognition, abnormal behavior detection and other advanced functions.

[0093] However, the above functions mainly provide driving convenience and enhance driving safety. When driving a vehicle, there can also be a demand for taking pictures of the scenery outside the vehicle. Usually, when encountering beautiful scenery that needs to be photographed, the user needs to get off the vehicle and use a mobile phone to take pictures. When encountering a situation where the vehicle cannot be stopped, the user cannot meet the better demand for taking pictures, which affects the user's driving experience.

[0094] To provide a picture-taking experience in a driving environment, the embodiment uses the camera unit of the vehicle terminal to provide an auxiliary picture-taking scheme. The user in the vehicle can take pictures of the scenery outside the vehicle without getting off the vehicle. The vehicle provides a real-time picture-taking function while driving, which improves the picture-taking experience of the user in the vehicle. The vehicle terminal provided in the embodiment not only can take pictures using the camera unit, but also can control the area to be photographed through the mobile terminal, so as to take pictures of only the scene in the area to be photographed and generate a final target image. The vehicle terminal provided in the embodiment provides a convenient and easy-to-operate picture-taking function, provides a real-time picture-taking function for any user (including a passenger or a driver) in the vehicle, and improves the riding experience and driving experience of the user. The embodiment expands the intelligent operation scene of the intelligent vehicle terminal and provides a real-time picture-taking experience based on the camera unit of the intelligent vehicle terminal.

[0095] Referring to FIG. 1, the vehicle terminal in the embodiment is introduced.

[0096] The vehicle terminal 100 in the embodiment includes a display unit 1040, a processor 1080, and a memory 1020. The display unit 1040 includes a display panel 1041, which is used to display information input by a user or information provided to the user and various operation interfaces of an application, etc. In the embodiment of the disclosure, the display unit 1040 is mainly used to display the interface of a client installed in the vehicle terminal 100, a shortcut window, a three-dimensional menu model, menu information of a menu item, etc.

[0097] Optionally, the display panel 1041 can be configured in the form of a liquid crystal display (LCD) or an organic light-emitting diode (OLED).

[0098] The processor 1080 is used to read a computer program and then execute the method defined in the computer program. For example, the processor 1080 reads an application, so that the application runs on the vehicle terminal 100 and the interface of the application is displayed on the display unit 1040. The processor 1080 can include one or more general-purpose processors and also can include one or more digital signal processors (DSPs) for performing related operations to implement the technical solutions provided in the embodiments of the disclosure.

[0099] The memory 1020 generally includes internal memory and external memory. The internal memory can be random access memory (RAM), read only memory (ROM), and cache memory (CACHE), etc. The external memory can be a hard disk, an optical disk, a USB disk, a floppy disk, or a tape drive, etc. The memory 1020 is used to store computer programs and other data. The computer programs include application programs corresponding to clients, etc. The other data can include data generated after the operating system or application programs are run, including system data (such as configuration parameters of the operating system) and user data. In the embodiments of the present disclosure, program instructions are stored in the memory 1020, and the processor 1080 executes the program instructions in the memory 1020 to implement any one of the methods for displaying a three-dimensional menu provided by the present disclosure.

[0100] In addition, the vehicle terminal 100 can further include a touch unit 1100 configured to receive input digital information, word information, or contact touch operations or non-contact gestures, and generate signal inputs related to user settings and function controls of the vehicle terminal 100, etc. The touch unit 1100 includes, but is not limited to, an infrared touch unit, a capacitive touch unit, an electromagnetic touch unit, a camera acquisition unit, etc. The camera acquisition unit is configured to acquire gestures of a user who does not touch the display unit. When the touch unit 1100 includes an infrared touch unit or an electromagnetic touch unit, the touch unit 1100 and the display unit 1040 can be arranged in a stacked manner. For example, a user performs a touch operation on a touch screen, and the touch unit 1100 can collect touch operations of the user on or near the display panel 1041 (such as operations of the user using a finger, a stylus, or any suitable object or accessory on the display panel 1041), and drive corresponding connection devices according to a pre-set program.

[0101] Optionally, the touch unit 1100 can include a touch detection device and a touch processor. The touch detection device detects a touch position of a user and detects signals caused by a touch operation, and transmits the signals to the touch processor. The touch processor receives touch information from the touch detection device, converts the touch information into touch coordinates, and sends the touch coordinates to the processor 1080. The touch processor can also receive commands from the processor 1080 and execute the commands. In the embodiments of the present disclosure, if a user clicks an application, the touch detection device in the touch unit 1100 detects the touch operation, and sends a signal corresponding to the detected touch operation to the touch processor. The touch processor converts the signal into touch coordinates and sends the touch coordinates to the processor 1080. The processor 1080 determines an operation to be performed by the user according to the received touch coordinates.

[0102] The display panel 1041 can be implemented in various types such as LCD, OLED, etc. In addition to the display unit 1040 and the touch unit 1100, the vehicle terminal 100 can further include an input unit 1030, which can include an image input device 1031 and other input devices 1032, which can be one or more of, but are not limited to, a physical keyboard, function keys (such as volume control keys, on-off keys, etc.), trackballs, mice, joysticks, etc.

[0103] In addition to the above, the vehicle terminal 100 can further include a power supply 1090 for supplying power to other modules, an audio circuit 1060, a near field communication module 1070, and an RF circuit 1010. The vehicle terminal 100 can further include one or more sensors 1050, such as an acceleration sensor, a light sensor, a pressure sensor, etc. The audio circuit 1060 specifically includes a speaker 1061 and a microphone 1062, etc., for example, the vehicle terminal 100 can collect the user's voice through the microphone 1062, and perform corresponding operations, etc.

[0104] As an embodiment, the number of processors 1080 can be one or more, and the processor 1080 and the memory 1020 can be coupled or relatively independent.

[0105] As an embodiment, the processor 1080 is configured to perform the following steps:

[0106] Step 1) generating an original video frame according to a video frame collected by at least one camera unit;

[0107] The original video frame in this embodiment can be video data formed by a video frame collected by one camera unit, or video data formed by splicing video frames collected by multiple camera units. The camera unit in this embodiment can collect a video frame under a certain viewing angle around the vehicle, or collect a video frame under a large viewing angle around the vehicle through a wide-angle camera. The original video frame in this embodiment can also be a video frame collected, that is, an image, or a spliced image obtained by splicing multiple video frames. The original video frame in this embodiment includes at least one video frame of a viewing angle, wherein one camera unit corresponds to one or more viewing angles, or multiple camera units correspond to one viewing angle. This embodiment does not make too many limitations.

[0108] Optionally, when a video frame collected by a camera unit is obtained, an original video frame is generated according to the video frame. In an implementation, one case is to determine the video frame as the original video frame, and another case is to obtain the original video frame by image processing on the video frame.

[0109] Optionally, the video frames collected by multiple camera units are spliced to generate an original video frame.

[0110] In the implementation, after the video frames captured by the plurality of camera units are acquired, the original video frame is generated according to the video frames captured by the plurality of camera units. In one case, the original video frame is generated after image stitching and image fusion are performed on the video frames captured by the plurality of camera units. In another case, the original video frame is obtained after image stitching and image fusion are performed on the video frames captured by the plurality of camera units, and image processing is performed on the image after the image stitching and image fusion. Optionally, the image processing includes, but is not limited to, scaling, cropping and the like. When the original video frame is generated, whether scaling, cropping and the like are performed on the video frame can be determined according to the display size of the display unit, so that the original video frame can be better displayed on the display unit.

[0111] In some embodiments, a plurality of camera units are installed on the vehicle, including an in-vehicle camera unit and an out-of-vehicle camera unit. The out-of-vehicle camera unit includes, but is not limited to, at least one of a camera unit at the front end of the vehicle body, a camera unit at the tail end of the vehicle body, a camera unit at the left side of the vehicle body, and a camera unit at the right side of the vehicle body, wherein the camera unit at the front end of the vehicle body can be one or more, the camera unit at the tail end of the vehicle body can be one or more, the camera unit at the left side of the vehicle body can be one or more, and the camera unit at the right side of the vehicle body can be one or more. The in-vehicle camera unit can be one or more. As shown in FIG. 2, the present embodiment provides a schematic diagram of the positions of the camera units of the vehicle, in which at least five camera units are installed on the vehicle, which are the camera unit at the front end of the vehicle body, the camera unit at the tail end of the vehicle body, the camera unit at the left side of the vehicle body, the camera unit at the right side of the vehicle body, and the in-vehicle camera unit.

[0112] Optionally, the focal length of the camera unit in the present embodiment can be automatically adjusted or manually adjusted. When manually adjusted, in one case, the user can adjust on the human-computer interaction interface displayed on the display unit, and in another case, the user can adjust on the human-computer interaction interface displayed on the mobile terminal connected with the vehicle terminal. By adjusting the focal length of the camera unit, the angle of view range of the camera unit can be adjusted.

[0113] In the implementation, the camera units at different positions can capture continuous video frames, the captured video frames can be cached in real time, and the original video frame at the same time can be generated after image stitching is performed on the video frames captured by the camera units at different positions at the same time. The original video frame at the same period can also be generated after image stitching is performed on the video frames captured by the camera units at different positions at the same period. Optionally, the original video frame is generated by the following way in the present embodiment:

[0114] The video frames collected by the camera units at different positions on the vehicle are image-stitched, and the stitched images are image-fused to obtain the original video frames. In the implementation, when the video frames collected by the camera units at different positions are used to generate the original video frames, the video frames collected by the camera units at different positions need to be image-stitched, and the stitched images need to be image-fused to obtain the final original video frames. The purpose of image-fusion is to fuse the edges of the video frames collected by the camera units at different positions in the stitched images, so as to form a complete image.

[0115] Optionally, after the video frames collected by the camera units at different positions on the vehicle, the video frames collected by the camera units at different positions are stitched according to the relationship between the positions of the camera units, wherein the position of any video frame collected by a camera unit in the original video frame corresponds to the position of the camera unit on the vehicle. As shown in FIGS. 3A-3B, the embodiment provides a schematic diagram of the video frames collected by the camera units at different positions. Referring to FIG. 3A, the video frame 1 is collected by the camera unit at the front end of the vehicle body, the video frame 2 is collected by the camera unit at the tail end of the vehicle body, the video frame 3 is collected by the camera unit at the left side of the vehicle body, the video frame 4 is collected by the camera unit at the right side of the vehicle body, and the video frame 5 is collected by the camera unit in the vehicle. The video frame 1 collected by the camera unit at the front end of the vehicle body is at the upper side in the original video frame, the video frame 2 collected by the camera unit at the tail end of the vehicle body is at the lower side in the original video frame, the video frame 3 collected by the camera unit at the left side of the vehicle body is at the left side in the original video frame, the video frame 4 collected by the camera unit at the right side of the vehicle body is at the right side in the original video frame, and the video frame 5 collected by the camera unit in the vehicle is at the center in the original video frame. Referring to FIG. 3B, the video frame 1a is collected by the camera unit a at the front end of the vehicle body, the video frame 1b is collected by the camera unit b at the front end of the vehicle body, the video frame 2 is collected by the camera unit at the tail end of the vehicle body, the video frame 3 is collected by the camera unit at the left side of the vehicle body, the video frame 4 is collected by the camera unit at the right side of the vehicle body, and the video frame 5 is collected by the camera unit in the vehicle. The video frame 1 collected by the camera unit at the front end of the vehicle body is at the upper side in the original video frame, the video frame 2 collected by the camera unit at the tail end of the vehicle body is at the lower side in the original video frame, the video frame 3 collected by the camera unit at the left side of the vehicle body is at the left side in the original video frame, the video frame 4 collected by the camera unit at the right side of the vehicle body is at the right side in the original video frame, and the video frame 5 collected by the camera unit in the vehicle is at the center in the original video frame.

[0116] Optionally, the original video frame in the embodiment includes a video frame corresponding to a video frame collected by a camera unit at a different position, wherein the video frame is obtained by image processing on the video frame collected by the camera unit, and the image processing includes image scaling, image cropping and the like. The shape of the video frame corresponding to the video frame collected by each camera unit can be predefined, and can be a rectangle, a trapezoid or other shape patterns. Optionally, the shape of the video frame corresponding to the video frame collected by each camera unit can also be determined according to the angle of view of the camera unit. For example, the angle of view of the camera unit at the front end of the vehicle body is greater than 90 degrees, and the video frame corresponding to the video frame collected by the camera unit at the front end of the vehicle body can be set as a trapezoid. The angle of view of the in-vehicle camera unit is smaller than that of the camera unit at the front end of the vehicle body, and the video frame corresponding to the video frame collected by the in-vehicle camera unit can be set as a rectangle. The shapes of the video frames corresponding to the video frames collected by different camera units can also be set as rectangles of different sizes. The shape of the video frame can be defined according to actual requirements, and the collected video frame can be cropped and spliced, and the embodiment does not make excessive limitation on the shape of the video frame corresponding to the video frame collected by different camera units.

[0117] Optionally, the original video frame collected by the camera unit in the embodiment can be displayed on the display unit of the vehicle terminal, or can not be displayed. The original video frame can also be sent to the mobile terminal, and can be displayed on the mobile terminal or can not be displayed on the mobile terminal. The embodiment does not make excessive limitation thereon.

[0118] In some embodiments, the original video frame is displayed on the display unit, and the display screen of the display unit is sent to the mobile terminal through a screen projection protocol, so as to determine the region information according to the display screen by the mobile terminal. In the implementation, the original video frame is displayed on the display unit, and the display screen of the display unit is projected to the mobile terminal for synchronous display. The mobile terminal and the vehicle terminal have a communication connection.

[0119] Optionally, the embodiment does not make excessive limitation on the width-height ratio of the display unit. The display unit can be a long screen or a square screen, for example, the display unit can be a conventional screen with a width-height ratio of 16:9 or 4:3, or can be a non-conventional long screen, a square screen, a special-shaped screen and the like. As shown in FIG. 4, the embodiment provides a schematic diagram of a display unit, which can be a conventional horizontal screen, a long screen, a conventional vertical screen, a square screen and the like. In the implementation, when the display screen of the display unit is projected to the mobile terminal for display, the display screen can be scaled, stretched and the like according to the display size (resolution) of the display screen and the display size (resolution) of the mobile terminal, and then adaptively displayed on the mobile terminal.

[0120] In some embodiments, when the display screen of the display unit includes a plurality of sub-regions, and one of the sub-regions is used to display the captured video frame, i.e., the original video frame is displayed through the sub-region, the sub-region can be projected to the mobile terminal for display only. Since the display size of the display unit is usually larger than that of the mobile terminal, in order to more clearly display the real-time captured video frame, the screen of the video frame can be projected to the mobile terminal for display only, which facilitates the user to control the shooting operation on the mobile terminal. Optionally, the projected display screen includes the original video frame and other sub-regions, and can also include the background region of the display screen other than the original video frame, such as menu bar, icon and other information. In the implementation, the original video frame is displayed on the display unit of the vehicle terminal, and the original video frame is synchronously displayed on the mobile terminal. The mobile terminal and the vehicle terminal establish a communication connection, the screen displayed by the display unit is projected to the connected mobile terminal for synchronous display through the projection mode, and the display unit and the mobile terminal are controlled to synchronously display the original video frame. Optionally, the projection protocol used in the embodiment includes but is not limited to DLNA (Digital Living Network Alliance), Miracast, WiDi, private protocol, etc. Through the projection mode, the mobile terminal and the vehicle terminal can synchronously display the same screen, which facilitates the user to control the shooting of the vehicle terminal through the mobile terminal, facilitates the user in the vehicle to also use the mobile terminal to realize the shooting control of the scenery outside the vehicle, and provides a more convenient shooting experience.

[0121] Optionally, the embodiment displays the original video frame through a display unit. The display unit in the embodiment can be a spliced screen or a non-spliced screen. The display unit in the embodiment includes an SOC board card and a central control display screen. The central control display screen further includes a camera, which can be located below the main driving area. The camera is used to collect facial information, eye information, and body posture of the driver. The embodiment does not make too many limitations on this. The central control display screen includes but is not limited to a plurality of display areas. The main driving area is used to display vehicle information. The copilot area is used to display media information. The copilot area can also be divided into a plurality of sub-areas. The embodiment does not make too many limitations on the number, size, and style of the divided areas of the central control display screen. As shown in FIG. 5, the embodiment further provides a schematic diagram of a display unit for displaying the original video frame. The display unit is a square screen. After real-time acquisition of video frames captured by a camera unit at the front end of the vehicle body, a camera unit at the tail end of the vehicle body, a camera unit at the left side of the vehicle body, a camera unit at the right side of the vehicle body, and an in-vehicle camera unit, the overall display picture after splicing and fusion is displayed in real time through a camera control panel application and existing video picture splicing algorithm and video frame picture edge fusion algorithm. The display picture is a spliced rectangle, which includes video frame 1 collected by the camera unit at the front end of the vehicle body, video frame 2 collected by the camera unit at the tail end of the vehicle body, video frame 3 collected by the camera unit at the left side of the vehicle body, video frame 4 collected by the camera unit at the right side of the vehicle body, and video frame 5 collected by the in-vehicle camera unit. A user can view the spliced video frame picture in real time.

[0122] The embodiment can support multiple camera units, for example, support six cameras, and Android supports two front and rear cameras by default. In the implementation, multiple cameras can also be used to simultaneously collect video frame pictures by modifying the underlying UVC (USB camera device communication protocol) driver. The embodiment can support multiple cameras to simultaneously establish a connection with the display unit of the vehicle terminal. In the camera control application, multiple cameras can be simultaneously turned on / off, and a real-time preview video frame preview interface function can be realized. The user can select to automatically turn on the camera control application in the settings of the vehicle terminal. After the vehicle terminal is turned on, multiple camera applications will be automatically opened, multiple cameras will be turned on in real time, and the user can preview and view the multiple camera pictures in real time. Multiple cameras collect video frames during driving in real time. When the user turns on multiple cameras, the video frames captured by the multiple cameras will be collected in real time. Optionally, a double-buffer drawing mechanism can be used to cache and store each frame of image collected by the multiple cameras in real time, and realize real-time refreshing of video frame data. In the drawing canvas, multiple video frames are processed by a splicing algorithm and cropped. The video frames collected by each camera are displayed according to the position of each camera. If the collected video frames exceed the size of the video frame display area, each frame of image is cropped at the edge to form a spliced picture. At this time, the edges of the spliced picture cannot be completely fused, and the edge fusion algorithm needs to be used to fuse the edges, and then the original video frame after splicing and fusion can be displayed.

[0123] In some embodiments, the display unit in the embodiment can use an Android SoC (System on Chip) system, Android 8.0 and above. Based on the Android platform application software, Launcher application, camera control application, and photographing application are installed on the display unit. The Launcher application manages and presents the user interface, including the desktop, application drawer, and components, and allows the user to customize the home screen, icons, widget layout, and some basic functions of the mobile phone, such as sliding effect and screen transition. The camera control application provides shooting functions, driving assistance functions, safety monitoring functions, driving recording functions, and traffic violation monitoring functions. The photographing application establishes a connection with the mobile terminal, displays the display picture of the display unit on the mobile terminal through the photographing application, controls the shooting through the mobile terminal, and sends control instructions to the display unit to control the shooting of the vehicle terminal.

[0124] As shown in FIG. 6, the embodiment also provides a process for displaying real-time original video frames, as shown below:

[0125] Step 600, the display unit and multiple camera units establish a connection.

[0126] Step 601, in response to a user opening a camera control application of a display unit, collecting video frames by using multiple camera units in vehicle driving;

[0127] Step 602, using a double-buffer drawing mechanism, storing each frame of video frames in a buffer in real time;

[0128] Step 603, image stitching of the video frames collected by the multiple camera units to obtain a stitched image;

[0129] Step 604, edge fusion of the stitched image to generate an original video frame.

[0130] In implementation, the video frames collected by the multiple camera units can be image stitched and image fused according to processing and cropping of a stitching algorithm to obtain the original video frame;

[0131] Step 605, real-time refreshing of the display unit to display the original video frame.

[0132] In some embodiments, the mobile terminal and the vehicle-mounted terminal establish a communication connection through a photographing application, the vehicle-mounted terminal starts the photographing application, the mobile terminal also starts the photographing application, and then a connection relationship between the two terminals is established through the photographing application using a screen projection protocol. On the interface of the photographing application of the mobile terminal, the current display screen of the display unit of the vehicle-mounted terminal can be displayed in real time, for example, the generated original video frame.

[0133] Step 2) receiving area information sent by the mobile terminal, the area information indicating at least part of an area in an original screen area corresponding to the original video frame, the mobile terminal and the vehicle-mounted terminal having established a communication connection;

[0134] Optionally, the mobile terminal can display area position information on the interface of the photographing application, select the area information, for example, display a screen including different area position identifiers on the mobile terminal, a user selects a position identifier A of the video frame collected by the front-end camera unit of the vehicle in the original screen area, and sends the position identifier A to the vehicle-mounted terminal. The vehicle-mounted terminal determines the video frame collected by the front-end camera unit of the vehicle as the area information according to the position identifier A.

[0135] In some embodiments, the processor is specifically configured to perform:

[0136] send the original video frame to the mobile terminal, so that the mobile terminal determines area information based on the original video frame.

[0137] The vehicle terminal sends the original video frames to the mobile terminal. The mobile terminal can select at least part of the area from the original picture area corresponding to the original video frames, and determine the selected at least part of the area as the area information. In one case, the mobile terminal can select the area corresponding to the video picture of at least one perspective from the original picture area, and take the video frame of the perspective as the area information sent to the vehicle terminal. In another case, the mobile terminal can select at least part of the area in the video picture of the same perspective from the original picture area, and determine at least part of the area in the video frame of the perspective as the area information. The mobile terminal can select the area information by touch gestures such as clicking, sliding, and long pressing. The area information can also be determined by drawing a figure of different shapes such as a rectangle or a circle on the original picture area of the displayed original video frames by touch gestures, or drawing a line on the original picture area of the displayed original video frames to determine the area corresponding to the line as the area information.

[0138] In some embodiments, the processor is specifically further configured to perform: sending at least part of the video frames in the original video frames to the mobile terminal, so that the mobile terminal determines the area information based on at least part of the video frames in the original video frames.

[0139] Optionally, at least part of the video frames in the original video frames include but are not limited to at least one video frame collected under one perspective, or at least one video frame collected by one camera unit, or at least one video frame obtained by image stitching of at least one video frame collected under multiple perspectives, or at least one video frame obtained by image stitching of at least one video frame collected by multiple camera units, or at least one video frame corresponding to part of the perspectives in one perspective, or part of the pictures in the display picture of at least one video frame collected by one camera unit, or at least one video frame corresponding to part of the perspectives in the stitched perspective after image stitching of multiple perspectives, or part of the pictures in the display picture of at least one video frame obtained by image stitching of at least one video frame collected by multiple camera units.

[0140] In implementation, multiple video frames under one perspective in the original video frames can be sent to the mobile terminal, or the video frames under multiple perspectives in the original video frames can be stitched and then sent to the mobile terminal, and the present embodiment does not make excessive limitation thereon.

[0141] In some embodiments, at least part of the video frames in the original video frames include video frames of at least one perspective; and the processor is specifically configured to perform: sending the video frames of at least one perspective in the original video frames to the mobile terminal.

[0142] Optionally, the view angle in the embodiment can be a complete view angle of one camera unit, or a partial view angle, or a spliced view angle obtained by splicing view angles of multiple camera units, or a partial view angle in the spliced view angle, and the embodiment does not make too many limitations on this.

[0143] In some embodiments, the processor is specifically further configured to perform: receiving a view angle switching instruction sent by the mobile terminal, the view angle switching instruction comprising the region information.

[0144] In implementation, the region information in the received view angle switching instruction is determined as the region information. For example, the view angle switching instruction indicates switching from a display screen of view angle A in the original display screen of the original video frame to a display screen of view angle B, and then the video frame of the camera unit of view angle B is determined as the region information.

[0145] In some embodiments, the processor is specifically configured to perform:

[0146] According to the view angle switching instruction, a first view angle is determined, and a video frame of the first view angle is sent to the mobile terminal.

[0147] Optionally, the view angle switching instruction comprises, but is not limited to, a touch gesture such as sliding, long pressing, clicking, and can also comprise a mobile terminal posture. In implementation, the user can trigger the view angle switching instruction through the touch gesture such as sliding, long pressing, clicking, for example, the current display screen of the mobile terminal displays a video frame of view angle A in the original video frame, the user performs a sliding operation (view angle switching instruction) on the display screen, determines that the first view angle corresponding to the sliding operation is view angle B, and then the vehicle-mounted terminal sends the video frame of view angle B to the mobile terminal, that is, switches the currently displayed video frame of view angle A to the video frame of view angle B on the mobile terminal side. The user can also trigger the generation of the view angle switching instruction through the mobile terminal posture, for example, through a three-axis acceleration sensor, a gyroscope sensor, a distance sensor, a gravity sensor, a magnetometer sensor, etc., when the mobile terminal posture is detected to change, the currently displayed video screen can be switched to the video screen corresponding to the change of the mobile terminal posture after the change of the mobile terminal posture, for example, the current mobile terminal displays a video frame of view angle A, when the mobile terminal rotates to the left, the current video frame is switched to a video frame of view angle C. When determining the video frame of the switched view angle, the direction of the motion track of the mobile terminal and the positional relationship of different view angles can be used for determination, for example, view angle A is a view angle at the front end of the vehicle, and view angle C is a view angle at the left side of the vehicle on the left side of view angle A, then when the mobile terminal rotates to the left, the current view angle A is switched to the video frame of view angle C, so that the direction of the motion of the mobile terminal is consistent with the direction of the video frame switching.

[0148] Step 3) determining a first target image according to the region information.

[0149] In some embodiments, the processor is further configured to: determine the first view angle according to the view angle switching instruction; receive a shooting instruction sent by the mobile terminal; and determine the first target image according to the video frame of the first view angle in response to the shooting instruction.

[0150] It should be noted that the view angle in the present embodiment refers to the shooting view angle of the camera unit. The shooting view angle refers to the range covered by the lens of the camera unit. When the shooting angle is exceeded, the object will not appear in the lens picture, i.e., the scenery beyond the shooting view angle of the camera unit cannot be shot. The view angle is usually expressed in degrees, i.e., the view angle (FOV) of the camera unit. The view angle refers to the included angle formed by the two edges of the maximum range of the lens, which is called the field of view angle. The shooting view angle in the present embodiment can be fixed or adjustable. In addition, the meanings of the "first view angle" and the "second view angle" in the present embodiment are the same as that of the "view angle", and "first" and "second" are only used to distinguish different view angles.

[0151] In the implementation, after the vehicle-mounted terminal sends the video frame of the first view angle corresponding to the view angle switching instruction to the mobile terminal, the shooting instruction sent by the mobile terminal is received. At this time, it is considered that the user needs to shoot the video frame of the first view angle. Therefore, the vehicle-mounted terminal determines the first target image according to the video frame of the first view angle, and saves the first target image to the local or sends the first target image to the mobile terminal for saving.

[0152] Optionally, the processor is specifically configured to execute:

[0153] receive a shooting instruction sent by the mobile terminal; and determine the first target image according to the video frame sent by the vehicle-mounted terminal to the mobile terminal last time.

[0154] In the implementation, when the user of the mobile terminal needs to take a picture of the picture of the currently displayed video frame, the shooting instruction can be triggered. The vehicle-mounted terminal determines the first target image according to the video frame when the shooting instruction is generated. Therefore, the first target image can be determined according to the video frame sent by the vehicle-mounted terminal to the mobile terminal last time, and the first target image is saved to the local or sent to the mobile terminal for saving.

[0155] In some embodiments, the processor is further configured to: send the first target image to the mobile terminal. The mobile terminal can perform operations such as saving and sharing on the first target image.

[0156] In some embodiments, the processor is further configured to execute any one of the following manners:

[0157] Manner 1: receive a first image sent by the mobile terminal, perform image fusion on the video frame corresponding to the region information and the first image, and determine the first target image.

[0158] In implementation, when image fusion of the first image is performed, the entire content of the first image can be fused, or only part of the content, such as only the target object in the first image, or only the background region in the first image, can be fused.

[0159] It should be noted that the principle of image fusion in this embodiment is to synthesize multiple images through a specific algorithm, and these images can come from different camera units, angles of view or times. Through image fusion, the information of the original data can be retained, and a more visual and practical image can be generated. The process of image fusion includes preprocessing steps such as denoising and registration, and then a new image is synthesized according to certain fusion rules. The image after image fusion can contain key information and features of the original image, and the image fusion technology can effectively combine image information from different sources to improve the quality and information quantity of the image, and realize information complementation and enhancement. The image fusion method includes but is not limited to any one or a combination of more of the following: pixel-level-based fusion, feature-level-based fusion, model-level-based fusion, etc. Pixel-level-based fusion: This method processes and combines the pixels of multiple images one by one, usually using weighted average, maximum value or minimum value, etc. to perform pixel-level fusion. Feature-level-based fusion: This method extracts and matches the features of multiple images, and then fuses according to the matching results. Common features include edges, textures, colors, etc. This fusion method can better preserve the details and features of the image. Model-level-based fusion: This method models and optimizes the information of multiple images to obtain the optimal fusion result. Common models include wavelet transform, multi-scale analysis and deep learning, etc. This fusion method can better handle images of different scales and resolutions. The image fusion method can be selected according to actual needs in this embodiment.

[0160] Method 2: receiving the first video sent by the mobile terminal, performing image fusion on the video frame corresponding to the region information and the first video, and determining the first target image.

[0161] In implementation, when image fusion of the first video is performed, the entire content of the first video can be fused, or only part of the content, such as only the target object in the first video, or only the background region in the first video, can be fused.

[0162] Method 3: receiving the first image sent by the mobile terminal, performing image fusion on the video frame corresponding to the region information and the first image, and determining the first target image; fusing the first image and the first target image, and sending the fused image to the mobile terminal.

[0163] In some embodiments, the processor is specifically further configured to: determine a second image according to an image collected by at least one in-vehicle camera unit; and perform image fusion on the video frame corresponding to the region information and the second image to determine the first target image.

[0164] In some embodiments, the in-vehicle camera unit can collect a face image as the second image, and the video frame corresponding to the region information and the face image can be fused to determine the first target image. Alternatively, the out-vehicle camera unit can collect an out-vehicle scene / person image as the second image, and the video frame corresponding to the region information and the out-vehicle scene / person image can be fused to determine the first target image.

[0165] In some embodiments, the processor is specifically configured to perform any one of the following:

[0166] (1) receiving first indication information; determining a target object in a first image according to the first indication information; performing image fusion on the video frame corresponding to the region information and the target object to determine the first target image; wherein the first indication information is used to indicate the position of the target object in the first image;

[0167] Optionally, the first indication information can be carried in the first image or can be sent separately, and the present embodiment does not make further limitation thereon.

[0168] (2) receiving second indication information; determining a target object in a second image according to the second indication information; performing image fusion on the video frame corresponding to the region information and the target object to determine the first target image; wherein the second indication information is used to indicate the position of the target object in the second image.

[0169] Optionally, the second indication information can be carried in the second image or can be sent separately.

[0170] In some embodiments, the first indication information / second indication information is used to determine the target object, and the first indication information includes but is not limited to text, graphics, lines, etc. The user can mark the position of the target object in the first image / second image in the form of text annotation or drawing a graphic region or drawing a line, so as to determine the target object in the first image, and then fuse the target object and the video frame.

[0171] In some embodiments, the processor is specifically configured to perform any one of the following:

[0172] a. if the region information includes a plurality of video frames, performing image splicing on the plurality of video frames to obtain the first target image; or

[0173] b. if the region information includes one video frame, determining the one video frame as the first target image; or

[0174] Optionally, if the region information comprises a partial region of one video frame, the one video frame is image cropped to obtain the first target image.

[0175] In some embodiments, the processor is further configured to perform: displaying the original video frame on the display unit; and updating a proportion of the video frame of the at least one view angle in the original video frame in response to a zoom operation of the user on the video frame of the at least one view angle contained in the original video frame.

[0176] In some embodiments, the processor is further configured to perform: displaying the original video frame on the display unit; and updating a display position of the video frame of the at least one view angle in response to a drag operation of the user on the video frame of the at least one view angle contained in the original video frame.

[0177] Optionally, the user can perform a zoom operation on the video frame of at least one sub-region in the original picture region on the vehicle terminal through a touch manner, and can also control a position of the at least one sub-region in the original picture region; one view angle corresponds to one sub-region in the original picture region.

[0178] In some embodiments, the processor is further configured to perform: receiving a zoom instruction sent by the mobile terminal, updating a proportion of the video frame of the at least one view angle in the original video frame according to zoom coordinate information corresponding to the zoom instruction, and displaying the video frame of the at least one view angle.

[0179] In some embodiments, the processor is further configured to perform: receiving a drag instruction sent by the mobile terminal, updating a display position of the video frame of the at least one view angle according to drag coordinate information corresponding to the zoom instruction, and displaying the video frame of the at least one view angle.

[0180] Optionally, the user can perform a zoom operation on the video frame of at least one sub-region in the original picture region on the vehicle terminal through a touch manner, and can also control a position of the at least one sub-region in the original picture region; one view angle corresponds to one sub-region in the original picture region.

[0181] The vehicle terminal provided in the embodiment can control a photographing position through the mobile terminal, determine the first target image according to region information sent by the mobile terminal, that is, control the vehicle terminal to take a photograph through the mobile terminal, and thus the in-vehicle personnel can take a photograph more conveniently during vehicle driving, a scheme is provided for the in-vehicle passengers to control the vehicle to take a photograph of a scenery along a route during driving through the mobile terminal, and the photographing experience of the passengers is improved.

[0182] The embodiment provides a scheme for selecting a partial photographing area by a mobile terminal, in which a user of the mobile terminal installs a photographing application, in the photographing application, an original picture of an original video frame collected by a vehicle-mounted terminal can be acquired in real time, or an original video frame generated by the vehicle-mounted terminal can be acquired in real time, the user can perform a touch gesture operation on a video frame picture (the original video frame) displayed by the mobile terminal, draw mark information such as a rectangle, a triangle, a pentagon, a diamond, a sector, an ellipse, a polygon, a line and the like through the touch gesture, mark area information of a partial area on an original picture area of the original video frame, and send the area information to the vehicle-mounted terminal, so as to instruct the vehicle-mounted terminal to select a photographing area selected by a user, thereby collecting a video frame according to the area information and generating a target image. The user can select area information of a photographing area by drawing mark information of different traces on the mobile terminal according to personal preferences in real time, capture a photo in real time according to different photographing areas, and further automatically generate a photo album cover and content by using the target image.

[0183] As shown in FIGS. 7A-7E, the embodiment provides a schematic diagram in which a user selects a photographing area on a mobile terminal, and the mobile terminal displays an original video frame, wherein the original video frame is obtained by image splicing and fusion of video frames collected by camera units at different positions, the original video frame includes video frames collected by camera units at different positions, which are a video frame A corresponding to a camera unit at a front end of a vehicle body, a video frame B corresponding to a camera unit at a tail end of the vehicle body, a video frame C corresponding to a camera unit at a left side of the vehicle body, a video frame D corresponding to a camera unit at a right side of the vehicle body, and a video frame E corresponding to a camera unit in the vehicle. The user can draw mark information such as a line and a graph on the mobile terminal, so as to instruct area information of a photographing area selected by a user of the vehicle-mounted terminal, thereby photographing a scene of the photographing area by using the camera unit, and obtaining a target image.

[0184] Referring to FIG. 7A, the user can draw a rectangular area on the mobile terminal, so as to instruct a photographing area of the vehicle-mounted terminal, and photograph a scene of the photographing area by using the camera unit, thereby obtaining a target image. In the implementation, the user touches an original picture of an original video frame displayed by the mobile terminal, draws a rectangular area, sends position information of the rectangular area to the vehicle-mounted terminal, the vehicle-mounted terminal determines area information of the photographing area according to the position information, photographs a scene of the photographing area by using the camera unit, and thereby obtains a target image.

[0185] The user can take real-time photos of the scenery along the way according to his / her preference in real-time driving. When the user draws a rectangular region on the mobile terminal, the user can take a photo manually by clicking at any position in the rectangular region, and the target image corresponding to the photo-taking region is automatically saved to the storage directory of the mobile terminal. The user can view the photo set including at least one target image in real time through the photo application or the photo album of the mobile terminal. The user can also draw a rectangular region on the original picture area of the original video frame displayed on the mobile terminal to determine the region information, and set the automatic timed photo-taking of the scenery corresponding to the region through the setting function of the photo application. The automatic timed photo-taking interval can be set to an interval of 100 milliseconds to 10 minutes. The automatic photo-taking duration can also be set, for example, to 1 hour, and the user can input the specified photo-taking duration.

[0186] Referring to FIG. 7B, the rectangular region can be a horizontal rectangular region or a vertical rectangular region. The horizontal rectangular region and the vertical rectangular region can be switched by the gravity sensing function of the mobile terminal when the user rotates the mobile terminal. The user can also change the size and style of the rectangular region by moving the frame and / or the vertex of the rectangular region. For example, the user can change the rectangular region into a vertical selection region by performing gesture sliding touch on the four frames of the rectangular region. The user can also change the rectangular region into a rectangular region with rounded corners by performing inward fine adjustment touch on the four vertices of the rectangular region. Therefore, the square, the rectangle, and the rectangular region with rounded corners all belong to the rectangular region of the embodiment.

[0187] Referring to FIG. 7C, the user can draw an elliptical region on the mobile terminal to indicate the photo-taking region of the vehicle-mounted terminal. The scene of the photo-taking region is photographed by the camera unit to obtain the target image. In the implementation, the user touches the original video frame displayed on the mobile terminal to draw the elliptical region, and sends the position information of the elliptical region to the vehicle-mounted terminal. The vehicle-mounted terminal determines the photo-taking region according to the position information, and photographs the scene of the photo-taking region by the camera unit to obtain the target image.

[0188] Referring to FIGS. 7D and 7E, the mobile terminal supports not only the vertical photo-taking picture display but also the horizontal photo-taking picture display. When the mobile terminal is switched from the vertical picture to the horizontal picture, the currently displayed photo-taking picture is automatically switched to the horizontal picture by the photo application. The user can take a photo of a partial region, and the target image obtained by the photo-taking satisfies the real photo-taking requirement of the user.

[0189] As shown in FIG. 8, the embodiment provides a full-scene preview and partial photo-taking process, and the process is specifically as follows:

[0190] Step 800: The mobile terminal installs a photo application.

[0191] Step 801, the mobile terminal and the vehicle-mounted terminal establish a connection through a DLAN.

[0192] Step 802, each raw video frame cached by the vehicle-mounted terminal is sent to the mobile terminal for display.

[0193] Step 803, the photographing application of the mobile terminal automatically adapts the raw video frame for display according to the current screen display mode.

[0194] Optionally, the screen display mode includes, but is not limited to, landscape display, portrait display, small window display, etc.

[0195] Step 804, the user draws region information on the raw video frame displayed on the preview interface of the photographing application of the mobile terminal through a touch gesture.

[0196] The region information drawn by the user through the touch gesture includes trajectory information of the touch point of the user.

[0197] Step 805, the photographing application of the mobile terminal monitors the region information and calls a graph recognition algorithm to display the drawn region graph on the current raw video frame.

[0198] Step 806, the mobile terminal sends the region information to the vehicle-mounted terminal.

[0199] Step 807, the vehicle-mounted terminal determines a shooting region according to the region information, shoots the scene corresponding to the shooting region, and obtains a target image.

[0200] Optionally, the scene corresponding to the shooting region is shot to obtain a first video frame; the first video frame is determined as the target image corresponding to the shooting region; or, the first video frame is image-cropped according to the shooting region to obtain the target image.

[0201] Step 808, an image set containing multiple target images is generated.

[0202] Step 809, the user selects at least one target image from the image set and automatically arranges and generates a photo album of different styles through a local template photo album.

[0203] The embodiment also provides a scheme for modifying the display proportion of the video frame collected by the camera unit in the original video frame in the preview interface of the mobile terminal. The mobile terminal controls the proportion of the video frame collected by each camera unit in the original video frame. For example, the original picture area of the original video frame includes a plurality of sub-areas, and one sub-area corresponds to one camera unit. On the mobile terminal side, the user realizes the switching of the multi-scene camera preview picture to the single camera preview picture through the touch and long press dragging method. As shown in FIGS. 9A-9C, the embodiment provides a sub-area dragging interface diagram. The user can change the proportion of the sub-area in the currently displayed picture by dragging the sub-area in the currently displayed original video frame picture. Referring to FIG. 9A, the currently displayed original video frame includes five sub-areas, each sub-area corresponds to one camera unit, and if it is needed to switch the current original video frame to the video frame collected by the front-end camera unit of the vehicle body, the user starts at an arbitrary position in the sub-area A corresponding to the front-end camera unit of the vehicle body, drags downward by a distance, the sub-area A is automatically stretched downward slowly, and until the sub-area A is enlarged and tiled to the entire display area, that is, one dragging is completed, and the switching display from the original video frame formed by the video frames collected by the five camera units to the video frame of the single camera unit is realized. Referring to FIG. 9B, the currently displayed original video frame includes the video frame collected by the front-end camera unit of the vehicle body, and if it is needed to switch the current video frame collected by the front-end camera unit of the vehicle body to the original video frame, the user starts at an arbitrary position in the sub-area A corresponding to the front-end camera unit of the vehicle body, drags upward by a distance, the sub-area A is automatically stretched upward slowly, and meanwhile, the other sub-areas in the original video frame are also updated and displayed, until the sub-area A is reduced to the minimum threshold value of the sub-area, one dragging is completed, and the switching display from the video frame of the single camera unit to the original video frame formed by the video frames collected by the five camera units is realized. Referring to FIG. 9C, the currently displayed original video frame includes five sub-areas, each sub-area corresponds to one camera unit, and if it is needed to switch the current original video frame to the video frame collected by the left camera unit of the vehicle body, the user starts at an arbitrary position in the sub-area C corresponding to the left camera unit of the vehicle body, drags rightward by a distance, the sub-area C is automatically stretched rightward slowly, and until the sub-area C is enlarged and tiled to the entire display area, that is, one dragging is completed, and the switching display from the original video frame formed by the video frames collected by the five camera units to the video frame of the single camera unit is realized.

[0204] As shown in FIG. 10, the embodiment also provides a mobile terminal local dynamic preview display scheme flow, and the specific process is as follows:

[0205] Step 1000, the mobile terminal is installed with a photographing application, and is connected with the vehicle-mounted terminal, and the original video frame generated by the video frames collected by the plurality of camera units is transmitted to the mobile terminal display preview in real time.

[0206] Step 1001, the user selects a sub-region corresponding to any one camera unit in the original video frame on the mobile terminal, and drags;

[0207] The original picture region of the original video frame includes a plurality of sub-regions, and one sub-region corresponds to one camera unit.

[0208] Step 1002, according to the dragging distance, the proportion of the display picture of the sub-region in the original video frame is updated and displayed in the current display picture of the mobile terminal;

[0209] In the implementation, according to the dragging distance of the user, the video picture in the sub-region is stretched in real time to the current position dragged by the user

[0210] Step 1003, the mobile terminal sends the coordinate information of real-time dragging to the vehicle terminal, and the vehicle terminal calculates the stretching length and width size of the video picture of the sub-region in real time according to the coordinate information, and regenerates the original video frame with other sub-regions;

[0211] Step 1004, the mobile terminal receives the updated original video frame of the vehicle terminal and displays and previews;

[0212] Step 1005, when the dragging distance is maximum, the video picture of the sub-region is displayed on the mobile terminal and the vehicle terminal in full screen synchronously.

[0213] In the implementation, when the user drags the boundary of the sub-region to the farthest boundary of the sub-region opposite to the sub-region in the direction away from the sub-region, the shooting picture of the camera unit corresponding to the sub-region is displayed in full screen in real time, and the shooting pictures of other camera units are no longer displayed.

[0214] As shown in FIGS. 11A-11B, the embodiment also provides a zoom preview display interface of the mobile terminal. The user can pinch in or pinch out on the interface of the mobile terminal displaying the original video frame by two fingers, so as to zoom in or zoom out the preview picture of the current original video frame, and zoom in to full screen display or zoom out to small window mode display. In the small window mode, the small window can be dragged to any position on the screen. Referring to FIG. 11A, taking the display picture of a single camera unit as an example, the current original video frame is the video frame captured by the front-end camera unit of the vehicle body. The user performs a zoom touch gesture on the display picture of the mobile terminal, for example, the user zooms in the current original video frame to full screen display by pinching in with two fingers, or zooms out the current original video frame to small window mode by pinching out with two fingers, and in the small window mode, the original video frame can be dragged to any position on the screen. Referring to FIG. 11B, taking the display picture of multiple camera units as an example, the current original video frame is generated by splicing the video frames captured by five camera units. The user performs a zoom touch gesture on the display picture of the mobile terminal, and zooms out the current original video frame to small window mode by pinching out with two fingers, and in the small window mode, the original video frame can be dragged to any position on the screen.

[0215] It should be noted that the display scheme of the mobile terminal preview interface pulling the screen to zoom in the picture captured by a single camera is not only applicable to the scene of operating the mobile terminal in the vehicle, but also applicable to the preview display scheme of the vehicle terminal. The user can pinch in or pinch out on the interface of the vehicle terminal displaying the original video frame by two fingers, so as to zoom in or zoom out the preview picture of the current original video frame, and zoom in to full screen display (optionally, the full screen here can also be the full area display of a sub-area in the display area), or zoom out to small window mode display. In the small window mode, the small window can be dragged to any position on the screen. Since the display unit of the vehicle terminal is usually divided into multiple display areas, the display pictures of multiple camera units, i.e., the original video frames, are displayed in one display area. The user can drag and drop the original video frame displayed in one display area to another display area, or drag and drop at least one video frame in the original video frame displayed in one display area to another display area for display.

[0216] As shown in FIGS. 12A-12E, the present embodiment provides a preview display interface of the vehicle terminal, referring to FIG. 12A, the display unit of the vehicle terminal includes a plurality of display areas, which are the main driver area, the central control area and the co-driver area respectively. The vehicle terminal generates original video frames by splicing the video frames collected by the five camera units, referring to FIG. 12B, the original video frames generated by the video frames collected by the camera units are displayed in the co-driver area, referring to FIG. 12C, the user drags the sub-area E in the original video frames to the central control area for display, and drags the sub-area A in the original video frames to the main driver area for display. Referring to FIG. 12D, the user can also perform zooming operation on the picture displayed in each display area, drag the sub-area A in the original video frames to the main driver area for full screen display, drag the sub-area E in the original video frames to the central control area for full screen display, and change the proportion of the sub-area B in the original video frames displayed in the co-driver area to enlarge the video picture of the sub-area B. Referring to FIG. 12E, the user can drag the sub-area A in the original video frames to the main driver area for full screen display, drag the sub-area E in the original video frames to the central control area for full screen display, and drag the sub-area B in the original video frames to the co-driver area for full screen display.

[0217] The present embodiment also provides a shooting control of the vehicle terminal according to the posture of the target object in the vehicle. In the implementation, the in-vehicle camera unit is used to collect in-vehicle images, the posture of the target object in the in-vehicle images is detected, and the shooting direction is determined according to the detection result. Optionally, the target object includes but is not limited to the driver, the co-driver occupant and the rear seat occupant. Optionally, the posture of the target object includes but is not limited to the face posture, the eye posture, the hand posture and the body posture. For example, the real-time rotating direction of the captured face is detected by the in-vehicle camera unit, when the face posture in the in-vehicle images is detected, it is detected that the face is observing the scene outside the left window, that is, the face is facing the left side of the window, it is determined that the shooting direction at this time should be the direction of the left side of the vehicle body, and the left side camera unit of the vehicle body is used for shooting, so that the image picture obtained by shooting is the scenery facing the user's face. That is, the in-vehicle camera unit shoots in real time by using the shooting direction corresponding to the face posture, so as to ensure that the scenery facing the face is consistent with the current shooting picture.

[0218] As shown in FIG. 13, the present embodiment provides a technical process for synchronizing the face rotating direction with the camera direction, which is specifically as follows:

[0219] Step 1300, collecting in-vehicle images by using the in-vehicle camera unit, and detecting the face posture in the in-vehicle images;

[0220] Step 1301, determining the direction facing the detected face posture as the shooting direction;

[0221] In implementation, the face rotation AI algorithm can be used to detect the direction in which the face is directly facing.

[0222] Step 1302: capturing an image by using the camera unit corresponding to the shooting direction to obtain a current shooting image.

[0223] Step 1303: sending the current shooting image to the mobile terminal for synchronous display.

[0224] The embodiment can realize that when the person in the vehicle rotates the face, the vehicle-mounted terminal and the mobile terminal synchronously display the shooting image corresponding to the rotation direction according to the face rotation direction.

[0225] As shown in FIG. 14, the embodiment further provides a flow of controlling shooting by using the direction of shooting by a mobile phone, and the flow is specifically as follows:

[0226] Step 1400: collecting an in-vehicle image by using an in-vehicle camera unit, and detecting a hand posture in the in-vehicle image.

[0227] Step 1401: determining a shooting direction of the mobile terminal held by the hand posture.

[0228] Step 1402: capturing an image by using the camera unit corresponding to the shooting direction to obtain a current shooting image.

[0229] Optionally, periodic automatic shooting can be further set, for example, the camera unit corresponding to the shooting direction is automatically shot every N milliseconds, and the shooting image is temporarily saved to the mobile terminal or locally. Optionally, a continuous shooting function can be further set, the camera unit corresponding to the shooting direction is continuously shot, and the images obtained by the continuous shooting are saved to the mobile terminal or locally.

[0230] Step 1403: sending the current shooting image to the mobile terminal for synchronous display.

[0231] Optionally, the current shooting video image can be temporarily stored, and saved to the mobile terminal or locally. The user can also select at least one shooting image from the temporarily stored shooting images for permanent storage, and can also select at least one shooting image to share with other mobile terminals connected to the vehicle-mounted terminal, or share to social media (such as WeChat, Weibo, and other social media).

[0232] As shown in FIG. 15, the embodiment further provides a scheme of fusing the shooting image of the mobile terminal and the shooting image of the vehicle-mounted terminal, and the specific implementation flow is as follows:

[0233] Step 1500: collecting an in-vehicle image by using an in-vehicle camera unit, and detecting a hand posture in the in-vehicle image.

[0234] Step 1501: determining a shooting direction of the mobile terminal held by the hand posture.

[0235] The photographing direction of the mobile terminal and the position of the camera unit corresponding to the photographing direction can be recognized by a hand photographing gesture posture AI algorithm. For example, the mobile terminal is photographing the scenery on the left side of the vehicle body. At this time, the camera unit corresponding to the photographing direction is the left side camera unit of the vehicle body, so that photographing is performed by using the left side camera unit of the vehicle body.

[0236] Step 1502, photographing is performed by using the camera unit corresponding to the photographing direction to obtain a current photographed image.

[0237] Step 1503, receiving a first image sent by the mobile terminal.

[0238] The first image is an image photographed by the user of the mobile terminal in the vehicle, so the first image usually contains vehicle body information such as the outline of the vehicle, the window, and the scenery that the user really wants to photograph.

[0239] Step 1504, image fusion is performed on the current photographed image and the first image to filter out the vehicle information in the first image to obtain a second image.

[0240] The second image obtained by filtering the image photographed by the mobile terminal by the vehicle body in this embodiment can be understood as a real picture photographed from the photographing angle of the user of the mobile terminal, so that the person in the vehicle does not need to get off the vehicle to take a photograph, and a photo without the vehicle body can be taken in the vehicle.

[0241] In some embodiments, the embodiment also provides a photographing scene and person synthesis technical solution. The solution can synthesize the person information in the image provided by the mobile terminal into the video frame collected by the camera unit of the vehicle terminal to perform person synthesis. The main driver, the co-pilot, and the person in the vehicle can save personal photos by using the mobile terminal, and the video frame of the scenery outside the vehicle collected by the camera unit is processed by using an image fusion algorithm to synthesize the scenery outside the vehicle and the person, and display the image of the person in the scenery outside the vehicle. The synthesized person image can also be displayed in real time on the preview interface of the photographing application of the mobile terminal.

[0242] As shown in FIGS. 16A-16B, the embodiment provides an operation interface diagram of a photographing scene and a person synthesis, as shown in FIG. 16A, after obtaining the image containing single person information sent by the mobile terminal, the person information in the image is extracted, the extracted person information and the video frame shot by at least one camera unit are image fused, for example, the extracted person information and the video frame shot by the left camera unit of the vehicle body are image fused, the fused image is obtained, the new original video frame is obtained by reimage splicing using the fused image and the video frame shot by other camera units, and the new original video frame is synchronously updated and displayed on the mobile terminal and the vehicle-mounted terminal. As shown in FIG. 16B, after obtaining the image containing multiple person information sent by the mobile terminal, the multiple person information in the image is extracted, the extracted multiple person information and the video frame shot by at least one camera unit are image fused, for example, the extracted multiple person information and the video frame shot by the front camera unit of the vehicle body are image fused, the fused image is obtained, the new original video frame is obtained by reimage splicing using the fused image and the video frame shot by other camera units, and the new original video frame is synchronously updated and displayed on the mobile terminal and the vehicle-mounted terminal.

[0243] In some embodiments, the embodiment can also fuse the current face with the scene outside the vehicle according to the face posture and gesture in the image inside the vehicle collected by the camera unit inside the vehicle in real time. For example, the camera unit inside the vehicle can monitor the face, expression and hand movement of the person inside the vehicle in real time, such as a gesture of giving a heart, giving an OK, a smiling expression, etc., the person expression and gesture picture is monitored in real time by the camera unit inside the vehicle, and the user inside the vehicle can select to image fuse the person shot by the camera unit inside the vehicle with the scenery picture shot by the camera unit outside the vehicle, to obtain multiple groups of shooting images, which can also be made into an AI photo album, an AI picture book, etc. by AI technology.

[0244] As shown in FIG. 17, the embodiment also provides a scheme of real-time photographing of a person inside a vehicle and a scene outside the vehicle, and the specific implementation process is as follows:

[0245] Step 1700, the mobile terminal is installed with a photographing application and is connected with the vehicle-mounted terminal;

[0246] Step 1701, the vehicle-mounted terminal transmits the original video frame formed by the video frames collected by multiple camera units to the mobile terminal in real time to display a preview;

[0247] Step 1702, the user zooms in the display picture of the video frame corresponding to the video frame collected by the camera unit inside the vehicle in the photographing application preview interface of the mobile terminal;

[0248] Step 1703, the user triggers photographing by long pressing the display picture of the zoomed-in video frame, and obtains a face image of the current face posture of the user;

[0249] In which, the user can snap the facial expression against the camera, make the hand gesture, and long press on the display picture collected by the in-vehicle camera unit to take a real-time snapshot.

[0250] Step 1704, display the face image and save it to the mobile terminal or locally;

[0251] Step 1705, drag the face image to the video frame corresponding to the video frame collected by any camera unit;

[0252] Step 1706, image fusion of the face image and the video frame to obtain a composite image.

[0253] In which, the face image is dragged to the display picture of any camera unit, and the video frame of the display picture is acquired in real time, the image fusion of the portrait and the scenery in the video frame is performed through the AI algorithm, and the composite image is saved.

[0254] The embodiment also provides a mobile terminal full-scene shooting technical solution, the mobile terminal is connected with the display unit of the vehicle terminal, and the video frame collected by the camera unit of the vehicle terminal is sent to the mobile terminal in real time for display. As shown in FIG. 18, the embodiment also provides a picture schematic diagram of real-time display of the mobile terminal video frame, in which the mobile terminal can be connected with the vehicle terminal, and the connection mode can adopt the existing screen projection technical means such as video DLNA screen projection, the cached data of the vehicle terminal is pulled to the mobile terminal for synchronous display in real time, and the mobile terminal displays the screen projection picture of the vehicle terminal in real time. The user of the mobile terminal can realize the above connection and display functions by installing a shooting application. The user can take a picture of each frame of the screen projection video frame in real time on the mobile terminal. Optionally, the shooting can be performed on the mobile terminal in a manual shooting or automatic shooting mode. The manual shooting means that the user can take a picture by clicking the blank area at the edge of the original video frame in the current display picture. The automatic shooting means that the user can select the required options such as automatic shooting and automatic shooting interval in the settings of the shooting application of the mobile terminal, and take a picture of the driving personnel or the passenger in the vehicle in real time and automatically in the scene where it is inconvenient to shoot the scenery outside the vehicle in the vehicle.

[0255] As shown in FIG. 19, the embodiment also provides a mobile terminal connection vehicle terminal screen projection display scheme flow, which is specifically as follows:

[0256] Step 1900, the mobile terminal is installed with a shooting application, and the mobile terminal is connected with the vehicle terminal through DLNA;

[0257] In which, the mobile terminal is installed with a shooting application, and the shooting application can be installed through the two-dimensional code scanning mode of scanning the camera control application of the vehicle terminal, and after installation, the connection with the vehicle terminal is automatically established.

[0258] Step 1901, the vehicle-mounted terminal transmits the buffered original video frames to the mobile terminal in real time for display;

[0259] Optionally, the mobile terminal and the vehicle-mounted terminal establish a connection through DLNA screen projection. There are various screen projection protocol technical solutions, and in the embodiment, DLNA screen projection is used as an example for illustration. When the user installs a photographing application of the mobile terminal, the user can select automatic connection or manual connection in the photographing application settings. That is, when the user enters the vehicle with the mobile terminal, if it is the first time to install the photographing application, the default is to automatically perform screen projection connection. That is, the user will automatically establish a connection with the vehicle-mounted terminal every time the user enters the vehicle. If the user does not want to automatically establish a connection, the user can close the automatic connection and open the manual connection configuration through the photographing application settings. That is, the user needs to manually and actively establish a connection with the vehicle-mounted terminal every time the user enters the vehicle.

[0260] Step 1902, the mobile terminal photographing application monitors the current display mode in real time;

[0261] Optionally, through the DLNA screen projection protocol, each frame of image data buffered and spliced and fused in the vehicle-mounted terminal can be transmitted to the mobile terminal in real time, and the mobile terminal receives the image data. Optionally, the display mode includes, but is not limited to, horizontal screen display, vertical screen display, small window display, and the like. The photographing application of the mobile terminal monitors the horizontal and vertical screen layout of the current display mode in real time through gravity sensing.

[0262] Step 1903, the original video frames obtained by splicing the video frames collected by each camera unit are displayed on the photographing application preview interface of the mobile terminal in the vertical screen display mode;

[0263] Step 1904, if it is detected that the mobile terminal switches to the horizontal screen display mode, the original video frames are switched and displayed in the horizontal screen display mode.

[0264] Optionally, the mobile terminal displays the real-time screen projection data in the vertical screen display mode by default and displays the data in real time through the photographing application preview interface. The user of the mobile terminal can magnify or reduce the display screen in real time through a touch gesture. If the mobile terminal is in the horizontal screen display mode or is switched from the vertical screen display mode to the horizontal screen display mode, the screen projection picture of the vehicle-mounted terminal can be displayed on the horizontal screen preview interface after being rotated, and the touch gesture is also supported for magnifying or reducing the display.

[0265] The hardware device of the vehicle terminal in the embodiment includes but is not limited to a central control display device, at least one camera unit, the central control display device includes but is not limited to a SOC board card, a central control display screen, a main driving area under-screen camera and the like; the display picture of the central control display screen includes a plurality of display areas, such as a main driving area, a copilot area and a central control area. The algorithm related to the vehicle terminal includes but is not limited to a video picture splicing algorithm, a video frame picture edge fusion algorithm, a graphic recognition algorithm, an image stretching algorithm, an image enlargement and reduction algorithm and the like. The shooting scheme of the vehicle terminal in the embodiment can be applied to a very wide range of scenes, for example, it can help the driver to take pictures when he / she encounters a scenic spot during a self-driving tour. During driving, the vehicle terminal can also take real-time pictures of the scenery outside the vehicle according to posture recognition (the direction of the face rotation, the line of sight of the eyes, the posture of the mobile phone when the hand holds the mobile phone to take pictures) and the like. For the copilot or the passenger in the back seat, if the mobile terminal is directly used to take pictures in the vehicle, the vehicle window glass will block the view, and if the mobile terminal is used to take pictures while driving, it will be dangerous and the full-scene picture cannot be obtained. Therefore, the shooting control scheme of the embodiment can realize full-scene control preview display, the mobile terminal of the passenger in the vehicle can be connected with the vehicle terminal at any time, and the mobile terminal can select a shooting area at any time to select and continuously shoot the shooting area and realize automatic shooting functions such as continuous shooting. In a driving scene, such as a self-driving tour, the passengers in the vehicle want to take pictures of the scenery along the way, but do not want to stop the vehicle and get out of the vehicle to take pictures every time, therefore, the real-time camera shooting picture scene can be realized through the personal picture and scenery fusion technical means. During driving, the driver wants to take real-time pictures of the surrounding road conditions, such as an accident or danger in front, and needs to take pictures in time to provide evidence, the full-scene shooting or full-scene video recording mode can be used to record the process. The full-scene shooting can clearly record the causes and consequences of the surrounding vehicles in the state.

[0266] The photographing control scheme provided by the embodiment mainly realizes real-time detection through the camera unit of the vehicle terminal, real-time display of the photographing picture through the in-vehicle display unit, selection of the photographing area by the mobile terminal, and real-time control of the photographing, so that the driver can take real-time photographs while driving. The video frames photographed by the multiple cameras outside the vehicle are spliced and displayed on the mobile terminal of the user, the user can select a photographing range on the mobile terminal, and then take a photograph. The picture synthesized by the multiple cameras outside the vehicle is displayed on the in-vehicle screen, and then at least part of the video frames are projected to the mobile terminal; the video frames projected to the mobile terminal are marked on the screen, and the user can also adjust the angle of view of the obtained video frames according to the posture of the mobile terminal, so as to display the video frames under the adjusted angle of view. The photographing range can also be obtained according to the line of sight focus of the driver, and the photographing can be controlled according to the voice. After the user establishes a connection between the mobile terminal and the vehicle terminal, the mobile terminal can display the video frames collected by the real-time full-scene camera. The driver and the members in the vehicle can both view the scenery outside the vehicle in real time through the mobile terminal, and select a region of the scenery to take a photograph. The scenery region can be enlarged and displayed for photographing through the gesture pinching and opening method. The user experience can be effectively improved without stopping the vehicle for photographing each time.

[0267] Based on the same inventive concept, the embodiment also provides a vehicle terminal, as shown in FIG. 20, which includes a display unit 2000 and a control circuit 2001, wherein:

[0268] The control circuit 2001 includes a processor and a memory, the memory is used to store a program executable by the processor, and the processor is used to read the program in the memory and perform the following steps:

[0269] 1) generating an original video frame according to a video frame collected by at least one camera unit;

[0270] 2) receiving area information sent by a mobile terminal, the area information indicating at least part of an area in an original picture region corresponding to the original video frame, and the mobile terminal being in communication connection with the vehicle terminal;

[0271] 3) determining a target video frame in the original video frame according to the area information;

[0272] 4) sending the target video frame to the mobile terminal, for the mobile terminal to determine a second target image according to the target video frame.

[0273] In some embodiments, the processor is specifically further configured to perform: sending the original video frame to the mobile terminal, for the mobile terminal to determine area information based on the original video frame.

[0274] In some embodiments, the processor is further specifically configured to perform: sending at least part of the video frames in the original video frames to the mobile terminal, so that the mobile terminal determines the region information based on at least part of the video frames in the original video frames.

[0275] Optionally, at least part of the video frames in the original video frames include, but are not limited to, at least one video frame captured under one view angle, or at least one video frame captured by one camera unit, or at least one video frame obtained by image stitching of at least one video frame captured under multiple view angles, or at least one video frame obtained by image stitching of at least one video frame captured by multiple camera units, or at least one video frame corresponding to part of view angles in one view angle, or part of display screens of at least one video frame captured by one camera unit, or at least one video frame corresponding to part of view angles in the stitched view angle after image stitching of multiple view angles, or part of display screens of at least one video frame obtained by image stitching of at least one video frame captured by multiple camera units.

[0276] In some embodiments, the processor is specifically configured to perform: sending the video frames of at least one view angle in the original video frames to the mobile terminal.

[0277] In some embodiments, the processor is further specifically configured to perform: receiving a view angle switching instruction sent by the mobile terminal, the view angle switching instruction including the region information; determining a second view angle according to the view angle switching instruction, and determining the video frames of the second view angle as the target video frames.

[0278] Optionally, the view angle switching instruction includes, but is not limited to, a touch gesture such as sliding, long pressing, clicking, and the like, and can also include a mobile terminal posture. In implementation, a user can trigger the view angle switching instruction through a touch gesture such as sliding, long pressing, clicking, and the like. For example, the mobile terminal currently displays a video frame of view angle A in the original video frame, the user performs a sliding operation (view angle switching instruction) on the display screen, determines that the first view angle corresponding to the sliding operation is view angle B, and the vehicle-mounted terminal sends the video frame of view angle B to the mobile terminal, that is, the video frame of view angle A currently displayed on the mobile terminal is switched to the video frame of view angle B. The user can also trigger the generation of the view angle switching instruction through a mobile terminal posture. For example, a three-axis acceleration sensor, a gyroscope sensor, a distance sensor, a gravity sensor, a magnetometer sensor, and the like can be used. When it is detected that the mobile terminal posture changes, the video frame currently displayed can be switched to the video frame corresponding to the changed mobile terminal posture. For example, the mobile terminal currently displays a video frame of view angle A, and when the mobile terminal rotates to the left, the current video frame is switched to a video frame of view angle C. When the video frame of the switched view angle is determined, the direction of the mobile terminal motion track and the positional relationship of different view angles can be used for determination. For example, view angle A is a view angle at the front end of the vehicle, and view angle C is a view angle at the left side of the vehicle. When the mobile terminal rotates to the left, the current view angle A is switched to the video frame of view angle C, so that the direction of the mobile terminal movement is consistent with the direction of the video frame switching.

[0279] In some embodiments, the processor is further configured to determine a third image according to an image collected by at least one in-vehicle camera unit, and send the third image to the mobile terminal, so that the mobile terminal performs image fusion on the target video frame and the third image to obtain a second target image.

[0280] In some embodiments, third indication information is sent to the mobile terminal, and the third indication information is used to indicate the position of a target object in the third image, so that the mobile terminal performs image fusion on the target video frame and the target object to obtain a second target image.

[0281] The third indication information can be sent to the mobile terminal in the third image, or can be sent to the mobile terminal separately.

[0282] It should be noted that "first", "second", and "third" in the present embodiment are only used for distinction, and do not represent sequence. The meanings of "first image", "second image", and "third image" in the present embodiment are the same.

[0283] The vehicle-mounted terminal of the embodiment can control the photographing position and take a photo through the mobile terminal. The mobile terminal selects a scenic area (area information) to be photographed, and the vehicle-mounted terminal sends a target video frame corresponding to the area information to the mobile terminal, so that the mobile terminal determines a second target image according to the target video frame. Since the principle of solving the problem of the vehicle-mounted terminal in the embodiment is similar to the principle of solving the problem of the vehicle-mounted terminal described above, the implementation of the vehicle-mounted terminal can be referred to the implementation of the vehicle-mounted terminal described above, and the repeated parts will not be described herein.

[0284] Based on the same inventive concept, the disclosure also provides a mobile terminal. Since the mobile terminal is the mobile terminal connected with the vehicle-mounted terminal described above, and the principle of solving the problem of the mobile terminal is similar to that of the vehicle-mounted terminal, the implementation of the mobile terminal can be referred to the implementation of the vehicle-mounted terminal, and the repeated parts will not be described herein.

[0285] As shown in FIG. 21, the mobile terminal includes a processor 2100 and a memory 2101 for storing programs executable by the processor 2100, and the processor 2100 is configured to read the programs in the memory 2101 and perform the following steps:

[0286] determining area information of an original video frame generated by a vehicle-mounted terminal, the area information indicating at least part of an original picture area corresponding to the original video frame, the mobile terminal being in communication connection with the vehicle-mounted terminal;

[0287] sending the area information to the vehicle-mounted terminal, so that the vehicle-mounted terminal determines a target video frame in the original video frame according to the area information;

[0288] receiving the target video frame sent by the vehicle-mounted terminal, and determining a target image according to the target video frame.

[0289] In some embodiments, the processor 2100 is specifically configured to perform the following steps:

[0290] in response to a selection instruction of a user, determining the area information of the original video frame; the selection instruction includes any one or more of the following:

[0291] a touch gesture performed by the user on the displayed original picture area; or,

[0292] a touch trajectory drawn by the user on the displayed original picture area; or,

[0293] a view angle switching instruction, the view angle switching instruction being an instruction triggered by a switching operation performed by the user on at least one view angle video frame in the original video frame; or,

[0294] A shooting instruction, the shooting angle being an instruction triggered by a user performing a shooting operation on the video frame of at least one of the view angles in the original video frame.

[0295] Optionally, the mobile terminal can select at least part of the region from the original picture region corresponding to the original video frame, and determine the selected at least part of the region as the region information. In one case, the mobile terminal can select the region corresponding to the video picture of at least one view angle from the original picture region, and determine the video frame of the view angle as the region information sent to the vehicle-mounted terminal. In another case, the mobile terminal can select at least part of the region in the video picture of the same view angle from the original picture region, and determine at least part of the region in the video frame of the view angle as the region information. The mobile terminal can select the region information by touch gestures such as clicking, sliding, and long pressing. The region information can also be selected by a touch trajectory drawn on the original picture region of the displayed original video frame by a touch gesture, for example, the user draws a figure of different shapes such as a rectangle or a circle on the original picture region of the displayed original video frame, and determines the drawn figure region as the region information; or draws a line on the original picture region of the displayed original video frame, and determines the region corresponding to the line as the region information. The region information can also be selected by a switching operation instruction triggered by performing a switching operation on the video frame of at least one view angle in the original video frame, and selecting the video frame after the view angle is switched as the region information. The region information can also be selected by a shooting instruction triggered by performing a shooting operation on the video frame of at least one view angle in the original video frame, and selecting the video frame when shooting as the region information.

[0296] In some embodiments, the processor 2100 is specifically configured to perform: sending at least part of the video frames in the original video frame to the mobile terminal, so that the mobile terminal determines the region information based on at least part of the video frames in the original video frame.

[0297] Optionally, at least part of the video frames in the original video frame include but are not limited to at least one video frame captured under one view angle, or at least one video frame captured by one camera unit, or at least one video frame obtained by image stitching of at least one video frame captured under multiple view angles, or at least one video frame obtained by image stitching of at least one video frame captured by multiple camera units, or at least one video frame corresponding to part of the view angles in one view angle, or part of the pictures in the display picture of at least one video frame captured by one camera unit, or at least one video frame corresponding to part of the view angles in the stitched view angles after multiple view angles are stitched, or part of the pictures in the display picture of at least one video frame obtained by image stitching of at least one video frame captured by multiple camera units.

[0298] As an optional implementation, the processor 2100 is specifically configured to perform:

[0299] receive the original video frames sent by the vehicle terminal, and determine the region information according to the original video frames.

[0300] As an optional implementation, the processor 2100 is specifically configured to perform:

[0301] in response to a first selection operation of a user on the original video frames, determine the region information according to at least part of the video frames of the original video frames; or,

[0302] in response to a second selection operation of a user on the original video frames, determine the region information according to part of the region of the original video frames.

[0303] As an optional implementation, the processor 2100 is specifically configured to perform:

[0304] receive at least part of the video frames in the original video frames sent by the vehicle terminal, and determine the region information according to the at least part of the video frames.

[0305] As an optional implementation, the processor 2100 is specifically configured to perform:

[0306] receive the video frames of at least one view angle sent by the vehicle terminal, and determine the region information according to the video frames of the at least one view angle.

[0307] As an optional implementation, the processor 2100 is specifically configured to perform:

[0308] in response to a switching operation of a user on the video frames of the at least one view angle, trigger generation of a view angle switching instruction, and determine the video frames of the view angle corresponding to the view angle switching instruction as the region information; or,

[0309] in response to a shooting operation of a user on the video frames of the at least one view angle, trigger generation of a shooting instruction, and determine the video frames of the view angle corresponding to the shooting instruction as the region information.

[0310] As an optional implementation, the processor 2100 is specifically configured to perform:

[0311] receive a fourth image sent by the vehicle terminal;

[0312] perform image fusion on the target video frame and the fourth image to obtain a target image.

[0313] As an optional implementation, the processor 2100 is specifically configured to perform:

[0314] obtain a local image, perform image fusion on the target video frame and the local image to obtain a target image; or,

[0315] acquire a local video, and perform image fusion on the target video frame and the local video to obtain a target image.

[0316] As an optional implementation, the processor 2100 is specifically configured to perform the following steps:

[0317] acquire a local image, and perform image fusion on the target video frame and the local image to obtain a target image;

[0318] perform image fusion on the local image and the target image to obtain a fused image.

[0319] The fusion of images and images also increases the right.

[0320] As an optional implementation, the processor 2100 is specifically configured to perform the following steps:

[0321] receive fourth indication information, the fourth indication information being used to indicate the position of a target object in the local image; and perform image fusion on the target video frame and the target object to obtain a target image.

[0322] Based on the same inventive concept, the embodiment of the disclosure also provides another vehicle-mounted terminal. Since the vehicle-mounted terminal is the vehicle-mounted terminal in the method of the embodiment of the disclosure, and the principle of solving the problem of the vehicle-mounted terminal is similar to that of the method, the implementation of the vehicle-mounted terminal can be referred to the implementation of the method, and the repeated parts will not be described here.

[0323] As shown in FIG. 22, the vehicle-mounted terminal includes a display unit 2200 and a control circuit 2201, wherein:

[0324] The control circuit 2201 includes a processor and a memory, the memory is used to store a program executable by the processor, and the processor is used to read the program in the memory and perform the following steps:

[0325] acquire a first image according to at least one camera unit, and determine the pose of a target object in the first image;

[0326] determine a view angle according to the pose of the target object;

[0327] generate an original video frame according to a video frame captured by the camera unit of the view angle;

[0328] determine a target image according to the original video frame.

[0329] Based on the same inventive concept, the embodiment of the disclosure also provides an image shooting method. As shown in FIG. 23, the specific implementation process of the method is as follows:

[0330] Step 2300, generating an original video frame according to a video frame collected by at least one camera unit;

[0331] Step 2301, receiving area information sent by a mobile terminal, the area information indicating at least part of an area of an original picture corresponding to the original video frame, the mobile terminal being in communication connection with the vehicle-mounted terminal;

[0332] Step 2302, determining a first target image according to the area information.

[0333] As an optional implementation, the method further comprises:

[0334] sending the first target image to the mobile terminal.

[0335] As an optional implementation, the method further comprises:

[0336] sending the original video frame to the mobile terminal for the mobile terminal to determine area information based on the original video frame.

[0337] As an optional implementation, the method further comprises:

[0338] sending at least part of the original video frame to the mobile terminal for the mobile terminal to determine area information based on at least part of the original video frame.

[0339] As an optional implementation, at least part of the original video frame comprises a video frame of at least one perspective; and the sending at least part of the original video frame to the mobile terminal comprises:

[0340] sending the video frame of at least one perspective to the mobile terminal.

[0341] As an optional implementation, the method further comprises:

[0342] receiving a perspective switching instruction sent by the mobile terminal, the perspective switching instruction comprising the area information.

[0343] As an optional implementation, the method further comprises:

[0344] determining a first perspective according to the perspective switching instruction;

[0345] sending a video frame of the first perspective to the mobile terminal.

[0346] As an optional implementation, the method further comprises:

[0347] determining a first perspective according to the perspective switching instruction;

[0348] receiving a shooting instruction sent by the mobile terminal;

[0349] determining the first target image according to the video frame of the first view angle in response to the shooting instruction.

[0350] As an optional implementation, the method further comprises:

[0351] receiving a first image sent by the mobile terminal, performing image fusion on the video frame corresponding to the region information and the first image, and determining the first target image; or

[0352] receiving a first video sent by the mobile terminal, performing image fusion on the video frame corresponding to the region information and the first video, and determining the first target image.

[0353] As an optional implementation, the method further comprises:

[0354] receiving a first image sent by the mobile terminal, performing image fusion on the video frame corresponding to the region information and the first image, and determining the first target image;

[0355] performing fusion on the first image and the first target image, and sending the fused image to the mobile terminal.

[0356] As an optional implementation, the method further comprises:

[0357] determining a second image according to images collected by at least one in-vehicle camera unit;

[0358] performing image fusion on the video frame corresponding to the region information and the second image, and determining the first target image.

[0359] As an optional implementation, the performing image fusion on the video frame corresponding to the region information and the second image, and determining the first target image comprises:

[0360] receiving first indication information, determining a target object in the first image according to the first indication information, performing image fusion on the video frame corresponding to the region information and the target object, and determining the first target image; wherein the first indication information is used to indicate the position of the target object in the first image; or

[0361] receiving second indication information, determining a target object in the second image according to the second indication information, performing image fusion on the video frame corresponding to the region information and the target object, and determining the first target image; wherein the second indication information is used to indicate the position of the target object in the second image.

[0362] As an optional implementation, the determining the first target image according to the region information comprises:

[0363] if the region information comprises a plurality of video frames, performing image stitching on the plurality of video frames to obtain the first target image; or,

[0364] if the region information comprises one video frame, determining the one video frame as the first target image; or,

[0365] if the region information comprises a partial region of one video frame, performing image cropping on the one video frame to obtain the first target image.

[0366] As an optional implementation, the method further comprises:

[0367] displaying the original video frame on a display unit;

[0368] in response to a zoom operation of a user on a video frame of at least one view angle contained in the original video frame, updating a proportion of the video frame of the at least one view angle in the original video frame; and / or,

[0369] in response to a drag operation of a user on a video frame of at least one view angle contained in the original video frame, updating a display position of the video frame of the at least one view angle.

[0370] As an optional implementation, the method further comprises:

[0371] receiving a zoom instruction sent by the mobile terminal, updating a proportion of a video frame of at least one view angle in the original video frame according to zoom coordinate information corresponding to the zoom instruction, and displaying the video frame of the at least one view angle; and / or,

[0372] receiving a drag instruction sent by the mobile terminal, updating a display position of a video frame of at least one view angle according to drag coordinate information corresponding to the zoom instruction, and displaying the video frame of the at least one view angle.

[0373] As an optional implementation, the method further comprises:

[0374] displaying the original video frame on a display unit;

[0375] sending a display picture of the display unit to the mobile terminal through a screen projection protocol, so as to determine the region information according to the display picture by the mobile terminal.

[0376] As an optional implementation, the generating the original video frame according to the video frames collected by the at least one camera unit comprises:

[0377] performing image stitching on the video frames collected by the plurality of camera units to generate the original video frame.

[0378] Based on the same inventive concept, the embodiment of the disclosure also provides an image shooting method, as shown in FIG. 24, the specific implementation process of the method is as follows:

[0379] Step 2400, generating an original video frame according to a video frame collected by at least one camera unit;

[0380] Step 2401, receiving area information sent by a mobile terminal, the area information indicating at least part of an area in an original picture area corresponding to the original video frame, the mobile terminal being in communication connection with the vehicle-mounted terminal;

[0381] Step 2402, determining a target video frame in the original video frame according to the area information;

[0382] Step 2403, sending the target video frame to the mobile terminal, for the mobile terminal to determine a second target image according to the target video frame.

[0383] As an optional implementation, the method further comprises:

[0384] sending the original video frame to the mobile terminal, for the mobile terminal to determine area information based on the original video frame.

[0385] As an optional implementation, the method further comprises:

[0386] sending at least part of the original video frames to the mobile terminal, for the mobile terminal to determine area information based on at least part of the original video frames.

[0387] As an optional implementation, at least part of the original video frames comprise video frames of at least one view angle; and the sending of the original video frame to the mobile terminal comprises:

[0388] sending the video frames of at least one view angle in the original video frame to the mobile terminal.

[0389] As an optional implementation, the method further comprises:

[0390] receiving a view angle switching instruction sent by the mobile terminal, the view angle switching instruction comprising the area information;

[0391] determining a second view angle according to the view angle switching instruction, and determining a video frame of the second view angle as the target video frame.

[0392] As an optional implementation, the method further comprises:

[0393] determining a third image according to an image collected by at least one in-vehicle camera unit;

[0394] sending the third image to the mobile terminal, so that the mobile terminal performs image fusion on the target video frame and the third image to obtain a second target image.

[0395] As an optional implementation, the method further comprises:

[0396] sending third indication information to the mobile terminal, the third indication information being used to indicate a position of a target object in the third image, so that the mobile terminal performs image fusion on the target video frame and the target object to obtain a second target image.

[0397] Based on the same inventive concept, the embodiments of the disclosure further provide an image shooting method, as shown in FIG. 25, and the specific implementation process of the method is as follows:

[0398] Step 2500: determining region information of an original video frame generated by a vehicle-mounted terminal, the region information indicating at least part of a region of an original picture corresponding to the original video frame, the mobile terminal being in communication connection with the vehicle-mounted terminal;

[0399] Step 2501: sending the region information to the vehicle-mounted terminal, so that the vehicle-mounted terminal determines a target video frame in the original video frame according to the region information;

[0400] Step 2502: receiving the target video frame sent by the vehicle-mounted terminal, and determining a target image according to the target video frame.

[0401] Based on the same inventive concept, the embodiments of the disclosure further provide an image shooting method, as shown in FIG. 26, and the specific implementation process of the method is as follows:

[0402] Step 2600: collecting a first image according to at least one camera unit, and determining a posture of a target object in the first image;

[0403] Step 2601: determining a view angle according to the posture of the target object;

[0404] Step 2602: generating an original video frame according to a video frame collected by the camera unit of the view angle;

[0405] Step 2603: determining a target image according to the original video frame.

[0406] Based on the same inventive concept, the embodiments of the disclosure further provide an image shooting device, since the device is the device in the image shooting method in the embodiments of the disclosure, and the principle of solving problems of the device is similar to that of the image shooting method, therefore, the implementation of the device can be referred to the implementation of the method, and the repeated parts will not be described here.

[0407] As shown in FIG. 27, the apparatus includes:

[0408] An original video unit 2700 configured to generate an original video frame according to a video frame captured by at least one camera unit;

[0409] A region receiving unit 2701 configured to receive region information sent by a mobile terminal, the region information indicating at least part of an original picture region corresponding to the original video frame, the mobile terminal having a communication connection established with the vehicle-mounted terminal;

[0410] An image determining unit 2702 configured to determine a first target image according to the region information.

[0411] Based on the same inventive concept, the embodiments of the present disclosure further provide an image capturing apparatus. Since the apparatus is the apparatus in the image capturing method of the embodiments of the present disclosure, and the principle of solving problems of the apparatus is similar to that of the image capturing method, the implementation of the apparatus can be referred to the implementation of the method, and the repeated parts will not be described herein.

[0412] As shown in FIG. 28, the apparatus includes:

[0413] An original video unit 2800 configured to generate an original video frame according to a video frame captured by at least one camera unit;

[0414] A region receiving unit 2801 configured to receive region information sent by a mobile terminal, the region information indicating at least part of an original picture region corresponding to the original video frame, the mobile terminal having a communication connection established with the vehicle-mounted terminal;

[0415] A video determining unit 2802 configured to determine a target video frame in the original video frame according to the region information.

[0416] A video sending unit 2803 configured to send the target video frame to the mobile terminal, so that the mobile terminal determines a second target image according to the target video frame.

[0417] Based on the same inventive concept, the embodiments of the present disclosure provide a non-transitory computer storage medium, which includes computer program code, when the computer program code is run on a computer, causes the computer to execute the method of displaying writing content as any one of the foregoing. Since the principle of solving problems of the computer storage medium is similar to that of the method of displaying writing content, the implementation of the computer storage medium can be referred to the implementation of the method, and the repeated parts will not be described herein.

[0418] In specific implementation process, the computer storage medium can include: universal serial bus flash drive (USB, Universal Serial Bus Flash Drive), mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and various storage medium that can store program codes.

[0419] Based on the same inventive concept, the embodiments of the present disclosure further provide a computer program product, which comprises computer program codes, and when the computer program codes run on a computer, the computer is caused to execute the method of displaying writing content as any one of the foregoing. Since the principle of solving problems of the above computer program product is similar to the method of displaying writing content, the implementation of the above computer program product can be referred to the implementation of the method, and the repeated parts will not be described here.

[0420] The computer program product can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium may, for example, be but is not limited to an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or apparatus, or any combination of the above. More specific examples (non-exhaustive list) of readable storage medium include: electrical connection with one or more conductive wires, portable disk, hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.

[0421] Those skilled in the art should understand that the embodiments of the present disclosure can be provided as a method, a system, or a computer program product. Therefore, the present disclosure can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present disclosure can take the form of a computer program product implemented on one or more computer usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer usable program codes.

[0422] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.

[0423] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart block or blocks.

[0424] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.

[0425] Obviously, numerous modifications and variations of the present disclosure are possible in light of the above teachings. It is therefore to be understood that within the scope of the present disclosure, the present disclosure can be practiced otherwise than as specifically described. Thus, unless specifically stated otherwise, concepts survived the true scope of the present disclosure and equivalents thereof.

Claims

1. A vehicle terminal, wherein, The vehicle terminal comprises a display unit and a control circuit, wherein: The control circuit comprises a processor and a memory, the memory is used to store programs executable by the processor, and the processor is used to read the programs in the memory and perform the following steps: According to the video frames collected by at least one camera unit, generate original video frames; Receive the area information sent by the mobile terminal, the area information represents at least part of the area in the original picture area corresponding to the original video frames, and the mobile terminal has a communication connection with the vehicle terminal; Determine the first target image according to the area information.

2. The vehicle terminal according to claim 1, wherein The processor is specifically further configured to perform: Send the first target image to the mobile terminal.

3. The in-vehicle terminal according to claim 1, wherein The processor is specifically further configured to perform: Send the original video frames to the mobile terminal for the mobile terminal to determine the area information based on the original video frames.

4. The vehicle terminal according to claim 1, wherein The processor is specifically further configured to perform: Send at least part of the video frames in the original video frames to the mobile terminal for the mobile terminal to determine the area information based on at least part of the video frames in the original video frames.

5. The vehicle terminal according to claim 4, wherein At least part of the video frames in the original video frames include video frames of at least one view angle; the processor is specifically configured to perform: Send the video frames of at least one view angle in the original video frames to the mobile terminal.

6. The vehicle terminal according to claim 5, wherein The processor is specifically further configured to perform: Receive the view angle switching instruction sent by the mobile terminal, the view angle switching instruction comprises the area information.

7. The vehicle terminal according to claim 6, wherein The processor is specifically further configured to perform: Determine the first view angle according to the view angle switching instruction; Send the video frames of the first view angle to the mobile terminal.

8. The vehicle terminal according to claim 6, wherein The processor is specifically further configured to perform: Determine the first view angle according to the view angle switching instruction; Receive the shooting instruction sent by the mobile terminal; In response to the shooting instruction, determine the first target image according to the video frames of the first view angle.

9. The in-vehicle terminal according to claim 1, wherein The processor is specifically further configured to perform: Receive the first image sent by the mobile terminal, and perform image fusion on the video frames corresponding to the area information and the first image to determine the first target image; or, Receive the first video sent by the mobile terminal, and perform image fusion on the video frames corresponding to the area information and the first video to determine the first target image.

10. The in-vehicle terminal according to claim 1, wherein The processor is specifically further configured to perform: Receive the first image sent by the mobile terminal, and perform image fusion on the video frames corresponding to the area information and the first image to determine the first target image; Fuse the first image and the first target image, and send the fused image to the mobile terminal.

11. The in-vehicle terminal according to claim 1, wherein The processor is specifically further configured to: Determine a second image according to the images collected by at least one in-vehicle camera unit; Perform image fusion on the video frames corresponding to the area information and the second image to determine the first target image.

12. The vehicle terminal according to any one of claims 9 to 11, wherein The processor is specifically configured to perform: Receive first indication information; determine a target object in the first image according to the first indication information; perform image fusion on the video frames corresponding to the area information and the target object to determine the first target image; wherein the first indication information is used to indicate the position of the target object in the first image; or, receive second indication information, determine a target object in a second image according to the second indication information, perform image fusion on the video frame corresponding to the region information and the target object to determine a first target image, wherein the second indication information is used to indicate a position of the target object in the second image.

13. The in-vehicle terminal according to claim 1, wherein The processor is specifically configured to perform: if the region information includes a plurality of video frames, perform image stitching on the plurality of video frames to obtain the first target image; or, if the region information includes one video frame, determine the one video frame as the first target image; or, if the region information includes a partial region of one video frame, perform image cropping on the one video frame to obtain the first target image.

14. The in-vehicle terminal according to claim 1, wherein The processor is specifically further configured to perform: display the original video frame on the display unit; in response to a zoom operation of a video frame of at least one view angle contained in the original video frame by a user, update a proportion of the video frame of the at least one view angle in the original video frame; and / or, in response to a drag operation of a video frame of at least one view angle contained in the original video frame by a user, update a display position of the video frame of the at least one view angle.

15. The in-vehicle terminal according to claim 1, wherein The processor is specifically further configured to perform: receive a zoom instruction sent by the mobile terminal, update a proportion of the video frame of the at least one view angle in the original video frame according to zoom coordinate information corresponding to the zoom instruction, and display the video frame of the at least one view angle; and / or, receive a drag instruction sent by the mobile terminal, update a display position of the video frame of the at least one view angle according to drag coordinate information corresponding to the drag instruction, and display the video frame of the at least one view angle. The processor is specifically further configured to perform:

16. The in-vehicle terminal according to claim 1, wherein display the original video frame on the display unit; send a display picture of the display unit to the mobile terminal through a projection protocol, so that the mobile terminal determines the region information according to the display picture. The processor is specifically configured to perform:

17. The in-vehicle terminal according to claim 1, wherein perform image stitching on video frames collected by a plurality of camera units to generate the original video frame. The vehicle-mounted terminal includes a display unit and a control circuit, wherein:

18. An in-vehicle terminal, wherein, The control circuit includes a processor and a memory, the memory is used to store a program executable by the processor, and the processor is used to read the program in the memory and perform the following steps: generate an original video frame according to a video frame collected by at least one camera unit; receive region information sent by a mobile terminal, the region information indicates at least a partial region in an original picture region corresponding to the original video frame, and the mobile terminal has a communication connection with the vehicle-mounted terminal; determine a target video frame in the original video frame according to the region information; send the target video frame to the mobile terminal, so that the mobile terminal determines a second target image according to the target video frame. The processor is specifically further configured to perform:

19. The vehicle terminal of claim 18, wherein, send the original video frame to the mobile terminal, so that the mobile terminal determines region information based on the original video frame. The processor is specifically further configured to perform:

20. The vehicle terminal of claim 18, wherein, ​ sending at least part of the video frames in the original video frames to the mobile terminal, for the mobile terminal to determine the region information based on at least part of the video frames in the original video frames.

21. The vehicle terminal of claim 20, wherein, At least part of the video frames in the original video frames comprise video frames of at least one view angle; the processor is specifically configured to perform: sending the video frames of at least one view angle in the original video frames to the mobile terminal.

22. The vehicle terminal of claim 21, wherein, The processor is specifically further configured to perform: receiving a view angle switching instruction sent by the mobile terminal, the view angle switching instruction comprising the region information; determining a second view angle according to the view angle switching instruction, and determining video frames of the second view angle as the target video frames.

23. The vehicle terminal of claim 18, wherein, The processor is specifically further configured to perform: determining a third image according to an image collected by at least one in-vehicle camera unit; sending the third image to the mobile terminal, for the mobile terminal to perform image fusion on the target video frames and the third image to obtain a second target image.

24. The vehicle terminal of claim 23, wherein, The processor is specifically further configured to perform: sending third indication information to the mobile terminal, the third indication information being used to indicate a position of a target object in the third image, for the mobile terminal to perform image fusion on the target video frames and the target object to obtain a second target image.

25. A mobile terminal, wherein, The mobile terminal comprises a processor and a memory, the memory is used to store programs executable by the processor, and the processor is used to read the programs in the memory and perform the following steps: determining region information of original video frames generated by a vehicle-mounted terminal, the region information indicating at least part of regions in an original picture region corresponding to the original video frames, the mobile terminal being in communication connection with the vehicle-mounted terminal; sending the region information to the vehicle-mounted terminal, for the vehicle-mounted terminal to determine target video frames in the original video frames according to the region information; receiving the target video frames sent by the vehicle-mounted terminal, and determining a target image according to the target video frames. The processor is specifically configured to perform:

26. The mobile terminal of claim 25, wherein, receiving the original video frames sent by the vehicle-mounted terminal, and determining the region information according to the original video frames. The processor is specifically configured to perform:

27. The mobile terminal of claim 26, wherein, in response to a first selection operation of a user on the original video frames, determining the region information according to at least part of the video frames of the original video frames; or in response to a second selection operation of a user on the original video frames, determining the region information according to part of the regions of the original video frames. The processor is specifically configured to perform:

28. The mobile terminal of claim 25, wherein, receiving at least part of the video frames in the original video frames sent by the vehicle-mounted terminal, and determining the region information according to the at least part of the video frames. At least part of the video frames in the original video frames comprise video frames of at least one view angle; the processor is specifically configured to perform:

29. The mobile terminal of claim 28, wherein, receiving the video frames of at least one view angle sent by the vehicle-mounted terminal, and determining the region information according to the video frames of at least one view angle. The processor is specifically configured to perform:

30. The mobile terminal of claim 29, wherein, in response to a switching operation of a user on the video frames of at least one view angle, triggering generation of a view angle switching instruction, and determining video frames of a view angle corresponding to the view angle switching instruction as the region information; or ​ ​ In response to a user's shooting operation on a video frame of the at least one view angle, a shooting instruction is triggered, and a video frame corresponding to the shooting instruction is determined as the region information.

31. The mobile terminal of claim 25, wherein, The processor is specifically further configured to perform: In response to a user's selection instruction, region information of the original video frame is determined; the selection instruction includes any one or more of the following: A touch gesture performed by the user on the displayed original picture region; or, A touch trajectory drawn by the user on the displayed original picture region; or, A view angle switching instruction, which is triggered by the user's switching operation on a video frame of at least one view angle in the original video frame; or, A shooting instruction, which is triggered by the user's shooting operation on a video frame of at least one view angle in the original video frame.

32. The mobile terminal of claim 25, wherein, The processor is specifically further configured to perform: Receiving a fourth image sent by the vehicle-mounted terminal; Image fusion is performed on the target video frame and the fourth image to obtain a target image.

33. The mobile terminal of claim 25, wherein, The processor is specifically further configured to perform: Obtaining a local image, and performing image fusion on the target video frame and the local image to obtain a target image; or, Obtaining a local video, and performing image fusion on the target video frame and the local video to obtain a target image.

34. The mobile terminal of claim 25, wherein, The processor is specifically further configured to perform: Obtaining a local image, and performing image fusion on the target video frame and the local image to obtain a target image; Image fusion is performed on the local image and the target image to obtain a fused image.

35. The mobile terminal of claim 33 or 34, wherein, The processor is specifically configured to perform: Receiving fourth indication information, which is used to indicate a position of a target object in the local image; Image fusion is performed on the target video frame and the target object to obtain a target image.

36. An in-vehicle terminal, wherein, The vehicle-mounted terminal includes a display unit and a control circuit, wherein: The control circuit includes a processor and a memory, the memory is used to store programs executable by the processor, and the processor is used to read the programs in the memory and perform the following steps: According to the at least one camera unit, a first image is collected, and a pose of a target object in the first image is determined; According to the pose of the target object, a view angle is determined; According to a video frame collected by the camera unit of the view angle, an original video frame is generated; According to the original video frame, a target image is determined.

37. An image capturing method, wherein, The method includes: According to a video frame collected by the at least one camera unit, an original video frame is generated; Receiving region information sent by a mobile terminal, the region information indicating at least part of a region in an original picture region corresponding to the original video frame, the mobile terminal being in communication connection with the vehicle-mounted terminal; According to the region information, a first target image is determined.

38. An image capturing method, wherein, The method includes: According to a video frame collected by the at least one camera unit, an original video frame is generated; Receiving region information sent by a mobile terminal, the region information indicating at least part of a region in an original picture region corresponding to the original video frame, the mobile terminal being in communication connection with the vehicle-mounted terminal; According to the region information, a target video frame in the original video frame is determined. The target video frame is sent to the mobile terminal, and the mobile terminal determines a second target image according to the target video frame.

39. An image capturing method, wherein, The method comprises: Determining area information of an original video frame generated by a vehicle terminal, the area information representing at least part of an original picture area corresponding to the original video frame, the mobile terminal being in communication connection with the vehicle terminal; Sending the area information to the vehicle terminal, so that the vehicle terminal determines a target video frame in the original video frame according to the area information; Receiving the target video frame sent by the vehicle terminal, and determining a target image according to the target video frame.

40. An image capturing method, wherein, The method comprises: Collecting a first image according to at least one camera unit, and determining a posture of a target object in the first image; Determining a view angle according to the posture of the target object; Collecting a video frame according to the camera unit of the view angle, and generating an original video frame; Determining a target image according to the original video frame.

41. A non-transitory computer storage medium having stored thereon a computer program, wherein, The program is executed by a processor to implement the steps of the method in any of claims 37-40.

Images