Vehicle-mounted image processing method and device, medium, electronic equipment and program product

Abstract

The present disclosure relates to a vehicle-mounted image processing method, device, medium, electronic equipment and program product. The method comprises: displaying a target application on a vehicle machine screen, the target application being built-in with a processing module, the processing module being configured to process images captured by a camera or a drive recorder; and in response to a triggering operation on the processing module in the target application, performing a processing operation corresponding to the processing module on the images captured by the camera or the drive recorder. Therefore, the processing operation corresponding to the processing module can be performed on the images captured by the vehicle-mounted camera or the drive recorder by triggering the processing module, so that video production on the images captured by the vehicle-mounted camera or the drive recorder at the vehicle machine end is realized. As a result, on the one hand, the complexity of video production can be reduced and the video production efficiency can be improved, and on the other hand, the images do not need to be transmitted to the cloud, so that the risk of image loss is reduced.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and more specifically, to a vehicle-mounted image processing method, apparatus, medium, electronic device, and program product. Background Technology

[0002] With the rise of the mobile internet era, more and more people enjoy recording precious moments in their lives through videos. However, the current technology, which typically involves recording and editing videos via mobile applications, suffers from limitations in its application scenarios. Summary of the Invention This summary section is provided to briefly introduce the concepts, which will be described in detail in the detailed description section below. This summary section is not intended to identify key or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0003] In a first aspect, this disclosure provides a vehicle-mounted image processing method, including: The target application is displayed on the vehicle's infotainment screen. The target application has different built-in image function modules, including a processing module for processing images captured by the camera or the dashcam. In response to a trigger operation on the processing module in the target application, the processing operation corresponding to the processing module is performed on the images captured by the camera or the dashcam.

[0004] Secondly, this disclosure provides an in-vehicle image processing device, comprising: The first display module is used to display the target application on the vehicle's infotainment screen. The target application has built-in different image function modules, and the different image function modules include a processing module, which is used to process images captured by the camera or the dashcam. A processing module is configured to perform processing operations corresponding to the processing module on images captured by the camera or the dashcam in response to a trigger operation on the processing module in the target application.

[0005] Thirdly, this disclosure provides a computer-readable medium having a computer program stored thereon, which, when executed by a processing device, implements the steps of the method described in any of the first aspects.

[0006] Fourthly, this disclosure provides an electronic device, comprising: A storage device on which computer programs are stored; A processing device for executing the computer program in the storage device to implement the steps of the method according to any one of the first aspects.

[0007] Fifthly, this disclosure provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the method described in any one of the first aspects.

[0008] The above technical solution allows the target application to be displayed on the vehicle's infotainment screen. The target application includes a processing module for processing images captured by the vehicle's camera or dashcam. Therefore, by triggering the processing module, the corresponding processing operation can be performed on the images captured by the vehicle's camera or dashcam, thereby enabling video production of the images captured by the vehicle's camera or dashcam on the vehicle's infotainment system. This reduces the complexity of video production and improves the efficiency of video production. Furthermore, it eliminates the need to transmit images to the cloud, thus reducing the risk of image loss.

[0009] Other features and advantages of this disclosure will be described in detail in the following detailed description section. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale. In the drawings: Figure 1 This is a flowchart illustrating an in-vehicle image processing method according to an exemplary embodiment of the present disclosure; Figure 2 This is a schematic diagram illustrating the desensitization of a target image in a local photo album according to an exemplary embodiment of the present disclosure; Figure 3 This is a schematic diagram illustrating a method for desensitizing real-time captured images according to an exemplary embodiment of the present disclosure; Figure 4 This is a schematic diagram illustrating the generation of a target image labeled with highlight fragments according to an exemplary embodiment of the present disclosure; Figure 5 This is a schematic diagram illustrating a configuration of highlight clip duration and / or content elements included in a highlight clip according to an exemplary embodiment of this disclosure; Figure 6 This is a schematic diagram illustrating an adjustment of the captured image according to an exemplary embodiment of the present disclosure; Figure 7 This is a block diagram illustrating an in-vehicle image processing apparatus according to an exemplary embodiment of the present disclosure; Figure 8 This is a schematic diagram of the structure of an electronic device according to an exemplary embodiment of the present disclosure. Detailed Implementation

[0011] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0012] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0013] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0014] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0015] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0016] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0017] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0018] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0019] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0020] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0021] Meanwhile, it is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0022] As mentioned in the background section, related technologies generally rely on mobile terminal applications for video recording and editing, which limits their application scenarios.

[0023] For example, if a driver is distracted by using their mobile phone to record video while driving, the risk of a traffic accident increases significantly. Therefore, in driving scenarios, it is not feasible to effectively record and edit videos using mobile applications.

[0024] To overcome the aforementioned technical problems, related technologies have proposed the concept of in-vehicle camera devices. These devices are installed in vehicles to capture images during driving. However, these in-vehicle camera devices only have recording capabilities and lack video editing functions. Therefore, after capturing images, they need to be transferred to a terminal, such as a mobile phone or computer, via the cloud or USB drive for video editing software. In other words, for images captured by the in-vehicle system, these technologies require cross-device image capture and video production, increasing the complexity of video production. Furthermore, images stored in the cloud typically have time limits, automatically being cleared after the time limit, resulting in image loss and inconvenience for users.

[0025] In view of the above, this disclosure provides a vehicle image processing method, apparatus, medium, electronic device and program product to solve the above-mentioned technical problems.

[0026] The embodiments of this disclosure will be further explained below with reference to the accompanying drawings.

[0027] Figure 1 This is a flowchart illustrating an in-vehicle image processing method according to an exemplary embodiment of the present disclosure, with reference to... Figure 1 The method may include the following steps: S101: Display the target application on the vehicle's infotainment screen. The target application has different built-in image function modules, including a processing module, which is used to process images captured by the vehicle's camera or dashcam.

[0028] In this embodiment, the vehicle-mounted camera can be a camera installed on the exterior of the vehicle or a camera installed inside the vehicle; this disclosure does not impose any limitations on this. When the vehicle-mounted camera is installed on the exterior of the vehicle, multiple cameras can be configured to capture images of the external environment of the vehicle from multiple angles; when the vehicle-mounted camera is installed inside the vehicle, multiple cameras can also be configured to capture images of the internal environment of the vehicle from multiple angles.

[0029] In this embodiment, the processing module can perform image stitching, highlight segment extraction, and content desensitization on the captured images. Of course, it can also perform other processing on the captured images. This embodiment does not impose any limitations on these processing methods.

[0030] In this embodiment, the images captured by the vehicle camera or dashcam can be images captured by the user when operating the vehicle camera or dashcam, or images captured by the user when operating the target application. This disclosure does not impose any limitations on this.

[0031] In some possible embodiments, the imaging function module may also include a shooting module, which is used to call upon an in-vehicle camera or dashcam to take pictures. Accordingly, the in-vehicle image processing method may also include: In response to a triggering operation on the target application, the launch page of the target application is displayed, and in response to a specific operation on the launch page, a second configuration page is displayed, wherein the second configuration page is at least used for the user to configure the shooting device; in response to a second configuration operation on the shooting device in the second configuration page, a target shooting device is determined according to the second configuration operation, wherein the target shooting device is one of a vehicle camera and a dashcam; in response to a triggering operation on the shooting module in the target application, shooting is performed through the target shooting device.

[0032] In this embodiment, the specific operation may be a long press operation, a swipe operation, or a double-click operation, etc., which is determined according to the actual situation. This embodiment does not impose any restrictions on this.

[0033] For example, when a user clicks on the target application, the application's launch page can be displayed. By long-pressing the launch page, a second configuration page can be displayed, allowing the user to configure the camera device. The target camera device is configured in the second configuration interface to establish a connection with the application, thus establishing a connection between the application and the camera device. Afterward, the application's function display interface is accessed, and the camera module is displayed. Clicking the camera module invokes the camera device connected to the application to take a picture. Once the image is captured, it can be stored in the vehicle's local photo album, allowing the processing module within the application to process the content captured by the camera or dashcam.

[0034] It should be understood that the above-described method of calling the target shooting device for recording is illustrative and does not constitute a limitation on the solution. Another possible approach is to display the shooting module after the user launches the target application. When the user clicks the shooting module, a camera device selection interface can pop up. By selecting a vehicle camera or dashcam connected to the target application in the camera device selection interface, the connected vehicle camera or dashcam can be used to record.

[0035] S102: In response to a trigger operation on the processing module in the target application, perform the processing operation corresponding to the processing module on the images captured by the vehicle camera or dashcam.

[0036] For example, the processing module may include a video editing module of the same type. By clicking the same video editing module, a video template preview interface is displayed, and the video template preview interface displays multiple preset video templates. By clicking the target video template among the multiple preset video templates, the vehicle's local photo album is displayed. By selecting the target image in the local photo album, a video matching the style of the target video template is generated.

[0037] For example, the processing module may include a highlight capture module. By clicking the highlight capture module, an in-vehicle camera or dashcam connected to the target application is invoked to capture images. During the capture process, the captured content is detected in real time, and the detected highlight content is displayed on the captured screen. After capture, the highlight segments containing the highlight content are automatically extracted and merged to generate a highlight image.

[0038] For example, the processing module may include a Time Story module. By clicking the Time Story module, the local photo album is automatically scanned to merge images of the same type, style, location, or within a preset time period into a single video for display.

[0039] The above technical solution allows the target application to be displayed on the vehicle's infotainment screen. The target application includes a processing module for processing images captured by the vehicle's camera or dashcam. Therefore, by triggering the processing module, the corresponding processing operation can be performed on the images captured by the vehicle's camera or dashcam, thereby enabling video production of the images captured by the vehicle's camera or dashcam on the vehicle's infotainment system. This reduces the complexity of video production and improves the efficiency of video production. Furthermore, it eliminates the need to transmit images to the cloud, thus reducing the risk of image loss.

[0040] To facilitate understanding of this solution, the possible implementation methods in this disclosure are described below.

[0041] In one possible manner, in response to a trigger operation on the processing module in the target application, performing the processing operation corresponding to the processing module on the images captured by the vehicle camera or dashcam may include: In response to a trigger operation on the desensitization module in the target application, a preset desensitization method is displayed for the user to select; in response to a selection operation of the target desensitization method among the preset desensitization methods, the images captured by the camera or dashcam are desensitized according to the target desensitization method, wherein the desensitization processing is used to blur and / or occlude content elements in the image that belong to the preset element type.

[0042] In this embodiment, the preset desensitization method and preset element type can be set according to actual conditions, and this disclosure does not impose any restrictions on them. For example, the preset desensitization method may include real-time desensitization, post-desensitization (i.e., non-real-time desensitization), full desensitization, and / or partial desensitization. The preset element type may be a human image and / or a license plate, etc.

[0043] For example, the target application's function display interface includes a desensitization module. Clicking the desensitization module brings up a desensitization method selection interface, which offers two desensitization methods: "Full Desensitization" and "Partial Desensitization." Clicking "Full Desensitization" displays the vehicle's local photo album. By selecting a target image from the local album, content elements of a preset element type in the target image are automatically blurred and / or obscured. Alternatively, clicking "Partial Desensitization" displays a desensitization element selection interface, which shows the element types in the target image. By selecting a target element type in the target image, content elements of that target element type are automatically blurred and / or obscured.

[0044] Using the above methods, content elements of a preset element type during the shooting process can be blurred and / or obscured according to the selected target desensitization method, thereby preventing the content elements of the preset element type from being captured and spread, and improving information security.

[0045] In possible ways, in response to a selection operation of a target desensitization method among preset desensitization methods, desensitizing the images captured by the vehicle camera or dashcam according to the target desensitization method may include: In response to the selection of the real-time desensitization method among the preset desensitization methods, the real-time captured image during the recording process of the vehicle camera or dashcam is displayed, and the real-time captured image is desensitized; or, in response to the selection of the post-desensitization method among the preset desensitization methods, the vehicle's local photo album is displayed, and in response to the selection of the target image in the local photo album, the target image is desensitized, wherein the local photo album is used to store images captured by the camera or dashcam.

[0046] For example, such as Figure 2 As shown, the target application's function display interface includes a desensitization module. Clicking the desensitization module displays a desensitization method selection interface, which offers two desensitization methods: "real-time desensitization" and "post-desensitization." Clicking "post-desensitization" displays the vehicle's local photo album. By selecting a target image from the local photo album, the system automatically blurs or obscures the portraits and / or license plates in the target image.

[0047] In one possible approach, to enable users to selectively desensitize content elements in the target image, after automatically blurring or occluding the portraits and / or license plates in the target image, an image preview interface can be displayed. The image preview interface displays a restore control and the blurred target image. After selecting the target portrait and / or target license plate in the blurred target image, clicking the restore control will restore the target portrait and / or target license plate to its state before blurring.

[0048] Alternatively, after selecting "Real-time Desensitization", a desensitization element selection interface will be displayed, which will show preset element types. By selecting the target element type from the preset element types, the content elements of the target element type in the images captured by the vehicle camera or dashcam will be automatically blurred and / or occluded.

[0049] Alternatively, after selecting the target image, a desensitization element selection interface is displayed, which shows the element types in the target image. By selecting the target element type in the target image, the content elements of the target element type in the target image are blurred and / or occluded.

[0050] Among the possible approaches, the methods also include: The desensitization switch control is displayed in the live-action shooting screen. When the desensitization switch control is in the on state, it indicates that the live-action shooting screen is desensitized. When the desensitization switch control is in the off state, it indicates that the live-action shooting screen is not desensitized. In response to the trigger operation of the switch control, the switch control is set to the off state and the desensitization processing of the live-action shooting screen is stopped.

[0051] For example, such as Figure 3 As shown, the target application's function display interface includes a desensitization module. Clicking the desensitization module displays a desensitization method selection interface, which offers two desensitization methods: "Real-time Desensitization" and "Post-desensitization." Clicking "Real-time Desensitization" displays the real-time footage captured by the vehicle camera or dashcam, and a desensitization switch control is displayed in the lower left corner of the display interface in the first display style. By sliding the desensitization switch control, a second desensitization switch control is displayed in the lower left corner of the display interface, and the desensitization processing of the real-time footage is stopped.

[0052] Using the above method, the real-time footage captured by the vehicle's camera or dashcam can be displayed on the vehicle's infotainment screen, and a desensitization switch control can be displayed in the real-time footage. By triggering the desensitization switch control, the desensitization status can be quickly changed, i.e. whether to desensitize the real-time footage, thereby further improving the user experience.

[0053] In one possible manner, in response to a trigger operation on the processing module in the target application, performing the processing operation corresponding to the processing module on the images captured by the vehicle camera or dashcam may include: In response to a trigger operation on the highlight recognition module in the target application, the vehicle's local photo album is displayed, where the local photo album is used to store images captured by the vehicle's camera or dashcam; in response to a selection operation on the target image in the local photo album, the highlight segments of the target image are identified, and the target image marked with the highlight segments is displayed.

[0054] In this embodiment, the target image selected in the local photo album can be one or more, and this disclosure does not impose any limitations on this. When there is only one target image, the highlight segments in the target image can be directly identified, and the target image marked with the highlight segments can be displayed. When there are multiple target images, the highlight segments in each target image can be identified separately, and then the multiple target images can be merged into a merged image for display, with the highlight segments marked at the corresponding positions in the merged image.

[0055] For example, such as Figure 4 As shown, the target application's interface displays a highlight recognition module. Clicking the highlight recognition module displays the local photo album, and a material display area appears below the local photo album. Clicking on "Video 1" and "Video 5" in the local photo album displays "Video 1" and "Video 5" in the material display area. Then, clicking "Recognize Material" identifies the highlight segments of "Video 1" and "Video 5," and merges "Video 1" and "Video 5" into a single merged image displayed on the vehicle's infotainment screen. Simultaneously, different styles of playback progress bars mark the highlight segments within the merged image's playback progress bar.

[0056] In one possible manner, in response to a selection operation on a target image in a local photo album, identifying highlight segments of the target image may include: In response to a selection operation of a target image in the local photo album, the content elements in the target image are identified to obtain element identification results, and a first control for viewing the element identification results and a second control for extracting highlight segments from the target image are displayed; in response to a trigger operation of the second control, a first configuration page is displayed, wherein the first configuration page is used for the user to configure the duration of the highlight segment and / or the content elements included in the highlight segment; in response to a first configuration operation on the first configuration page, the highlight segment in the target image is determined based on the first configuration operation and the element identification results.

[0057] For example, such as Figure 5As shown, the target application's function display interface displays a highlight recognition module. Clicking the highlight recognition module displays the local album, and a material display area is displayed below the local album. Clicking "Video 1" and "Video 5" in the local album displays "Video 1" and "Video 5" in the material display area. Next, by clicking "Recognize Material," the first control "View Details" for viewing the element recognition results and the second control "Highlight Extraction" for extracting highlight segments from the target image are displayed. Clicking "Highlight Extraction" displays the first configuration page, which shows the preset highlight segment duration and the content elements included in the highlight segment. By modifying the highlight segment duration and the content elements included in the highlight segment, the target highlight segment duration and target content elements are obtained. Finally, by clicking "Next," the highlight segments of the target image are identified based on the target highlight segment duration and target content elements, and the target image marked with highlight segments is displayed in the highlight video preview interface to determine whether the selected highlight segments meet the user's expectations. If the selected highlight segments do not meet the user's expectations, the first configuration page can be redisplayed by clicking the return control in the upper left corner of the highlight video preview interface to modify the highlight segment duration and the content elements included in the highlight segment.

[0058] The above solution allows users to customize the duration of highlight clips and / or the content elements included in the highlight clips through the first configuration page, thereby making the generated highlight clips more in line with user needs and further improving the user experience.

[0059] In one possible manner, in response to a trigger operation on the processing module in the target application, performing the processing operation corresponding to the processing module on the images captured by the vehicle camera or dashcam may include: In response to a trigger operation on the object recognition module in the target application, the system displays the real-time captured footage from the vehicle camera or dashcam and performs object recognition on the real-time captured footage; when a specific object is recognized in the real-time captured footage, the specific object is labeled and displayed in the real-time captured footage.

[0060] In this embodiment, the objects to be identified can be set according to actual conditions, and this disclosure does not show any specific details. For example, the objects to be identified can be preset as elderly people, children, and / or pets, etc. Then, after the object identification module is triggered, a real-time captured image is displayed, and the elderly people, children, and / or pets in the real-time captured image are automatically identified and labeled. Alternatively, after the object identification module is triggered, an object identification configuration interface can be displayed. After configuring the objects to be identified in the object identification configuration interface, a real-time captured image is displayed, and the objects to be identified in the real-time captured image are automatically identified and labeled, such as automatically identifying and labeling elderly people, children, and / or pets in the real-time captured image.

[0061] In this embodiment, the content of the annotation can be set according to the actual situation. This disclosure embodiment does not impose any restrictions on this. For example, the content of the annotation can be the age or mood of a specific object.

[0062] The above solution enables the identification and annotation of specific objects in real-time captured footage, allowing for a quick and intuitive understanding of the status of specific objects and further enhancing the user experience.

[0063] In some possible embodiments, the imaging function module may also include a shooting module, which is used to call upon an in-vehicle camera or dashcam to take pictures. Accordingly, the in-vehicle image processing method may also include: In response to a trigger operation on the shooting module in the target application, a real-time shooting screen is displayed, wherein the real-time shooting screen displays a third control for adjusting the shooting screen; when the real-time shooting screen is an interior view of the vehicle, in response to a trigger operation on the third control, the camera is captured by the vehicle's exterior camera or dashcam; when the real-time shooting screen is an exterior view of the vehicle, in response to a trigger operation on the third control, the camera is captured by the vehicle's interior camera.

[0064] For example, such as Figure 6 As shown, the target shooting device connected to the target application includes an in-vehicle camera for capturing images inside the vehicle and an external camera for capturing images of the parking space. The in-vehicle camera has a higher shooting priority than the external camera. Therefore, when the shooting module is clicked, the in-vehicle camera connected to the target application is invoked to capture images and display the live footage from inside the vehicle. A third control for adjusting the image is displayed in the upper right corner of the live footage from inside the vehicle. Clicking this third control invokes the external camera connected to the target application to capture images and display the live footage from outside the vehicle. Similarly, a third control for adjusting the image is also displayed in the upper right corner of the live footage from outside the vehicle. Clicking this third control invokes the in-vehicle camera connected to the target application to capture images and display the live footage from inside the vehicle.

[0065] It should be understood that the higher priority of the in-vehicle camera than the external camera is merely illustrative and constitutes a limitation on the solution. In possible ways, the external camera can also have a higher priority than the in-vehicle camera.

[0066] Additionally, when multiple external and / or internal cameras are present in the vehicle, triggering the third-party control can bring up a camera selection interface, allowing users to select a target camera and display its live feed. Alternatively, the priority or switching order of the cameras can be pre-set, so that when the third-party control is triggered, the cameras are switched according to their priority or switching order to display the corresponding live feed.

[0067] It should be understood that the above-described methods for adjusting the captured image are merely illustrative. In other possible ways, switching between in-vehicle and out-of-vehicle views can also be achieved. For example, when multiple out-of-vehicle cameras and multiple in-vehicle cameras are present, a fourth control for switching between different out-of-vehicle views and a fifth control for switching between different in-vehicle views can be displayed in the live-stream captured image. Thus, when the displayed live-stream captured image is from the first out-of-vehicle camera, clicking the fourth control switches to the live-stream captured image from the second out-of-vehicle camera. When the displayed live-stream captured image is from the first in-vehicle camera, clicking the fifth control switches to the live-stream captured image from the second in-vehicle camera.

[0068] The above solution allows for switching between in-vehicle and external camera views by triggering a third control, thus enabling convenient acquisition of footage from different perspectives. This, in turn, enriches the video content when creating videos based on images captured by in-vehicle cameras.

[0069] Based on the same concept, this disclosure also provides an in-vehicle image processing device, such as... Figure 7 As shown, the vehicle-mounted image processing device 700 may include: The first display module 701 is used to display the target application on the vehicle's infotainment screen. The target application has built-in different image function modules, including a processing module, which is used to process images captured by the vehicle camera or dashcam. The processing module 702 is used to perform processing operations corresponding to the processing module on images captured by the vehicle camera or dashcam in response to a trigger operation on the processing module in the target application.

[0070] The in-vehicle image processing device 700 described above can display a target application on the vehicle screen. The target application includes a processing module for processing images captured by an in-vehicle camera or dashcam. Therefore, the processing module can be triggered to perform the corresponding processing operation on the images captured by the in-vehicle camera or dashcam, thereby enabling video production of the images captured by the in-vehicle camera or dashcam on the vehicle screen. This reduces the complexity of video production and improves the efficiency of video production. Furthermore, it eliminates the need to transmit images to the cloud, thus reducing the risk of image loss.

[0071] In one possible manner, the processing module 702 may include: The first display submodule is used to display preset desensitization methods for the user to select in response to a trigger operation on the desensitization module in the target application; The processing submodule is used to respond to the selection operation of the target desensitization method in the preset desensitization methods, and to perform desensitization processing on the images captured by the vehicle camera or dashcam according to the target desensitization method. The desensitization processing is used to blur and / or occlude content elements in the image that belong to the preset element type.

[0072] In some possible ways, the processing submodule may include: The first processing unit is configured to, in response to the selection of a real-time desensitization method among preset desensitization methods, display the real-time captured image during the recording process of the vehicle camera or dashcam, and perform desensitization processing on the real-time captured image; or, The second processing unit is used to display the vehicle's local photo album in response to the selection operation of the post-desensitization method in the preset desensitization method, and to perform desensitization processing on the target image in response to the selection operation of the target image in the local photo album. The local photo album is used to save images captured by the vehicle camera or dashcam.

[0073] In some possible ways, the processing submodule may also include: The first display unit is used to display a desensitization switch control in the real-time shooting screen when it is in the on state. When the desensitization switch control is in the on state, it indicates that the real-time shooting screen is desensitized. When the desensitization switch control is in the off state, it indicates that the real-time shooting screen is not desensitized. The third processing unit is used to respond to the trigger operation of the switch control, set the switch control to the off state, and stop the desensitization processing of the real-time captured image.

[0074] In one possible manner, the processing module 702 may include: The second display submodule is used to display the vehicle's local photo album in response to a trigger operation of the highlight recognition module in the target application, wherein the local photo album is used to save images captured by the vehicle camera or dashcam. The third display submodule is used to respond to the selection operation of the target image in the local album, identify the highlight segments of the target image, and display the target image marked with the highlight segments.

[0075] In some possible ways, the third display submodule may include: The second display unit is used to respond to the selection operation of the target image in the local album, identify the content elements in the target image, obtain the element identification result, and display a first control for viewing the element identification result and a second control for extracting highlight segments from the target image. The third display unit is used to display a first configuration page in response to a trigger operation of the second control, wherein the first configuration page is used for the user to configure the duration of the highlight clip and / or the content elements included in the highlight clip; The determining unit is configured to, in response to a first configuration operation on a first configuration page, determine a highlight segment in the target image based on the first configuration operation and the element recognition result.

[0076] In some possible ways, the processing submodule may also include: The recognition unit is used to respond to the trigger operation of the object recognition module in the target application, display the real-time shooting screen during the shooting process of the vehicle camera or dashcam, and perform object recognition on the real-time shooting screen; The fourth display unit is used to annotate and display the specific object in the real-time shooting frame when the specific object is identified in the real-time shooting frame.

[0077] In some possible embodiments, the imaging function module also includes a shooting module, which is used to call upon an in-vehicle camera or dashcam to take pictures. Accordingly, the in-vehicle image processing device 700 may also include: The second display module is used to display the real-time shooting screen in response to the trigger operation of the shooting module in the target application, wherein the real-time shooting screen displays a third control for adjusting the shooting screen; The first shooting module is used to shoot through the vehicle's external camera or dashcam in response to the trigger operation of the third control when the real-time shooting screen is the interior of the vehicle. The second shooting module is used to take pictures through the vehicle's in-vehicle camera in response to the trigger operation of the third control when the real-time shooting screen is the exterior view of the vehicle.

[0078] In some possible embodiments, the imaging function module also includes a shooting module, which is used to call upon an in-vehicle camera or dashcam to take pictures. Accordingly, the in-vehicle image processing device 700 may also include: The third display module is used to display the launch page of the target application in response to a trigger operation on the target application, and to display a second configuration page in response to a specific operation on the launch page, wherein the second configuration page is used at least for the user to configure the shooting device; The determination module is used to respond to a second configuration operation on the shooting device in the second configuration page, and determine the target shooting device according to the second configuration operation, wherein the target shooting device is one of a vehicle camera and a dashcam. The third shooting module is used to take pictures through the target shooting device in response to the trigger operation of the shooting module in the target application.

[0079] Based on the same concept, embodiments of this disclosure also provide a computer-readable medium having a computer program stored thereon, which, when executed by a processing device, implements the steps of any of the above-described vehicle image processing methods.

[0080] Based on the same concept, this disclosure also provides an electronic device that may include: A storage device on which computer programs are stored; The processing device is used to execute a computer program stored in the storage device to implement the steps of any of the above-described vehicle image processing methods.

[0081] Based on the same concept, this disclosure also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of any of the above-described vehicle image processing methods.

[0082] The following is for reference. Figure 8 The diagram illustrates a structural schematic of an electronic device suitable for implementing embodiments of the present disclosure. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 8 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0083] like Figure 8As shown, the electronic device 800 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 808 into a random access memory (RAM) 803. The RAM 803 also stores various programs and data required for the operation of the electronic device 800. The processing device 801, ROM 802, and RAM 803 are interconnected via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0084] Typically, the following devices can be connected to I / O interface 805: input devices 806 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 807 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 808 including, for example, magnetic tapes, hard disks, etc.; and communication devices 809. Communication device 809 allows electronic device 800 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 8 An electronic device 800 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0085] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 809, or installed from a storage device 808, or installed from a ROM 802. When the computer program is executed by a processing device 801, it performs the functions defined in the methods of embodiments of this disclosure.

[0086] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0087] In some implementations, communication can be conducted using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol), and can be interconnected with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed networks.

[0088] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0089] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to: display a target application on the vehicle's infotainment screen, wherein the target application has built-in different image function modules, each including a processing module for processing images captured by a camera or dashcam; and, in response to a trigger operation on the processing module in the target application, perform processing operations corresponding to the processing module on the images captured by the vehicle camera or dashcam.

[0090] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0091] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0092] The modules described in the embodiments of this disclosure can be implemented in software or hardware. The names of the modules are not, in some cases, intended to limit the functionality of the module itself.

[0093] The functions described above in this document can be performed at least in part by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.

[0094] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0095] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0096] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0097] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative forms of implementing the claims. Regarding the apparatus in the above embodiments, the specific manner in which the various modules perform their operations has been described in detail in the embodiments relating to the method, and will not be elaborated upon here.

Claims

1. A vehicle-mounted image processing method, characterized in that, include: The target application is displayed on the vehicle's infotainment screen. The target application has different built-in image function modules, including a processing module for processing images captured by a vehicle camera or dashcam. The processing module includes a highlight recognition module. In response to a trigger operation on the processing module in the target application, the processing operation corresponding to the processing module is performed on the images captured by the vehicle camera or the dashcam. The step of responding to a trigger operation on the processing module in the target application and performing the processing operation corresponding to the processing module on the images captured by the vehicle camera or the dashcam includes: In response to a trigger operation of the highlight recognition module in the target application, the local photo album of the vehicle is displayed, wherein the local photo album is used to save images captured by the vehicle camera or the dashcam, and the highlight recognition module is displayed on the function display interface of the target application. In response to a selection operation of a target image in the local photo album, a highlight segment of the target image is identified, and the target image labeled with the highlight segment is displayed.

2. The vehicle-mounted image processing method according to claim 1, characterized in that, The processing module further includes a desensitization module. The step of performing the processing operation corresponding to the processing module on images captured by the vehicle camera or the dashcam in response to a trigger operation on the processing module in the target application further includes: In response to a trigger operation on the de-identification module in the target application, a preset de-identification method is displayed for the user to select; In response to the selection operation of the target desensitization method in the preset desensitization methods, the images captured by the vehicle camera or the dashcam are desensitized according to the target desensitization method, wherein the desensitization processing is used to blur and / or occlude content elements in the image that belong to the preset element type.

3. The vehicle-mounted image processing method according to claim 2, characterized in that, The step of responding to the selection operation of the target desensitization method among the preset desensitization methods, and performing desensitization processing on the images captured by the vehicle camera or the dashcam according to the target desensitization method, includes: In response to the selection of a real-time desensitization method among the preset desensitization methods, the system displays the real-time captured footage from the vehicle camera or dashcam during recording, and desensitizes the real-time captured footage; or, In response to the selection of a post-desensitization method in the preset desensitization methods, the vehicle's local photo album is displayed, and in response to the selection of a target image in the local photo album, the target image is desensitized.

4. The vehicle-mounted image processing method according to claim 3, characterized in that, The method further includes: The desensitization switch control is displayed in the live shooting screen when it is in the on state. When the desensitization switch control is in the on state, it indicates that the live shooting screen is desensitized. When the desensitization switch control is in the off state, it indicates that the live shooting screen is not desensitized. In response to the trigger operation of the switch control, the switch control is set to the off state, and the desensitization processing of the real-time captured image is stopped.

5. The vehicle-mounted image processing method according to claim 1, characterized in that, The step of identifying highlight segments of the target image in response to a selection operation of the target image in the local photo album includes: In response to the selection operation of the target image in the local album, the content elements in the target image are identified to obtain the element identification result, and a first control for viewing the element identification result and a second control for extracting highlight segments from the target image are displayed. In response to a triggering operation on the second control, a first configuration page is displayed, wherein the first configuration page is used for the user to configure the duration of the highlight clip and / or the content elements included in the highlight clip; In response to a first configuration operation on the first configuration page, a highlight segment in the target image is determined based on the first configuration operation and the element recognition result.

6. The vehicle-mounted image processing method according to claim 1, characterized in that, The processing module further includes an object recognition module. The step of performing the processing operation corresponding to the processing module on images captured by the vehicle-mounted camera or the dashcam in response to a trigger operation on the processing module in the target application further includes: In response to a trigger operation on the object recognition module in the target application, the real-time shooting footage during the recording process of the vehicle camera or the dashcam is displayed, and object recognition is performed on the real-time shooting footage; When a specific object is identified in the live-stream video, the specific object is labeled and displayed in the live-stream video.

7. The vehicle image processing method according to any one of claims 1-6, characterized in that, The imaging function module further includes a shooting module, which is used to call the vehicle-mounted camera or dashcam to shoot. The method further includes: In response to a trigger operation on the shooting module in the target application, a real-time shooting screen is displayed, wherein the real-time shooting screen displays a third control for adjusting the shooting screen; When the real-time captured image is the interior view of the vehicle, in response to the triggering operation of the third control, the image is captured by the vehicle's exterior camera or the dashcam. When the real-time captured image is an external view of the vehicle, the image is captured via the vehicle's in-vehicle camera in response to a trigger operation on the third control.

8. The vehicle image processing method according to any one of claims 1-6, characterized in that, The imaging function module further includes a shooting module, which is used to call the vehicle-mounted camera or dashcam to shoot. The method further includes: In response to a triggering operation on the target application, the launch page of the target application is displayed, and in response to a specific operation on the launch page, a second configuration page is displayed, wherein the second configuration page is at least used for the user to configure the shooting device; In response to a second configuration operation of the shooting device on the second configuration page, a target shooting device is determined according to the second configuration operation, wherein the target shooting device is one of the vehicle camera and the dashcam; In response to a trigger operation on the shooting module in the target application, a shot is taken by the target shooting device.

9. A vehicle-mounted image processing device, characterized in that, include: The first display module is used to display the target application on the vehicle's infotainment screen. The target application has built-in different image function modules, including a processing module. The processing module is used to process images captured by an in-vehicle camera or a dashcam. The processing module includes a highlight recognition module. A processing module is configured to, in response to a trigger operation on the processing module in the target application, perform the processing operation corresponding to the processing module on the images captured by the vehicle camera or the dashcam. The processing module is further configured to respond to a trigger operation of the highlight recognition module in the target application by displaying the vehicle's local photo album, wherein the local photo album is used to save images captured by the vehicle camera or the dashcam, and the highlight recognition module is displayed on the function display interface of the target application. The processing module is further configured to, in response to a selection operation of a target image in the local album, identify highlight segments of the target image and display the target image labeled with the highlight segments.

10. A computer-readable medium having a computer program stored thereon, characterized in that, When executed by a processing device, the computer program performs the steps of the method according to any one of claims 1-8.

11. An electronic device, characterized in that, include: A storage device on which computer programs are stored; A processing device for executing the computer program in the storage device to implement the steps of the method according to any one of claims 1-8.

12. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1-8.

Images