Method and system for generating fused image stream and electronic equipment

Abstract

The invention discloses a method and a system for generating a fused image stream and electronic equipment. The method comprises the following steps: acquiring a first image set shot by a vehicle-mounted camera device and a second image set shot by a mobile terminal; determining a time window for selecting a target image according to the shooting information of the first image set and / or the second image set; respectively selecting corresponding images in the time window from the first image set and the second image set at least according to the time window for clustering, and generating a fused image flow. According to the method for generating the fused image stream, the images shot by the vehicle-mounted shooting device and the mobile terminal respectively are combined, and the images are clustered, so that the content of the fused image stream is selected more abundant and reasonable, and related requirements of users are met.

Description

Technical Field

[0001] This application relates to the field of mobile phone and vehicle-mounted camera integration (or "mobile phone and vehicle-mounted camera integration") technology, and in particular to a method, system and electronic device for generating a fused image stream based on the mobile phone and vehicle-mounted camera integration technology. Background Technology

[0002] People's reliance on smartphones in daily life has become commonplace. Besides connectivity and information access, photography is a frequently used function, allowing people to capture memorable moments anytime, anywhere. Correspondingly, smartphone manufacturers have provided powerful image processing capabilities specifically for photography, such as continuously improving camera pixels, offering more different focal length magnifications, eliminating red-eye in low-light shooting through software, and adjusting colors. In addition, smartphones also offer some interesting photo processing features. For example, the "Recommended for You" feature generates a photo stream over a period of time, adding background music and effects. Effects include partial zoom, several photos moving in and out of the frame, and others. Another example is generating a photo stream based on a person (the main subject), accompanied by background music, and even including some videos. During this process, users can easily add or delete content and adjust the generated results.

[0003] However, the current "Recommended for You" feature on mobile phones only selects content based on time / aggregation, and the only way to increase the difference between people is by shuffling the time based on specific people. The background music is also randomly matched, which reduces the value of repeatedly viewing, sharing and keeping the photo stream for a long time.

[0004] On the other hand, the functions offered by intelligent vehicles are becoming increasingly diverse, and self-driving travel has made in-vehicle cameras (including built-in and external cameras) even more useful. During the journey, built-in cameras have gradually become in-vehicle video recording devices that offer a unique perspective for recording the journey, while external cameras (such as cameras connected to dashcams or external cameras installed around the vehicle) can capture some scenery that is not easy to capture with a mobile phone.

[0005] While existing technologies can automatically identify time, location, and objects, add music, and generate memoirs, they cannot automatically integrate different data sources, such as videos from mobile phones and videos recorded by bicycle dashcams. Moreover, current technologies primarily process single data content, and the exported image streams are not substantially related to the subject matter.

[0006] Therefore, an improved scheme for generating fused image streams is needed. Summary of the Invention

[0007] This application provides a method, system, and electronic device for generating a fused image stream, in order to solve at least one of the aforementioned technical problems in the prior art.

[0008] According to a first aspect of this application, a method for generating a fused image stream is provided, comprising: acquiring a first image set captured by an in-vehicle camera device and a second image set captured by a mobile terminal; determining a time window for selecting target images based on the capturing information of the first image set and / or the second image set; and clustering corresponding images located in the time window from the first image set and the second image set, respectively, based on the time window, to generate a fused image stream.

[0009] In one embodiment, clustering the corresponding images located within the time window from the first image set and the second image set further includes: identifying similar or identical objects in the corresponding target image sets located within the time window selected from the first image set and the second image set, and clustering the images containing similar or identical objects together.

[0010] In one embodiment, determining the time window for selecting images for a target trip based on the shooting information of the first image set and / or the second image set further includes: determining the subject of the target trip based on the shooting information of the first image set and / or the second image set; and determining the time window for selecting target images based on the subject of the target trip.

[0011] In one embodiment, the step of clustering corresponding images located in the time window from the first image set and the second image set according to the time window further includes: selecting a first target image set from the first image set that matches the theme of the target trip according to the theme of the target trip, and selecting a second target image set from the second image set that matches the theme of the target trip, and clustering the first target image set and the second target image set.

[0012] In one embodiment, the shooting information of the first image set or the second image set includes the shooting location, shooting time, shooting content and / or shooting frequency of the first image set or the second image set.

[0013] In one embodiment, the method further includes: acquiring environmental information of the first image set and the second image set, wherein the environmental information includes the weather at the time of shooting, the music at the time of shooting, and / or user emotion information extracted from the first image set or the second image set; selecting matching background music and / or special effects display content according to the environmental information, so as to include the background music and / or special effects display content in the generated fused image stream.

[0014] In one embodiment, the method further includes, after the vehicle's infotainment system is connected to the user's mobile terminal, performing the following operations: obtaining, on the user's mobile terminal, a first image set captured by an in-vehicle camera, shooting information of the first image set, and related environmental information stored on the infotainment system; or obtaining, on the vehicle's infotainment system, a second image set captured by the user's mobile terminal, shooting information of the second image set, and related environmental information.

[0015] According to a second aspect of this application, a system for generating a fused image stream is provided, comprising: a data acquisition module configured to acquire a first image set captured by an in-vehicle camera device and a second image set captured by a mobile terminal; a time window determination module configured to determine a time window for selecting target images based on the capturing information of the first image set and / or the second image set; and an image generation module configured to cluster corresponding images located in the first image set and the second image set respectively according to the time window to generate a fused image stream.

[0016] In one implementation, the image generation module is further configured to: identify similar or identical objects in corresponding target image sets selected from the first image set and the second image set respectively within the time window, and cluster images containing similar or identical objects together.

[0017] In one implementation, the time window determination module is further configured to: determine the subject of the target trip based on the shooting information of the first image set and / or the second image set; and determine a time window for selecting target images based on the subject of the target trip.

[0018] In one implementation, the image generation module is further configured to: select a first target image set from the first image set that matches the theme of the target trip, and select a second target image set from the second image set that matches the theme of the target trip, and cluster the first target image set and the second target image set.

[0019] In one embodiment, the data acquisition module is further configured to acquire environmental information of the first image set and the second image set, wherein the environmental information includes the weather at the time of shooting, the music at the time of shooting, and / or user emotion information extracted from the first image set or the second image set, and the image generation module is further configured to select matching background music and / or special effects display content according to the environmental information, so as to include the background music and / or special effects display content in the generated fused image stream.

[0020] In one embodiment, the data acquisition module is further configured to perform the following operations after the vehicle's in-vehicle infotainment system connects to the user's mobile terminal: acquiring, via file virtualization, a first set of images captured by the in-vehicle camera, the vehicle's driving route information, and related environmental information stored on the in-vehicle infotainment system; or acquiring, via file virtualization, a second set of images captured by the user's mobile terminal, the capturing information of the second set of images, and the related environmental information.

[0021] According to a third aspect of this application, an electronic device is provided, comprising: a processor and a memory, wherein the memory stores a computer program, characterized in that the processor executes the computer program to implement the steps of the method described above.

[0022] According to a fourth aspect of this application, a readable storage medium is provided, on which a computer program is stored, the computer program implementing the steps of the above-described method when executed by a processor.

[0023] In summary, the method, system, and electronic device for generating fused image streams provided in this application have at least the following advantages:

[0024] Beneficial effects:

[0025] The aforementioned method for generating fused image streams combines images captured by both the in-vehicle camera and the mobile terminal. By clustering these images, the selection of content in the fused image stream becomes richer and more reasonable. The generated fused image stream possesses a stronger narrative and a more specific timeline, meeting relevant user needs. For example, for a complete road trip, the method presented in this paper can intelligently cluster, automatically match, and fuse content captured by the mobile phone and the in-vehicle camera, thereby generating an image stream containing cherished memories. Attached Figure Description

[0026] To more clearly illustrate the specific embodiments of this application, the specific embodiments will be described below in conjunction with the accompanying drawings. Obviously, the accompanying drawings described below are only some non-exhaustive embodiments of this application.

[0027] Figure 1 This is a flowchart of a method for generating a fused image stream according to an embodiment of this application;

[0028] Figure 2 This is a flowchart of a method for generating a fused image stream according to another embodiment of this application;

[0029] Figure 3 This is a flowchart of a method for generating a fused image stream according to another embodiment of this application;

[0030] Figure 4 This is a schematic diagram illustrating the interconnection between a mobile phone and a vehicle-mounted system in one embodiment of this application.

[0031] Figure 5 This is a schematic diagram of a method for generating a fused image stream according to yet another embodiment of this application;

[0032] Figure 6 This is a schematic diagram of a system for generating a fused image stream according to an embodiment of this application;

[0033] Figure 7 This is a schematic diagram of an electronic device according to an embodiment of this application. Detailed Implementation

[0034] To make the above and other features and advantages of this application clearer, the application is further described below with reference to the accompanying drawings. It should be understood that the specific embodiments given herein are for the purpose of explanation to those skilled in the art, and are exemplary only, not restrictive.

[0035] In the following description, numerous specific details are set forth to provide a thorough understanding of this application. However, it will be apparent to those skilled in the art that the specific details are not required to practice this application. In other instances, well-known steps or operations have not been described in detail to avoid obscuring this application.

[0036] The method for generating a fused image stream provided in this application embodiment can be executed by the system for generating a fused image stream provided in this application embodiment, and the system can be configured in an electronic device.

[0037] Reference Appendix Figure 1 As shown, Figure 1 An embodiment of the present application illustrates a method for generating a fused image stream, the method comprising steps 110-130.

[0038] Step 110: Obtain the first set of images captured by the vehicle-mounted camera device and the second set of images captured by the mobile terminal.

[0039] The first image set and the second image set may each include a collection of images, videos, or both. The vehicle-mounted camera device may include an interior camera and exterior cameras located at different positions outside the vehicle. The vehicle-mounted camera device may be connected to a vehicle infotainment system to transmit images and / or videos captured by the vehicle-mounted camera to the vehicle's infotainment system. The mobile terminal may include a user's mobile electronic device such as a mobile phone, tablet, laptop, or smart wearable device.

[0040] Step 120: Determine the time window for selecting the target image based on the shooting information of the first image set and / or the second image set.

[0041] The time window used to select the target image can be, for example, the time from the start to the end of a trip or a specified time period desired by the user. For instance, a trip could be a road trip. The process of determining the time window for selecting the target image based on the shooting information of the first image set and / or the second image set can be implemented based on algorithms built into or preset on the vehicle's infotainment system or mobile terminal. Alternatively, the start and end times of the time window can also be manually selected by the user.

[0042] In one implementation, the subject of the target journey is determined based on the shooting information of the first image set and / or the second image set; and a time window for selecting target images is determined based on the subject of the target journey.

[0043] In some implementations, the shooting information of the first image set or the second image set includes the shooting location, shooting time, shooting content and / or shooting frequency of the first image set or the second image set, respectively.

[0044] Step 130: At least select the corresponding images located in the time window from the first image set and the second image set respectively according to the time window, perform clustering, and generate a fused image stream.

[0045] For example, after determining the time window corresponding to a self-driving tour trip based on the shooting information of the first image set, the corresponding images in the first image set and the corresponding images with similar content in the second image set corresponding to the time window are further identified. Then, the corresponding images in the first image set and the corresponding images in the second image set are clustered to generate at least one image cluster with similar content in the time window. Then, based on the at least one image cluster, a fused image stream corresponding to the time window is generated.

[0046] The above-described method for generating fused image streams combines images captured by the vehicle-mounted camera and the mobile terminal. By clustering these images within the same time window, it is possible to generate fused image streams with more similar content. The generated fused image streams are more targeted and meet the relevant user needs.

[0047] Appendix Figure 2 and attached Figure 3 The following are schematic flowcharts illustrating a method for generating a fused image stream according to one embodiment of this application. Figure 2 The method shown may include steps 210-240.

[0048] Step 210: Obtain the first image set captured by the vehicle-mounted camera device and the second image set captured by the mobile terminal.

[0049] See attached document Figure 3 As shown in an exemplary embodiment, a road trip begins, and an in-vehicle camera and a mobile terminal (e.g., a smartphone) respectively initiate automatic or active image capture operations, including recording photos and videos taken by the in-vehicle camera and the smartphone during the trip. The in-vehicle camera can automatically capture images during the journey or capture images based on user input, while smartphone capture can include manual captures taken inside the vehicle and at the destination. At the end of the trip, for example, by connecting the vehicle and smartphone, the smartphone and smartphone can access each other's relevant images (e.g., photos and videos taken by the in-vehicle camera and smartphone) and various related information (e.g., relevant environmental information recorded by the smartphone or smartphone). An image stream containing a combination of photos stored on both the smartphone and smartphone can be generated on the smartphone or smartphone, and the image stream can be saved and shared. More information on the interconnection between the smartphone and smartphone can be found in the following description. Figure 4 and Figure 5 Detailed description.

[0050] Step 220: Determine the subject of the target journey based on the shooting information of the first image set and / or the second image set; and determine the time window for selecting target images based on the subject of the target journey.

[0051] In one exemplary embodiment, the shooting information of the first image set captured by the vehicle-mounted camera device may include at least the shooting location, shooting time, shooting content, and / or shooting frequency of the first image set. For example, the shooting location of the first image set may include the vehicle's driving route and displacement information when the first image set was captured, thereby determining the start and end times of the selected shooting content of the vehicle-mounted camera device during the trip (e.g., a road trip) based on the vehicle's driving route and displacement information. The shooting information of the second image set captured by the mobile terminal may include at least the shooting location, shooting time, shooting content, and / or shooting frequency of the second image set. For example, the shooting content corresponding to the mobile terminal during the same trip as the vehicle-mounted camera device can be determined based on the shooting time, shooting frequency, shooting content, and shooting location of photos and videos on the mobile terminal (e.g., images with similar shooting content at the same shooting location and shooting time). For example, the theme of the target trip can be various suitable themes such as road trips, parenting time, personal photo albums, training and learning, and landscape photography, which will not be elaborated here.

[0052] Step 230: Based on the theme of the target trip, select a first target image set that matches the theme of the target trip from the first image set, and select a second target image set that matches the theme of the target trip from the second image set, and cluster the first target image set and the second target image set.

[0053] In some implementations, determining a time window for selecting images for a target journey based on the shooting information of a first image set and / or a second image set further includes: identifying similar or identical objects in the corresponding target image sets selected from the first and second image sets within the time window, and clustering images containing similar or identical objects together.

[0054] For example, when the theme of the target journey is parenting time, similar or identical objects can be identified in the corresponding target image sets selected from the first and second image sets within the time window corresponding to that parenting time segment. In other words, similar or identical objects in the first and second image sets that correspond to the target person (e.g., a child) can be identified. The length of the time window can be very short (e.g., several months) or very long (e.g., several years). Within a time window of several years, a decade, or even several decades, the appearance of the same person may change. This paper envisions using a similarity algorithm based on changes in a person's growth to identify similar and identical objects of the target person.

[0055] In one exemplary implementation, the theme of the target journey can be determined through similar object identification, or it can be a user-specified theme or a system default theme. The theme determines the selection of the target content; for example, if the theme is a children's image stream, photos / videos related to children will be selected. A similar method can be used to determine other themes (e.g., landscape themes). Based on the target theme, images and videos from both the vehicle-mounted and mobile devices can be identified, classified, and clustered for similar objects, thereby generating a fused image stream based on the clustered images.

[0056] Step 240: Obtain environmental information for the first image set and the second image set, wherein the environmental information includes the weather, music, and / or user emotion information extracted from the first or second image set when the vehicle-mounted camera or mobile terminal is shooting; and select matching background music and / or special effects display content based on the environmental information to include the background music and / or special effects display content in the generated fused image stream.

[0057] For example, environmental information could include music playing in the target image set, weather conditions in the target image set, and user emotions in the first and / or second target image sets. Based on this environmental information, background music with a high degree of matching is selected for fusion based on a preset background music matching algorithm or through user-defined settings. In some implementations, users can generate a fused image stream using image generation templates provided by corresponding programs on their mobile phones or in-vehicle systems. They can also adjust the configuration of the image stream to generate a fused image that meets their expectations. Furthermore, the method also includes performing the following operations after the vehicle's in-vehicle system is connected to the user's mobile terminal: obtaining, via file virtualization, a first image set captured by the in-vehicle camera, its capture information, and related environmental information stored on the in-vehicle system; or obtaining, via file virtualization, a second image set captured by the user's mobile terminal, its capture information, and related environmental information.

[0058] Figure 4 This is a schematic diagram illustrating the interconnection between a mobile phone and a vehicle-mounted system in one embodiment of this application.

[0059] See attached document Figure 4 As shown, for example, acquiring a first set of images captured by an in-vehicle camera device may include the following steps:

[0060] Step b1: The vehicle-mounted computer (also known as the in-vehicle computer) can be configured with, for example, an Android system. An Android application A (e.g., the Gallery application) on the vehicle-mounted computer generates files (e.g., a first image set) by taking photos and / or recording videos and writes them to the file system of the vehicle-mounted computer.

[0061] Step b2: Based on the vehicle-mounted connectivity service (HU Connectivity Service), obtain a list of files or a single file from the vehicle-mounted file system;

[0062] Step b3: Based on the vehicle-mounted connectivity service, the vehicle-mounted device sends a list of files or a single file to the mobile device via wireless network;

[0063] Step b4: Based on the Mobile Connectivity Service, the mobile device receives a list of files or a single file synchronously sent from the vehicle's infotainment system via a wireless network;

[0064] Step b5: Based on the mobile connection service, create a virtual vehicle system directory in the mobile device's file system, and write a list of files or a single file into this virtual vehicle system directory; and

[0065] Step b6: The corresponding application on the mobile device reads the file list or a single file in the virtual directory of the vehicle's infotainment system.

[0066] Please refer to the appendix again. Figure 4 As shown, for example, acquiring a second set of images captured by a mobile terminal may include the following steps:

[0067] Step a1: Application B on the mobile device generates files (e.g., a second image set) by taking photos and / or recording videos and writes them to the phone's file system;

[0068] Step a2: Based on the mobile connection service, obtain a list of files or a single file from the mobile file system;

[0069] Step a3: Based on the mobile connection service, the mobile device sends a list of files or a single file to the vehicle's infotainment system via wireless network;

[0070] Step a4: Based on the vehicle-mounted connectivity service, the vehicle-mounted device receives a list of files or a single file synchronously sent from the mobile device via wireless network;

[0071] Step a5: Based on the vehicle-mounted connection service, create a virtual phone directory in the vehicle-mounted file system and write a list of files or a single file into the virtual phone directory;

[0072] Step a6: The corresponding application on the vehicle's infotainment system directly reads and retrieves the file list or a single file from the phone's virtual directory.

[0073] Figure 5 This is a schematic diagram of a method for generating a fused image stream according to yet another embodiment of this application.

[0074] See attached document Figure 5 As shown, for example, the mobile domain (i.e., the mobile device) obtains photos and videos of the first target image set, along with related environmental information, from the vehicle domain (i.e., the vehicle device) through connection to the vehicle domain and file virtualization. Then, based on the target theme, it further obtains photos and videos of the corresponding second target image set from the mobile device's local storage. This second set is then combined with the photos and videos of the first target image set obtained from the mobile domain. An application on the mobile domain generates a photo memory set, performing template matching, content selection, and background music matching based on user configuration management. Instead of user-defined settings, the template matching and content selection can also be determined based on the theme and shooting information (e.g., shooting content, shooting time, and / or shooting location), and music matching can be determined based on environmental information (e.g., route, music, or weather).

[0075] It is understandable that the vehicle-mounted system domain can also obtain the target image set and related user configuration management information from the mobile phone domain, and perform further image fusion operations to generate the corresponding image stream, which will not be elaborated here.

[0076] This application provides a method for generating a fused image stream. Based on the determination of the target theme, a time window is further determined. Background music is added to the image stream using environmental information, and the entire process is achieved through the combination of the vehicle-mounted system and the mobile terminal. This method for generating a fused image stream can automatically match background music and special effects templates based at least on environmental information provided by the vehicle-mounted system and the mobile terminal, combined with the identification of relevant elements in the captured content. This increases the adaptability of the content and background music, enhancing the emotional impact of the photo stream.

[0077] See attached document Figure 6 As shown, according to this application, a system for generating a fused image stream is provided. The system includes a data acquisition module 610 configured to acquire a first image set captured by an in-vehicle camera device and a second image set captured by a mobile terminal; a time window determination module 620 configured to determine a time window for selecting target images based on the shooting information of the first image set and / or the second image set; and an image generation module 630 configured to cluster corresponding images located in the first image set and the second image set respectively according to the time window to generate a fused image stream.

[0078] In some embodiments, the image generation module is further configured to: identify similar or identical objects in corresponding target image sets selected from the first image set and the second image set respectively within the time window, and cluster images containing similar or identical objects together.

[0079] In some implementations, the time window determination module is further configured to: determine the subject of the target journey based on the shooting information of the first image set and / or the second image set; and determine a time window for selecting target images based on the subject of the target journey.

[0080] In some embodiments, the image generation module is further configured to: select a first target image set from the first image set that matches the theme of the target trip, and select a second target image set from the second image set that matches the theme of the target trip, and cluster the first target image set and the second target image set.

[0081] In some embodiments, the data acquisition module is further configured to acquire environmental information of the first image set and the second image set, the environmental information including the weather at the time of shooting, the music at the time of shooting, and / or user emotion information extracted from the first image set or the second image set, and the image generation module is further configured to select matching background music and / or special effects display content according to the environmental information, so as to include the background music and / or special effects display content in the generated fused image stream.

[0082] In some embodiments, the data acquisition module is further configured to perform the following operations after the vehicle's in-vehicle infotainment system connects to the user's mobile terminal: on the user's mobile terminal, acquire, via file virtualization, a first image set captured by the in-vehicle camera device, the vehicle's driving route information, and related environmental information stored on the in-vehicle infotainment system; or on the terminal, acquire, via file virtualization, a second image set captured by the user's mobile terminal, the capture information of the second image set, and the related environmental information.

[0083] The system for generating fused image streams in this application realizes the correlation between vehicle-mounted shooting devices and mobile terminal content, making the selection of fused image stream content more accurate and reasonable, and possessing stronger storytelling and a more specific timeline.

[0084] It should be understood that the specific features, operations, and details described above with respect to the method of this application can also be similarly applied to the system of this application, or vice versa. Furthermore, each step of the method of this application described above can be performed by the corresponding component or module of the system of this application.

[0085] It should be understood that the various modules / units of the system of this application can be implemented wholly or partially through software, hardware, firmware, or a combination thereof. Each module / unit can be embedded in the processor of the electronic device in hardware or firmware form or independent of the processor, or it can be stored in the memory of the electronic device in software form for the processor to call to execute the operation of each module / unit. Each module / unit can be implemented as an independent component or module, or two or more modules / units can be implemented as a single component or module.

[0086] like Figure 7 As shown, this application provides an electronic device 700, which includes a processor 710 and a memory 720 storing computer program instructions. The processor 710 executes the computer program instructions to implement the steps of the method for generating a fused image stream described above. This electronic device 700 can be broadly categorized as a server, terminal, or any other electronic device with the necessary computing and / or processing capabilities.

[0087] In one embodiment, the electronic device 700 may include a processor, memory, and communication interface connected via a system bus. The processor of the electronic device 700 can provide necessary computing, processing, and / or control capabilities. The memory of the electronic device 700 may include a non-volatile storage medium and internal memory. The non-volatile storage medium may store an operating system, computer programs, etc. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The communication interface of the electronic device 700 can be used to communicate with external devices via a network connection. When the computer program is executed by the processor, it performs the steps of the method for generating a fused image stream described above in this application.

[0088] This application also provides a computer-readable storage medium storing computer program instructions that, when executed by a processor, implement the steps of the method for generating a fused image stream described above.

[0089] Those skilled in the art will understand that the method steps of this application can be performed by a computer program instructing related hardware, such as electronic device 700 or a processor. The computer program can be stored in a non-transitory computer-readable storage medium, and its execution causes the steps of this application to be performed. Depending on the context, any reference herein to memory, storage, or other media may include non-volatile or volatile memory. Examples of non-volatile memory include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, magnetic tape, floppy disk, magneto-optical data storage device, optical data storage device, hard disk, solid-state drive, etc. Examples of volatile memory include random access memory (RAM), external cache memory, etc.

[0090] The technical features described above can be combined arbitrarily. Although not all possible combinations of these technical features are described, any combination of these technical features should be considered to be covered by this specification, provided that such combination does not contain contradictions.

[0091] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A method of generating a fused image stream, characterized by, The method comprises: acquiring a first image set captured by a vehicle-mounted camera and a second image set captured by a mobile terminal; determining a time window for selecting target images according to shooting information of the first image set and / or the second image set; and selecting respective images located in the time window from the first image set and the second image set respectively according to the time window to generate a fused image stream. The step of selecting respective images located in the time window from the first image set and the second image set respectively according to the time window to generate a fused image stream further comprises:

2. The method of claim 1, wherein, identifying similar objects or identical objects in the respective target image sets selected from the first image set and the second image set respectively, and clustering images containing similar objects or identical objects together. The step of determining a time window for selecting target images according to shooting information of the first image set and / or the second image set further comprises:

3. The method of claim 1, wherein, determining a theme of a target journey according to the shooting information of the first image set and / or the second image set; and determining a time window for selecting target images according to the theme of the target journey. The step of selecting respective images located in the time window from the first image set and the second image set respectively according to the time window to generate a fused image stream further comprises:

4. The method of claim 3, wherein, selecting a first target image set conforming to the theme of the target journey from the first image set and a second target image set conforming to the theme of the target journey from the second image set according to the theme of the target journey, and clustering the first target image set and the second target image set. The shooting information of the first image set or the second image set comprises shooting position, shooting time, shooting content and / or shooting frequency of the first image set or the second image set.

5. The method according to any one of claims 1-3, characterized in that, The method further comprises:

6. The method according to claim 3 or 4, characterized in that, acquiring environmental information of the first image set and the second image set, wherein the environmental information comprises weather at the time of shooting, music at the time of shooting and / or user emotion information extracted from the first image set or the second image set; selecting matched background music and / or special effect display content according to the environmental information to include the background music and / or special effect display content in the generated fused image stream. The method further comprises:

7. The method of claim 6, wherein, after the vehicle infotainment terminal is connected with the mobile terminal of the user, the following operations are performed: acquiring the first image set captured by the vehicle-mounted camera, shooting information of the first image set and related environmental information stored in the infotainment terminal through file virtualization on the mobile terminal of the user; or acquiring the second image set captured by the mobile terminal of the user, shooting information of the second image set and related environmental information through file virtualization on the infotainment terminal. The system comprises: a data acquisition module configured to acquire a first image set captured by a vehicle-mounted camera and a second image set captured by a mobile terminal; 8. A system for generating a fused image stream, characterized by a time window determination module configured to determine a time window for selecting target images according to shooting information of the first image set and / or the second image set; and a clustering module configured to select respective images located in the time window from the first image set and the second image set respectively according to the time window to generate a fused image stream. ​ The image generation module is configured to generate a fused image stream by clustering respective images in the time window selected from the first image set and the second image set respectively according to the time window.

9. The system of claim 8, wherein, The image generation module is further configured to identify similar objects or identical objects in the respective target image sets in the time window selected from the first image set and the second image set respectively, and cluster images containing similar objects or identical objects together.

10. The system of claim 8, wherein, The time window determination module is further configured to determine a theme of the target trip according to shooting information of the first image set and / or the second image set, and determine the time window for selecting target images according to the theme of the target trip.

11. The system of claim 10, wherein, The image generation module is further configured to select a first target image set conforming to the theme of the target trip from the first image set and a second target image set conforming to the theme of the target trip from the second image set according to the theme of the target trip, and cluster the first target image set and the second target image set.

12. The system of any one of claims 8-10, wherein The data acquisition module is further configured to acquire environment information of the first image set and the second image set, wherein the environment information includes weather at the time of shooting, music at the time of shooting, and / or user emotion information extracted from the first image set or the second image set, and The image generation module is further configured to select matching background music and / or special effect display content according to the environment information to include the background music and / or special effect display content in the generated fused image stream.

13. The system of claim 12, wherein The data acquisition module is further configured to perform the following operations after the vehicle machine end is connected with the user's mobile terminal: acquire the first image set of the vehicle-mounted camera, the driving route information of the vehicle, and the related environment information stored in the vehicle machine end through file virtualization on the user's mobile terminal; or acquire the second image set, the shooting information of the second image set, and the related environment information through file virtualization on the vehicle machine end.

14. An electronic device, comprising: including: a processor and a memory, wherein the memory stores a computer program, and wherein the processor implements the steps of the method according to any one of claims 1 to 7 when executing the computer program.

15. A readable storage medium, characterized by, The computer program is stored on the readable storage medium and implements the steps of the method according to any one of claims 1 to 7 when executed by a processor.

Images