Content generation method, controller, vehicle and storage medium
By fusion processing of vehicle-mounted cameras and operational information to generate multimedia content, the problem of limited vehicle imaging functions has been solved, enabling diversified and emotional imaging output, and improving user experience and the utilization rate of imaging functions.
Patent Information
- Application Number
- CN202611107844.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-07-23
- Publication Date
- 2026-11-17
AI Technical Summary
Existing vehicle imaging functions only support simple image storage and viewing, lacking the ability to further process images, making it difficult to meet the diverse and emotional needs of users, resulting in low utilization of the imaging function.
By fusing images of the target captured by the vehicle's onboard camera with vehicle operation information, multimedia content is generated. Using visual effect evaluation strategies and a fusion strategy library, the optimal fusion method is determined, and operation information is added or integrated into the images to generate multimedia content with emotional value and commemorative significance.
It improves the utilization rate of vehicle imaging functions, enhances the interactivity and entertainment value of imaging functions, meets users' personalized and emotional needs, and improves user experience and participation.
Smart Images

Figure CN123123530A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of vehicle technology, specifically to a content generation method, a controller, a vehicle, and a storage medium. Background Technology
[0002] With the continuous improvement of vehicle intelligence, in-vehicle cameras have become a standard feature, enabling vehicles to have imaging capabilities. Currently, vehicles can not only use in-vehicle cameras for driving recording but also to capture, save, or export images. However, current vehicle imaging functions only support simple storage, viewing, or exporting of captured images, lacking further image processing capabilities, which fails to meet user needs and thus limits the utilization of vehicle imaging functions. Summary of the Invention
[0003] This application provides a content generation method, a controller, a vehicle, and a storage medium, aiming to improve the imaging function of a vehicle, meet user needs, and thereby increase the utilization rate of the vehicle's imaging function.
[0004] In a first aspect, embodiments of this application provide a content generation method, including: Multimedia content is obtained by fusing the target images captured by the vehicle's onboard camera with the vehicle's operational information.
[0005] Optionally, the multimedia content obtained by fusing the target image captured by the vehicle's onboard camera with the vehicle's operating information includes: Multimedia content is obtained by adding the vehicle's operating information to the target image captured by the vehicle's onboard camera. Alternatively, based on a fusion strategy, the target images captured by the vehicle's onboard cameras and the vehicle's operational information can be fused together to obtain multimedia content.
[0006] Optionally, embodiments of this application further include: Based on the visual effect evaluation strategy and / or the occupant preference information of the aforementioned vehicle, as well as the preset fusion strategies in the fusion strategy library, a fusion strategy for the aforementioned target image and the aforementioned operational information is determined. Alternatively, display the preset fusion strategies in the fusion strategy library, and in response to the selection operation of the preset fusion strategy, determine the fusion strategy for the target image and the runtime information.
[0007] Optionally, the above-mentioned fusion strategy for the target image and the above-mentioned operational information, determined based on the visual effect evaluation strategy and the preset fusion strategies in the fusion strategy library, includes: Based on the visual effect evaluation strategy, determine the visual effect of each preset fusion strategy in the fusion strategy library on the above target image and the above running information. Based on the above-mentioned fusion visual effects, a fusion strategy for the above-mentioned target image and the above-mentioned operational information is determined from the above-mentioned preset fusion strategies.
[0008] Optionally, the above-mentioned fusion strategy for the target image and the above-mentioned operational information, determined based on the visual effect evaluation strategy and the preset fusion strategies in the fusion strategy library, includes: Based on the visual effect evaluation strategy, shooting events, and preset fusion strategies in the fusion strategy library, a fusion strategy that matches the shooting events for the target images and the operational information is determined. The aforementioned shooting event refers to the event that triggers the taking of the aforementioned target image.
[0009] Optionally, the multimedia content obtained by fusing the target image captured by the vehicle's onboard camera with the vehicle's operating information includes: Multimedia content is obtained by fusing the target images captured by the vehicle's onboard camera with the target operation information associated with the captured event from the vehicle's operation information. The aforementioned shooting event refers to the event that triggers the taking of the aforementioned target image.
[0010] Optionally, embodiments of this application further include: In response to a shooting event, the vehicle's onboard camera is controlled to take a picture and obtain the target image.
[0011] Optionally, the aforementioned shooting event includes either a user triggering a shooting command or the vehicle's operating information meeting a preset information condition.
[0012] Optionally, the vehicle's operational information includes at least one of the following: a digital human model corresponding to the vehicle's occupants, a three-dimensional model of the vehicle, time information, location information, weather information, altitude information, mileage information, and driving trajectory.
[0013] Optionally, the aforementioned vehicle-mounted camera includes at least one of an exterior vehicle-mounted camera and an interior vehicle-mounted camera, wherein the exterior vehicle-mounted camera includes at least one of a camera connected to the vehicle body and a camera mounted on a moving vehicle within the vehicle.
[0014] Optionally, when the aforementioned vehicle-mounted camera includes a camera configured on the aforementioned moving vehicle, the aforementioned action of controlling the vehicle's on-board camera to capture an image in response to a shooting event to obtain a target image includes: In response to a shooting event, if the current environment of the vehicle meets the shooting conditions for a moving vehicle, the vehicle is controlled to move around the vehicle and take pictures to obtain the target image.
[0015] Optionally, the vehicle-mounted camera includes both an exterior vehicle-mounted camera and an interior vehicle-mounted camera. If the vehicle occupant's selection information for the interior vehicle-mounted camera is obtained, the target image includes both an exterior target image and an interior target image; otherwise, the target image includes only the exterior target image. The aforementioned images of the targets outside the vehicle were obtained by taking pictures using the aforementioned vehicle-mounted cameras outside the vehicle, and the aforementioned images of the targets inside the vehicle were obtained by taking pictures using the aforementioned vehicle-mounted cameras inside the vehicle.
[0016] Secondly, embodiments of this application also provide a controller, including: a memory storing a computer program thereon; and a processor for executing the computer program in the memory to implement the content generation method provided in embodiments of this application.
[0017] Thirdly, embodiments of this application also provide a vehicle, including a controller provided in embodiments of this application, or a content generation method provided in embodiments of this application.
[0018] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, the computer program being loaded by a processor to perform the steps of the content generation method provided in this embodiment.
[0019] Fifthly, this application also provides a computer program product, including a computer program or instructions, which, when executed by a processor, implement the steps of the content generation method provided in this embodiment.
[0020] Beneficial effects: In this embodiment of the application, the vehicle performs fusion processing on the target image captured by the vehicle's onboard camera and the vehicle's operating information to obtain multimedia content. This enables the vehicle's imaging function to not only store, view, or export the captured images, but also to further process the images, so as to meet the increasingly diverse usage needs of users and thereby improve the utilization rate of the vehicle's imaging function. Attached Figure Description
[0021] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0022] Figure 1This is a flowchart illustrating the content generation method provided by an exemplary embodiment of this disclosure; Figure 2 This is a schematic diagram of a content generation system provided by an exemplary embodiment of this disclosure; Figure 3 This is another schematic diagram of the content generation system provided by the exemplary embodiments of this disclosure; Figure 4 This is an interactive diagram of the various modules provided in the exemplary embodiments of this disclosure; Figure 5 This is another flowchart illustrating the content generation method provided by an exemplary embodiment of this disclosure; Figure 6 This is a schematic diagram of a vehicle provided by an exemplary embodiment of this disclosure. Detailed Implementation
[0023] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0024] In the description of this application, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," and "outer," etc., indicating orientation or positional relationships based on the orientation or positional relationships shown in the accompanying drawings, are used only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this application. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more of the stated features. In the description of this application, "a plurality of" means two or more, unless otherwise explicitly specified.
[0025] "A and / or B" includes the following three combinations: A only, B only, and a combination of A and B.
[0026] The use of "applies to" or "configured to" in this application implies open and inclusive language, which does not exclude the applicability to or configuration to devices performing additional tasks or steps. Additionally, the use of "based on" implies openness and inclusivity, because processes, steps, calculations, or other actions "based on" one or more of the stated conditions or values may in practice be based on additional conditions or values beyond those stated.
[0027] In this application, the term "exemplary" is used to mean "used as an example, illustration, or description." Any embodiment described as "exemplary" in this application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use this application. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that this application can be made without using these specific details. In other instances, well-known structures and processes are not described in detail to avoid obscuring the description of this application with unnecessary detail. Therefore, this application is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in this application.
[0028] On the one hand, this embodiment provides a content generation method applied to vehicles, such as... Figure 1 As shown, it includes: S101: Multimedia content is obtained by fusing target images captured by the vehicle's onboard camera with the vehicle's operating information.
[0029] In this context, a vehicle-mounted camera refers to a camera installed on a vehicle. Optionally, the vehicle-mounted camera can be fixedly installed on the vehicle, in which case it cannot be moved. For example, a vehicle-mounted camera can include at least one of an external camera connected to the vehicle body and an internal camera. Alternatively, a vehicle-mounted camera can refer to a camera placed inside the vehicle, but it can exist independently of the vehicle. For example, a vehicle-mounted camera can include a camera mounted on a moving vehicle within the vehicle, and the moving vehicle can be detached from the vehicle, allowing the camera on the moving vehicle to also detach from the vehicle. Optionally, a vehicle-mounted camera can include at least one camera. When multiple vehicle-mounted cameras are included, the target images captured by the multiple vehicle-mounted cameras can be stitched together to form a panoramic image or superimposed and fused. This application embodiment does not impose limitations on this.
[0030] Vehicle operation information refers to various information that can be obtained from the vehicle. It may include various data collected by the vehicle's sensors (excluding onboard cameras), results generated based on the collected data, vehicle environmental information, vehicle occupant information, vehicle's own physical parameters, and at least one of the results generated based on the vehicle's own physical parameters. The data collected by the sensors may include at least one of location information, altitude information, and mileage information. The results generated based on the collected data may include driving trajectory. The vehicle's environmental information may include at least one of time information (time information may include at least one of time information, holiday information, and commemorative date information that has special significance for the occupants) and weather information. The vehicle occupant information may include digital human models corresponding to the occupants. The results generated based on the vehicle's own physical parameters may include a three-dimensional vehicle model generated based on the vehicle model, etc. The embodiments of this application are not limited here.
[0031] Multimedia content refers to information presented in various media formats such as text, images, audio, and video. For example, multimedia content may include images and text, audio and images, or video, etc., and this application embodiment does not impose any limitations on this. Optionally, when multimedia content includes images and text, the multimedia content may be, for example, a pictorial or poster, etc., and this application embodiment does not impose any limitations on this. Optionally, the generated multimedia content may have commemorative significance or meet the current personalized needs of the vehicle occupants.
[0032] Optionally, after capturing the target image, the vehicle can immediately perform fusion processing based on the target image and the vehicle's operating information to obtain multimedia content. Alternatively, the vehicle can first capture the target image, and after meeting preset generation conditions, perform fusion processing based on the target image and the vehicle's operating information to obtain multimedia content. This application embodiment does not limit the scope of the multimedia content.
[0033] Optionally, after obtaining the multimedia content, it can be saved in the vehicle or displayed on the vehicle's screen for easy viewing by passengers at any time. Alternatively, the vehicle can push the multimedia content to the passenger's terminal device or the cloud to achieve cross-device interaction and convenient sharing, thereby allowing passengers to view the multimedia content at any time and ensuring its persistent storage and accessibility.
[0034] Optionally, the vehicle may also be equipped with a printing function so that multimedia content can be printed.
[0035] In related technologies, vehicle imaging functions are limited to simply capturing and storing the scenery outside the vehicle. The resulting content is relatively monotonous and lacks sufficient interactivity and entertainment elements, failing to meet the deeper needs of modern users for personalized and emotional digital content, thus reducing the utilization rate of vehicle imaging functions. In this embodiment, multimedia content is obtained by fusing target images captured by the vehicle's onboard camera with the vehicle's operating information. This not only allows for the continuous recording and preservation of exciting moments during driving but also provides diverse image processing methods to transform simple target images into multimedia content with emotional value and commemorative significance. This enhances the expressive dimension of driving memories, strengthens the contextual relevance of the content output by the vehicle's imaging function, and imbues the output with interactive and entertaining elements. This enriches the vehicle's imaging function, enhances its appeal, meets users' diverse usage needs and deeper needs for personalized and emotional digital content, strengthens user stickiness and emotional identification with the vehicle system, improves user experience, increases user engagement, and ultimately improves the utilization rate of the vehicle's imaging function.
[0036] In some embodiments, multimedia content is obtained by fusing target images captured by the vehicle's onboard camera with vehicle operation information, including: Multimedia content is obtained by adding vehicle operation information to target images captured by the vehicle's onboard camera. Alternatively, based on a fusion strategy, target images captured by the vehicle's onboard cameras and vehicle operation information can be fused together to obtain multimedia content.
[0037] The fusion strategy is used to indicate how to fuse the target image and the running information. It can be set according to the actual situation. For example, the fusion strategy may include at least one of the fusion template and the fusion theme style. Different fusion templates have different layouts, typography and colors. Optionally, the fusion template may also include text. Different fusion templates have different text. This application embodiment does not limit this.
[0038] Optionally, vehicle operation information can be added to any location on the target image, or it can be added to a blank area of the target image. Optionally, when the vehicle operation information includes multiple types, the positions of the different operation information on the target image can be different. Optionally, when the operation information includes a 3D vehicle model, the 3D vehicle model can be superimposed on the target image at a specified angle.
[0039] In this embodiment, vehicle operation information is added to a target image captured by the vehicle's onboard camera to obtain multimedia content; or, based on a fusion strategy, the target image captured by the vehicle's onboard camera and the vehicle's operation information are fused to obtain multimedia content. This allows the fusion strategy to differ when the target image and / or operation information are different, improving the visual effect of the fusion of the target image and operation information, further enriching the multimedia content, making the multimedia content more in line with user needs, and thus further improving the utilization rate of the vehicle's imaging function.
[0040] In some embodiments, the present application further includes: determining a fusion strategy for the target image and operation information based on a visual effect evaluation strategy and / or the occupant preference information of the vehicle, as well as a preset fusion strategy in a fusion strategy library; or, displaying a preset fusion strategy in a fusion strategy library, and determining a fusion strategy for the target image and operation information in response to a selection operation of the preset fusion strategy.
[0041] The visual effect evaluation strategy refers to a method that transforms subjective perceptions such as aesthetics, readability, and harmony in visual presentation into quantifiable indicators. It can be used to evaluate the fused visual effect when a target image and runtime information are fused based on a preset fusion strategy. The type of visual effect evaluation strategy can be set according to actual circumstances. For example, a visual effect evaluation strategy may include a visual effect evaluation model or visual effect evaluation rules; this embodiment of the application does not limit this.
[0042] A preset fusion strategy can be used to instruct how to fuse target images and operational information. It may include at least one of preset fusion templates and preset fusion theme styles, which are not limited in this embodiment. Optionally, the preset fusion strategy can be generated manually and / or generated through a fusion strategy model. When generated through a fusion strategy model, existing multimedia content can be collected through community platforms (such as dedicated forums or social sharing walls) and stored in a "user-co-created content library." The fusion strategy model can be trained using the existing multimedia content in the "user-co-created content library" to enrich the fusion strategy library and optimize the composition rules and color matching of preset fusion templates in the fusion strategy library, thereby promoting the iterative upgrade of the vehicle's imaging function's intelligence level. The fusion strategy for target images and operational information refers to a fusion strategy that fuses target images and operational information.
[0043] The term "vehicle occupant" can refer to either the driver or passengers of the vehicle; this embodiment of the application does not limit this definition. Optionally, the fusion strategy library can be deployed on the vehicle, or it can be deployed in the cloud. Optionally, since there are many preset fusion strategies in the fusion strategy library, preset fusion strategies can be filtered and displayed based on preset filtering rules. These preset filtering rules may include at least one of the following: occupant preference information, popular fusion strategies, and commonly used fusion strategies. Optionally, when the fusion strategy library is deployed in the cloud, the cloud can filter and display preset fusion strategies based on preset filtering rules and send the displayed preset fusion strategies to the vehicle for display. Optionally, the preset fusion strategy selected by the selection operation can be determined as the fusion strategy for the target image and running information. Optionally, after selecting a preset fusion strategy, the occupant can also manually adjust the preset fusion strategy, and the vehicle will then determine the adjusted preset fusion strategy as the fusion strategy for the target image and running information.
[0044] In this embodiment, a fusion strategy for the target image and operational information is determined based on a visual effect evaluation strategy and / or the vehicle occupants' preference information, as well as preset fusion strategies in a fusion strategy library; or, preset fusion strategies in the fusion strategy library are displayed, and in response to the selection operation of a preset fusion strategy, a fusion strategy for the target image and operational information is determined. This allows for automatic determination of the fusion strategy or manual selection of the fusion strategy by the vehicle occupants, enriching the determination methods of the fusion strategy. This can improve the generation efficiency of the fusion strategy or make the generated fusion strategy more in line with the needs of the occupants, thereby making the multimedia content generated based on the fusion strategy more in line with the needs of the occupants and further improving the utilization rate of the vehicle's imaging function.
[0045] In some embodiments, based on a visual effect evaluation strategy and preset fusion strategies in a fusion strategy library, a fusion strategy for the target image and runtime information is determined, including: Based on the visual effect evaluation strategy, determine the visual effect of each preset fusion strategy in the fusion strategy library on the fusion of target image and runtime information; Based on the fusion visual effect, a fusion strategy for the target image and runtime information is determined from the preset fusion strategies.
[0046] Each preset fusion strategy refers to the visual effect of fusing the target image and operational information. It describes the visual effect achieved when fusing the target image and operational information based on the preset fusion strategy, and can be represented numerically. A higher value indicates a better visual effect, and a lower value indicates a worse visual effect. Optionally, the preset fusion strategy with the best visual effect can be determined as the fusion strategy for the target image and operational information. Alternatively, the visual effects can be sorted, and the preset fusion strategies of the top preset visual effects can be displayed. In response to the occupant's selection, the selected preset fusion strategy is determined as the fusion strategy for the target image and operational information. This embodiment does not limit the specific implementation. Optionally, after selecting a preset fusion strategy, the occupant can manually adjust the preset fusion strategy, and the vehicle will then determine the adjusted preset fusion strategy as the fusion strategy for the target image and operational information.
[0047] Understandably, since it is necessary to determine the visual effect of each preset fusion strategy on the fusion of the target image and the runtime information, the visual effect evaluation strategy can be used to determine the visual effect of each preset fusion strategy on the fusion of the target image and the runtime information based on the content features of the target image and the information features of the runtime information.
[0048] In this embodiment, based on the visual effect evaluation strategy, the visual effect of each preset fusion strategy in the fusion strategy library on the target image and running information is determined; based on the fusion visual effect, the fusion strategy for the target image and running information is determined from the preset fusion strategies, so as to select the fusion strategy with the best fusion visual effect, so that the multimedia content generated based on the fusion strategy is more in line with the needs of the occupants, and further improves the utilization rate of the vehicle's imaging function.
[0049] In some embodiments, based on a visual effect evaluation strategy and preset fusion strategies in a fusion strategy library, a fusion strategy for the target image and runtime information is determined, including: Based on visual effect evaluation strategies, shooting events, and preset fusion strategies in the fusion strategy library, a fusion strategy for the target image and runtime information that matches the shooting event is determined; where shooting event refers to the event that triggers the shooting of the target image.
[0050] Different shooting events have different thematic requirements, and different thematic requirements correspond to different fusion strategies. Therefore, determining the fusion strategy based on the shooting event ensures that the fusion strategy aligns with the thematic requirements of the shooting event. For example, if the shooting event is reaching a target mileage, the fusion strategy would be one that aligns with the mileage theme. Or, if the shooting event is the vehicle arriving at a famous tourist attraction, the fusion strategy would be one that aligns with the location theme.
[0051] Optionally, based on the shooting event, candidate fusion strategies can be determined from each preset fusion strategy in the fusion strategy library. Based on the visual effect evaluation strategy, the fusion visual effect of each candidate fusion strategy on the target image and running information can be determined. Based on the fusion visual effect, the fusion strategy that conforms to the shooting event and is suitable for the target image and running information can be determined from the candidate fusion strategies.
[0052] Optionally, when a shooting event triggers a shooting command from the user, the subject requirements can be manually set by the user.
[0053] In this embodiment, based on the visual effect evaluation strategy, the shooting event, and the preset fusion strategy in the fusion strategy library, a fusion strategy for the target image and operation information that conforms to the shooting event is determined; wherein, the shooting event refers to the event that triggers the shooting of the target image, so that the fusion strategy can not only meet the visual requirements, but also meet the theme requirements of the shooting event, making the multimedia content generated based on the fusion strategy more in line with the needs of the occupants, and further improving the utilization rate of the vehicle's imaging function.
[0054] In some embodiments, multimedia content is obtained by fusing target images captured by the vehicle's onboard camera with vehicle operation information, including: Multimedia content is obtained by fusing target images captured by the vehicle's onboard camera with target operation information associated with the shooting event from the vehicle's operation information; where the shooting event refers to the event that triggers the shooting of the target image.
[0055] The target operation information refers to information related to the generation of the shooting event, information generated during the shooting process, and / or default operation information. For example, when the shooting event includes vehicle operation information that meets preset information conditions, the target operation information includes operation information that meets the preset information conditions. In this case, the shooting event is triggered based on the target operation information, and the target operation information is related to the generation of the shooting event. Alternatively, the target operation information includes time information and / or location information for shooting the target image, etc. In this case, the target operation information includes information generated during the shooting process. Or, the default operation information may include a 3D model of the vehicle, etc. This embodiment of the application does not limit the scope of the target operation information. Optionally, when the user triggers the shooting command at the shooting time, the user can also manually set the target operation information.
[0056] Optionally, the target operation information may include first target operation information and second target operation information. The first target operation information may refer to operation information that is added to different target images. For example, the first target operation information may include at least one of time information, location information, and vehicle 3D model. The second target operation information is selected based on different shooting events. That is, the second target operation information refers to information related to the generation of shooting events. For example, when the shooting event includes at least one of holidays, special locations, and tourist destinations, the second target operation information may include a digital human model of the occupants. Or, when the shooting event includes the mileage reaching the target mileage, the second target operation information may include the mileage. Or, when the shooting event includes altitude information exceeding the altitude threshold, the second target operation information may include the altitude information. This application embodiment does not limit this.
[0057] Optionally, target runtime information can be added to the target image to obtain multimedia content; alternatively, the target image and target runtime information can be fused together based on a fusion strategy to obtain multimedia content.
[0058] Since vehicle operation information includes various types, fusing all operation information with the target image would reduce the diversity of multimedia content, thereby reducing the utilization of the vehicle's imaging function. Therefore, in this embodiment, multimedia content is obtained by fusing the target image captured by the vehicle's onboard camera with the target operation information associated with the shooting event from the vehicle's operation information. Here, the shooting event refers to the event that triggers the capture of the target image, ensuring that the target operation information differs depending on the shooting event, further improving the diversity of multimedia content and making the generated multimedia content more suitable for the needs of passengers, thus further improving the utilization rate of the vehicle's imaging function.
[0059] In some embodiments, this application further includes: in response to a shooting event, controlling the vehicle's onboard camera to take a picture to obtain a target image. Here, "in response to a shooting event" can mean detecting a shooting event and then controlling the vehicle's onboard camera to take a picture to obtain the target image, rather than periodically controlling the vehicle's onboard camera to take pictures. This improves the intelligent shooting level of the target image, making the target image more in line with user needs. Furthermore, in response to a shooting event, controlling the vehicle's onboard camera to take a picture to obtain the target image, and then the vehicle performing fusion processing based on the target image and the vehicle's operating information to obtain multimedia content, realizes a process of generating multimedia content once per shot, ensuring that the target image used to generate the multimedia content more meets user needs and further improving the utilization rate of the vehicle's imaging function.
[0060] In some embodiments, the shooting event includes either a user-triggered shooting command or the vehicle's operating information meeting preset information conditions. These preset information conditions can be set according to actual circumstances. Different operating information corresponds to different preset information conditions. For example, if the operating information includes either time information or location information, and the time information indicates a holiday, a summary day (weekly, monthly, and / or annual summary day), and / or the location information indicates a special location, a tourist destination, or the first arrival in a city, it means that the time and / or location information meet the preset information conditions, and the vehicle's onboard camera is controlled to take a picture to obtain the target image. Similarly, if the operating information includes mileage, and the mileage reaches a target mileage, it means that the mileage meets the preset information conditions, and the vehicle's onboard camera is controlled to take a picture to obtain the target image. Or, if the operating information includes altitude information, and the altitude exceeds a height threshold, it means that the altitude meets the preset information conditions, and the vehicle's onboard camera is controlled to take a picture to obtain the target image. Optionally, when the shooting event includes a time information indicating a summary day, the occupant's travel trajectory and usage habits within a fixed period can be visually presented, effectively improving user engagement.
[0061] Optionally, the user-triggered shooting command can refer to a command triggered manually by the user on the vehicle's infotainment system interface or a voice-triggered command; this embodiment of the application does not limit this.
[0062] In this embodiment, the shooting event includes either a user-triggered shooting command or the vehicle's operating information meeting a preset information condition, thus enriching the shooting triggering methods, thereby improving interactive flexibility and personalized experience, and further improving the utilization rate of the vehicle's imaging function.
[0063] In some embodiments, the vehicle's operational information includes at least one of the following: a digital human model corresponding to the vehicle's occupants, a 3D model of the vehicle, time information, location information, weather information, altitude information, mileage information, and driving trajectory. This makes the vehicle's operational information diverse, ensuring that the multimedia content has a realistic contextual relevance, further improving the diversity of multimedia content, and making the multimedia content generated based on the operational information more in line with the needs of the occupants. Furthermore, when the operational information includes a digital human model corresponding to the vehicle's occupants, it can increase artistic expression, fun, and interactivity. When the operational information includes a 3D model of the vehicle, it can enhance the sense of space and immersion, further improving the utilization rate of the vehicle's imaging function.
[0064] In some embodiments, the vehicle-mounted camera includes at least one of an exterior vehicle-mounted camera and an interior vehicle-mounted camera. The exterior vehicle-mounted camera includes at least one of a camera connected to the vehicle body and a camera mounted on a moving vehicle within the vehicle. The camera connected to the vehicle body refers to a camera mounted outside the vehicle. The moving vehicle refers to a device equipped with a camera and capable of movement; it can be configured according to actual conditions, such as a drone, robot, or robotic dog, etc., and this embodiment does not limit the scope of the application.
[0065] In this embodiment of the application, the vehicle-mounted camera includes at least one of an external vehicle-mounted camera and an internal vehicle-mounted camera. The external vehicle-mounted camera includes at least one of a camera connected to the vehicle body and a camera mounted on a moving vehicle within the vehicle. This enriches the types of vehicle-mounted cameras, thereby enriching the content of the target image and making the multimedia content generated based on the target image more in line with the needs of the occupants, further improving the utilization rate of the vehicle's imaging function.
[0066] In some embodiments, where the external vehicle-mounted camera includes a camera configured on a moving vehicle, in response to a shooting event, controlling the vehicle's on-board camera to take a picture to obtain a target image includes: In response to a shooting event, if the current environment of the vehicle meets the shooting conditions for a moving vehicle, the vehicle is controlled to move around the vehicle and take pictures to obtain the target image.
[0067] The phrase "moving vehicle orbiting the vehicle and taking pictures" can refer to the moving vehicle using the vehicle as a reference point, allowing it to move to at least one position around the vehicle for filming. For example, if the moving vehicle is a drone, it can be controlled to take off and fly around the vehicle to take pictures from an aerial perspective. Optionally, if the occupants select a moving vehicle, and the current environment meets the conditions for filming, the moving vehicle can be controlled to orbit the vehicle and take pictures to obtain the target image; otherwise, cameras connected to the vehicle body and / or in-vehicle cameras can be controlled to take pictures to obtain the target image.
[0068] While it is possible to take pictures using cameras on moving vehicles, there are limitations to this method. For example, if the moving vehicle is a robot dog and the vehicle is traveling on a road, controlling the robot dog to take pictures would be dangerous. Or, if the moving vehicle is a drone, the current environment of the vehicle may restrict the drone's movement. Therefore, in this embodiment, in response to a shooting event, if the current environment of the vehicle meets the shooting conditions, the moving vehicle is controlled to move around the vehicle and take pictures to obtain the target image. This allows for the expansion of visual dimensions while avoiding management risks and ensuring safety.
[0069] In some embodiments, the vehicle-mounted camera includes an exterior vehicle-mounted camera and an interior vehicle-mounted camera. If the vehicle occupant's selection information for the interior vehicle-mounted camera is obtained, the target image includes an exterior target image and an interior target image; otherwise, the target image includes an exterior target image. The exterior target image is captured by the exterior vehicle-mounted camera, and the interior target image is captured by the interior vehicle-mounted camera.
[0070] In this embodiment, the vehicle-mounted camera can be displayed before the images of the external and internal targets are obtained. The selection information for the internal vehicle-mounted camera can refer to the selection information for the internal vehicle-mounted camera. Alternatively, the images of the external and internal targets can be displayed after the images of the external and internal targets are obtained. The selection information for the internal vehicle-mounted camera can refer to the selection information for the internal target image. This embodiment of the application does not limit the specific implementation of the embodiment.
[0071] Optionally, in response to a shooting event, the system can control both the exterior and interior vehicle cameras to capture images of the target outside and inside the vehicle. If the system obtains information about the vehicle occupants' selection of the interior camera, it performs fusion processing based on the exterior and interior target images and the vehicle's operational information to obtain multimedia content. If the system does not obtain information about the vehicle occupants' selection of the interior camera, it performs fusion processing based on the exterior target image and the vehicle's operational information to obtain multimedia content. Alternatively, if the system obtains information about the vehicle occupants' selection of the interior camera, it can respond to a shooting event and control both the exterior and interior vehicle cameras to capture images of the target outside and inside the vehicle. These images are then fused together to obtain multimedia content. If the system does not obtain information about the vehicle occupants' selection of the interior camera, it controls the exterior camera to capture images of the target outside the vehicle, which are then fused together with the vehicle's operational information to obtain multimedia content.
[0072] In this embodiment, the vehicle-mounted camera includes an exterior vehicle-mounted camera and an interior vehicle-mounted camera. When the vehicle occupants' selection information for the interior vehicle-mounted camera is obtained, the target image includes both an exterior target image and an interior target image; otherwise, the target image includes only an exterior target image. The exterior target image is captured by the exterior vehicle-mounted camera, and the interior target image is captured by the interior vehicle-mounted camera. This allows for the selective fusion of interior target images, enriching the visual layers of multimedia content, making the multimedia content more suitable for the occupants' needs, and further improving the utilization rate of the vehicle's imaging function.
[0073] The following is based on Figure 2-5The content generation method provided in the embodiments of this application will be further described below. For example... Figure 2 As shown, the content generation method provided in this application embodiment can be implemented through a content generation system. The content generation system can consist of software, hardware, algorithms, and the cloud. At the software level, the content generation system includes a shooting control module, a storage management module, a display interaction module, and a communication collaboration module. The shooting control module is used to respond to shooting events, control the vehicle camera to shoot, and obtain the target image. The storage medium provides three storage paths: local storage in the vehicle, cache on the terminal device, and cloud storage. Passengers can configure the save location according to their actual needs and support one-click upload to social platforms or personal cloud albums for backup and sharing. The display interaction module runs on the vehicle's operating system and is used to preview the generated effect of multimedia content in real time. It supports interactive functions such as scaling, rotation, and color adjustment. Passengers can intuitively evaluate the final presentation quality and can save the multimedia content as a local file or set it as desktop wallpaper after passenger confirmation. If it does not meet the passenger's expectations, the vehicle can directly discard the multimedia content. The communication collaboration module is used to realize a two-way data transmission and message notification mechanism between the vehicle, terminal device, and cloud based on a secure and stable network protocol, ensuring that multimedia content can be pushed synchronously and in a timely manner, and supporting cross-device status linkage to ensure the consistency and continuity of user experience.
[0074] At the hardware level, the hardware serves as the vehicle's perception foundation and can include external cameras, internal cameras, and various sensors. External cameras include cameras mounted on the vehicle and cameras mounted on drones. External cameras are used to collect visual information such as road landscapes, landmarks, and natural scenery during driving, supporting standard wide-angle lenses or high-end 360-degree panoramic cameras to meet the field of view coverage requirements in different scenarios. Cameras on drones take off and fly around the vehicle under certain shooting conditions, capturing unique images from an aerial perspective and expanding the visual dimension. Internal cameras are used to capture the status of people inside the vehicle, such as driver expressions and passenger interactions, supporting autofocus, dynamic resolution adjustment, and low-light enhancement technology to ensure clear images are obtained even under complex lighting conditions. Various sensors, such as GPS positioning modules, inertial navigation units, odometers, and altitude sensors, acquire real-time vehicle operation information, including key parameters such as location information, driving trajectory, mileage, altitude information, and speed changes.
[0075] At the algorithm level, a "multimedia content generation algorithm" module is used as the core engine. This algorithm uses multimodal fusion technology to fuse target images captured by cameras with vehicle operation information. Optionally, image enhancement processing can be performed during the generation of multimedia content, such as adding beauty filters, noise reduction, color enhancement, and / or edge enhancement to images of people to improve visual quality. Optionally, a fusion theme style can be set according to the occupants' preferences, and a fusion template can be matched based on the target image. Optionally, not only can the generated multimedia content be displayed, but it can also be directly set as the desktop wallpaper of the in-vehicle infotainment system, achieving an immersive daily experience. Simultaneously, the vehicle has learning and iteration capabilities, continuously optimizing the fusion template through user feedback.
[0076] The cloud platform possesses dual capabilities: persistent data storage and intelligent evolution. On one hand, all generated multimedia content can be synchronously backed up to the cloud, forming a complete digital memory archive. Even if the vehicle malfunctions or is replaced, occupants can still restore all multimedia content by logging in with their accounts, effectively preventing data loss. On the other hand, the cloud can collect user-uploaded multimedia content through community platforms (such as dedicated forums and social sharing walls), establishing a "user-co-created content library." It can also continuously enrich the fusion strategy library using multimedia content fusion strategy models, driving iterative upgrades to the intelligence level of the content generation system. Furthermore, the cloud platform has data analysis capabilities, statistically analyzing user preference trends, popular fusion strategies, and frequently used fusion strategies, providing data support for subsequent optimization and personalized recommendation preset fusion strategies.
[0077] The following is based on Figure 3 This paper describes another structure for a content generation system. The content generation system includes a storage management module, a display module, a communication and collaboration module, a multimedia content generation algorithm module, an information acquisition module, and a low-level driver module. The interaction process between these modules can be described as follows: Figure 4As shown, the hardware driver module is responsible for initializing, configuring, and reading data from various hardware components to ensure stable operation. The information acquisition module includes an in-vehicle camera and sensors. The in-vehicle camera captures target images in response to shooting events, while the sensors collect data. The in-vehicle camera and sensors send data to the multimedia content generation algorithm module inside the vehicle's infotainment system via the hardware driver interface. The multimedia content generation algorithm module obtains a fusion template from the cloud, fuses the target image with the data collected by the sensors based on the fusion template, and combines user preferences, the vehicle's 3D model, and the shooting event to obtain personalized multimedia content with commemorative significance. Next, the multimedia content generation algorithm module sends the multimedia content to the storage management module through the communication collaboration module. This supports local saving or synchronization to the cloud and terminal devices, enabling multi-device backup and long-term retention. Alternatively, it can be sent to the display module for real-time preview on the vehicle's display screen, allowing users to view the effect and decide whether to retain it. This completes the entire process from data acquisition and intelligent processing to multi-device presentation, providing users with efficient, convenient, and emotionally valuable multimedia content generation services.
[0078] The following reference Figure 5 Using a poster as an example of multimedia content, this application describes the content generation method provided in its embodiments. When a user triggers the shooting function, the content generation system initializes according to preset software and hardware configuration options, including selecting parameters such as the position, number, and shooting angle of the vehicle-mounted camera. After configuration, the vehicle-mounted camera automatically captures the current environment to obtain a target image. The content generation system generates a 3D model of the vehicle based on its model information, adjusts its size and perspective to fit the spatial proportions and perspective of the target image, enhancing the realism and immersion of the image. The target image is then enhanced by acquiring the vehicle's operating information, determining the target operating information from it, and adding the target operating information and the vehicle's 3D model to the target image to obtain the poster. The poster is previewed on the vehicle and / or synchronized to a terminal device via a push notification mechanism. If the user is satisfied, they can choose to save it to local storage, the cloud, or share it on a social media platform. If the effect is not as expected, it can be discarded with one click without needing to be retained. Optionally, users can pre-configure shooting strategies and camera parameters in the system settings, such as turning on the camera in a specific direction and setting trigger shooting conditions, so as to obtain posters that better suit their personal preferences in subsequent use.
[0079] As can be seen from the above, in this embodiment of the application, the vehicle performs fusion processing on the target image captured by the vehicle's onboard camera and the vehicle's operating information to obtain multimedia content. This enables the vehicle's imaging function to not only store, view, or export the captured images, but also to further process the images, so as to meet the increasingly diverse usage needs of users and thereby improve the utilization rate of the vehicle's imaging function.
[0080] This application also provides a computer-readable storage medium storing instructions that, when executed by a processor, configure the processor to perform the above-described vehicle content generation method.
[0081] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0082] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0083] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0084] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0085] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.
[0086] Memory may include non-persistent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.
[0087] Computer-readable media include both permanent and non-permanent, removable and non-removable media, which can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient media, such as modulated communication signals and carrier waves.
[0088] This application also provides a computer program product, including a computer program or instructions, which, when executed by a processor, implement the content generation method provided in this application.
[0089] This application also provides a controller that stores a computer program or instructions thereon, which, when executed by a processor, implements the content generation method provided in this application.
[0090] This application also provides a vehicle 600, including the controller provided in this embodiment, or executing the content generation method provided in this application embodiment, such as... Figure 6 The diagram shown is a schematic representation of the architecture of a vehicle 600 provided in an embodiment of this application. In this embodiment, the vehicle 700 can be a gasoline-powered vehicle, a plug-in hybrid electric vehicle, or a new energy vehicle, etc., and this application does not specifically limit it in this regard.
[0091] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of this application, "multiple" means two or more, unless otherwise explicitly specified.
[0092] It should be noted that, in the data processing stage, the technical solution of this application strictly limits the scope of data collection to the minimum necessary to achieve the technical objectives, preventing the acquisition of irrelevant information. For any user information to be collected, the data subject will be clearly informed and their consent obtained. Furthermore, technologies such as encrypted storage and access control are employed to strengthen data security and ensure the security and compliance of the entire data processing process. The technical model and decision-making mechanism are based on objective technical parameters and do not introduce unnecessary parameters such as gender or age that may lead to discrimination, resolutely eliminating algorithmic discrimination and upholding public order and good morals. In addition, the specification fully describes the technical implementation methods, application scenarios, and compliance protection details. The claims are consistent with the content of the specification, key compliance designs are clear and verifiable, and the overall technical design is guided by the protection of public interests and adherence to social ethics, without any circumstances that harm public interests or violate public order and good morals.
[0093] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.
[0094] The embodiments, implementation methods, and related technical features of this application can be combined and substituted for each other without conflict.
[0095] The above are merely preferred embodiments of this application and are not intended to limit this application in any way. Any simple modifications, equivalent changes, and alterations made to the above embodiments based on the technical essence of this application without departing from the scope of the technical solution of this application shall still fall within the scope of the technical solution of this application.
Claims
1. A content generation method, characterized in that, Applied to vehicles, including: Multimedia content is obtained by fusing target images captured by the vehicle's onboard camera with the vehicle's operating information.
2. The method according to claim 1, characterized in that, The multimedia content is obtained by fusing the target image captured by the vehicle's onboard camera with the vehicle's operating information, including: Multimedia content is obtained by adding the vehicle's operating information to the target image captured by the vehicle's onboard camera. Alternatively, based on a fusion strategy, the target image captured by the vehicle's onboard camera and the vehicle's operating information can be fused together to obtain multimedia content.
3. The method according to claim 2, characterized in that, The method further includes: Based on the visual effect evaluation strategy and / or the occupant preference information of the vehicle, as well as the preset fusion strategies in the fusion strategy library, a fusion strategy for the target image and the operation information is determined. Alternatively, a preset fusion strategy in the fusion strategy library can be displayed, and in response to the selection operation of the preset fusion strategy, a fusion strategy for the target image and the running information can be determined.
4. The method according to claim 3, characterized in that, The method for determining a fusion strategy for the target image and the runtime information based on a visual effect evaluation strategy and preset fusion strategies in a fusion strategy library includes: Based on the visual effect evaluation strategy, determine the visual effect of each preset fusion strategy in the fusion strategy library on the fusion of the target image and the running information; Based on the fused visual effect, a fusion strategy for the target image and the running information is determined from the preset fusion strategy.
5. The method according to claim 3, characterized in that, The method for determining a fusion strategy for the target image and the runtime information based on a visual effect evaluation strategy and preset fusion strategies in a fusion strategy library includes: Based on the visual effect evaluation strategy, shooting events, and preset fusion strategies in the fusion strategy library, a fusion strategy for the target image and the running information that matches the shooting event is determined. The shooting event refers to the event that triggers the shooting of the target image.
6. The method according to claim 1, characterized in that, The multimedia content is obtained by fusing the target image captured by the vehicle's onboard camera with the vehicle's operating information, including: Multimedia content is obtained by fusing the target image captured by the vehicle's onboard camera with the target operation information associated with the captured event from the vehicle's operation information. The shooting event refers to the event that triggers the shooting of the target image.
7. The method according to claim 1, characterized in that, The method further includes: In response to a shooting event, the vehicle's onboard camera is controlled to take a picture and obtain the target image.
8. The method according to claim 7, characterized in that, The shooting event includes either a user triggering a shooting command or the vehicle's operating information meeting one of the preset information conditions.
9. The method according to claim 1, characterized in that, The vehicle's operational information includes at least one of the following: digital human models corresponding to the vehicle's occupants, a three-dimensional model of the vehicle, time information, location information, weather information, altitude information, mileage information, and driving trajectory.
10. The method according to any one of claims 1-9, characterized in that, The vehicle-mounted camera includes at least one of an exterior vehicle-mounted camera and an interior vehicle-mounted camera. The exterior vehicle-mounted camera includes at least one of a camera connected to the vehicle body and a camera mounted on a moving vehicle within the vehicle.
11. The method according to claim 10, characterized in that, When the vehicle-mounted camera includes a camera mounted on the moving vehicle, the step of controlling the vehicle-mounted camera to capture a target image in response to a shooting event includes: In response to a shooting event, if the current environment of the vehicle meets the shooting conditions for a moving vehicle, the vehicle is controlled to move around the vehicle and take a picture to obtain the target image.
12. The method according to claim 10, characterized in that, The vehicle-mounted camera includes an exterior vehicle-mounted camera and an interior vehicle-mounted camera. When the vehicle occupants select the interior vehicle-mounted camera, the target image includes both an exterior target image and an interior target image; otherwise, the target image includes the exterior target image. The exterior target image is obtained by taking pictures using the exterior vehicle-mounted camera, and the interior target image is obtained by taking pictures using the interior vehicle-mounted camera.
13. A controller, characterized in that, include: A memory on which computer programs are stored; A processor for executing the computer program in the memory to implement the content generation method as described in any one of claims 1 to 12.
14. A vehicle, characterized in that, Includes the controller as described in claim 13, or performs the content generation method as described in any one of claims 1 to 12.
15. A storage medium, characterized in that, It stores a computer program, which is loaded by a processor to execute the content generation method as described in any one of claims 1 to 12.
