Media resource processing method and device, storage medium and electronic equipment

Abstract

The invention discloses a media resource processing method and device, a storage medium and electronic equipment. The method comprises the steps that vehicle driving information of a target vehicle is acquired, and the vehicle driving information comprises the driving state of the target vehicle and current road condition information; under the condition that the vehicle driving information meets a preset image display condition, target media resources are automatically obtained from a media resource library, the target media resources comprise driving parameters and audio and video data, and the media resource library comprises local media resources corresponding to the vehicle-mounted system and media resources on an online content interaction platform; based on the target image display parameter, performing adaptation processing on the target media resource to obtain a processed media resource; and displaying the processed media resource on a display device in the head-up display system. According to the method and the device, the technical problem of relatively single media resource processing mode in a vehicle system is solved.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to a method and device for processing media resources, a storage medium, and an electronic device. Background Art

[0002] At the current stage, the application of HUD (Head-Up Display) systems in the automotive field mainly focuses on vehicle speed, navigation guidance, warning signals, etc., to assist drivers to drive the vehicle more attentively.

[0003] However, the display content of the above-mentioned HUD system is limited to displaying basic driving information of the vehicle in the driving scene, cannot adapt to diverse scenes, and the displayed content is relatively single, which causes the technical problem of a relatively single way of processing media resources in the vehicle system.

[0004] To address the above-mentioned problems, no effective solutions have been proposed so far. Summary of the Invention

[0005] The embodiments of the present application provide a method and device for processing media resources, a storage medium, and an electronic device to at least solve the technical problem of a relatively single method for processing media resources in a vehicle system.

[0006] According to one aspect of an embodiment of the present application, a method for processing media resources is provided, including: obtaining vehicle driving information of a target vehicle, wherein the vehicle driving information includes the driving status and current road condition information of the target vehicle; when the vehicle driving information meets preset image display conditions, automatically obtaining target media resources from a media resource library, wherein the target media resources include driving parameters and audio and video data, and the media resource library includes local media resources corresponding to the vehicle-mounted system and media resources on the online content interaction platform; based on the target image display parameters, adapting the target media resources to obtain processed media resources; and displaying the processed media resources on a display device in a head-up display system.

[0007] Optionally, the above-mentioned obtaining of the vehicle driving information of the target vehicle includes: obtaining the driving status of the target vehicle; locating the target position of the target vehicle, and obtaining current road condition information at the target position.

[0008] Optionally, when the vehicle driving information meets the preset image display conditions, the target media resources are automatically obtained from the media resource library, including: when the driving status indicates that the target vehicle is in a non-manual driving state, the target media resources are automatically obtained from the vehicle system; or when the driving status indicates that the target vehicle is in a non-manual driving state, the target media resources are obtained from an online content interaction platform through the target network.

[0009] Optionally, the above-mentioned adaptation processing of the target media resource based on the target image display parameters to obtain the processed media resource includes: adjusting the image resolution of the target media resource based on the target resolution in the target image display parameters to obtain the adjusted media resource; processing the adjusted media resource based on the target transparency in the target image display parameters to obtain the processed media resource.

[0010] Optionally, the above-mentioned displaying of the processed media resources on the display device in the head-up display system includes: obtaining target image content by rendering the processed media resources; transmitting the target image content to the head-up display system of the target vehicle; performing imaging processing on the target image content based on the head-up display system to obtain imaged image content; and projecting the imaged image content onto the display device in the head-up display system.

[0011] Optionally, the above-mentioned projecting of the imaged image content onto the display device in the head-up display system includes: when the target image content is a video picture and during the playback of the video picture, real-time detection of the driver's driving status; when the driving state switches from a non-manual driving state to a manual driving state, pausing the video picture currently projected on the display device.

[0012] Optionally, the above method also includes: obtaining the driver's gesture interaction action in the process of displaying the processed media resources on the display device of the head-up display system; based on the type of the gesture interaction action, controlling the currently displayed video screen to switch to the target video screen, wherein the target video screen is obtained by adjusting the currently displayed video screen according to the type, and the processed media resources include the video screen.

[0013] Optionally, the above method also includes: obtaining the driver's limb state detection result during the process of displaying the processed media resources on the display device of the head-up display system; when the limb state detection result indicates that the driver's hands are not placed on the target area of the steering wheel, canceling the display of the processed media resources.

[0014] According to another aspect of an embodiment of the present application, a media resource processing device is also provided, including: a first acquisition unit, used to obtain vehicle driving information of a target vehicle, wherein the vehicle driving information includes the driving status and current road condition information of the target vehicle; a second acquisition unit, used to automatically obtain target media resources from a media resource library when the vehicle driving information meets preset image display conditions, wherein the target media resources include driving parameters and audio and video data, and the media resource library includes local media resources corresponding to the vehicle-mounted system and media resources on the online content interaction platform; a first processing unit, used to adapt the target media resources based on the target image display parameters to obtain processed media resources; a first display unit, used to display the processed media resources on a display device in a head-up display system.

[0015] According to another aspect of the embodiments of the present application, a computer-readable storage medium is provided, in which a computer program is stored. The computer program is used to execute the above-mentioned media resource processing method when run by an electronic device.

[0016] According to another aspect of the embodiments of the present application, a computer program product is provided, including a computer program that implements the steps of the above method when the computer program is executed by a processor.

[0017] According to another aspect of the embodiments of the present application, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to execute the media resource processing method through the computer program.

[0018] Through the above-described embodiments provided by this application, based on the acquired driving status and road condition information of the target vehicle, a target media resource is automatically selected from a media resource library, provided that preset image display conditions are met. Based on the target image display parameters of the head-up display system, the target media resource is adapted and processed to obtain a processed media resource, which is then displayed on a display device in the head-up display system. In other words, by combining vehicle driving information, while ensuring vehicle safety, media resources with richer content are automatically acquired and projected onto the display device, thereby achieving the technical effect of increasing the diversity of head-up display content and improving the in-vehicle visual entertainment experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The drawings described herein are used to provide further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute improper limitations on the present application.

[0020] Figure 1is a schematic diagram of an application scenario of an optional method for processing media resources according to an embodiment of the present application;

[0021] Figure 2 is a flowchart of an optional method for processing media resources according to an embodiment of the present application;

[0022] Figure 3 is an overall schematic diagram of an optional method for processing media resources according to an embodiment of the present application;

[0023] Figure 4 is a schematic diagram of an optional non-manual driving state under safe conditions according to an embodiment of the present application;

[0024] Figure 5 is a schematic diagram of an optional network communication for acquiring a target media resource according to an embodiment of the present application;

[0025] Figure 6 It is an optional picture obtained by processing the video picture according to the target image display parameters according to an embodiment of the present application;

[0026] Figure 7 is a schematic diagram of an optional method of projecting a processed image onto a display device through a projection control module according to an embodiment of the present application;

[0027] Figure 8 is a schematic diagram of an optional vehicle traveling in an unsafe condition according to an embodiment of the present application;

[0028] Figure 9 is a schematic diagram of an optional intelligent control HUD playback according to an embodiment of the present application;

[0029] Figure 10 is a structural diagram of an optional media resource processing device according to an embodiment of the present application;

[0030] Figure 11 It is a schematic structural diagram of an optional electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0031] In order to enable those skilled in the art to better understand the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0032] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in a sequence other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0033] The technical solutions in the embodiments of this application will comply with legal provisions during implementation. When performing operations in accordance with the technical solutions in the embodiments, the data used will not involve user privacy. While ensuring that the operation process is compliant and legal, the security of the data is guaranteed.

[0034] In addition, when the above embodiments of this application are applied to specific products or technologies, user permission or consent must be obtained, and the collection, use and processing of relevant data must comply with the relevant regulations and standards of the relevant country or region.

[0035] According to one aspect of the embodiment of the present application, a method for processing media resources is provided. As an optional implementation, the above-mentioned method for processing media resources can be applied to, but is not limited to, Figure 1 The application scenario shown in Figure 1 In the illustrated application scenario, the target terminal 102 may, but is not limited to, communicate with the server 106 via the network 104. The server 106 may, but is not limited to, perform operations on the database 108, such as writing or reading data. The target terminal 102 may, but is not limited to, include a human-computer interaction screen, a processor, and memory. The human-computer interaction screen may, but is not limited to, be used to display a video corresponding to a target media resource displayed on the display device of the head-up display system on the target terminal 102. The processor may, but is not limited to, be used to respond to the human-computer interaction operation, execute a corresponding operation, or generate a corresponding instruction and transmit the generated instruction to the server 106. The memory is used to store relevant processed data, such as vehicle driving information, target media resources, and target image display parameters.

[0036] Optionally, in this embodiment, the target terminal may be a terminal configured with a target client, which may include but is not limited to at least one of the following: a mobile phone (such as an Android phone, an iOS phone, etc.), a laptop, a tablet computer, a PDA, an MID (Mobile Internet Devices), a PAD, a desktop computer, a smart TV, etc. The target client may be a video client, an instant messaging client, a browser client, an education client, etc. The network may include but is not limited to: a wired network, a wireless network, wherein the wired network includes: a local area network, a metropolitan area network, and a wide area network, and the wireless network includes: Bluetooth, WIFI, and other networks that implement wireless communication. The server may be a single server, or a server cluster consisting of multiple servers, or a cloud server.

[0037] The technical solution of this application can be widely applied to various fields such as entertainment interaction, personalized content push, social and interactive experience, and the integration of virtual display and augmented display in various smart cockpits, demonstrating its practical value. Specific examples of the technical solution of this application in different scenarios are given below.

[0038] (1) Personalized content push in the smart cockpit: When the vehicle is started and confirmed to be in a non-driving state (such as parking or autonomous driving mode), the system can intelligently recommend film and television content based on the user's viewing history and personal preferences. For example, when a new episode of a user's favorite TV series is released, the system can automatically detect it and present it to the user on the HUD, eliminating the need for manual search, thus enhancing the user experience.

[0039] It supports multi-user account management. Different drivers or passengers can log in through their personal accounts according to their preferences to obtain customized entertainment content recommendations, making the HUD a personalized in-car entertainment center.

[0040] (2) Social and interactive experience: Leveraging the display advantages of the HUD and the vehicle's networking capabilities, passengers can participate in real-time social media interactions through the HUD, such as watching live broadcasts and sending comments or barrages, creating a social entertainment scene in the car. During self-driving tours or convoys, multiple vehicles can simultaneously play the same program through the 5G network, enhancing interaction and communication among team members and making the journey more interesting.

[0041] (3) Integration of virtual reality and augmented reality:

[0042] Combined with the vehicle's sensor data (such as GPS, cameras, radar, etc.), HUD can generate augmented reality content that integrates with the actual environment, such as superimposing virtual billboards on real streets, or adding AR game elements to navigation information to enhance driving pleasure.

[0043] When parked, the HUD can be transformed into a virtual reality display, using cameras around the vehicle to capture images and forming a panoramic immersive experience through image processing. Users can experience the outdoor scenery in the car or participate in activities such as VR fitness, broadening the boundaries of in-car entertainment.

[0044] The above application scenarios not only enrich the entertainment function of HUD, but also integrate it into multiple fields such as social, education, and virtual reality, greatly expanding the possibilities of HUD in the era of smart cockpits, and achieving the technical effects of improving passenger entertainment experience, vehicle intelligence level and driving safety.

[0045] In order to solve the above-mentioned problem of a relatively single method for processing media resources in a vehicle system, a method for processing media resources is proposed in an embodiment of the present application. Figure 2 4 is a flowchart of a method for processing media resources according to an embodiment of the present application, and the flow includes the following steps S202 to S208.

[0046] It should be noted that the media resource processing method shown in step S202 to step S208 can be, but is not limited to, executed by an electronic device, wherein the electronic device can be, but is not limited to, Figure 1 The target terminal or server is shown.

[0047] Step S202, obtaining vehicle driving information of the target vehicle, wherein the vehicle driving information includes the driving state and current road condition information of the target vehicle;

[0048] The system can obtain real-time information about the vehicle's driving status and current road conditions by, but is not limited to, reading the vehicle's CAN bus and ADAS system. For example, the system will check whether the vehicle is in park (gear position P), whether the vehicle speed is zero, whether the assisted driving or autonomous driving function is activated, and whether there are potential safety hazards in the surrounding environment.

[0049] Step S204: If the vehicle driving information meets the preset image display conditions, target media resources are automatically obtained from a media resource library, where the target media resources include driving parameters and audio and video data. The media resource library includes local media resources corresponding to the vehicle system and media resources on the online content interaction platform.

[0050] When it is determined that the target vehicle state meets the preset image display conditions, Figure 3 The content acquisition module 302 shown obtains target media resources from the local media or online video platform of the target vehicle's in-vehicle system. The content acquisition process can be automatically selected based on the user's viewing history and preferences, or the user can directly select through voice, gesture, or touch interface. In this embodiment, this is not limited to this.

[0051] In addition, the above-mentioned preset image display conditions can also be understood as image head-up display conditions, which means that after analyzing the user's driving behavior data (for example, non-manual driving), it is determined that the image is allowed to be displayed head-up (which can also be understood as head-up display).

[0052] Step S206, performing adaptation processing on the target media resource based on the target image display parameters to obtain a processed media resource;

[0053] pass Figure 3 After receiving audio and video data from the media resource library, the image rendering and HUD adaptation module performs necessary image parameter adjustments to suit the HUD's display characteristics. Specifically, the target image display parameter values meet the HUD display parameter requirements. This may include adjusting the original video content to a resolution suitable for HUD display, enhancing the image's HDR effect, adjusting color balance and contrast, and controlling transparency and edge clipping to ensure the content is clear and does not interfere with the driver's vision.

[0054] Step S208 : displaying the processed media resources on a display device in the head-up display system.

[0055] In this embodiment, the vehicle driving information includes but is not limited to the driving status of the target vehicle (such as parking, manual driving, automatic driving), vehicle speed, gear information, engine status, environmental perception information (such as road condition information detected by radar and camera), etc.

[0056] Preset image display conditions refer to the conditions under which entertainment content is allowed to be played on the HUD display while ensuring driving safety. These conditions include but are not limited to the vehicle being parked, the autonomous driving mode being activated, and the current road conditions allowing the driver to focus on non-driving information. For details, please refer to Figure 4 It is shown as being in P gear or in automatic driving state (which can also be understood as assisted driving state).

[0057] Target media resources include but are not limited to images, text, videos, audio, and other content obtained from the vehicle system or through the Internet. For example, based on user preferences, audio and video content suitable for playback on the HUD is selected from the vehicle system, including but not limited to TV series, movies, variety shows, etc.

[0058] The media resource library includes but is not limited to the media resources stored locally in the vehicle system and the media resources on the online content interaction platform accessible through the network connection. Local resources can be video files downloaded or pre-installed by users, while online media resources include resources obtained from video platforms through the Internet. For details, please refer to Figure 5 Two ways to obtain it are shown.

[0059] The target image display parameters may refer to, but are not limited to, parameter settings adapted to the HUD display characteristics, including resolution, brightness, contrast, transparency, color balance, HDR enhancement, etc., to ensure that the video content is clearly discernible under various lighting conditions and does not interfere with the driver's vision.

[0060] The display device includes but is not limited to the windshield of the target vehicle, or a display independent of the windshield and the vehicle-mounted system display screen. The processed video content can be displayed through the display device, allowing the driver or passenger to watch entertainment content without diverting their eyes.

[0061] In order to understand the above media resource processing method more clearly, let's first combine Figure 3 The overall architecture diagram shown provides a brief introduction to it.

[0062] like Figure 3 As shown, the control system used to implement the above-mentioned media resource processing method includes but is not limited to a vehicle status detection module 301, a content acquisition module 302, an image rendering and HUD adaptation module 303, a HUD projection control module 304, a user interaction module 305, a safety interrupt controller 306, and a data bus and central processing unit 307.

[0063] Among them, the vehicle driving information of the target vehicle (for example, power on / ignition, automatic driving, manual driving, etc.) is obtained in real time through the vehicle status detection module 301. After obtaining the vehicle driving information, it is determined whether the current status of the target vehicle meets the preset image display conditions. If so, the audio and video content is obtained from the vehicle system or from the online content interaction platform through the target network through the content acquisition module.

[0064] The above-mentioned preset image display conditions may be, but are not limited to, the driving state of the target vehicle meeting the first condition and the current road condition information meeting the second condition. The first condition and the second condition will be explained below in conjunction with specific embodiments.

[0065] After acquiring the target media resource, the target media resource can be transmitted to the image rendering and HUD adaptation module 303 via the data bus and the central processing unit 307, but is not limited to, so as to adapt the target media resource according to the target image display parameters of the head-up display system, for example, adapting and adjusting the screen size, adjusting the resolution, etc., to obtain the processed media resource.

[0066] The processed media resources are transmitted to the HUD projection control module 304, which starts imaging and displays the imaged picture on the display device of the head-up display system, for example, projecting it onto the front windshield.

[0067] It should be noted that the adapted media resources (eg video content) are controlled by the HUD projection control module and played on the HUD device. Figure 3 The safety interrupt controller 306 shown continuously detects driving status and status changes, for example, monitors vehicle status and driving information. Once an unsafe driving condition is detected (such as vehicle start-up, switching from parking state to manual driving, etc.), it will automatically pause or turn off video playback and restore the HUD's normal driving information display to ensure driving safety.

[0068] In addition, during the process of displaying the processed media resources on the display device, the following methods can be used: Figure 3 The user interaction module 305 shown is used to control the display screen, for example, to control the page to be reduced or enlarged through gesture interaction.

[0069] Through the above-described method, based on the acquired driving status and road condition information of the target vehicle, target media resources are automatically selected from the media resource library, provided that preset image display conditions are met. Based on the target image display parameters of the head-up display system, these target media resources are adapted and processed to obtain processed media resources, which are then displayed on the display device of the head-up display system. In other words, by integrating vehicle driving information, while ensuring vehicle safety, media resources with richer content are automatically acquired and projected onto the display device, achieving the technical effect of increasing the diversity of head-up display content and enhancing the in-vehicle visual entertainment experience.

[0070] As an optional example, the above-mentioned obtaining of the vehicle driving information of the target vehicle includes:

[0071] Get the driving status of the target vehicle;

[0072] Locate the target position of the target vehicle and obtain the current road condition information at the target position.

[0073] The above-mentioned acquisition of the driving state of the target vehicle may refer to, but is not limited to, reading the state of the target vehicle from the target control unit of the target vehicle via a target bus, wherein the target bus may refer to, but is not limited to, a communication network inside the vehicle, for example, Figure 3 The CAN (Controller Area Network) bus shown in the figure serves as a channel for information transmission, connecting the various control units and sensor data of the vehicle; the target control unit (such as the ECU, electronic control unit) is one of the multiple intelligent components of the vehicle, responsible for collecting and managing the vehicle's driving status information, including vehicle speed, gear position, engine status, etc.

[0074] The vehicle's internal communication network reads the vehicle's driving information from the control unit in real time. This information is the key to determining whether to allow media resources (e.g., video content) to be played on the HUD.

[0075] Positioning refers to the use of GPS (Global Positioning System) or other positioning technologies to determine the specific geographic location of the target vehicle, and at the same time obtain current road condition information at the target location based on the on-board sensor system. The on-board sensor system includes but is not limited to radar, camera, lidar, etc., which can perceive environmental information around the vehicle, such as road type, traffic conditions, obstacle distance, etc.

[0076] Among them, radar is a sensor that uses radio waves to detect the distance, speed and direction of the target. However, in modern smart vehicles, environmental perception is not limited to radar. It may also include various types of technologies such as cameras, lidar, ultrasonic sensors, etc., which together constitute a comprehensive on-board sensing system to monitor and understand the environmental conditions around the vehicle in real time, including but not limited to other vehicles, pedestrians, obstacles, road signs and weather conditions.

[0077] After obtaining the driving status and current road condition information of the target vehicle, the system analyzes whether the target vehicle is currently in a non-manual driving state, whether there are obstacles on the current road, etc., and then comprehensively determines whether HUD display is allowed.

[0078] By integrating information about the vehicle's internal state and the external road environment, the system can more comprehensively assess the safety of video playback. For example, even if the vehicle is parked, if it's at a busy intersection or a narrow parking aisle, the system may determine that the current environment is unsuitable for playback, preventing unforeseen circumstances from causing the driver to react slowly. This comprehensive environmental awareness ensures that entertainment playback can maximize user safety.

[0079] As an optional example, when the vehicle driving information meets the preset image display conditions, automatically obtaining the target media resource from the media resource library includes:

[0080] Automatically acquiring the target media resource from the vehicle system when the driving status indicates that the target vehicle is in a non-manual driving state; or

[0081] When the driving state indicates that the target vehicle is in a non-manual driving state, target media resources are obtained from an online content interaction platform through a target network.

[0082] When it is determined that the driving state of the target vehicle is non-manual driving, that is, in parking, intelligent driving or assisted driving state, pre-stored media resources such as movies, TV series, music and other entertainment content will be automatically obtained from the target vehicle's on-board multimedia system.

[0083] Alternatively, when the driving status indicates that the target vehicle is in a non-manual driving state, the vehicle is connected to an online content interaction platform through the in-vehicle network to obtain media resources from the cloud in real time or on demand to enrich the entertainment content selection on the HUD.

[0084] The target network may include but is not limited to 5G networks, Wi-Fi and other data connection methods, and the online interactive platform includes various streaming services, such as various video platforms, which provide real-time or on-demand audio and video content.

[0085] The above approach, through both local and online resource acquisition methods, combined with intelligent judgment of the target vehicle's driving status and network environment, not only enriches the media resource library of the HUD entertainment system, but also ensures the security and compliance of content playback, providing passengers with a smooth, personalized and safe entertainment experience.

[0086] As an optional implementation, the target media resource is adapted based on the target image display parameters to obtain the processed media resource, including:

[0087] Based on the target resolution in the target image display parameter, adjusting the image resolution of the target media resource in the central processing unit of the vehicle system to obtain an adjusted media resource;

[0088] The adjusted media resource is processed in the central processing unit based on the target transparency in the target image display parameter to obtain a processed media resource.

[0089] The target resolution in the target image display parameters refers to the resolution value that the system needs to set in order to adapt to the specific display environment and visual effects of the HUD. It is usually lower than the resolution of a conventional screen to ensure that the driver can see without blocking his or her line of sight.

[0090] The central processing unit (CPU) of the in-vehicle system is responsible for processing and adjusting various parameters of the video content to ensure that the content can be displayed correctly on different display devices.

[0091] After acquiring the media resources, the system will adjust the original resolution of the video through the central processing unit in the vehicle system to meet the display standards of the HUD, thereby achieving clear and distortion-free video images on the HUD display.

[0092] The target transparency in the above target image display parameters is to ensure that the driver can still clearly see the road ahead when watching the video content on the HUD. Usually, an appropriate transparency value needs to be set to make the image semi-transparent.

[0093] By processing the transparency of the video image, the video content is ensured to be integrated with the actual field of view in front of the vehicle, ensuring the entertainment experience without affecting driving safety.

[0094] The primary function of the Image Rendering and HUD Adaptation Module 303 is to ensure the display quality and visual safety of video content on the HUD device. Its main workflow involves the following: After successfully acquiring local or online media resources, it enters the image processing phase. First, the central processing unit intelligently adjusts the video's image resolution based on the HUD display's physical dimensions, viewing angle, and the driver's visual preferences. For example, this involves reducing or enlarging the video size and resampling the video frame to fit the smaller HUD display area, while maintaining image clarity and color fidelity.

[0095] Afterwards, the transparency of the adjusted video image is controlled, which is a particularly critical step. Because the essence of HUD projection is to overlay information in front of the driver's line of sight, and too high an image opacity may block the driver's view of the road. Through fine-tuning of the central processing unit, the video image will be displayed with appropriate transparency, which neither interrupts the driver's driving field of view nor affects the viewing effect of the image. The processed media resources can be referenced Figure 6 shown.

[0096] In this embodiment, by adaptively adjusting image display parameters, the display quality of media resources (e.g., video content) on the HUD is improved; by controlling the transparency of the video image, the driving safety risks caused by watching videos are reduced, reflecting the importance the in-vehicle entertainment system attaches to driving safety.

[0097] The central processing unit precisely adjusts the image resolution and transparency of media resources, ensuring the safe and efficient display of high-quality video content on the HUD device. This not only optimizes the user's visual experience, but also sets a new standard for human-computer interaction and driving safety in the smart cockpit.

[0098] As an optional implementation, displaying the processed media resources on a display device in a head-up display system includes:

[0099] Obtain target image content by performing image rendering on the processed media resources;

[0100] transmitting target image content to a head-up display system of a target vehicle;

[0101] Based on the head-up display system block, the target image content is imaged and processed to obtain the image content after imaging;

[0102] The image content after imaging is projected onto the display device in the head-up display system.

[0103] The processed media resources may be, but are not limited to, video files whose resolution and transparency are adjusted in the above embodiments. Image rendering is the process of converting these video files into output suitable for a specific display device.

[0104] During this process, the video image will be subjected to image rendering operations such as color space conversion, contrast enhancement, and HDR (high dynamic range) optimization to generate the final target image content and ensure the best visual effect of the video on the HUD.

[0105] After the processing is completed, the processed target image content can be transmitted from the vehicle system to the HUD system through a target bus, but is not limited to, and then the target image content is imaged according to the projection control module in the HUD system to obtain the imaged image content.

[0106] The projection control module is a core component of the HUD device, responsible for converting digital image signals into visible light for display on the windshield. Imaging processing utilizes the projection control module to convert the target image content into a format suitable for HUD projection. This includes image resizing and viewing angle correction, ensuring the driver sees a clear, distortion-free image at the appropriate angle.

[0107] like Figure 7 As shown, the image content after imaging is projected onto the HUD display device, which is usually composed of a high-brightness LED light source, an optical lens, a reflector, etc. It projects the image in the form of a virtual image directly in front of the driver, so that the driver can watch the video content without having to lower his head to view the display screen, effectively reducing the operational burden during driving and improving driving safety.

[0108] It is worth noting that the entire display process ensures precise control of the entire process from image rendering to final projection, achieving a balance between high-quality video entertainment content and driving safety and human-computer interaction, fully embodying the humanized design concept of smart cockpit technology.

[0109] Through in-depth image rendering technology and display optimization adapted to HUD characteristics, the video content displayed on the HUD is ensured to achieve the ultimate picture quality, so that drivers can enjoy a high-quality visual experience even when driving at high speeds or in complex lighting conditions.

[0110] Through image rendering, image transmission and display technology, a perfect combination of video content and HUD equipment is achieved, which not only provides the driver with the ultimate visual enjoyment, but also enhances the driving experience through a safe and convenient display method, demonstrating the huge potential of smart cockpit technology in integrating entertainment and driving safety.

[0111] As an optional implementation, projecting the imaged content onto a display device in a head-up display system includes:

[0112] When the target image content is a video screen and the video screen is being played, the driving state of the driver is detected in real time;

[0113] When the driving state is switched from the non-manual driving state to the manual driving state, the video image currently projected on the display device is paused.

[0114] While the video is playing on the HUD display, the driver's driving status needs to be continuously monitored. For example, the driver's driving mode can be acquired in real time through a camera in the vehicle system to determine whether the driver has switched from non-manual driving (such as automatic driving or parking) to manual driving. Based on the change in driving status, the driver can then determine whether to continue playing the video on the HUD display.

[0115] Obviously, the above-mentioned pause of the video image currently projected on the display device is only an example and is not limited thereto. For example, the HUD display may be automatically turned off when it is detected that the driving state is switched from a non-manual driving state to a manual driving state.

[0116] Through the above method, it is ensured that in any situation that may pose a threat to driving safety, the system can respond quickly, stop the video playback on the HUD display device, and ensure the safety of the driver and passengers.

[0117] In specific implementations, the vehicle status detection module can also be used to continuously analyze the driving status of the target vehicle (including gear position, speed, activation status of the auxiliary driving system, etc.). Figure 8 As shown in the figure, once the system detects a switch from a non-manual driving mode (such as automated driving, assisted driving, or parking) to a manual driving mode (such as a non-P gear or exiting assisted driving), it immediately triggers a pause mechanism, interrupting the video projection. This process occurs instantly and automatically, requiring no additional driver input, demonstrating the system's high level of intelligence and autonomy in safety control.

[0118] Through this embodiment, a strategy for automatically adjusting video playback according to different driving states is implemented, ensuring that the entertainment function in the smart cockpit can flexibly adapt to driving needs and improving the overall intelligence level of the system.

[0119] As an optional example, the above method further includes:

[0120] Acquiring a driver's gesture interaction action during display of the processed media resource on a display device of the head-up display system;

[0121] Based on the type of the gesture interaction action, the currently displayed video screen is controlled to switch to the target video screen, wherein the target video screen is obtained by adjusting the currently displayed video screen according to the type, and the processed media resources include the video screen.

[0122] Gesture interaction actions can be, but are not limited to, the driver controlling the HUD system through specific gestures, such as waving the palm to pause playback, waving left or right to switch videos, etc.

[0123] While the video content is being displayed on the HUD, the system can recognize and respond to the driver's gesture commands, providing users with a control method that does not require physical contact, which is both convenient and safe.

[0124] The type of gesture interaction refers to the control commands represented by different gestures, such as pause, play, fast forward, fast rewind, and volume adjustment. Based on the gesture interaction, the currently displayed video screen can be switched to the target video screen corresponding to the gesture interaction type. For example, waving your hand to the left can rewind the video screen to the previous frame of the current screen; or a closing gesture of your fingers can zoom the current full-screen video screen into a small window.

[0125] In other words, it can intelligently adjust the content of the video being played based on gesture commands, such as switching to the next video preset by the user or adjusting the playback progress.

[0126] According to the type of gesture interaction action, the current video screen can be controlled to switch to the target video screen corresponding to the type of gesture interaction action, achieving flexible control of the video screen and enhancing the user's interactive experience with the HUD system.

[0127] In addition to the above gesture interaction actions, you can also Figure 9 The voice control method shown can be used to turn on or off the HUD playback. You can also set a control button in the display screen of the HUD display device and control the turning on or off of the HUD playback by triggering the button.

[0128] The introduction of gesture recognition technology provides users with a more intelligent, safe, and convenient way to control video, optimizing the driver's interaction experience with the HUD system. It also adapts to autonomous and intelligent driving scenarios, demonstrating a more natural and smooth communication method between the in-vehicle entertainment system and the user.

[0129] As an optional implementation, the above method further includes:

[0130] obtaining a driver's limb state detection result during display of the processed media resource on a display device of the head-up display system;

[0131] When the limb state detection result indicates that the driver's hands are not placed on the target area of the steering wheel, the processed media resource is canceled from being displayed.

[0132] While playing video content on the display device of the HUD device, it can also continuously monitor the driver's limb status through sensors installed inside the vehicle system (such as cameras, infrared sensors, etc.), specifically, paying attention to the position of the driver's hands.

[0133] After detecting the driver's limb state, the limb state detection results are analyzed. For example, when it is detected that the driver's hands are not placed in the preset target area of the steering wheel, the system will take action, namely, cancel the playback of the media resources (video images or other entertainment content) currently displayed on the HUD.

[0134] The target area may refer to, but is not limited to, a specific area on the steering wheel, and generally refers to where the driver's hands should be placed when operating the steering wheel to ensure sufficient control and reaction speed.

[0135] The triggering of this condition means that the driver may be performing non-driving activities. At this time, in order to ensure driving safety, the system will immediately interrupt the display of video or other entertainment content and restore the HUD to the basic driving information display state.

[0136] In one specific embodiment, multiple sensors, such as, but not limited to, cameras, pressure sensors, and position sensors, can be combined to continuously monitor whether the driver's hands are on a target area on the steering wheel. If the driver's hands are detected leaving the steering wheel, regardless of the vehicle's driving mode, the system immediately interrupts video playback, eliminating potential driving distractions. This process is automatic and rapid, eliminating the need for the driver to manually disable the entertainment system upon realizing a hazard, further enhancing the system's safety and reliability.

[0137] This embodiment monitors the driver's physical state to ensure that the system can quickly respond to any situation that could affect driving safety, canceling any entertainment content and reverting the HUD display to driving safety information. This mechanism, combined with the real-time monitoring of driving status mentioned in the previous embodiment, provides comprehensive safety protection, ensuring the safety of both driver and passengers.

[0138] As can be seen from the description of the above embodiments, the use of the technical solutions in the embodiments of the present application to process real-time data has at least the following beneficial effects:

[0139] (1) Enriching the diversity of HUD display content, for example, including audio and video data obtained from local or online content interaction platforms;

[0140] (2) The use scenarios of the HUD display system have been expanded, which has improved the safety and practicality of the in-vehicle entertainment system and provided users with a new and immersive entertainment experience while taking into account the importance of driving safety;

[0141] (3) By monitoring the driver's driving status in real time, the HUD display screen can be intelligently controlled. For example, when the assisted driving function is exited, the display of film and television content can be canceled and the display of vehicle driving information can be automatically switched.

[0142] (4) By introducing gesture interaction, the flexibility of the interaction between the user and the HUD display is increased, thereby improving the driving experience.

[0143] It should be noted that for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that this application is not limited by the order of the actions described, because according to this application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by this application.

[0144] According to another aspect of the embodiment of the present application, there is also provided Figure 10 A media resource processing device is shown, the device comprising:

[0145] The first acquisition unit 1002 is configured to acquire vehicle driving information of the target vehicle, wherein the vehicle driving information includes the driving state and current road condition information of the target vehicle;

[0146] A second acquisition unit 1004 is configured to automatically acquire target media resources from a media resource library when the vehicle driving information satisfies a preset image display condition, wherein the target media resources include driving parameters and audio and video data, and the media resource library includes local media resources corresponding to the vehicle system and media resources on the online content interaction platform;

[0147] A first processing unit 1006 is configured to perform adaptation processing on the target media resource based on the target image display parameter to obtain a processed media resource;

[0148] The first display unit 1008 is configured to display the processed media resources on a display device in the head-up display system.

[0149] Optionally, the first obtaining unit 1002 includes:

[0150] A reading module, used for reading the driving status of the target vehicle from the target control unit of the target vehicle through the target bus;

[0151] The positioning module is used to locate the target position of the target vehicle and obtain the current road condition information at the target position based on the vehicle-mounted sensor system.

[0152] Optionally, the first obtaining unit 1002 includes:

[0153] A first acquisition module is used to obtain the driving status of the target vehicle;

[0154] The second acquisition module is used to locate the target position of the target vehicle and obtain current road condition information at the target position.

[0155] Optionally, the second obtaining unit 1004 includes:

[0156] The third acquisition module is used to automatically acquire target media resources from the vehicle system when the driving status indicates that the target vehicle is in a non-manual driving state; or to acquire target media resources from an online content interaction platform through a target network when the driving status indicates that the target vehicle is in a non-manual driving state.

[0157] Optionally, the first processing unit 1006 includes:

[0158] an adjustment module, configured to adjust the image resolution of the target media resource in the central processing unit of the vehicle system based on the target resolution in the target image display parameter to obtain an adjusted media resource;

[0159] The first processing module is configured to process the adjusted media resource in the central processing unit based on the target transparency in the target image display parameter to obtain a processed media resource.

[0160] Optionally, the first display unit 1008 includes:

[0161] An image rendering module is used to render the processed media resources to obtain target image content;

[0162] a first transmission module, configured to transmit the target image content to a head-up display system of a target vehicle;

[0163] A second processing module is used to perform imaging processing on the target image content based on the head-up display system to obtain image content after imaging;

[0164] The third processing module is used to project the image content after imaging onto the display device in the head-up display system.

[0165] Optionally, the third processing module includes:

[0166] The detection submodule is used to detect the driving status of the driver in real time when the target image content is a video picture and the video picture is being played;

[0167] The pause submodule is used to pause the video picture currently projected on the display device when the driving state is switched from the non-manual driving state to the manual driving state.

[0168] Optionally, the above device further includes:

[0169] a second display unit, configured to obtain a driver's gesture interaction action during the process of displaying the processed media resource on a display device of the head-up display system;

[0170] The control unit is used to control the currently displayed video screen to switch to the target video screen based on the type of gesture interaction action, wherein the target video screen is obtained by adjusting the currently displayed video screen according to the type, and the processed media resources include the video screen.

[0171] Optionally, the above device further includes:

[0172] a third display unit, configured to obtain a driver's limb status detection result during the process of displaying the processed media resource on a display device of the head-up display system;

[0173] The second processing unit is configured to cancel display of the processed media resource when the limb state detection result indicates that the driver's hands are not placed on the target area of the steering wheel.

[0174] It should be noted that the embodiments of the media resource processing device here can refer to the embodiments of the media resource processing method described above, which will not be repeated here.

[0175] According to another aspect of the embodiment of the present application, an electronic device for implementing the above-mentioned media resource processing method is also provided. The electronic device may be Figure 1 The target terminal or server shown in FIG. This embodiment is described by taking the electronic device as the target terminal as an example. Figure 11 As shown, the electronic device includes a memory 1102 and a processor 1104. The memory 1102 stores a computer program, and the processor 1104 is configured to execute the steps in any of the above method embodiments through the computer program.

[0176] Optionally, in this embodiment, the electronic device may be located in at least one network device among a plurality of network devices of a computer network.

[0177] Optionally, in this embodiment, the processor may be configured to execute the following steps through a computer program:

[0178] S1, obtaining vehicle driving information of a target vehicle, wherein the vehicle driving information includes a driving state and current road condition information of the target vehicle;

[0179] S2, when the vehicle driving information meets the preset image display conditions, automatically obtaining target media resources from a media resource library, wherein the target media resources include driving parameters and audio and video data, and the media resource library includes local media resources corresponding to the vehicle system and media resources on the online content interaction platform;

[0180] S3, performing adaptation processing on the target media resource based on the target image display parameters to obtain a processed media resource;

[0181] S4: Display the processed media resources on a display device in the head-up display system.

[0182] Alternatively, those skilled in the art will appreciate that Figure 11 The structure shown is for illustration only. Figure 11 It does not limit the structure of the electronic device. For example, the electronic device may also include Figure 11 More or fewer components (such as network interfaces, etc.) as shown in, or with Figure 11 Different configurations shown.

[0183] Among them, the memory 1102 can be used to store software programs and modules, such as the program instructions / modules corresponding to the media resource processing method and device in the embodiment of the present application. The processor 1104 executes various functional applications and data processing by running the software programs and modules stored in the memory 1102, that is, realizing the above-mentioned media resource processing method. The memory 1102 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 1102 may further include a memory remotely located relative to the processor 1104, and these remote memories may be connected to the terminal via a network. Examples of the above-mentioned networks include but are not limited to the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof. Among them, the memory 1102 can be used specifically but not limited to store vehicle driving information, target media resources, and target image display parameters. As an example, such as Figure 11 As shown, the memory 1102 may include, but is not limited to, the first acquisition unit 1002, the second acquisition unit 1004, the first processing unit 1006, and the first display unit 1008 of the media resource processing device. In addition, other modules and units in the media resource processing device may also be included but are not limited to, which will not be repeated in this example.

[0184] Optionally, the transmission device 1106 is configured to receive or send data via a network. Specific examples of the network may include a wired network and a wireless network. In one embodiment, the transmission device 1106 includes a network interface controller (NIC), which can be connected to other network devices and a router via a network cable to communicate with the Internet or a local area network. In one embodiment, the transmission device 1106 is a radio frequency (RF) module, which is configured to communicate with the Internet wirelessly.

[0185] In addition, the electronic device further includes: a display 1108 for displaying video images on a vehicle-mounted system or a HUD display; and a connection bus 1110 for connecting various module components in the electronic device.

[0186] In other embodiments, the target terminal or server may be a node in a distributed system, wherein the distributed system may be a blockchain system, and the blockchain system may be a distributed system formed by connecting multiple nodes via network communication. The nodes may form a point-to-point network, and any computing device, such as a server, target terminal, or other electronic device, may become a node in the blockchain system by joining the point-to-point network.

[0187] According to another aspect of the present application, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the media resource processing method provided in various optional implementations of the aforementioned server verification processing and other aspects, wherein the computer program is configured to perform the steps of any of the aforementioned method embodiments when executed.

[0188] Optionally, in this embodiment, the computer-readable storage medium may be configured to store a computer program for performing the following steps:

[0189] S1, obtaining vehicle driving information of a target vehicle, wherein the vehicle driving information includes a driving state and current road condition information of the target vehicle;

[0190] S2, when the vehicle driving information meets the preset image display conditions, automatically obtaining target media resources from a media resource library, wherein the target media resources include driving parameters and audio and video data, and the media resource library includes local media resources corresponding to the vehicle system and media resources on the online content interaction platform;

[0191] S3, performing adaptation processing on the target media resource based on the target image display parameters to obtain a processed media resource;

[0192] S4: Display the processed media resources on a display device in the head-up display system.

[0193] Alternatively, in the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories), or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.

[0194] Optionally, in this embodiment, a person of ordinary skill in the art may understand that all or part of the steps in the various methods of the above embodiments may be completed by instructing the hardware related to the target terminal through a program, and the program may be stored in a computer-readable storage medium, which may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc.

[0195] The serial numbers of the above embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0196] If the integrated units in the above embodiments are implemented in the form of software functional units and sold or used as independent products, they can be stored in the above-mentioned computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling one or more computer devices (which can be personal computers, servers, or network devices, etc.) to execute all or part of the steps of the methods of each embodiment of the present application.

[0197] In the above embodiments of the present application, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.

[0198] In the several embodiments provided in this application, it should be understood that the disclosed client can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is merely a logical functional division. In actual implementation, there may be other division methods, such as combining or integrating multiple units or components into another system, or ignoring or not implementing some features. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interface, indirect coupling or communication connection of units or modules, and may be electrical or other forms.

[0199] Units described as separate components may or may not be physically separate, and components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0200] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0201] The above is only a preferred embodiment of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A method for processing media resources, characterized in that: include: Acquiring vehicle driving information of a target vehicle, wherein the vehicle driving information includes a driving state and current road condition information of the target vehicle; When the vehicle driving information satisfies a preset image display condition, target media resources are automatically obtained from a media resource library, wherein the target media resources include driving parameters and audio and video data, and the media resource library includes local media resources corresponding to the vehicle system and media resources on the online content interaction platform; Based on the target image display parameters, adapting the target media resource to obtain a processed media resource; The processed media resources are displayed on a display device in a head-up display system.

2. The method according to claim 1, characterized in that The obtaining of the target vehicle's driving information includes: Obtaining the driving status of the target vehicle; The target position of the target vehicle is located, and the current road condition information at the target position is obtained.

3. The method according to claim 1, characterized in that When the vehicle driving information satisfies a preset image display condition, automatically acquiring target media resources from a media resource library includes: When the driving state indicates that the target vehicle is in a non-manual driving state, automatically acquiring the target media resource from the vehicle-mounted system; or When the driving state indicates that the target vehicle is in a non-manual driving state, the target media resource is obtained from the online content interaction platform via a target network.

4. The method according to claim 1, wherein The adapting processing of the target media resource based on the target image display parameter to obtain the processed media resource includes: Adjusting the image resolution of the target media resource based on the target resolution in the target image display parameter to obtain an adjusted media resource; The adjusted media resource is processed based on the target transparency in the target image display parameter to obtain the processed media resource.

5. The method according to claim 1, wherein Displaying the processed media resource on a display device in the head-up display system includes: Obtaining target image content by performing image rendering on the processed media resources; transmitting the target image content to the head-up display system of the target vehicle; Based on the head-up display system, imaging processing is performed on the target image content to obtain imaged image content; The imaged content is projected onto a display device in the head-up display system.

6. The method according to claim 5, characterized in that The projecting of the imaged content onto a display device in the head-up display system includes: When the target image content is a video picture and the video picture is played, detecting the driving state of the driver in real time; When the driving state is switched from a non-manual driving state to a manual driving state, the video image currently projected on the display device is paused.

7. The method according to any one of claims 1 to 6, characterized in that The method further comprises: Acquiring a driver's gesture interaction action during displaying the processed media resource on a display device of the head-up display system; Based on the type of the gesture interaction action, the currently displayed video screen is controlled to switch to a target video screen, wherein the target video screen is obtained by adjusting the currently displayed video screen according to the type, and the processed media resources include the video screen.

8. The method according to any one of claims 1 to 6, characterized in that The method further comprises: obtaining a driver's limb state detection result during display of the processed media resource on the display device of the head-up display system; When the limb state detection result indicates that the driver's hands are not placed on the target area of the steering wheel, the processed media resource is canceled from being displayed.

9. A media resource processing device, characterized in that: include: a first acquiring unit, configured to acquire vehicle driving information of a target vehicle, wherein the vehicle driving information includes a driving state and current road condition information of the target vehicle; a second acquisition unit, configured to automatically acquire target media resources from a media resource library when the vehicle driving information satisfies a preset image display condition, wherein the target media resources include driving parameters and audio and video data, and the media resource library includes local media resources corresponding to the vehicle system and media resources on the online content interaction platform; A first processing unit is configured to perform adaptation processing on the target media resource based on the target image display parameter to obtain a processed media resource; The first display unit is configured to display the processed media resource on a display device in a head-up display system.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein the program can be executed by a terminal device or a computer to execute the method according to any one of claims 1 to 9.

11. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to execute the method according to any one of claims 1 to 9 through the computer program.

Images