Vehicle-mounted projection control method and device, electronic equipment and storage medium

The on-board projection controller collects music features, generates matching projection content and plays it simultaneously, solving the problem of insufficient interaction between on-board multimedia and projection content, and improving the audio-visual experience and interactivity of the on-board entertainment system.

CN119094829APending Publication Date: 2024-12-06CHONGQING JINKANG NEW ENERGY VEHICLE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411201164.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-29
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

In the existing in-vehicle system, the interaction between the in-vehicle multimedia and the content projected in-vehicle is not strong, resulting in weak entertainment and affecting the user's experience.

Method used

Through the on-board projection controller, the features of music content are collected, the preset projection material library is traversed, the matching projection content is generated, and the time stamp is played synchronously, and the projection effect is adjusted to match the music content.

Benefits of technology

It realizes the perfect synchronization of projected content and music, improves the audio-visual experience of the in-car entertainment system, enhances immersion and interactivity, and satisfies the visual enjoyment and user experience of drivers and passengers.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119094829A_ABST
    Figure CN119094829A_ABST
Patent Text Reader

Abstract

The invention provides a vehicle-mounted projection control method and device, electronic equipment and a storage medium, and the method comprises the steps: collecting music content currently played by a vehicle-mounted multimedia system, carrying out the feature extraction of the music content, obtaining a music feature corresponding to the music content, traversing a preset projection material library according to the music feature, obtaining a target projection material, and transmitting the target projection material to the vehicle-mounted multimedia system. And processing the target projection material, generating to-be-projected content, and controlling the to-be-projected content and music content to be synchronously played according to the to-be-projected content and the music content currently played by the vehicle-mounted multimedia system. According to the embodiment of the invention, the projection content matched with the music is intelligently generated by collecting the music content in real time and extracting the music features, and the vehicle-mounted projection and the music are synchronously played automatically, so that the vehicle-mounted projection content is accurately matched with the vehicle-mounted music, the audio-visual experience of the vehicle-mounted entertainment system is improved, and the user experience is improved. The immersion and interactivity of entertainment in the vehicle are enhanced, and the visual enjoyment and use experience of drivers and passengers are further met.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of vehicle technology, and in particular to a vehicle-mounted projection control method, device, electronic equipment and storage medium. Background Art

[0002] With the continuous development of in-vehicle scenario technology and the increasingly close connection between people and cars, drivers have more and more requirements for cars beyond daily commuting. Therefore, more and more vehicles are equipped with in-vehicle systems. Traditional in-vehicle systems mainly include players, multimedia and other audio and video equipment to provide entertainment services for passengers in the car.

[0003] At present, the intelligent vehicle-mounted system also includes a water mist generating device and a controller for generating water mist, wherein the controller communicates with the projection device and the water mist generating device, and the controller enables the projection device to project the image onto the water mist. However, in the vehicle-mounted systems of existing vehicles, the vehicle-mounted projection is mainly used in scenes of finding the vehicle or welcoming guests. The interactivity between the vehicle-mounted multimedia and the content of the vehicle-mounted projection is not strong, and they usually run independently, resulting in weak entertainment, thereby affecting the user's experience of using the vehicle. Summary of the invention

[0004] In view of this, the present invention aims to propose a vehicle-mounted projection control method, device, electronic device and storage medium to solve the problem that the interactivity between the vehicle-mounted multimedia and the content of the vehicle-mounted projection is not strong, which affects the user's experience of using the vehicle, and to realize vehicle-mounted projection control that interacts synchronously with the vehicle-mounted multimedia.

[0005] According to a first aspect of the present invention, a vehicle-mounted projection control method is provided, which is applied to a vehicle-mounted projection controller, wherein the vehicle-mounted projection controller is communicatively connected to a vehicle-mounted multimedia system, and the method comprises:

[0006] Collecting music content currently played by the in-vehicle multimedia system, performing feature extraction on the music content, and obtaining music features corresponding to the music content;

[0007] According to the music features, a preset projection material library is traversed to obtain target projection materials, and the target projection materials are processed to generate content to be projected;

[0008] According to the content to be projected and the music content currently being played by the in-vehicle multimedia system, the content to be projected is controlled to be played synchronously with the music content.

[0009] Optionally, collecting the music content currently played by the in-vehicle multimedia system, performing feature extraction on the music content, and obtaining music features corresponding to the music content includes:

[0010] In response to monitoring that the in-vehicle multimedia system is in a playing state, collecting music content currently being played by the in-vehicle multimedia system;

[0011] Using a preset audio algorithm to perform feature analysis on the music content, and extracting rhythm features, melody features, and timbre features of the music content;

[0012] The rhythm features, melody features and timbre features are aggregated and processed to obtain music features corresponding to the music content.

[0013] Optionally, traversing a preset projection material library according to the music feature to obtain a target projection material, and processing the target projection material to generate content to be projected includes:

[0014] Using the predetermined correspondence between music features and projection materials, traversing the preset projection material library, and obtaining the target projection material matching the music features; wherein the preset projection material library includes multiple types of projection materials, and the projection materials include multiple colors and dynamic effects;

[0015] Adjusting the color and dynamic effects of the target projection material to match the music characteristics;

[0016] The adjusted target projection materials are aggregated and processed to generate the content to be projected.

[0017] Optionally, controlling the content to be projected to be played synchronously with the music content according to the content to be projected and the music content currently played by the in-vehicle multimedia system includes:

[0018] Adjusting the playback effect of the content to be projected to match the music content currently being played by the in-vehicle multimedia system;

[0019] Respectively obtain the timestamps of the content to be projected and the music content currently being played;

[0020] The timestamp is used to control the synchronous playing of the content to be projected and the music content.

[0021] Optionally, adjusting the playback effect of the content to be projected to match the music content currently played by the in-vehicle multimedia system includes:

[0022] Obtain vehicle brightness, vehicle ambient temperature and vehicle driving status;

[0023] Adjusting the projection brightness and color saturation of the content to be projected according to the vehicle brightness and vehicle ambient temperature;

[0024] The dynamic effect of the content to be projected is adjusted according to the driving state of the vehicle; wherein the playing effect of the content to be projected matches the music content.

[0025] Optionally, the using the timestamp to control the synchronous playing of the content to be projected and the music content includes:

[0026] A high-pressure pump is used to adjust the water pressure to a preset pressure value for water spraying, thereby generating a projection water curtain in a preset area;

[0027] In response to the consistency of the timestamps of the content to be projected and the music content, the content to be projected is projected onto a projection water curtain in a preset area, and the content to be projected is controlled to be played synchronously with the music content.

[0028] Optionally, after controlling the synchronous playback of the content to be projected and the music content currently played by the in-vehicle multimedia system according to the content to be projected and the music content currently played by the in-vehicle multimedia system, the method further includes:

[0029] In response to a control instruction input by a user, the playback of the content to be projected and the music content is adjusted.

[0030] According to a second aspect of the present invention, there is provided a vehicle-mounted projection control device, which is applied to a vehicle-mounted projection controller, wherein the vehicle-mounted projection controller is communicatively connected to a vehicle-mounted multimedia system, and the device comprises:

[0031] A music feature module, used to collect the music content currently played by the in-vehicle multimedia system, perform feature extraction on the music content, and obtain music features corresponding to the music content;

[0032] A projection generation module is used to traverse a preset projection material library according to the music features, obtain target projection materials, process the target projection materials, and generate content to be projected;

[0033] The projection control module is used to control the synchronous playing of the content to be projected and the music content currently played by the in-vehicle multimedia system according to the content to be projected.

[0034] According to another aspect of the present invention, there is also provided an electronic device, comprising:

[0035] processor;

[0036] a memory for storing instructions executable by the processor;

[0037] The processor is configured to execute the instructions to implement the vehicle-mounted projection control method as described above.

[0038] According to another aspect of the present invention, a readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the vehicle-mounted projection control method described above are implemented.

[0039] The vehicle projection control method provided by the embodiment of the present invention collects the music content currently played by the vehicle multimedia system, extracts the features of the music content, obtains the music features corresponding to the music content, traverses the preset projection material library according to the music features, obtains the target projection material, processes the target projection material, generates the content to be projected, and controls the content to be projected to be played synchronously with the music content according to the content to be projected and the music content currently played by the vehicle multimedia system. The embodiment of the present invention combines the vehicle audio with the vehicle projection, collects the music content in real time to extract the music features, intelligently generates the projection content matching the music, and automatically adjusts the vehicle projection effect to be synchronized with the currently playing music by synchronously and accurately controlling the projection and the music, so as to achieve the accurate matching of the vehicle projection content with the vehicle music, and the close coordination of the projection content and the note rhythm of the music, so as to ensure the perfect synchronization of the projection content and the music, thereby improving the audio-visual experience of the vehicle entertainment system, enhancing the immersion and interactivity of the in-vehicle entertainment, and further satisfying the visual enjoyment and use experience of the driver and passengers.

[0040] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0042] Figure 1 is a flowchart of a vehicle-mounted projection control method provided by an embodiment of the present invention;

[0043] Figure 2 yes Figure 1 A flowchart of step 101 in the vehicle projection control method provided by an embodiment of the present invention;

[0044] Figure 3 yes Figure 1 A flowchart of step 102 in the vehicle projection control method provided by an embodiment of the present invention;

[0045] Figure 4 yes Figure 1 A flowchart of step 103 in the vehicle projection control method provided by an embodiment of the present invention;

[0046] Figure 5is a flowchart of another vehicle-mounted projection control method provided by an embodiment of the present invention;

[0047] Figure 6 Schematic diagram of a scene of a vehicle-mounted projection control method provided by an embodiment of the present invention;

[0048] Figure 7 is a structural schematic diagram of a vehicle-mounted projection control device provided by an embodiment of the present invention;

[0049] Figure 8 It is a structural schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0050] To make the purpose, technical scheme and advantages of the embodiments of the present invention clearer, the embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. However, it will be appreciated by those skilled in the art that in the embodiments of the present invention, many technical details are proposed in order to enable the reader to better understand the present application. However, even without these technical details and various changes and modifications based on the following embodiments, the technical scheme claimed in the present application can be implemented. The division of the following embodiments is for the convenience of description, and should not constitute any limitation on the specific implementation of the present invention. The various embodiments can be combined and referenced with each other without contradiction.

[0051] Reference Figure 1 , shows a flowchart of the steps of the vehicle projection control method provided by an embodiment of the present invention, which is applied to the vehicle projection controller end, and the vehicle projection controller is communicatively connected with the vehicle multimedia system. The method may include:

[0052] Step 101 , collect the music content currently played by the in-vehicle multimedia system, perform feature extraction on the music content, and obtain music features corresponding to the music content.

[0053] In an embodiment of the present invention, in order to solve the problem that the current in-vehicle multimedia and the in-vehicle projection run independently, the interactivity between the displayed contents of the two is not strong, which affects the user's experience of using the vehicle, and to realize the in-vehicle projection control that interacts synchronously with the in-vehicle multimedia, this embodiment combines the in-vehicle audio system with the in-vehicle projection, and automatically adjusts the pattern, color, and dynamic effect of the in-vehicle projection by real-time analysis of the rhythm, melody, and timbre of the played music, thereby ensuring the synchronization of the projection content with the music, bringing an unprecedented audio-visual feast to the driver and passengers, which not only enhances the immersion and interactivity of the in-vehicle entertainment, but also enhances the pleasant experience of the driver and passengers through the combination of audio and video.

[0054] In this embodiment, the vehicle-mounted projection controller is communicatively connected to the vehicle-mounted multimedia system, collects the music content currently played by the vehicle-mounted multimedia system, and extracts features of the music content to obtain music features corresponding to the music content. Specifically, the vehicle-mounted projection controller collects music data from the vehicle-mounted multimedia system in real time, and can use audio analysis algorithms (such as FFT, beat detection, pitch tracking, etc.) to process the music data to extract key features such as rhythm, melody, and timbre. Among them, the music features corresponding to the music content can specifically include information such as beat position, melody line, and timbre classification, which will not be repeated here.

[0055] In order to facilitate those skilled in the art to fully understand the above-mentioned vehicle-mounted projection control method, refer to Figure 6 , Figure 6 It is a scene schematic diagram of the vehicle projection control method provided by an embodiment of the present invention, specifically including: a vehicle projection controller and a vehicle multimedia system, the vehicle projection controller is communicatively connected with the vehicle multimedia system, the vehicle projection controller is used to control the water curtain projection device to perform water curtain projection, the vehicle multimedia system includes a user interface and an audio device for playing vehicle music, the vehicle projection controller and the vehicle multimedia system are connected to a vehicle power supply, and the vehicle power supply is used to power the vehicle projection controller and the vehicle multimedia system to ensure the normal operation of the vehicle projection controller and the vehicle multimedia system.

[0056] Step 102, traverse the preset projection material library according to the music features, obtain the target projection material, process the target projection material, and generate the content to be projected.

[0057] In an embodiment of the present invention, a preset projection material library is pre-stored in a vehicle storage space. The preset projection material library has rich built-in projection materials. The preset projection material library includes multiple types of projection materials, and the projection materials include multiple colors and dynamic effects. After determining the music features, the on-board projection controller traverses the preset projection material library according to the music features to obtain target projection materials, processes the target projection materials, and generates content to be projected, wherein the content to be projected includes a combination sequence of patterns, colors, and dynamic effects, which can be obtained by automatically selecting and combining the target projection materials, or by users creating the target projection materials according to personal preferences and music styles. The content to be projected can be in the form of text, patterns, or dynamic patterns, etc., which are not specifically limited here.

[0058] Specifically, a predetermined correspondence between music features and projection materials is used, and a preset projection material library is traversed to obtain target projection materials that match the music features. The color and dynamic effects of the target projection materials are adjusted to match the music features. The adjusted target projection materials are aggregated and processed to generate content to be projected. In this embodiment, according to the music feature data, the preset projection material library is traversed, and patterns, colors, and dynamic effects that match the music features are intelligently selected. The selected projection materials are combined and adjusted to generate content to be projected, ensuring that they are coordinated with the music features.

[0059] Step 103 , according to the content to be projected and the music content currently being played by the in-vehicle multimedia system, the content to be projected and the music content are controlled to be played synchronously.

[0060] In an embodiment of the present invention, the vehicle-mounted projection controller processes the content to be projected and the music content currently being played by the vehicle-mounted multimedia system, and can use a synchronization control algorithm to ensure that the content to be projected is closely coordinated with every note and rhythm of the music content. In some embodiments, the content to be projected can be rendered in real time in the vehicle environment and projected synchronously, and the projection content synchronized with the music can be played in real time in the vehicle environment, providing an immersive audio-visual experience for the driver and passengers.

[0061] Specifically, the vehicle-mounted projection controller first adjusts the playback effect of the content to be projected to match the music content currently being played by the vehicle-mounted multimedia system, ensuring that the content to be projected is closely coordinated with every note and rhythm of the music content. In this embodiment, the synchronization control algorithm is implemented using a timestamp, and the timestamps of the content to be projected and the currently played music content are obtained respectively, and the timestamps are used to control the synchronous playback of the content to be projected and the music content.

[0062] The vehicle projection control method provided by the embodiment of the present invention collects the music content currently played by the vehicle multimedia system, extracts the features of the music content, obtains the music features corresponding to the music content, traverses the preset projection material library according to the music features, obtains the target projection material, processes the target projection material, generates the content to be projected, and controls the content to be projected to be played synchronously with the music content according to the content to be projected and the music content currently played by the vehicle multimedia system. The embodiment of the present invention combines the vehicle audio with the vehicle projection, collects the music content in real time to extract the music features, intelligently generates the projection content matching the music, and automatically adjusts the vehicle projection effect to be synchronized with the currently playing music by synchronously and accurately controlling the projection and the music, so as to achieve the accurate matching of the vehicle projection content with the vehicle music, and the close coordination of the projection content and the note rhythm of the music, so as to ensure the perfect synchronization of the projection content and the music, thereby improving the audio-visual experience of the vehicle entertainment system, enhancing the immersion and interactivity of the in-vehicle entertainment, and further satisfying the visual enjoyment and use experience of the driver and passengers.

[0063] Further, see Figure 2 , showing Figure 1 A flowchart of step 101 in a vehicle-mounted projection control method is provided. The method is substantially the same as the vehicle-mounted projection control method provided in the first embodiment of the present invention. Step 101 may include:

[0064] Step 201 , in response to monitoring that the in-vehicle multimedia system is in a playing state, collecting music content currently being played by the in-vehicle multimedia system.

[0065] Step 202: Use a preset audio algorithm to perform feature analysis on the music content to extract rhythm features, melody features, and timbre features of the music content.

[0066] Step 203, the rhythm features, melody features and timbre features are aggregated to obtain music features corresponding to the music content.

[0067] It should be noted that in the embodiment of the present invention, the vehicle-mounted projection control can monitor in real time whether the vehicle-mounted multimedia system is in a playing state. Once the system is detected to be in a playing state, the currently playing music data is immediately collected from the vehicle-mounted multimedia system in real time, and the music data is processed using a preset audio algorithm to identify the beat position, melody line and timbre changes in the music, and generate corresponding feature data. Specifically, the rhythm features, melody features and timbre features of the music are extracted, and the extracted rhythm features, melody features and timbre features are integrated and summarized to form a comprehensive music feature data set. It should be noted that the preset audio algorithm can be one of a beat detection algorithm, a pitch tracking algorithm, a spectrum analysis algorithm, etc. In this embodiment, the preset audio algorithm is not specifically limited, and it can be any algorithm for extracting music data features.

[0068] In this embodiment, the playback status of the in-vehicle multimedia system is monitored in real time to ensure that audio collection is started immediately when the system starts playing. An efficient audio processing algorithm is used to analyze the spectral characteristics of the music in real time to improve the accuracy and real-time performance of feature extraction. Feature fusion can be used to ensure the coordination and consistency between various feature data, provide accurate data support for subsequent intelligent matching and synchronous playback, and ensure that the system can quickly respond to music changes in a real-time environment and extract music features in a timely manner.

[0069] The embodiment of the present invention monitors the playing status of the in-vehicle multimedia system in real time, collects the currently playing music content, and uses a preset audio algorithm to extract the rhythm, melody and timbre characteristics of the music to form a comprehensive music feature, thereby providing accurate data support for subsequent projection content generation and synchronous playback.

[0070] Further, see Figure 3 , showing Figure 1 A flowchart of step 102 in a vehicle-mounted projection control method is provided. The method is substantially the same as the vehicle-mounted projection control method provided in the first embodiment of the present invention. Step 102 may include:

[0071] Step 301, using the predetermined correspondence between music features and projection materials, traverse the preset projection material library to obtain the target projection material matching the music features.

[0072] The preset projection material library includes various types of projection materials, and the projection materials include various colors and dynamic effects;

[0073] Step 302, adjusting the color and dynamic effect of the target projection material to match the music characteristics;

[0074] Step 303: aggregate and process the adjusted target projection materials to generate content to be projected.

[0075] It should be noted that in the embodiment of the present invention, the vehicle-mounted projection controller traverses the preset projection material library according to the predetermined correspondence between the music characteristics and the projection materials, and intelligently selects the target projection material that matches the music characteristics. Specifically, the pattern, color and dynamic effect that are coordinated with the music characteristics (rhythm, melody, timbre) are selected from the material library to obtain the target projection material, which may include a variety of colors and dynamic effects.

[0076] In this embodiment, in order to further improve the matching degree between the target projection material and the music characteristics, the color of the target projection material can be adjusted according to the music characteristics to match it with the emotion and atmosphere of the music. The dynamic effects of the target projection material, such as speed, intensity and change mode, can be adjusted according to the rhythm and melody of the music to ensure synchronization with the music. The adjusted target projection material is obtained, and the color and dynamic effects match the music characteristics. The adjusted target projection materials are combined and summarized to form a complete sequence of content to be projected, ready for synchronous playback, to ensure coordination and consistency between the various projection materials, and perfect matching with the music characteristics.

[0077] It should be noted that, in this embodiment, projection materials can be classified and retrieved to ensure the diversity and availability of the materials, intelligently select and combine projection materials according to music characteristics, and dynamically adjust the color of the projection materials according to the music characteristics to enhance visual expression, and adjust the dynamic effects of the projection materials in real time according to the rhythm and melody of the music to improve synchronization and immersion, ensure that it can quickly respond to music changes in a real-time environment, and adjust the projection materials in time, further improve the matching accuracy of music characteristics and projection materials, and ensure perfect synchronization between the projection content and the music.

[0078] The embodiment of the present invention intelligently selects and adjusts the projection material according to the music characteristics, generates content to be projected that matches the music, improves the matching accuracy between the music characteristics and the projection material, ensures the perfect synchronization between the projection content and the music, further enhances the audio-visual experience of the in-vehicle entertainment system, and brings novel visual enjoyment and emotional resonance to the driver and passengers.

[0079] Further, see Figure 4 , showing Figure 1 A flowchart of step 103 in a vehicle-mounted projection control method is provided. The method is substantially the same as the vehicle-mounted projection control method provided in the first embodiment of the present invention. Step 103 may include:

[0080] Step 401: Adjust the playing effect of the content to be projected to match the music content currently being played by the in-vehicle multimedia system.

[0081] Step 402, respectively obtain the timestamps of the content to be projected and the currently played music content.

[0082] Step 403: Use the timestamp to control the synchronous playing of the content to be projected and the music content.

[0083] It should be noted that in the embodiment of the present invention, the playback effect of the content to be projected, such as speed, brightness, dynamic changes, etc., is adjusted according to the rhythm, melody and timbre characteristics of the music content to ensure the synchronization and coordination between the projected content and the music. During the playback process, the changes in the music content are monitored in real time, and the playback effect of the projected content is dynamically adjusted to maintain the best audio-visual experience, so that the adjusted content to be projected has a playback effect that matches the music content.

[0084] Specifically, in order to ensure the synchronous playback of the content to be projected and the music content, the present embodiment adopts time synchronization: respectively obtain the timestamps of the content to be projected and the music content to ensure the synchronization of the two on the timeline, mark the timestamps on each key frame or beat point of the projection content and the music content, provide an accurate time reference for the synchronous playback, use the timestamps to control the synchronous playback of the content to be projected and the music content, ensure that the projection content appears at the correct time point and is closely coordinated with the rhythm and melody of the music, monitor the timestamps in real time during the playback process, and dynamically adjust the playback progress of the projection content to cope with possible delays or deviations. It should be noted that time synchronization can use NTP (Network Time Protocol) or PTP (Precision Time Protocol) to ensure the accuracy and consistency of the timestamps.

[0085] The embodiment of the present invention ensures that the system can quickly respond to music changes in a real-time environment and adjust the playback effect of the projection content in a timely manner by playing the projection content synchronized with the music in real time in the vehicle environment. The accuracy of the timestamp and the stability of the synchronization control are used to ensure the perfect synchronization of the projection content and the music, and ensure that the adjusted projection content can provide a high-quality visual experience to meet the personalized needs of users.

[0086] Specifically, step 401 adjusts the playback effect of the content to be projected to match the music content currently played by the in-vehicle multimedia system, which may specifically include:

[0087] First, obtain the vehicle brightness, vehicle ambient temperature and vehicle driving status;

[0088] Secondly, adjusting the projection brightness and color saturation of the content to be projected according to the vehicle brightness and vehicle ambient temperature;

[0089] Secondly, the dynamic effect of the content to be projected is adjusted according to the driving state of the vehicle; wherein the playing effect of the content to be projected matches the music content.

[0090] It should be noted that in the above steps, the vehicle-mounted projection controller can monitor the brightness level inside the vehicle in real time through the vehicle-mounted sensor or camera, and monitor the ambient temperature inside the vehicle in real time through the vehicle-mounted temperature sensor, and monitor the driving state of the vehicle in real time through the vehicle-mounted sensor and the vehicle status system, such as speed, acceleration, steering, etc., to obtain vehicle brightness, vehicle ambient temperature and vehicle driving state data. According to the vehicle brightness data, the projection brightness of the content to be projected is adjusted to ensure the visibility and comfort of the projected content under different lighting conditions, according to the vehicle ambient temperature data, the color saturation of the content to be projected is adjusted to adapt to the visual experience under different temperatures, and according to the vehicle driving state data, the dynamic effect of the content to be projected is adjusted, such as reducing the dynamic changes when driving at high speed and increasing the dynamic effect when driving at low speed or parking to ensure driving safety. The adjusted content to be projected, the projection brightness and color saturation are adapted to the vehicle environment, and the dynamic effect matches the vehicle driving state, and it is ensured that the playback effect of the adjusted content to be projected matches the rhythm, melody and timbre characteristics of the music content to create a harmonious audio-visual experience.

[0091] The embodiments of the present invention dynamically adjust the playback effect of the projection content by monitoring the changes of the music content and the vehicle environment in real time during the playback process, and play the projection content that is synchronized with the music and adapted to the vehicle environment in real time in the vehicle environment. When adjusting the projection content, it is ensured that driving safety is not affected, especially when the vehicle is in motion, the dynamic effects that may distract the driver's attention are reduced, the adaptability of the projection content to different vehicle environments and driving conditions is improved, and the comfort and safety of the audio-visual experience are ensured.

[0092] Specifically, step 403 of using the timestamp to control the synchronous playback of the content to be projected and the music content may include:

[0093] A high-pressure pump is used to adjust the water pressure to a preset pressure value for water spraying, thereby generating a projection water curtain in a preset area;

[0094] In response to the consistency of the timestamps of the content to be projected and the music content, the content to be projected is projected onto a projection water curtain in a preset area, and the content to be projected is controlled to be played synchronously with the music content.

[0095] It should be noted that in the above steps, a high-pressure pump is used to adjust the water pressure to a preset pressure value, which can be 60-100 kg / cm2, to ensure that the water flow can form a stable water curtain, and the high-pressure water flow is sprayed into a fan-shaped water mist through a special nozzle to form a projection water curtain in a preset area for subsequent image projection, in response to the consistency of the timestamps of the content to be projected and the music content, to ensure the synchronous playback of the projection content and the music content. This embodiment uses a high-precision high-pressure pump to ensure the stability and adjustability of the water pressure to form a uniform water curtain, and adopts a special nozzle design to ensure that the water flow can form a uniform and delicate water mist, providing a good medium for image projection.

[0096] Specifically, the content to be projected is projected onto the projection water curtain in a preset area using light sources such as lasers or LEDs to form a transparent image, and the projection content synchronized with the music is played in real time on the projection water curtain, ensuring that the static patterns, texts, dynamic pictures and effects in the projection content can be presented through the water curtain as a three-dimensional image effect that is both real and unreal, providing users with a unique visual effect.

[0097] The embodiment of the present invention presents three-dimensional and dynamic projection content on the projection water curtain, improves the richness and layering of the visual experience, and adopts high-precision time synchronization technology to ensure that the timestamps of the projection content and the music content are consistent, thereby achieving synchronous playback.

[0098] Reference Figure 5 , shows a flow chart of steps of another vehicle-mounted projection control method provided by an embodiment of the present invention, which method is basically the same as the vehicle-mounted projection control method provided by the first embodiment of the present invention, except that the method may further include:

[0099] Step 101 , collect the music content currently played by the in-vehicle multimedia system, perform feature extraction on the music content, and obtain music features corresponding to the music content.

[0100] Step 102, traverse the preset projection material library according to the music features, obtain the target projection material, process the target projection material, and generate the content to be projected.

[0101] Step 103 , according to the content to be projected and the music content currently being played by the in-vehicle multimedia system, the content to be projected and the music content are controlled to be played synchronously.

[0102] The above steps 101 to 103 are described in the foregoing description and will not be repeated here.

[0103] Step 104: In response to a control instruction input by a user, play adjustment is performed on the content to be projected and the music content.

[0104] In the embodiment of the present invention, the vehicle multimedia system can integrate a highly sensitive touch screen, support multi-touch and gesture operation, provide an intuitive and convenient user interface, and can also integrate advanced voice recognition technology, support natural language processing, and allow users to control the system through voice commands. Other operation modes, such as physical buttons, remote control, etc., can also be integrated as needed to meet the needs of different users. In response to the control instructions input by the user, the projection content and music content are played and adjusted. By providing a wealth of system setting options, including brightness, contrast, color, dynamic effects, etc., users can adjust according to their personal preferences, allowing users to customize projection content, playlists, operation interfaces, etc. to meet personalized needs, support the creation and management of user profiles, save the user's personalized settings, and facilitate users to synchronize settings between different devices.

[0105] On the basis of achieving the beneficial effects of the first embodiment, the embodiment of the present invention can support multiple operation modes, including touch screen, voice control, etc., through personalized settings and adjustable content to be projected and music content, and provide rich setting options and customization functions to meet the personalized needs of users, improve the usability and convenience of vehicle projection control, and provide flexible operation options and personalized settings for different users, thereby enhancing the satisfaction and comfort of user experience.

[0106] Reference Figure 7 , shows a schematic structural diagram of a vehicle-mounted projection control device provided by an embodiment of the present invention, which is applied to a vehicle-mounted projection controller end, wherein the vehicle-mounted projection controller is communicatively connected with a vehicle-mounted multimedia system, and the device comprises:

[0107] The music feature module 501 is used to collect the music content currently played by the in-vehicle multimedia system, perform feature extraction on the music content, and obtain music features corresponding to the music content;

[0108] A projection generation module 502 is used to traverse a preset projection material library according to the music features, obtain target projection materials, process the target projection materials, and generate content to be projected;

[0109] The projection control module 503 is used to control the synchronous playback of the content to be projected and the music content currently played by the in-vehicle multimedia system according to the content to be projected and the music content currently played by the in-vehicle multimedia system.

[0110] Furthermore, the music feature module 501 includes:

[0111] A collection submodule, for collecting music content currently being played by the in-vehicle multimedia system in response to monitoring that the in-vehicle multimedia system is in a playing state;

[0112] A feature extraction submodule, used to perform feature analysis on the music content using a preset audio algorithm, and extract rhythm features, melody features, and timbre features of the music content;

[0113] The processing submodule is used to aggregate the rhythm features, melody features and timbre features to obtain the music features corresponding to the music content.

[0114] Furthermore, the projection generation module 502 includes:

[0115] A matching submodule, for adopting a predetermined correspondence between music features and projection materials, traversing a preset projection material library, and obtaining a target projection material matched with the music features; wherein the preset projection material library includes multiple types of projection materials, and the projection materials include multiple colors and dynamic effects;

[0116] A first adjustment submodule, used to adjust the color and dynamic effect of the target projection material to match the music characteristics;

[0117] The generation submodule is used to aggregate and process the adjusted target projection materials to generate content to be projected.

[0118] Furthermore, the projection control module 503 includes:

[0119] A second adjustment submodule, used to adjust the playback effect of the content to be projected to match the music content currently played by the in-vehicle multimedia system;

[0120] An acquisition submodule, used to respectively acquire the timestamps of the content to be projected and the currently played music content;

[0121] The control submodule is used to use the timestamp to control the synchronous playing of the content to be projected and the music content.

[0122] Furthermore, the second adjustment submodule includes:

[0123] An acquisition unit, used to acquire vehicle brightness, vehicle ambient temperature and vehicle driving status;

[0124] A first adjustment unit, configured to adjust the projection brightness and color saturation of the content to be projected according to the vehicle brightness and the vehicle ambient temperature;

[0125] The second adjustment unit is used to adjust the dynamic effect of the content to be projected according to the driving state of the vehicle; wherein the playing effect of the content to be projected matches the music content.

[0126] Furthermore, the control submodule includes:

[0127] A generating unit, used to use a high-pressure pump to adjust the water pressure to a preset pressure value for water spraying, thereby generating a projection water curtain in a preset area;

[0128] The control unit is used to project the content to be projected onto a projection water curtain in a preset area in response to the consistency of the timestamps of the content to be projected and the music content, and to control the synchronous playback of the content to be projected and the music content.

[0129] Furthermore, the device also includes:

[0130] The play adjustment module is used to adjust the play of the content to be projected and the music content in response to a control instruction input by a user.

[0131] The vehicle projection control device provided by the embodiment of the present invention collects the music content currently played by the vehicle multimedia system, extracts the features of the music content, obtains the music features corresponding to the music content, traverses the preset projection material library according to the music features, obtains the target projection material, processes the target projection material, generates the content to be projected, and controls the content to be projected to be played synchronously with the music content according to the content to be projected and the music content currently played by the vehicle multimedia system. The embodiment of the present invention combines the vehicle audio with the vehicle projection, collects the music content in real time to extract the music features, intelligently generates the projection content matching the music, and automatically adjusts the vehicle projection effect to be synchronized with the currently playing music by synchronously and accurately controlling the projection and the music, so as to achieve the accurate matching of the vehicle projection content with the vehicle music, and the close coordination of the projection content and the note rhythm of the music, so as to ensure the perfect synchronization of the projection content and the music, thereby improving the audio-visual experience of the vehicle entertainment system, enhancing the immersion and interactivity of the in-vehicle entertainment, and further satisfying the visual enjoyment and use experience of the driver and passengers.

[0132] Reference Figure 8 , an embodiment of the present invention further provides an electronic device, such as Figure 8 As shown, it includes a processor 601, a communication interface 602, a memory 603 and a communication bus 604, wherein the processor 601, the communication interface 602, and the memory 603 communicate with each other through the communication bus 604.

[0133] Memory 603, used for storing computer programs;

[0134] The processor 601 is used to execute the program stored in the memory 603 to implement the following steps:

[0135] Collecting music content currently played by the in-vehicle multimedia system, performing feature extraction on the music content, and obtaining music features corresponding to the music content;

[0136] According to the music features, a preset projection material library is traversed to obtain target projection materials, and the target projection materials are processed to generate content to be projected;

[0137] According to the content to be projected and the music content currently being played by the in-vehicle multimedia system, the content to be projected is controlled to be played synchronously with the music content.

[0138] The communication bus mentioned in the above terminal may be an in-vehicle Ethernet bus or a CAN FD (CAN with Flexible Data rate) bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0139] The communication interface is used for communication between the above terminal and other devices.

[0140] The memory may include a random access memory (RAM) or a non-volatile memory, such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0141] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0142] In another embodiment of the present invention, a computer-readable storage medium is provided. The computer-readable storage medium stores instructions. When the instructions are executed on a computer, the computer executes the vehicle-mounted projection control method described in any of the above embodiments.

[0143] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk (SSD)), etc.

[0144] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0145] Each embodiment in this specification is described in a related manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0146] The above description is only a preferred embodiment of the present invention and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims

1. A vehicle-mounted projection control method, characterized in that: Applied to a vehicle-mounted projection controller, the vehicle-mounted projection controller is communicatively connected with a vehicle-mounted multimedia system, and the method comprises: Collecting music content currently played by the in-vehicle multimedia system, performing feature extraction on the music content, and obtaining music features corresponding to the music content; According to the music features, a preset projection material library is traversed to obtain target projection materials, and the target projection materials are processed to generate content to be projected; According to the content to be projected and the music content currently being played by the in-vehicle multimedia system, the content to be projected is controlled to be played synchronously with the music content.

2. The method according to claim 1, characterized in that The collecting the music content currently played by the in-vehicle multimedia system, performing feature extraction on the music content, and obtaining the music features corresponding to the music content, includes: In response to monitoring that the in-vehicle multimedia system is in a playing state, collecting music content currently being played by the in-vehicle multimedia system; Using a preset audio algorithm to perform feature analysis on the music content, and extracting rhythm features, melody features, and timbre features of the music content; The rhythm features, melody features and timbre features are aggregated and processed to obtain music features corresponding to the music content.

3. The method according to claim 1, characterized in that The step of traversing a preset projection material library according to the music feature to obtain a target projection material, and processing the target projection material to generate content to be projected includes: Using the predetermined correspondence between music features and projection materials, traversing the preset projection material library, and obtaining the target projection material matching the music features; wherein the preset projection material library includes multiple types of projection materials, and the projection materials include multiple colors and dynamic effects; Adjusting the color and dynamic effects of the target projection material to match the music characteristics; The adjusted target projection materials are aggregated and processed to generate the content to be projected.

4. The method according to claim 1, characterized in that: The controlling the content to be projected to be played synchronously with the music content according to the content to be projected and the music content currently played by the in-vehicle multimedia system comprises: Adjusting the playback effect of the content to be projected to match the music content currently being played by the in-vehicle multimedia system; Respectively obtain the timestamps of the content to be projected and the music content currently being played; The timestamp is used to control the synchronous playing of the content to be projected and the music content.

5. The method according to claim 4, characterized in that The adjusting the playing effect of the content to be projected to match the music content currently played by the in-vehicle multimedia system includes: Obtain vehicle brightness, vehicle ambient temperature and vehicle driving status; Adjusting the projection brightness and color saturation of the content to be projected according to the vehicle brightness and vehicle ambient temperature; The dynamic effect of the content to be projected is adjusted according to the driving state of the vehicle; wherein the playing effect of the content to be projected matches the music content.

6. The method according to claim 4, characterized in that The using the timestamp to control the synchronous playing of the content to be projected and the music content includes: A high-pressure pump is used to adjust the water pressure to a preset pressure value for water spraying, thereby generating a projection water curtain in a preset area; In response to the consistency of the timestamps of the content to be projected and the music content, the content to be projected is projected onto a projection water curtain in a preset area, and the content to be projected is controlled to be played synchronously with the music content.

7. The method according to claim 1, characterized in that After controlling the synchronous playback of the content to be projected and the music content currently played by the in-vehicle multimedia system according to the content to be projected and the music content currently played by the in-vehicle multimedia system, the method further includes: In response to a control instruction input by a user, the playback of the content to be projected and the music content is adjusted.

8. A vehicle-mounted projection control device, characterized in that: Applied to a vehicle-mounted projection controller, the vehicle-mounted projection controller is communicatively connected with a vehicle-mounted multimedia system, and the device comprises: A music feature module, used to collect the music content currently played by the in-vehicle multimedia system, perform feature extraction on the music content, and obtain music features corresponding to the music content; A projection generation module is used to traverse a preset projection material library according to the music features, obtain target projection materials, process the target projection materials, and generate content to be projected; The projection control module is used to control the synchronous playing of the content to be projected and the music content currently played by the in-vehicle multimedia system according to the content to be projected.

9. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the instructions to implement the vehicle-mounted projection control method according to any one of claims 1 to 7.

10. A readable storage medium, characterized in that: The readable storage medium stores a computer program, and when the computer program is executed by a processor, the vehicle-mounted projection control method according to any one of claims 1 to 7 is implemented.