In-vehicle karaoke method, device, in-vehicle intelligent cockpit system and vehicle
By collecting voice trigger signals on the on-board microphone, using song recognition algorithms and audio analysis algorithms, convenient operation of on-board karaokes and seamless interconnection of multiple systems are achieved, solving the problems of cumbersome operations and safety hazards in the existing technology, and improving the in-car entertainment experience.
Patent Information
- Application Number
- CN202411938701.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-26
- Publication Date
- 2025-04-01
AI Technical Summary
In the prior art, the in-vehicle karaoke method has cumbersome processes, inconvenient operation, and safety hazards, and the software cannot be interconnected.
The user's voice trigger signal is collected through the vehicle microphone, the audio information is recognized using the song recognition algorithm, and output it to the target karaoke software for playback. At the same time, the music database and audio analysis algorithm are used to regulate the color and brightness of the atmosphere lights, and the seat position and air conditioning gear are adjusted.
It realizes convenient operation of in-car karaoke, reduces user operation complexity and safety risks, enhances in-car entertainment experience, and realizes seamless interconnection of multiple systems.
Smart Images

Figure CN119741902A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of automobile technology, and in particular to an in-vehicle karaoke method, device, in-vehicle intelligent cockpit system and vehicle. Background Art
[0002] With the development of automobile intelligence, the entertainment functions in the car cockpit are becoming more and more abundant. Among them, karaoke software and song recognition functions are loved by the majority of users. However, the intelligent linkage of hardware products has not been realized in the car cockpit at present. The microphone end is only used as an audio input device and cannot receive data from the car system. The product experience has great limitations. Entering the karaoke mode and turning on the song recognition function usually requires complex operations through the car display screen, and the software cannot be interconnected, requiring users to input across software, which poses a great safety hazard during driving and is not convenient enough to operate. Summary of the invention
[0003] The purpose of this application is to provide a method and device for in-vehicle karaoke singing, an in-vehicle intelligent cockpit system and a vehicle, so as to solve the problem of complicated process of the in-vehicle karaoke singing method in the prior art.
[0004] To achieve the above objectives, in a first aspect, an embodiment of the present application provides a vehicle-mounted karaoke method, which is applied to a vehicle-mounted intelligent cockpit system, comprising:
[0005] When a trigger signal of the vehicle microphone is collected, audio information is collected and recognized through the cabin microphone or the vehicle microphone; the trigger signal is achieved by the user touching the multi-function button of the vehicle microphone for a short time or pressing the multi-function button for a long time through voice control; the audio information is the voice demand information of the user;
[0006] The audio information is sent to a song recognition algorithm, and recognition and matching are performed by the song recognition algorithm to obtain a track recognition result;
[0007] The song recognition result is output to the corresponding target karaoke software, and the target karaoke software is used to play the recognized karaoke songs.
[0008] Optionally, after playing the identified karaoke songs using the target karaoke software, the method further includes:
[0009] Using a music database, obtaining album information of the karaoke song;
[0010] The color of the associated ambient light of the multifunctional linkage seat is determined according to the album cover color or the target color in the album information.
[0011] Optionally, after determining the color of the ambient light associated with the multifunctional linkage seat, the method further includes:
[0012] Using an audio analysis algorithm, extracting music rhythm features and music intensity features of the karaoke song;
[0013] According to the music rhythm characteristics and the music intensity characteristics, converting into brightness change parameters and color change parameters of the atmosphere light;
[0014] According to the brightness change parameter and the color change parameter, during the playing of the karaoke song, the brightness and color of the atmosphere light are correspondingly adjusted.
[0015] Optionally, after playing the identified karaoke songs using the target karaoke software, the method further includes:
[0016] According to the historical storage information, the seat position of the multi-function linkage seat is adjusted to the preset position, and the in-vehicle control is started to the corresponding gear position.
[0017] Optionally, the vehicle-mounted microphone comprises at least:
[0018] The shell meets automotive-grade requirements; the multi-function button is installed on the shell, can be pressed and rebound based on user operations, can recognize the user's continuous short-term touch or long-press operations, and output the vehicle-machine signal for controlling the on-board intelligent cockpit system based on the pressing operation.
[0019] Optionally, before collecting and identifying audio information through the cockpit microphone or the vehicle-mounted microphone, the method further includes:
[0020] Get current car information;
[0021] Determining whether a preset safety start condition is met according to the current vehicle use information;
[0022] When the conditions are met, the audio information is collected and recognized through the cockpit microphone or the vehicle-mounted microphone;
[0023] If the conditions are not met, the recognition audio information will not be collected.
[0024] Optionally, collecting and identifying audio information through a cockpit microphone or the vehicle-mounted microphone includes:
[0025] Collecting ambient sound data through a cockpit microphone or the vehicle-mounted microphone;
[0026] Determining whether there is user voice in the environmental sound data;
[0027] If yes, performing speech recognition on the user speech, and using the recognized user speech as the audio information;
[0028] If not, the music accompaniment audio in the environmental sound data is obtained, and the music accompaniment audio is used as the audio information.
[0029] In a second aspect, an embodiment of the present application provides a vehicle-mounted karaoke device, which is applied to a vehicle-mounted intelligent cockpit system, including:
[0030] A first processing module is used for collecting and identifying audio information through a cabin microphone or the vehicle-mounted microphone when a trigger signal of the vehicle-mounted microphone is collected; the trigger signal is realized by a user touching the multi-function button of the vehicle-mounted microphone for a short time or pressing the multi-function button for a long time through voice control; the audio information is the voice demand information of the user;
[0031] The second processing module is used to send the audio information to a song recognition algorithm, perform recognition and matching through the song recognition algorithm, and obtain a track recognition result;
[0032] The third processing module is used to output the song recognition result to the corresponding target karaoke software, and use the target karaoke software to play the recognized karaoke songs.
[0033] In a third aspect, an embodiment of the present application provides an in-vehicle smart cockpit system, comprising a computer-readable storage medium storing a computer program and a processor, wherein when the computer program is read and executed by the processor, the in-vehicle karaoke method as described in the first aspect is implemented.
[0034] In a fourth aspect, an embodiment of the present application provides a vehicle, comprising the on-board intelligent cockpit system as described in the third aspect.
[0035] The beneficial effects of the above technical solution of the present application are as follows:
[0036] Embodiments of the present application BRIEF DESCRIPTION OF THE DRAWINGS
[0037] Figure 1 One of the flow charts of the in-vehicle karaoke method provided in an embodiment of the present application;
[0038] Figure 2 The second flowchart of the in-vehicle karaoke method provided in an embodiment of the present application;
[0039] Figure 3 This is a structural diagram of the in-vehicle karaoke device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0040] In order to make the technical problems, technical solutions and advantages to be solved by the present application clearer, a detailed description will be given below with reference to the accompanying drawings and specific embodiments.
[0041] It should be understood that the references to "one embodiment" or "an embodiment" throughout the specification mean that the specific features, structures, or characteristics associated with the embodiment are included in at least one embodiment of the present application. Therefore, the references to "in one embodiment" or "in an embodiment" appearing throughout the specification do not necessarily refer to the same embodiment. In addition, these specific features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
[0042] In the embodiments of the present application, the term "and / or" describes the association relationship of the associated objects, indicating that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.
[0043] In the embodiments of the present application, the term "plurality" refers to two or more than two, and other quantifiers are similar.
[0044] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0045] The embodiments of the present application provide a method and device for in-vehicle karaoke, an in-vehicle intelligent cockpit system and a vehicle. The method and the device are based on the same application concept. Since the method and the device solve the problem in a similar way, the implementation of the device and the method can refer to each other, and the repeated parts will not be repeated.
[0046] Reference Figure 1 As shown, the embodiment of the present application provides a method for singing karaoke in a vehicle, which is applied to a vehicle intelligent cockpit system, comprising:
[0047] Step 11, when the trigger signal of the vehicle-mounted microphone is collected, audio information is collected and identified through the cockpit microphone or the vehicle-mounted microphone; the trigger signal is achieved by the user through voice control, continuously touching the multi-function button of the vehicle-mounted microphone for a short time or long pressing the multi-function button; the audio information is the user's voice demand information.
[0048] In the embodiment of the present application, the user's voice control is combined with the intelligent body of the vehicle-mounted microphone to perform voice recognition trigger signal, or the user presses the multi-function button of the vehicle-mounted microphone, and continuously touches the multi-function button of the vehicle-mounted microphone for a short time to generate the trigger signal of the vehicle-mounted microphone by short pressing twice or three times in a preset 2 to 3 seconds, or long pressing the multi-function button to achieve, for example, long pressing for more than 3 seconds to generate the trigger signal of the vehicle-mounted microphone. The vehicle-mounted microphone is connected to the vehicle-mounted intelligent cockpit system wirelessly or wired. When the vehicle-mounted intelligent cockpit system receives the trigger signal, it can use the cockpit microphone of the seat in the vehicle-mounted intelligent cockpit system to collect and identify audio information, or it can use the vehicle-mounted microphone to collect and identify audio information.
[0049] In another implementation, the present application utilizes both a cockpit microphone and a vehicle-mounted microphone to collect and identify audio information. The vehicle-mounted intelligent cockpit system merges and processes the two types of collected audio information to obtain merged target audio information, and uses the target audio information to identify songs.
[0050] Step 12, sending the audio information to a song recognition algorithm, performing recognition and matching through the song recognition algorithm, and obtaining a track recognition result;
[0051] Step 13, output the song recognition result to the corresponding target karaoke software, and use the target karaoke software to play the recognized karaoke songs.
[0052] It should be noted that the vehicle-mounted intelligent cockpit system includes: software with multiple recognition functions that can recognize songs by listening to them, various types of karaoke software, communication modules, seats, atmosphere lights, etc. The software with recognition functions and the karaoke software can be the same software or different software. In this application, the vehicle-mounted microphone is used in conjunction with the vehicle-mounted intelligent cockpit system.
[0053] In an embodiment of the present application, a song recognition algorithm is provided in the vehicle-mounted intelligent cockpit system. After acquiring the audio information, the audio information is sent to the song recognition algorithm, and identification and matching are performed through the song recognition algorithm to obtain a track recognition result. The track recognition result includes song name information and the type of karaoke software corresponding to the song name information. According to the track recognition result, the song name information is output to the corresponding target karaoke software, and the identified karaoke songs are played using the target karaoke software. The user can then use the vehicle-mounted microphone to sing karaoke in or outside the car.
[0054] Optionally, the vehicle-mounted microphone comprises at least:
[0055] The shell meets automotive-grade requirements; the multi-function button is installed on the shell, can be pressed and rebound based on user operations, can recognize the user's continuous short-term touch or long-press operations, and output the vehicle-machine signal for controlling the on-board intelligent cockpit system based on the pressing operation.
[0056] In an embodiment of the present application, the vehicle-mounted microphone provided by the present application is a multifunctional vehicle-mounted microphone for karaoke in the cockpit. The microphone has a button shell, a button assembly, a microphone head, a sound cavity, a preamplifier, a signal processing circuit, a control circuit, a USB connection interface, a Bluetooth module, a power module and other structures, wherein the functions of the buttons and their keys correspond to the control functions of the cockpit software.
[0057] Specifically, the in-vehicle microphone includes: (1) a shell; a shell that meets the requirements of automotive grade, with a layout of components including buttons and interfaces on the shell; the shell must be able to withstand temperature changes and vibrations in the car. At the same time, the shell design must be ergonomic, providing users with a comfortable grip experience and facilitating users to use the microphone in the car. It is made of sturdy and durable materials, such as high-strength engineering plastics or metal alloys, which can withstand a certain impact force to prevent the microphone from being damaged in collisions, bumps, etc. in the car; it has good sealing to prevent dust, moisture, etc. from entering the microphone and affecting its performance; the appearance design of the shell should be beautiful and match the interior decoration style of the car, and the heat dissipation problem should be considered to prevent the internal components of the microphone from overheating and affecting the performance or service life.
[0058] (2) Button assembly (i.e., multi-function button): installed on the housing, capable of being pressed and rebounded based on user operations, capable of identifying different user pressing operations (long press, continuous press), and outputting signals to control the vehicle based on the pressing operations; the button design should be ergonomic, and the size, shape, and touch of the button should be easy for the user to operate, and can be easily triggered whether in the driving process or when used by passengers. It should have good durability, be able to withstand frequent pressing operations, and maintain good touch and operation sensitivity after long-term use. The trigger feedback of the button should be obvious, such as slight tactile feedback or sound prompts, so that the user clearly knows that the operation has been received.
[0059] (3) Microphone: Converts external sound signals into weak electrical signals. When listening to songs and identifying songs, it is responsible for collecting the music sounds in the environment; when turning on the karaoke mode, it will also collect the user's speaking, singing and other sounds. The microphone must have high sensitivity and be able to clearly capture the sounds inside the car, including subtle music melodies and lyrics. It must have a good frequency response range to adapt to the sound collection of different types of music and ensure that the collected sound is not distorted. It must have strong anti-interference capabilities to reduce the impact of engine noise, wind noise and other electronic equipment interference on sound collection.
[0060] (4) Sound cavity: Optimizes sound collection and transmission, making the sound clearer and fuller. Through reasonable design, the resonance and reflection of the sound are adjusted to assist the microphone to better collect sound signals. The structural design of the sound cavity should be scientific and reasonable, and be able to match the characteristics of the microphone to achieve the best sound collection effect. The internal surface should be smooth to reduce energy loss and distortion during sound reflection. It should have a certain degree of sealing to prevent interference from external noise and prevent sound leakage in the sound cavity.
[0061] (5) Preamplifier: Preliminary amplification of the weak electrical signal output by the microphone to enhance the signal strength so that the subsequent processing module can process the signal more effectively. The preamplifier should have the characteristics of low noise and try not to introduce additional noise during the signal amplification process to avoid affecting the sound quality. It should also have high gain stability to ensure that it can provide a stable amplification factor under different working environments and input signal strengths. It should have a wide dynamic range and be able to adapt to input signals of different strengths to avoid signal overload or insufficient amplification.
[0062] (6) Signal processing circuit: Perform equalization, compression and other processing on the signal output by the preamplifier. For example, before transmitting to the vehicle computer, ensure that the sound signal is balanced at different frequencies to avoid the loss of certain frequencies or over-amplification during the signal transmission process. The signal processing circuit must have high-precision signal processing capabilities and be able to accurately equalize and compress signals of different frequencies; low distortion, maintaining the original characteristics of the signal as much as possible during signal processing to avoid introducing too much distortion; fast response, being able to process the signal in real time during signal conditioning without causing noticeable delays, ensuring the real-time nature of functions such as song recognition.
[0063] (7) Control circuit: The circuit has the functions of identifying button operation instructions, coordinating the work and communication between the various components of the microphone, etc. When a long-press button operation is detected, the microphone is triggered to enter the relevant process of listening to songs and identifying songs; when a continuous double-click button operation is detected, a command is sent to start the karaoke mode customized by the car computer. The control circuit must have high-precision button operation recognition capabilities, and be able to accurately distinguish different operations such as long press and double click to avoid false triggering; it must have a reliable communication interface to establish a stable and high-speed communication connection with the car computer to ensure the accurate transmission of sound signals and control instructions. It must have high reliability and durability, because the vehicle environment may have vibrations and other conditions, and it must be ensured that the control circuit will not malfunction during long-term use.
[0064] (8) USB interface: provides a wired data transmission and charging method. The USB interface can be connected to the vehicle computer or other devices to transmit data (such as transmitting the configuration information of the microphone, etc.), and it can also charge the built-in rechargeable battery of the microphone. The USB interface must comply with relevant USB standards to ensure compatibility with other devices; the interface must be firm and reliable, and will not become loose or have poor contact in the event of bumps during driving; it must have a certain data transmission speed to meet the data exchange requirements between the microphone and external devices, and ensure that the audio is stably input into the cockpit for song recognition.
[0065] (9) Bluetooth module: realizes wireless communication between the microphone and the vehicle computer or other Bluetooth devices. It is used to transmit sound signals, control commands and other information, so that users can use the microphone in the car without using a wired connection. The Bluetooth module must comply with the Bluetooth communication standard, have good compatibility, and be able to stably connect with a variety of Bluetooth devices; have strong signal transmission capabilities, and be able to ensure stable signal transmission in the complex electromagnetic environment of the car, avoid disconnection or signal interference, and ensure stable audio input to the cockpit for listening to songs and identifying songs; low power consumption, while ensuring communication functions, minimize the consumption of microphone power and extend the use time of the microphone.
[0066] (10) Power module: Provides a stable power supply for each component inside the microphone. Power can be obtained through the vehicle power supply (such as the cigarette lighter interface) or the built-in rechargeable battery, and converted into the operating voltage required by each component. The power module must have high power conversion efficiency to reduce energy loss and ensure that the microphone will not experience performance degradation or failure due to power supply problems during use; it must have safety functions such as overcharge protection and over-discharge protection to protect the safety of the battery and other components and extend the service life of the microphone; it must have good compatibility with the vehicle power interface, be able to obtain power from the vehicle power supply stably, and will not interfere with the vehicle electronic system during the charging process.
[0067] Optionally, after playing the identified karaoke songs using the target karaoke software, the method further includes:
[0068] Using a music database, obtaining album information of the karaoke song;
[0069] The color of the associated ambient light of the multifunctional linkage seat is determined according to the album cover color or the target color in the album information.
[0070] In an embodiment of the present application, the in-vehicle intelligent cockpit system has the ability to identify the color of song albums. It can obtain the album information of the currently playing karaoke songs by connecting to the music database, and determine the color of the atmosphere light based on the album cover color or specific color identification.
[0071] Optionally, after determining the color of the ambient light associated with the multifunctional linkage seat, the method further includes:
[0072] Using an audio analysis algorithm, extracting music rhythm features and music intensity features of the karaoke song;
[0073] According to the music rhythm characteristics and the music intensity characteristics, converting into brightness change parameters and color change parameters of the atmosphere light;
[0074] According to the brightness change parameter and the color change parameter, during the playing of the karaoke song, the brightness and color of the atmosphere light are correspondingly adjusted.
[0075] In the embodiment of the present application, the atmosphere light should be able to dynamically change according to the rhythm and melody of the music to achieve the effect of following the rhythm of the music. The present application can extract the music rhythm, music intensity and other characteristics of the karaoke song through the audio analysis algorithm, and convert them into parameters such as the brightness and color change of the atmosphere light, so as to create a more vivid and infectious karaoke atmosphere.
[0076] Optionally, after playing the identified karaoke songs using the target karaoke software, the method further includes:
[0077] According to the historical storage information, the seat position of the multi-function linkage seat is adjusted to the preset position, and the in-vehicle control is started to the corresponding gear position.
[0078] In an embodiment of the present application, after the target karaoke software is used to play the identified karaoke songs, that is, when the vehicle-mounted intelligent cockpit system enters the "karaoke mode", the seat position should be automatically adjusted according to the historical storage information, that is, according to the stored user settings, and the adjustment process should be smooth and quiet, and should not cause interference or discomfort to the user. At the same time, the adjusted seat position should accurately meet the user's expectations and provide the user with the best riding experience. The vehicle-mounted air conditioner in this application should turn on automatically and adjust to the corresponding gear according to the stored user settings. The air conditioning startup and adjustment process should be fast and stable, and should not cause interference or discomfort to the user. At the same time, the adjusted air conditioning state should meet the user's expectations and provide the user with a comfortable karaoke environment.
[0079] In a specific embodiment, an in-vehicle smart cockpit system linked to in-vehicle karaoke includes: software with the function of preparing to listen to songs and identifying songs: the software must have the ability to recognize and match audio, have sufficient audio resources for matching, and be able to receive signals to start and transmit signals to other functional modules in the cockpit.
[0080] When it is detected that the song recognition function is turned on (through touch, voice control or long pressing the microphone button), the cockpit microphone is used to collect and identify audio (through the microphone if the microphone button is long pressed), and the identified audio stream is sent to the recognition algorithm. The recognition algorithm is used to perform track recognition and matching on the identified audio stream to obtain the track recognition result, and the recognition result is output to the karaoke software (which can be the same software).
[0081] Karaoke software suitable for in-car scenarios: The software should have sufficient song resources, song search function, audio processing function and other functions required for karaoke, and should match the in-car environment and be able to receive signals to start.
[0082] When the user enters the "Karaoke Mode" by short-pressing the multi-function button continuously, the cockpit with "Karaoke Mode" multi-function linkage will include: a system and software linked to the multi-function button, seats with electronic adjustment, setting storage and linkage functions, ambient lights with linkage and music rhythm functions, air conditioning with automatic opening, adjustment and setting storage functions, etc.
[0083] Preferably, the multi-function button of the vehicle-mounted microphone is a physical button or a touch button.
[0084] Preferably, the multi-function button is provided with vibration feedback. More preferably, vibration feedback is provided when the pairing with the cockpit is successful, the recognition is successful, etc.
[0085] Preferably, the vehicle-mounted microphone can be fixed by means of magnetism or the like.
[0086] Preferably, the vehicle-mounted microphone can be recharged by wireless charging.
[0087] Preferably, the vehicle-mounted microphone can control the audio volume.
[0088] Preferably, a pattern protrusion is provided on the side surface of the body of the multi-function button of the vehicle-mounted microphone and / or on the surface of the multi-function button.
[0089] Preferably, a fingerprint recognition device is provided on the surface of the multi-function button.
[0090] Preferably, the vehicle-mounted microphone can communicate with the vehicle-mounted intelligent cockpit system via WIFI, USB data cable or other forms.
[0091] Preferably, the vehicle-mounted microphone may be provided with an ambient light capable of being linked with the cabin ambient light in color and melody.
[0092] Preferably, the cockpit of the in-vehicle intelligent cockpit system has a programmable cockpit / shortcut command or similar capabilities to realize a karaoke mode.
[0093] Preferably, the karaoke software in the in-vehicle smart cockpit system has the function of identifying songs by listening to them.
[0094] Preferably, the karaoke software of the in-vehicle smart cockpit system has a social interaction function, which facilitates users to interact and share their works.
[0095] Optionally, before collecting and identifying audio information through the cockpit microphone or the vehicle-mounted microphone, the method further includes:
[0096] Get current car information;
[0097] Determining whether a preset safety start condition is met according to the current vehicle use information;
[0098] When the conditions are met, the audio information is collected and recognized through the cockpit microphone or the vehicle-mounted microphone;
[0099] If the conditions are not met, the recognition audio information will not be collected.
[0100] In an embodiment of the present application, the current vehicle usage information includes vehicle status information and vehicle location information; when it is determined that the vehicle is in a parking state based on the vehicle status information, and when it is determined that the vehicle is in a safe position based on the vehicle location information and the preset map information, it is determined that the preset safety startup conditions are met; otherwise, it is determined that the preset safety startup conditions are not met.
[0101] Specifically, since the singing function is recommended to be turned on only after the vehicle is stable and safe, the vehicle usage information needs to be determined, and whether the preset safety start conditions are met based on the vehicle usage information. When the preset safety start conditions are met, the karaoke function can be started, and then the cockpit microphone or the vehicle microphone is used to collect and identify audio information. If the preset safety start conditions are not met, the karaoke function cannot be started, and you can wait until the vehicle stops to determine whether the preset safety start conditions are met.
[0102] The current vehicle usage information includes vehicle status information and vehicle location information; when it is determined that the vehicle is in a parked state based on the vehicle status information, and when it is determined that the vehicle is in a safe position based on the vehicle location information and the preset map information, it is determined that the preset safety start condition is met; otherwise, it is determined that the preset safety start condition is not met. When and only when the current vehicle usage information meets the above two conditions, it can be determined that the preset safety start condition is met.
[0103] Optionally, collecting and identifying audio information through a cockpit microphone or the vehicle-mounted microphone includes:
[0104] Collecting ambient sound data through a cockpit microphone or the vehicle-mounted microphone;
[0105] Determining whether there is user voice in the environmental sound data;
[0106] If yes, performing speech recognition on the user speech, and using the recognized user speech as the audio information;
[0107] If not, the music accompaniment audio in the environmental sound data is obtained, and the music accompaniment audio is used as the audio information.
[0108] In an embodiment of the present application, ambient sound data is collected through a cockpit microphone or the vehicle-mounted microphone; it is determined whether there is user voice in the ambient sound data; if there is user voice, the recognized user voice is used as the audio information, and the user's audio information can be used to determine the song name information that the user wants to find; if there is no user voice, it may be music accompaniment audio played by the user, and the music accompaniment audio is used as the audio information, and the song name that the user wants to find can also be determined subsequently.
[0109] Furthermore, after the song name is fed back to the user, song parameter information input by the user is obtained, the song parameter information including track information, volume information and sound effect mode information; the song parameter information includes track information, volume information and sound effect mode information; a target sound effect mode is started from the several sound effect modes, the target sound effect mode corresponds to the sound effect information; a song corresponding to the track information is played in the target sound effect mode, and the volume is adjusted according to the volume information; the volume information includes microphone volume information and system volume information, and the sound effect mode information includes KTV mode, recording studio mode, concert hall mode and original sound mode.
[0110] In summary, this application can achieve: (1) One-click karaoke: When the user plays songs in the cockpit in any form (cockpit audio, mobile phone speaker, passenger humming, etc.), the user can enter the song recognition mode by long pressing the button on the microphone. The microphone inputs the audio information during the long press period into the cockpit with the song recognition function. After the cockpit software recognizes the song, it outputs the song name to the karaoke software, which searches for the song and starts singing. (2) One-click karaoke mode: Short press the multi-function button twice in a row to quickly open the karaoke software and turn on the cabin "karaoke mode" (the seats, air conditioning, and ambient lights are adjusted to the set values).
[0111] Reference Figure 2As shown in the flowchart, in this application, when a user hears a song he wants to sing, the user can take out the microphone (here it is the car microphone) and press it for a long time to listen to the song and identify the song. The subsequent car system (car smart cockpit system) performs an automated process, which includes: the microphone inputs the collected audio into the music software, the software identifies the music being played, outputs the music name to the karaoke software, and the karaoke software enters the corresponding song. This automated process avoids the drawback of the prior art that the user needs to open the car system or software, search for songs, and enter the song name before singing karaoke.
[0112] This application adopts a unique button operation method: a specific operation of the button on the car microphone housing, that is, long pressing the button to listen to the song and identify the song and enter the karaoke, and double-clicking the button continuously to open the karaoke mode customized by the car machine. This design integrates multiple functions on one button and triggers different functions through different operation methods.
[0113] The application breaks the limitation of traditional karaoke mode, allowing users to use various forms of audio as trigger sources, greatly enriching the in-car entertainment scene. Whether listening to music played by the cockpit audio system during a long journey, playing your favorite songs on your mobile phone in a relaxed atmosphere, or even humming impromptu, it can be an opportunity to start karaoke, bringing more joy and interaction to users; this unique button operation method is different from the operation of traditional in-car entertainment equipment, which greatly simplifies the user operation process and improves the user experience.
[0114] The vehicle microphone of the present application collects sound and transmits it to the vehicle computer for song recognition. The vehicle computer automatically inputs the recognition result into the karaoke software and enters the karaoke, and triggers the vehicle computer to start the customized karaoke mode through the microphone button operation. This involves efficient and stable data transmission between the microphone and the vehicle computer and fast collaborative work at the software level. The interactive process of the present application can ensure the advancement in the field of in-vehicle entertainment systems. The advantages of the present application are:
[0115] 1. Operation convenience is greatly improved:
[0116] In the prior art, to achieve the process from listening to songs to singing karaoke, users usually need to perform a series of complex operations on the car screen, such as searching for the entrance to the song recognition function in multiple menus, and then manually opening the karaoke software and searching for the recognized songs. This method is not only cumbersome to operate, but also easily distracts the driver's attention during driving, increasing safety risks.
[0117] This application sets a button on the car microphone. Users only need to press and hold the button to start the song recognition function. The car computer automatically recognizes the song and inputs the result into the karaoke software to enter the karaoke state; double-clicking the button continuously can directly open the karaoke mode customized by the car computer. This one-click operation greatly simplifies the operation process. Users do not need to perform complex operations on the car computer screen, which improves the convenience and efficiency of operation and reduces safety risks during driving.
[0118] 2. Wider application scenarios:
[0119] Existing technologies can often only identify songs from specific sources, such as music played by the car computer or audio played by specific music software. However, this application can identify songs played in any form in the cabin, including cockpit audio, mobile phone speakers, and passengers humming. This greatly broadens the usage scenarios and meets the entertainment needs of users in different situations. Whether you are listening to music played by the cockpit audio on a long journey, or playing your favorite songs on your mobile phone with friends, or even humming impromptu, you can easily start song recognition and enter karaoke mode, bringing users a richer and more diverse entertainment experience.
[0120] 3. Better intelligent interaction experience:
[0121] In the prior art, the functions of song recognition and karaoke are usually independent and require users to operate and set them separately. However, this application realizes the seamless connection between song recognition and karaoke software. After the car computer recognizes the song, it automatically inputs the result into the karaoke software, without the need for users to manually search and enter the song name. This intelligent interaction method not only improves the convenience of operation, but also brings users a smoother and more coherent entertainment experience.
[0122] A series of functions in this application integrate multiple technical fields such as audio recognition, cross-module signal connection, seat control, atmosphere light control and air conditioning control. The convenient operation of this application provides a pleasant and safe entertainment experience: when the traditional in-vehicle entertainment system turns on the karaoke function, users often need to perform a series of cumbersome operations, such as searching for songs, adjusting the volume, setting sound effects, etc. on the car computer. These operations are not only time-consuming, but also distract users and affect the entertainment experience. However, this application simplifies these complex operation processes into a simple button action through a one-button start method, allowing users to quickly enter the karaoke state at the moment of inspiration. Whether you are moved by the songs on the radio during a long journey, or humming to relieve boredom when you are stuck in a traffic jam, you can use simple button operations to transform these instantaneous music impulses into actual karaoke actions, greatly enriching the user's in-car entertainment experience; during driving, any complex operation may cause the driver to be distracted and increase the risk of traffic accidents. This application allows users to turn on karaoke-related functions without focusing too much attention on the car screen for complex operations, and only needs to perform simple button operations at the familiar microphone position. This effectively reduces the time the driver takes their eyes off the road to operate the entertainment system, reduces the possibility of traffic accidents caused by distraction, and provides a certain degree of protection for driving safety.
[0123] Reference Figure 3 As shown, the embodiment of the present application provides a vehicle-mounted karaoke device, which is applied to a vehicle-mounted intelligent cockpit system, including:
[0124] The first processing module 31 is used to collect and identify audio information through the cabin microphone or the vehicle-mounted microphone when a trigger signal of the vehicle-mounted microphone is collected; the trigger signal is realized by the user touching the multi-function button of the vehicle-mounted microphone for a short time or pressing the multi-function button for a long time through voice control; the audio information is the voice demand information of the user;
[0125] The second processing module 32 is used to send the audio information to the song recognition algorithm, perform recognition and matching through the song recognition algorithm, and obtain a track recognition result;
[0126] The third processing module 33 is used to output the song recognition result to the corresponding target karaoke software, and use the target karaoke software to play the recognized karaoke songs.
[0127] Optionally, in the embodiment of the present application, the above-mentioned in-vehicle karaoke device further includes:
[0128] The fourth processing module is used to obtain the album information of the karaoke song by using the music database;
[0129] The first determination module is used to determine the color of the associated ambient light of the multifunctional linkage seat according to the album cover color or the target color in the album information.
[0130] Optionally, in the embodiment of the present application, the above-mentioned in-vehicle karaoke device further includes:
[0131] A fifth processing module is used to extract the music rhythm characteristics and music intensity characteristics of the karaoke song by using an audio analysis algorithm;
[0132] A sixth processing module, used for converting the music rhythm characteristics and the music intensity characteristics into brightness change parameters and color change parameters of the atmosphere light;
[0133] The seventh processing module is used to adjust the brightness and color of the atmosphere light accordingly during the playing of the karaoke song according to the brightness change parameter and the color change parameter.
[0134] Optionally, in the embodiment of the present application, the above-mentioned in-vehicle karaoke device further includes:
[0135] The eighth processing module is used to adjust the seat position of the multifunctional linkage seat to a preset position according to the historical storage information, and start the in-vehicle control to a corresponding gear position.
[0136] Optionally, the vehicle-mounted microphone comprises at least:
[0137] The shell meets automotive-grade requirements; the multi-function button is installed on the shell, can be pressed and rebound based on user operations, can recognize the user's continuous short-term touch or long-press operations, and output the vehicle-machine signal for controlling the on-board intelligent cockpit system based on the pressing operation.
[0138] Optionally, in the embodiment of the present application, the above-mentioned in-vehicle karaoke device further includes:
[0139] The acquisition module is used to obtain the current vehicle information;
[0140] A judgment module, used to judge whether a preset safety start condition is met according to the current vehicle use information;
[0141] A ninth processing module, configured to collect and identify audio information through a cabin microphone or the vehicle-mounted microphone when the conditions are met;
[0142] The tenth processing module is used for not collecting and identifying audio information when the conditions are not met.
[0143] Optionally, the first processing module 31 is specifically used for:
[0144] Collecting ambient sound data through a cockpit microphone or the vehicle-mounted microphone;
[0145] Determining whether there is user voice in the environmental sound data;
[0146] If yes, performing speech recognition on the user speech, and using the recognized user speech as the audio information;
[0147] If not, the music accompaniment audio in the environmental sound data is obtained, and the music accompaniment audio is used as the audio information.
[0148] Among them, the implementation embodiments of the above-mentioned in-vehicle karaoke method are all applicable to the embodiments of the in-vehicle karaoke device, and can also achieve the same technical effects.
[0149] The embodiment of the present application provides a vehicle-mounted intelligent cockpit system, including a computer-readable storage medium storing a computer program and a processor. When the computer program is read and executed by the processor, the following is implemented: Figure 1 The in-car karaoke method.
[0150] An embodiment of the present application provides a vehicle, comprising the in-vehicle intelligent cockpit system as described above.
[0151] A readable storage medium in an embodiment of the present application stores a program or instruction thereon. When the program or instruction is executed by a processor, the steps in the in-vehicle karaoke method as described above are implemented and the same technical effect can be achieved. To avoid repetition, it will not be described here.
[0152] The processor is the processor in the in-vehicle karaoke method described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0153] The present application also provides a computer program product, including computer instructions, which, when executed by a processor, implement the above Figure 1 or Figure 2 The various processes of the method embodiment shown can achieve the same technical effect, and will not be described again here to avoid repetition.
[0154] The above exemplary embodiments are described with reference to the accompanying drawings, and many different forms and embodiments are feasible without departing from the spirit and teachings of the present application. Therefore, the present application should not be constructed as a limitation of the exemplary embodiments proposed herein. More specifically, these exemplary embodiments are provided so that the present application will be perfect and complete, and the scope of the present application will be conveyed to those who are familiar with the technology. In these figures, the component sizes and relative sizes may be exaggerated for clarity. The terms used here are only based on the purpose of describing specific exemplary embodiments and are not intended to be limiting. As used herein, unless the text clearly indicates otherwise, the singular forms "one", "an" and "the" are intended to include these multiple forms. It will be further understood that the terms "comprising" and / or "including" when used in this specification indicate the presence of the features, integers, steps, operations, components and / or components, but do not exclude the presence or increase of one or more other features, integers, steps, operations, components, components and / or their groups. Unless otherwise indicated, when stated, a range of values includes the upper and lower limits of that range and any subranges therebetween.
[0155] The above is a preferred embodiment of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles described in the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.
Claims
1. A car karaoke method, characterized in that: Applied to vehicle-mounted intelligent cockpit systems, including: When a trigger signal of the vehicle microphone is collected, audio information is collected and recognized through the cabin microphone or the vehicle microphone; the trigger signal is achieved by the user touching the multi-function button of the vehicle microphone for a short time or pressing the multi-function button for a long time through voice control; the audio information is the voice demand information of the user; The audio information is sent to a song recognition algorithm, and recognition and matching are performed by the song recognition algorithm to obtain a track recognition result; The song recognition result is output to the corresponding target karaoke software, and the target karaoke software is used to play the recognized karaoke songs.
2. The method according to claim 1, characterized in that After using the target karaoke software to play the identified karaoke songs, the method further includes: Using a music database, obtaining album information of the karaoke song; The color of the associated ambient light of the multifunctional linkage seat is determined according to the album cover color or the target color in the album information.
3. The method according to claim 2, characterized in that After determining the associated ambient light color of the multifunctional linkage seat, the method further includes: Using an audio analysis algorithm, extracting music rhythm features and music intensity features of the karaoke song; According to the music rhythm characteristics and the music intensity characteristics, converting into brightness change parameters and color change parameters of the atmosphere light; According to the brightness change parameter and the color change parameter, during the playing of the karaoke song, the brightness and color of the atmosphere light are correspondingly adjusted.
4. The method according to claim 1, characterized in that: After using the target karaoke software to play the identified karaoke songs, the method further includes: According to the historical storage information, the seat position of the multi-function linkage seat is adjusted to the preset position, and the in-vehicle control is started to the corresponding gear position.
5. The method according to claim 1, characterized in that The vehicle-mounted microphone at least comprises: The shell meets automotive-grade requirements; the multi-function button is installed on the shell, can be pressed and rebound based on user operations, can recognize the user's continuous short-term touch or long-press operations, and output the vehicle-machine signal for controlling the on-board intelligent cockpit system based on the pressing operation.
6. The method according to claim 1, characterized in that Before collecting and identifying audio information through the cockpit microphone or the vehicle-mounted microphone, the method further includes: Get current car information; Determining whether a preset safety start condition is met according to the current vehicle use information; When the conditions are met, the audio information is collected and recognized through the cockpit microphone or the vehicle-mounted microphone; If the conditions are not met, the recognition audio information will not be collected.
7. The method according to claim 1, characterized in that The audio information is collected and recognized through the cockpit microphone or the vehicle microphone, including: Collecting ambient sound data through a cockpit microphone or the vehicle-mounted microphone; Determining whether there is user voice in the environmental sound data; If yes, performing speech recognition on the user speech, and using the recognized user speech as the audio information; If not, the music accompaniment audio in the environmental sound data is obtained, and the music accompaniment audio is used as the audio information.
8. A car-mounted karaoke device, characterized in that: Applied to vehicle-mounted intelligent cockpit systems, including: A first processing module is used for collecting and identifying audio information through a cabin microphone or the vehicle-mounted microphone when a trigger signal of the vehicle-mounted microphone is collected; the trigger signal is realized by a user touching the multi-function button of the vehicle-mounted microphone for a short time or pressing the multi-function button for a long time through voice control; the audio information is the voice demand information of the user; The second processing module is used to send the audio information to a song recognition algorithm, perform recognition and matching through the song recognition algorithm, and obtain a track recognition result; The third processing module is used to output the song recognition result to the corresponding target karaoke software, and use the target karaoke software to play the recognized karaoke songs.
9. An in-vehicle intelligent cockpit system, characterized in that: It comprises a computer-readable storage medium storing a computer program and a processor, and when the computer program is read and executed by the processor, the in-vehicle karaoke method as claimed in any one of claims 1 to 7 is implemented.
10. A vehicle, characterized in that: Comprising the in-vehicle intelligent cockpit system as claimed in claim 9.