Vehicle voice image replacement method and device, vehicle and storage medium

Abstract

The invention relates to a vehicle voice image replacement method and device, a vehicle and a storage medium, and the method comprises the steps: collecting an in-vehicle image of the vehicle, and extracting face key feature points of a user from the in-vehicle image; based on the face key feature points, determining a face three-dimensional shape of the user, and obtaining face depth information of the user according to the face three-dimensional shape; and converting the face depth information into point cloud data, performing filtering processing on the point cloud data to obtain processed point cloud data, generating a face three-dimensional model of the user by using the processed point cloud data, and replacing the face three-dimensional model with the voice image of the vehicle. According to the embodiment of the invention, the face information recognized by the camera is converted into the three-dimensional model through the computer vision technology, and the recognized three-dimensional model is replaced by the voice image of the vehicle machine through the voice synthesis technology, so that the intelligent assistant has more personalized appearance and voice, and interactive experience closer to a user is provided.

Description

Technical Field

[0001] The present application relates to the field of vehicle driving assistance technology, and in particular to a method, device, vehicle and storage medium for replacing a voice image of a vehicle. Background Art

[0002] At present, in-vehicle voice has become one of the most important functions in modern cars. Users can interact with the interface through voice recognition and voice control without using a mouse, keyboard or physical buttons. The natural interaction method can reduce the user's burden and operation burden, thereby improving the user's operation efficiency and convenience.

[0003] In the related art, the voice image of the current vehicle can be configured according to the voice image resource file in accordance with the voice image protocol corresponding to the current vehicle, and the current voice image of the vehicle can be automatically changed when the application scenario switching conditions are met.

[0004] However, the related technology cannot obtain the voice image of the vehicle based on specific facial information, which makes it difficult to meet the personalized needs of users, reduces the user's interactive experience, and has low intelligence, which urgently needs to be improved. Summary of the invention

[0005] The present application provides a method, device, vehicle and storage medium for replacing the voice image of a vehicle to solve the problem that the related technology cannot obtain the voice image of the vehicle according to specific facial information, is difficult to meet the personalized needs of users, reduces the user's interactive experience, and has low intelligence.

[0006] The first aspect of the present application provides a method for replacing the voice image of a vehicle, comprising the following steps: capturing an in-vehicle image of the vehicle, and extracting key facial feature points of a user from the in-vehicle image; determining a three-dimensional face shape of the user based on the key facial feature points, and acquiring facial depth information of the user based on the three-dimensional face shape; converting the facial depth information into point cloud data, filtering the point cloud data to obtain processed point cloud data, and using the processed point cloud data to generate a three-dimensional face model of the user, so as to replace the three-dimensional face model with the voice image of the vehicle.

[0007] Optionally, in one embodiment of the present application, replacing the three-dimensional facial model with the voice image of the vehicle includes: converting preset text information into corresponding sound data, and extracting lip shape parameters corresponding to the sound data; inputting the sound data and the lip shape parameters into the three-dimensional facial model to synchronize the sound data with the lip shape to generate a synchronized voice image of the vehicle.

[0008] Optionally, in one embodiment of the present application, extracting the user's facial key feature points from the in-car image includes: extracting the user's facial image from the in-car image, and determining the user's facial area based on the facial image; locating at least one of the user's eyes, nose, mouth and eyebrows in the facial area.

[0009] Optionally, in one embodiment of the present application, the point cloud data is filtered to obtain processed point cloud data, and the processed point cloud data is used to generate a three-dimensional face model of the user, including: filtering the point cloud data to remove noise in the point cloud data to obtain the processed point cloud data; based on a preset triangulation algorithm, converting the processed point cloud data into a triangular mesh, and generating the three-dimensional face model of the user based on the triangular mesh.

[0010] Optionally, in an embodiment of the present application, it also includes: based on the personalized needs of the user, receiving the user's voice command; in response to the user's voice command, querying the corresponding voice image from a preset voice image database, and displaying the voice image.

[0011] The second aspect of the present application provides a device for replacing a voice image of a vehicle, comprising: an acquisition module for acquiring an in-vehicle image of the vehicle and extracting key facial feature points of a user from the in-vehicle image; a determination module for determining a three-dimensional face shape of the user based on the key facial feature points, and obtaining facial depth information of the user based on the three-dimensional face shape; a replacement module for converting the facial depth information into point cloud data, filtering the point cloud data to obtain processed point cloud data, and using the processed point cloud data to generate a three-dimensional face model of the user, so as to replace the three-dimensional face model with the voice image of the vehicle.

[0012] Optionally, in one embodiment of the present application, the replacement module includes: a conversion unit, used to convert preset text information into corresponding sound data, and extract lip shape parameters corresponding to the sound data; a synchronization unit, used to input the sound data and the lip shape parameters into the three-dimensional face model to synchronize the sound data with the lip shape and generate a synchronized voice image of the vehicle.

[0013] Optionally, in one embodiment of the present application, the acquisition module includes: a recognition unit, used to extract the facial image of the user from the in-vehicle image, and determine the facial area of ​​the user based on the facial image; a positioning unit, used to locate at least one key facial feature point of the user's eyes, nose, mouth and eyebrows within the facial area.

[0014] Optionally, in one embodiment of the present application, the replacement module also includes: a processing unit, used to filter the point cloud data to remove noise in the point cloud data and obtain the processed point cloud data; a generation unit, used to convert the processed point cloud data into a triangular mesh based on a preset triangulation algorithm, and generate a three-dimensional face model of the user based on the triangular mesh.

[0015] Optionally, in one embodiment of the present application, it also includes: a receiving module for receiving the user's voice instructions based on the user's personalized needs; a query module for responding to the user's voice instructions, querying the corresponding voice image from a preset voice image database, and displaying the voice image.

[0016] The third aspect of the present application provides a vehicle, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the vehicle voice image replacement method as described in the above embodiment.

[0017] The fourth aspect of the present application provides a computer-readable storage medium, which stores a computer program, and when the program is executed by a processor, it implements the above-mentioned method for replacing the voice image of a vehicle.

[0018] The embodiment of the present application uses computer vision and speech synthesis technology to convert the facial information recognized by the camera into a three-dimensional model through computer vision technology, and replace the recognized three-dimensional model with the voice image of the vehicle computer using speech synthesis technology, so that the smart assistant has a more personalized appearance and voice, provides an interactive experience closer to the user, enhances the emotional connection between the user and the smart assistant, and makes the voice interaction more natural and intuitive, improves the driver's attention to the smart assistant, thereby reducing the driver's pressure, making the driving process more pleasant, and improving the fun of the interaction. The intelligence is high. Therefore, it solves the problem that the related technology cannot obtain the voice image of the vehicle based on specific facial information, is difficult to meet the personalized needs of users, reduces the user's interactive experience, and has low intelligence.

[0019] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0021] Figure 1A flowchart of a method for replacing a voice image of a vehicle provided according to an embodiment of the present application;

[0022] Figure 2 A schematic diagram of a method for recognizing a face and replacing a voice image with a camera according to an embodiment of the present application;

[0023] Figure 3 This is a schematic diagram of the position of a face scanning camera in a vehicle according to an embodiment of the present application;

[0024] Figure 4 A schematic diagram of screen prompts during face recording according to an embodiment of the present application;

[0025] Figure 5 A schematic diagram showing the progress effect during voice image replacement according to an embodiment of the present application;

[0026] Figure 6 It is a structural schematic diagram of a vehicle voice image replacement device provided according to an embodiment of the present application;

[0027] Figure 7 It is a schematic diagram of the structure of a vehicle provided according to an embodiment of the present application. DETAILED DESCRIPTION

[0028] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0029] The following describes the voice image replacement method, device, vehicle and storage medium of the vehicle of the embodiment of the present application with reference to the accompanying drawings. In view of the problem that the related technology mentioned in the above background technology cannot obtain the voice image of the vehicle according to the specific face information, it is difficult to meet the personalized needs of the user, the user's interactive experience is reduced, and the intelligence is low, the present application provides a method for replacing the voice image of the vehicle, in which computer vision and speech synthesis technology are used to convert the face information recognized by the camera into a three-dimensional model through computer vision technology, and the recognized three-dimensional model is replaced with the voice image of the vehicle machine by using speech synthesis technology, so that the intelligent assistant has a more personalized appearance and sound, provides a more user-friendly interactive experience, enhances the emotional connection between the user and the intelligent assistant, and makes the voice interaction more natural and intuitive, improves the driver's attention to the intelligent assistant, thereby reducing the driver's pressure, making the driving process more pleasant, and improving the fun of the interaction. Thus, the problem that the related technology cannot obtain the voice image of the vehicle according to the specific face information, it is difficult to meet the personalized needs of the user, reduces the user's interactive experience, and has low intelligence is solved.

[0030] Specifically, Figure 1 A flowchart of a method for replacing a voice image of a vehicle provided in an embodiment of the present application.

[0031] like Figure 1 As shown, the vehicle voice image replacement method comprises the following steps:

[0032] In step S101, an in-vehicle image of a vehicle is collected, and key facial feature points of a user are extracted from the in-vehicle image.

[0033] It is understandable that the in-vehicle images in the embodiments of the present application can be captured by an in-vehicle camera. Figure 2 As shown in the figure, the user starts the car and activates the voice assistant system. The system starts to use the camera in the car for face recognition. The camera is located as shown in Figure 3 shown.

[0034] During the actual implementation process, the embodiment of the present application can perform face detection and use the in-vehicle camera to capture the vehicle's interior image to extract the user's facial key feature points from the in-vehicle image, thereby providing support for obtaining facial information and then generating a voice image.

[0035] Optionally, in one embodiment of the present application, extracting key facial feature points of a user from an in-car image includes: extracting a facial image of the user from the in-car image, and determining a facial area of ​​the user based on the facial image; locating at least one key facial feature point of the user among the eyes, nose, mouth and eyebrows within the facial area.

[0036] Among them, the embodiment of the present application can use a camera to capture images inside the car, extract the user's facial image from the images inside the car to determine the user's facial area, and locate the key points of the detected face to determine the key feature points on the face within the facial area, such as eyes, nose, mouth, eyebrows, etc.

[0037] The embodiment of the present application can determine the key feature points of the face, thereby further providing support for the subsequent generation of a voice image, thereby improving the user experience and enhancing the user's satisfaction with the product.

[0038] In step S102, the three-dimensional shape of the user's face is determined based on the key feature points of the face, and the user's face depth information is obtained according to the three-dimensional shape of the face.

[0039] It can be understood that the three-dimensional shape of the face in the embodiment of the present application can be determined by structured light technology.

[0040] During the actual implementation process, the embodiments of the present application can reconstruct the three-dimensional shape of the face based on the key feature points of the face and the three-dimensional coordinates obtained by scanning with structured light technology, and extract the user's facial depth information from the three-dimensional face shape, thereby providing a basis for subsequent changes in the voice image, thereby improving the user's usage experience and enhancing user satisfaction with the product.

[0041] In step S103, the facial depth information is converted into point cloud data, the point cloud data is filtered to obtain processed point cloud data, and the processed point cloud data is used to generate a three-dimensional facial model of the user, so as to replace the three-dimensional facial model with the voice image of the vehicle.

[0042] It is understandable that the conversion of point cloud data in the embodiment of the present application can be achieved by a graphics algorithm. In order to ensure that the generated 3D model is more detailed and more similar to the user, during the 3D model generation process, the system allows the user to shake his head left and right so that the acquired face depth information is richer. The screen interface prompts information such as Figure 4 shown.

[0043] Among them, the embodiment of the present application can convert facial depth information into point cloud data through a graphics algorithm, filter the point cloud data using a computer program to obtain processed point cloud data, and use the processed point cloud data to generate a three-dimensional facial model of the user to replace the three-dimensional facial model with the voice image of the vehicle.

[0044] The embodiment of the present application can use speech synthesis technology to replace the recognized three-dimensional model with the voice image of the vehicle computer, so that the smart assistant has a more personalized appearance and voice. By changing the voice image, the user experience can be improved and the user satisfaction with the product can be enhanced.

[0045] Optionally, in one embodiment of the present application, the point cloud data is filtered to obtain processed point cloud data, and the processed point cloud data is used to generate a three-dimensional face model of the user, including: filtering the point cloud data to remove noise in the point cloud data to obtain processed point cloud data; based on a preset triangulation algorithm, converting the processed point cloud data into a triangular mesh, and generating a three-dimensional face model of the user based on the triangular mesh.

[0046] It can be understood that the filtering process in the embodiment of the present application is a signal processing technology, the purpose of which is to extract required information from the signal or remove unnecessary interference components.

[0047] As a possible implementation method, the embodiment of the present application can filter the point cloud data to remove noise and unnecessary details in the point cloud data to obtain processed point cloud data. Based on the triangulation algorithm, the processed point cloud data is converted into a triangular mesh, and a three-dimensional face model of the user is generated based on the triangular mesh, thereby providing support for replacing the vehicle's voice image, thereby making the voice interaction more natural and intuitive, and enhancing the fun of the interaction.

[0048] Optionally, in one embodiment of the present application, the three-dimensional face model is replaced with the voice image of the vehicle, including: converting preset text information into corresponding sound data, and extracting lip shape parameters corresponding to the sound data; inputting the sound data and lip shape parameters into the three-dimensional face model to synchronize the sound data with the lip shape, and generating a synchronized voice image of the vehicle.

[0049] It is understandable that, in the embodiment of the present application, after the three-dimensional model is generated, the system will fuse the sound data into the three-dimensional model in the background and match the text with the mouth shape of the model. Figure 5 As shown, in order to make the user aware of the progress, the matching progress will be displayed on the central control page. The user can customize the name of the generated voice image and select it in the voice image selection interface. The system confirms the voice image selected by the user and starts using the selected voice image to respond to the user's voice commands and provide information.

[0050] During the actual implementation process, the embodiment of the present application can use a speech synthesis engine to convert preset text information into corresponding sound data, and extract the lip shape parameters corresponding to the sound data, merge the sound data and lip shape parameters into the three-dimensional face model, and perform real-time matching, control and adjustment to ensure that the sound matches the lip shape of the model, so as to synchronize the sound data and the lip shape and generate a synchronized voice image of the vehicle.

[0051] The embodiments of the present application can use speech synthesis technology to match a pre-recorded or generated voice image with text information, thereby generating a synchronized voice image of the vehicle and completing the replacement of the voice image, thereby making the smart assistant have a more personalized appearance and voice, providing a more user-friendly interactive experience, and enhancing the driver's attention to the smart assistant, thereby reducing the driver's stress and making the driving process more pleasant.

[0052] Optionally, in an embodiment of the present application, it also includes: based on the user's personalized needs, receiving the user's voice command; in response to the user's voice command, querying the corresponding voice image from a preset voice image database, and displaying the voice image.

[0053] Among them, the embodiments of the present application can obtain the user's personalized needs, and based on the user's personalized needs, receive the user's voice commands, respond to the user's voice commands, query the voice image that matches the user's personalized needs from the preset voice image database, and display the synchronized voice image in the vehicle's infotainment system.

[0054] The embodiments of the present application can select a suitable voice image according to the personalized needs of the user, so that the intelligent assistant has a more personalized appearance and voice, providing an interactive experience that is closer to the user, and by customizing the sound characteristics, emotional state or other attributes of the voice image, thereby enhancing the emotional connection between the user and the intelligent assistant.

[0055] According to the vehicle voice image replacement method proposed in the embodiment of the present application, computer vision and speech synthesis technology are used to convert the facial information recognized by the camera into a three-dimensional model through computer vision technology, and the recognized three-dimensional model is replaced with the voice image of the vehicle computer using speech synthesis technology, so that the smart assistant has a more personalized appearance and sound, provides an interactive experience closer to the user, enhances the emotional connection between the user and the smart assistant, and makes the voice interaction more natural and intuitive, thereby increasing the driver's attention to the smart assistant, thereby reducing the driver's pressure, making the driving process more pleasant, and improving the fun of the interaction. As a result, the problem that the relevant technology cannot obtain the voice image of the vehicle based on specific facial information, is difficult to meet the personalized needs of users, reduces the user's interactive experience, and has low intelligence is solved.

[0056] Next, the voice image replacement device for a vehicle proposed in accordance with an embodiment of the present application will be described with reference to the accompanying drawings.

[0057] Figure 6 It is a structural schematic diagram of a voice image replacement device for a vehicle according to an embodiment of the present application.

[0058] like Figure 6 As shown, the vehicle voice image replacement device 10 includes: a collection module 100, a determination module 200 and a replacement module 300.

[0059] Specifically, the acquisition module 100 is used to acquire the in-vehicle image of the vehicle and extract the key feature points of the user's face from the in-vehicle image.

[0060] The determination module 200 is used to determine the three-dimensional shape of the user's face based on the key feature points of the face, and obtain the user's face depth information according to the three-dimensional shape of the face.

[0061] The replacement module 300 is used to convert the facial depth information into point cloud data, filter the point cloud data to obtain processed point cloud data, and use the processed point cloud data to generate a three-dimensional facial model of the user to replace the three-dimensional facial model with the voice image of the vehicle.

[0062] Optionally, in one embodiment of the present application, the replacement module 300 includes: a conversion unit and a synchronization unit.

[0063] The conversion unit is used to convert the preset text information into corresponding sound data and extract the lip parameters corresponding to the sound data.

[0064] The synchronization unit is used to input the sound data and the lip shape parameters into the three-dimensional face model to synchronize the sound data and the lip shape and generate a synchronized voice image of the vehicle.

[0065] Optionally, in one embodiment of the present application, the acquisition module 100 includes: an identification unit and a positioning unit.

[0066] The recognition unit is used to extract the user's face image from the in-vehicle image and determine the user's facial area based on the face image.

[0067] The positioning unit is used to locate at least one key facial feature point of the user's eyes, nose, mouth and eyebrows in the facial area.

[0068] Optionally, in one embodiment of the present application, the replacement module 300 further includes: a processing unit and a generating unit.

[0069] The processing unit is used to filter the point cloud data to remove noise in the point cloud data and obtain processed point cloud data.

[0070] The generation unit is used to convert the processed point cloud data into a triangular mesh based on a preset triangulation algorithm, and generate a three-dimensional face model of the user according to the triangular mesh.

[0071] Optionally, in one embodiment of the present application, the vehicle voice image replacement device 10 further includes: a receiving module and a query module.

[0072] The receiving module is used to receive the user's voice command based on the user's personalized needs.

[0073] The query module is used to query the corresponding voice image from the preset voice image database in response to the user's voice command and display the voice image.

[0074] It should be noted that the above explanation of the embodiment of the vehicle voice image replacement method is also applicable to the vehicle voice image replacement device of this embodiment, and will not be repeated here.

[0075] According to the vehicle voice image replacement device proposed in the embodiment of the present application, computer vision and speech synthesis technology are used to convert the facial information recognized by the camera into a three-dimensional model through computer vision technology, and the recognized three-dimensional model is replaced with the voice image of the vehicle computer using speech synthesis technology, so that the smart assistant has a more personalized appearance and sound, provides an interactive experience closer to the user, enhances the emotional connection between the user and the smart assistant, and makes the voice interaction more natural and intuitive, thereby increasing the driver's attention to the smart assistant, thereby reducing the driver's pressure, making the driving process more pleasant, and improving the fun of the interaction. Therefore, the problem that the related technology cannot obtain the voice image of the vehicle based on specific facial information, is difficult to meet the personalized needs of users, reduces the user's interactive experience, and has low intelligence is solved.

[0076] Figure 7 A schematic diagram of the structure of a vehicle provided in an embodiment of the present application. The vehicle may include:

[0077] A memory 701 , a processor 702 , and a computer program stored in the memory 701 and executable on the processor 702 .

[0078] When the processor 702 executes the program, the method for replacing the voice image of the vehicle provided in the above embodiment is implemented.

[0079] Furthermore, the vehicle also includes:

[0080] The communication interface 703 is used for communication between the memory 701 and the processor 702 .

[0081] The memory 701 is used to store computer programs that can be executed on the processor 702 .

[0082] The memory 701 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0083] If the memory 701, the processor 702 and the communication interface 703 are implemented independently, the communication interface 703, the memory 701 and the processor 702 can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 7 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0084] Optionally, in a specific implementation, if the memory 701, the processor 702 and the communication interface 703 are integrated on a chip, the memory 701, the processor 702 and the communication interface 703 can communicate with each other through an internal interface.

[0085] The processor 702 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.

[0086] This embodiment also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the method for replacing the voice image of a vehicle as described above is implemented.

[0087] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or N embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0088] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0089] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or N executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0090] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or N wirings (electronic devices), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways as necessary and then storing it in a computer memory.

[0091] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiment, the N steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0092] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0093] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0094] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A method for replacing a vehicle's voice image, characterized in that: The following steps are involved: Collecting an in-vehicle image of the vehicle, and extracting key facial feature points of the user from the in-vehicle image; Determine the three-dimensional shape of the user's face based on the key feature points of the face, and obtain the user's face depth information according to the three-dimensional shape of the face; The facial depth information is converted into point cloud data, the point cloud data is filtered to obtain processed point cloud data, and the processed point cloud data is used to generate a three-dimensional facial model of the user, so as to replace the three-dimensional facial model with the voice image of the vehicle.

2. The method according to claim 1, characterized in that The step of replacing the three-dimensional face model with the voice image of the vehicle comprises: Converting the preset text information into corresponding sound data, and extracting the lip parameters corresponding to the sound data; The sound data and the lip shape parameters are input into the three-dimensional face model to synchronize the sound data with the lip shape and generate a synchronized voice image of the vehicle.

3. The method according to claim 1, characterized in that The step of extracting key facial feature points of the user from the in-vehicle image comprises: Extracting a facial image of the user from the in-vehicle image, and determining a facial region of the user according to the facial image; At least one key facial feature point of the user's eyes, nose, mouth and eyebrows is located in the facial area.

4. The method according to claim 1, characterized in that: The filtering process is performed on the point cloud data to obtain processed point cloud data, and the processed point cloud data is used to generate the three-dimensional face model of the user, including: Performing filtering processing on the point cloud data to remove noise in the point cloud data to obtain the processed point cloud data; Based on a preset triangulation algorithm, the processed point cloud data is converted into a triangular mesh, and a three-dimensional face model of the user is generated according to the triangular mesh.

5. The method according to claim 1, characterized in that Also includes: Based on the personalized needs of the user, receiving a voice command from the user; In response to the user's voice command, a corresponding voice image is searched from a preset voice image database, and the voice image is displayed.

6. A vehicle voice image replacement device, characterized in that: include: The acquisition module is used to acquire the in-vehicle image of the vehicle and extract the key feature points of the user's face from the in-vehicle image; A determination module, configured to determine a three-dimensional face shape of the user based on the key feature points of the face, and obtain face depth information of the user according to the three-dimensional face shape; A replacement module is used to convert the facial depth information into point cloud data, filter the point cloud data to obtain processed point cloud data, and use the processed point cloud data to generate a three-dimensional facial model of the user, so as to replace the three-dimensional facial model with the voice image of the vehicle.

7. The device according to claim 6, characterized in that The replacement module comprises: A conversion unit, used to convert the preset text information into corresponding sound data, and extract the lip parameters corresponding to the sound data; The synchronization unit is used to input the sound data and the lip shape parameters into the three-dimensional face model to synchronize the sound data with the lip shape and generate a synchronized voice image of the vehicle.

8. The device according to claim 7, characterized in that The acquisition module comprises: A recognition unit, configured to extract a facial image of the user from the in-vehicle image, and determine a facial region of the user based on the facial image; A positioning unit is used to locate at least one key facial feature point of the user's eyes, nose, mouth and eyebrows in the facial area.

9. A vehicle, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the method for replacing a voice image of a vehicle as described in any one of claims 1 to 5.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: The program is executed by a processor to implement the voice image replacement method for a vehicle as described in any one of claims 1 to 5.

Images