Real-time voice evaluation and analysis method and system based on text-to-voice technology

Abstract

The invention relates to the technical field of voice interview, and particularly discloses a real-time voice evaluation and analysis method and system based on a text-to-voice technology, and the method comprises the steps: receiving a resume uploaded by a user, analyzing the resume, and determining a keyword; reading interview questions from a pre-constructed question bank based on the keywords, screening and classifying the interview questions, and importing the interview questions into a knowledge base; creating an interview scene based on the knowledge base, obtaining a user interview condition in real time, and generating a test result; and feeding back a test result to the user, and synchronously generating an interview suggestion. The real-time evaluation method based on the large model and the TTS technology are combined, the automatic and multi-dimensional voice evaluation function is achieved, the voice evaluation efficiency and accuracy are improved, immediate feedback and improvement suggestions are provided, and the user is helped to have better performance in interview and training.

Description

Technical Field

[0001] The present invention relates to the field of voice interview technology, and in particular to a real-time voice evaluation and analysis method and system based on text-to-speech technology. Background Art

[0002] Current speech assessment tools usually rely on manual judgment, which is highly subjective and inefficient. Traditional methods are difficult to provide immediate feedback and cannot meet the needs of users in interviews and training. The main defects include: 1. Low efficiency: manual assessment requires a lot of time and manpower; 2. High subjectivity: assessment results vary from person to person and lack consistency; 3. Delayed feedback: It is impossible to provide improvement suggestions in real time.

[0003] The technical problem that the technical solution of the present invention intends to solve is how to provide an efficient and accurate speech evaluation tool by combining text-to-speech (TTS) technology and big data analysis. Summary of the invention

[0004] The object of the present invention is to provide a real-time speech evaluation and analysis method and system based on text-to-speech technology to solve the problems raised in the above background technology.

[0005] To achieve the above object, the present invention provides the following technical solutions:

[0006] A real-time speech evaluation and analysis method based on text-to-speech technology, the method comprising:

[0007] Receiving a resume uploaded by a user, parsing the resume, and determining keywords;

[0008] Read interview questions from the pre-built question bank based on keywords, filter and classify them, and then import them into the knowledge base;

[0009] Create an interview scenario based on the knowledge base, obtain user interview situations in real time, and generate test results;

[0010] Feedback test results to users and generate interview suggestions simultaneously.

[0011] As a further solution of the present invention: the steps of creating an interview scenario based on the knowledge base, obtaining the user interview situation in real time, and generating a test result include:

[0012] Search for basic knowledge questions in the knowledge base based on keywords;

[0013] Simulate a high-pressure interview environment based on existing high-pressure interview scenarios;

[0014] Use TTS technology to convert basic knowledge questions into voice to simulate real conversations;

[0015] Obtain the user's interview status in real time and generate test results.

[0016] As a further solution of the present invention: the step of obtaining the user's interview situation in real time and generating the test result includes:

[0017] Obtain the user's interview images and audio in real time;

[0018] Recognizing the interview image and generating a capability assessment report;

[0019] Convert interview audio into text, recognize the text, and generate a knowledge assessment report;

[0020] Statistical ability assessment report and knowledge assessment report to get the test results.

[0021] As a further solution of the present invention: the step of feeding back the test results to the user and simultaneously generating interview suggestions includes:

[0022] Read and identify competency assessment reports and knowledge assessment reports, generate interview suggestions, and insert competency assessment reports and knowledge assessment reports;

[0023] Provide competency assessment reports and knowledge assessment reports with interview suggestions to users.

[0024] The technical solution of the present invention also provides a real-time speech evaluation and analysis system based on text-to-speech technology, the system comprising:

[0025] A resume parsing module, used to receive a resume uploaded by a user, parse the resume, and determine keywords;

[0026] The question acquisition module is used to read interview questions from the pre-built question bank based on keywords, filter and classify them, and then import them into the knowledge base;

[0027] An interview scenario building module is used to create interview scenarios based on the knowledge base, obtain user interview situations in real time, and generate test results;

[0028] The test result feedback module is used to feed back the test results to the user and simultaneously generate interview suggestions.

[0029] As a further solution of the present invention: the interview scene tower building module includes:

[0030] A topic query unit is used to query basic knowledge topics in the knowledge base based on keywords;

[0031] Environmental simulation unit, used to simulate high-pressure interview environment based on existing high-pressure interview scenarios;

[0032] The dialogue conversion unit is used to convert basic knowledge questions into speech using TTS technology to simulate real dialogue;

[0033] The situation acquisition unit is used to acquire the user's interview situation in real time and generate test results.

[0034] As a further solution of the present invention: the situation acquisition unit includes:

[0035] The acquisition subunit is used to acquire the user's interview image and interview audio in real time;

[0036] An identification subunit, used to identify the interview image and generate a capability assessment report;

[0037] The conversion subunit is used to convert the interview audio into text, recognize the text, and generate a knowledge assessment report;

[0038] The statistics subunit is used for statistical ability assessment report and knowledge assessment report to obtain test results.

[0039] As a further solution of the present invention: the test result feedback module includes:

[0040] A suggestion insertion module is used to read and identify the competency assessment report and the knowledge assessment report, generate interview suggestions, and insert the competency assessment report and the knowledge assessment report;

[0041] The report feedback module is used to feed back the competency assessment report and knowledge assessment report containing interview suggestions to the user.

[0042] Compared with the prior art, the beneficial effects of the present invention are: the present invention combines the real-time evaluation method based on a large model with TTS technology to realize automated and multi-dimensional speech evaluation functions, improve the efficiency and accuracy of speech evaluation, provide instant feedback and improvement suggestions, and help users perform better in interviews and training. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention.

[0044] Figure 1 A flowchart of a real-time speech evaluation and analysis method based on text-to-speech technology. DETAILED DESCRIPTION

[0045] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0046] Figure 1 The flowchart of the real-time speech evaluation and analysis method based on text-to-speech technology is as follows. In an embodiment of the present invention, a real-time speech evaluation and analysis method based on text-to-speech technology includes:

[0047] Receiving a resume uploaded by a user, parsing the resume, and determining keywords;

[0048] Read interview questions from the pre-built question bank based on keywords, filter and classify them, and then import them into the knowledge base;

[0049] Create an interview scenario based on the knowledge base, obtain user interview situations in real time, and generate test results;

[0050] Feedback test results to users and generate interview suggestions simultaneously.

[0051] In an example of the technical solution of the present invention, a specific interactive interview solution is provided as follows:

[0052] Leveraging TTS technology and large model capabilities, we conduct multi-dimensional evaluation of user voice input, and provide semantic analysis and intent judgment based on content and context.

[0053] Step 1: Data acquisition and processing

[0054] 1. Resume upload and analysis

[0055] Users upload audio files or perform real-time voice input through the platform.

[0056] The system receives voice data and performs pre-processing such as noise reduction and sound quality optimization.

[0057] 2. Question bank update

[0058] The system updates data in a timely manner from professional knowledge bases and topics contributed by the open source community, and imports them into the knowledge base after screening and classification.

[0059] Step 2: Testing process

[0060] Multi-dimensional testing

[0061] Stress test: simulate a high-pressure interview environment to test the user's ability to withstand stress.

[0062] Basic knowledge test: Generate basic knowledge questions in professional fields for testing.

[0063] Questionnaire test: evaluates users’ soft skills and personality traits.

[0064] Regarding the voice evaluation process in the above content, it is as follows:

[0065] 1. Use TTS technology to convert text into voice and simulate real conversation.

[0066] 2. The user answers via voice, and the system analyzes the voice content in real time.

[0067] Step 3: Evaluation and Feedback

[0068] 1. Results Analysis

[0069] The system records and analyzes the user's responses and generates detailed test results.

[0070] 2. Report Generation

[0071] Generate a personalized evaluation report with strengths and weaknesses analysis and improvement suggestions.

[0072] 3. User Feedback

[0073] Provide evaluation reports and improvement suggestions to users to help optimize interview performance.

[0074] Furthermore, the process of setting up the interview scenario and generating the test results is as follows:

[0075] The steps of creating an interview scenario based on the knowledge base, obtaining the user interview situation in real time, and generating a test result include:

[0076] Search for basic knowledge questions in the knowledge base based on keywords;

[0077] Simulate a high-pressure interview environment based on existing high-pressure interview scenarios;

[0078] Use TTS technology to convert basic knowledge questions into voice to simulate real conversations;

[0079] Obtain the user's interview status in real time and generate test results.

[0080] Specifically, the step of obtaining the user's interview situation in real time and generating the test results includes:

[0081] Obtain the user's interview images and audio in real time;

[0082] Recognizing the interview image and generating a capability assessment report;

[0083] Convert interview audio into text, recognize the text, and generate a knowledge assessment report;

[0084] Statistical ability assessment report and knowledge assessment report to get the test results.

[0085] In addition, the step of feeding back the test results to the user and simultaneously generating interview suggestions includes:

[0086] Read and identify competency assessment reports and knowledge assessment reports, generate interview suggestions, and insert competency assessment reports and knowledge assessment reports;

[0087] Provide competency assessment reports and knowledge assessment reports with interview suggestions to users.

[0088] In the technical solution of the present invention, the specific modules of the system used to complete the above steps are as follows:

[0089] 1. User interface module:

[0090] Simple and intuitive, supports voice input and feedback viewing.

[0091] 2. Voice processing module:

[0092] Integrate speech recognition and TTS technology to ensure high quality of voice input and output.

[0093] 3. Big data analysis module:

[0094] Use a large model for semantic analysis and intent judgment.

[0095] 4. Feedback generation module:

[0096] Generate detailed speech assessment reports in real time.

[0097] As a preferred embodiment of the technical solution of the present invention, a real-time speech evaluation and analysis system based on text-to-speech technology is also provided, the system comprising:

[0098] A resume parsing module, used to receive a resume uploaded by a user, parse the resume, and determine keywords;

[0099] The question acquisition module is used to read interview questions from the pre-built question bank based on keywords, filter and classify them, and then import them into the knowledge base;

[0100] An interview scenario building module is used to create interview scenarios based on the knowledge base, obtain user interview situations in real time, and generate test results;

[0101] The test result feedback module is used to feed back the test results to the user and simultaneously generate interview suggestions.

[0102] Furthermore, the interview scenario tower building module includes:

[0103] A topic query unit is used to query basic knowledge topics in the knowledge base based on keywords;

[0104] Environmental simulation unit, used to simulate high-pressure interview environment based on existing high-pressure interview scenarios;

[0105] The dialogue conversion unit is used to convert basic knowledge questions into speech using TTS technology to simulate real dialogue;

[0106] The situation acquisition unit is used to acquire the user's interview situation in real time and generate test results.

[0107] Specifically, the situation acquisition unit includes:

[0108] The acquisition subunit is used to acquire the user's interview image and interview audio in real time;

[0109] An identification subunit, used to identify the interview image and generate a capability assessment report;

[0110] The conversion subunit is used to convert the interview audio into text, recognize the text, and generate a knowledge assessment report;

[0111] The statistics subunit is used for statistical ability assessment report and knowledge assessment report to obtain test results.

[0112] In addition, the test result feedback module includes:

[0113] A suggestion insertion module is used to read and identify the competency assessment report and the knowledge assessment report, generate interview suggestions, and insert the competency assessment report and the knowledge assessment report;

[0114] The report feedback module is used to feed back the competency assessment report and knowledge assessment report containing interview suggestions to the user.

[0115] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A real-time speech evaluation and analysis method based on text-to-speech technology, characterized in that: The method comprises: Receiving a resume uploaded by a user, parsing the resume, and determining keywords; Read interview questions from the pre-built question bank based on keywords, filter and classify them, and then import them into the knowledge base; Create an interview scenario based on the knowledge base, obtain user interview situations in real time, and generate test results; Feedback test results to users and generate interview suggestions simultaneously.

2. The real-time speech evaluation and analysis method based on text-to-speech technology according to claim 1, characterized in that: The steps of creating an interview scenario based on the knowledge base, obtaining the user interview situation in real time, and generating a test result include: Search for basic knowledge questions in the knowledge base based on keywords; Simulate a high-pressure interview environment based on existing high-pressure interview scenarios; Use TTS technology to convert basic knowledge questions into voice to simulate real conversations; Obtain the user's interview status in real time and generate test results.

3. The real-time speech evaluation and analysis method based on text-to-speech technology according to claim 2, characterized in that: The step of obtaining the user's interview situation in real time and generating the test results includes: Obtain the user's interview images and audio in real time; Recognizing the interview image and generating a capability assessment report; Convert interview audio into text, recognize the text, and generate a knowledge assessment report; Statistical ability assessment report and knowledge assessment report to get the test results.

4. The real-time speech evaluation and analysis method based on text-to-speech technology according to claim 1, characterized in that: The step of feeding back the test results to the user and simultaneously generating interview suggestions includes: Read and identify competency assessment reports and knowledge assessment reports, generate interview suggestions, and insert competency assessment reports and knowledge assessment reports; Provide competency assessment reports and knowledge assessment reports with interview suggestions to users.

5. A real-time speech evaluation and analysis system based on text-to-speech technology, characterized in that: The system comprises: A resume parsing module, used to receive a resume uploaded by a user, parse the resume, and determine keywords; The question acquisition module is used to read interview questions from the pre-built question bank based on keywords, filter and classify them, and then import them into the knowledge base; An interview scenario building module is used to create interview scenarios based on the knowledge base, obtain user interview situations in real time, and generate test results; The test result feedback module is used to feed back the test results to the user and simultaneously generate interview suggestions.

6. The real-time speech evaluation and analysis system based on text-to-speech technology according to claim 5, characterized in that: The interview scenario tower building module includes: A topic query unit is used to query basic knowledge topics in the knowledge base based on keywords; Environmental simulation unit, used to simulate high-pressure interview environment based on existing high-pressure interview scenarios; The dialogue conversion unit is used to convert basic knowledge questions into speech using TTS technology to simulate real dialogue; The situation acquisition unit is used to acquire the user's interview situation in real time and generate test results.

7. The real-time speech evaluation and analysis system based on text-to-speech technology according to claim 6, characterized in that: The situation acquisition unit includes: The acquisition subunit is used to acquire the user's interview image and interview audio in real time; An identification subunit, used to identify the interview image and generate a capability assessment report; The conversion subunit is used to convert the interview audio into text, recognize the text, and generate a knowledge assessment report; The statistics subunit is used for statistical ability assessment report and knowledge assessment report to obtain test results.

8. The real-time speech evaluation and analysis system based on text-to-speech technology according to claim 5, characterized in that: The test result feedback module comprises: A suggestion insertion module is used to read and identify the competency assessment report and the knowledge assessment report, generate interview suggestions, and insert the competency assessment report and the knowledge assessment report; The report feedback module is used to feed back the competency assessment report and knowledge assessment report containing interview suggestions to the user.

Images