Product-based online double-recording processing method and device, terminal, storage medium and computer program product
By introducing product-based processing methods into online dual recording technology, dynamically generate product speech and record audio and video data streams, the existing problems of inflexible and poor results of online dual recording are solved, and a more efficient and convenient dual recording experience is achieved.
Patent Information
- Application Number
- CN202411883692.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-19
- Publication Date
- 2025-04-11
AI Technical Summary
The existing online dual recording technology is inflexible and the recording method is fixed, resulting in poor results and cannot meet increasingly stringent regulatory requirements and customer experience needs.
Provide a product-based online dual recording processing method, which realizes remote online dual recording across platforms by displaying the dual recording interface, generating sending requests, recording audio and video data streams and sending them to the server, and dynamically generates product speeches.
A more flexible and convenient dual recording process is realized, dynamic speech adapts to different user needs, and generates high-quality dual recording video files, improving customer experience and efficiency and reducing costs.
Smart Images

Figure CN119815112A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of big data, and in particular to a product-based online dual recording processing method, device, terminal, storage medium and computer program product. Background Art
[0002] At present, according to regulatory requirements, before financial institutions sell products (funds, wealth management, etc.) to customers, they must introduce products to customers, inform them of risks, and solicit their opinions. The entire process must be recorded in audio and video, referred to as "double recording". Early regulatory requirements required customers to record double recordings when purchasing products offline at financial institutions. Customers did not need to record double recordings when purchasing products online by themselves, so early double recordings only supported on-site double recordings. However, as regulatory requirements become more stringent, more and more products (such as wealth management products) require mandatory double recordings even when purchased online. Although customers can first record double recordings offline and then purchase online, this will bring about problems such as poor customer experience, low efficiency, and high costs. To solve these problems, remote double recording came into being.
[0003] In the prior art, the existing online dual recording is to automatically play and record the preset voice.
[0004] However, in the prior art, since the existing online dual recording automatically plays and records the preset voice, the recording method is inflexible and the dual recording effect is poor. Summary of the invention
[0005] The present application provides a product-based online dual recording processing method, device, terminal, storage medium and computer program product to solve the technical problems of inflexibility and poor effect of online dual recording.
[0006] In a first aspect, the present application provides a product-based online dual recording processing method, comprising:
[0007] In response to the input operation, a dual recording interface is displayed, and a sending request is generated; wherein the input operation is used to input the user information of the target object, and the user information includes the product to be traded; the sending request includes the target object and the online room number of the target object;
[0008] Based on the sending request, the online room number is sent to the second terminal; wherein the online room number is used to enter the dual recording interface of the second terminal;
[0009] Dual recording is performed on the dual recording interface of the first terminal and the dual recording interface of the second terminal; during the dual recording process, the product to be traded is explained based on a preset speech template and the user information; and the audio and video data streams generated in the process are sent to a preset server, so that the server generates a dual recording video file based on the received audio and video data streams.
[0010] In a second aspect, the present application provides a product-based online dual recording processing device, comprising:
[0011] A display module is used to display a dual recording interface and generate a sending request in response to an input operation; wherein the input operation is used to input user information of a target object, the user information includes a product to be traded; the sending request includes a target object and an online room number of the target object;
[0012] A first sending module, configured to send the online room number to the second terminal based on the sending request; wherein the online room number is used to enter the dual recording interface of the second terminal;
[0013] A dual recording module, used for performing dual recording on the dual recording interface of the first terminal and the dual recording interface of the second terminal;
[0014] An explanation module, used to explain the product to be traded based on a preset speech template and the user information during the dual recording process;
[0015] The second sending module is used to send the audio and video data streams generated in the process to a preset server, so that the server generates a dual-audio video file according to the received audio and video data streams.
[0016] In a third aspect, the present application provides a first terminal, comprising: a processor, and a memory communicatively connected to the processor; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory to implement the method described in the first aspect.
[0017] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, they are used to implement the method described in the first aspect.
[0018] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the implementation method of the first aspect as above.
[0019] The product-based online dual recording processing method, device, terminal, storage medium and computer program product provided by the present application, in response to an input operation, displays a dual recording interface and generates a sending request; wherein the input operation is used to input the user information of the target object, and the user information includes the product to be traded; the sending request includes the target object and the online room number of the target object. Based on the sending request, the online room number is sent to the second terminal; wherein the online room number is used to enter the dual recording interface of the second terminal. Dual recording is performed on the dual recording interface of the first terminal and the dual recording interface of the second terminal; during the dual recording process, the product to be traded is explained based on the preset speech template and user information; and the audio and video data stream generated in the process is sent to the preset server, so that the server generates a dual recording video file according to the received audio and video data stream. In this solution, the preset speech template and real-time user information are equivalent to the dynamically generated product speech, and the product to be traded is explained according to the product speech, and a dual recording video file is generated. Therefore, compared with other remote dual recordings, the dual recording of this application is more flexible and convenient, and realizes cross-platform remote online dual recording with dynamic scripts, which solves the problems of poor customer experience, low efficiency and high cost caused by on-site dual recording requiring customers to go to the on-site offline dual recording, and is used to solve the technical problems of the inflexibility and poor effect of online dual recording. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0021] Figure 1 A flowchart of a product-based online dual recording processing method provided in an embodiment of the present application;
[0022] Figure 2 A schematic diagram of a scenario of a product-based online dual recording processing method provided in an embodiment of the present application;
[0023] Figure 3 A flowchart of another product-based online dual recording processing method provided in an embodiment of the present application;
[0024] Figure 4 A flowchart of another product-based online dual recording processing method provided in an embodiment of the present application;
[0025] Figure 5 A flowchart of another product-based online dual recording processing method provided in an embodiment of the present application;
[0026] Figure 6 A schematic diagram of the overall process of a product-based online dual recording processing method provided in an embodiment of the present application;
[0027] Figure 7 A schematic diagram of the structure of a product-based online dual recording processing device provided in an embodiment of the present application;
[0028] Figure 8 A schematic diagram of the structure of a first terminal provided in an embodiment of the present application.
[0029] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION
[0030] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.
[0031] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use, processing, transmission, provision, disclosure and application of the relevant data comply with the relevant laws, regulations and standards of the relevant countries and regions, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.
[0032] In addition, this application involves big data analysis of user information (including but not limited to personal biometrics, identity data, consumption data, asset data, electronic terminal operation data, etc.), and the use of artificial intelligence technology for automated decision-making, and a technical solution for making decisions that have a significant impact on personal rights and interests based on the results of automated decision-making. The application provides users with corresponding operation entrances for them to choose to agree or reject the results of automated decision-making; if the user chooses to reject, the expert decision-making process will be entered.
[0033] It should be noted that the online dual recording processing method, device, terminal, storage medium and computer program product based on the product of this application can be used in the field of big data, and can also be used in any field except the field of big data. The application field of the online dual recording processing method, device, terminal, storage medium and computer program product based on the product of this application is not limited.
[0034] At present, according to regulatory requirements, before financial institutions sell products (funds, wealth management, etc.) to customers, they must introduce products to customers, inform them of risks, and solicit their opinions. The entire process must be recorded in audio and video, referred to as "double recording". Early regulatory requirements required customers to record double recordings when purchasing products offline at financial institutions. Customers did not need to record double recordings when purchasing products online by themselves, so early double recordings only supported on-site double recordings. However, as regulatory requirements become more stringent, more and more products (such as wealth management products) require mandatory double recordings even when purchased online. Although customers can first record double recordings offline and then purchase online, this will bring about problems such as poor customer experience, low efficiency, and high costs. To solve these problems, remote double recording came into being.
[0035] In one example, the existing online dual recording automatically plays a preset voice and records it. However, in the prior art, since the existing online dual recording automatically plays a preset voice and records it, the recording method is inflexible and the dual recording effect is poor.
[0036] The present application provides a product-based online dual recording processing method, which aims to solve the above technical problems of the prior art.
[0037] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.
[0038] Figure 1 A flowchart of a product-based online dual recording processing method provided in an embodiment of the present application is applied to a first terminal, such as Figure 1 As shown, the method includes:
[0039] Step 101, in response to an input operation, displaying a dual recording interface and generating a sending request; wherein the input operation is used to input user information of a target object, the user information including the product to be traded; the sending request includes the target object and the online room number of the target object.
[0040] For example, Figure 2 A scenario diagram of a product-based online dual recording processing method provided in an embodiment of the present application, such as Figure 2As shown, the method includes: a first terminal (i.e., a PC terminal), a second terminal (such as a client device such as a mobile phone or a tablet), and a preset server. The first terminal is the terminal where the business personnel who assist in handling the business are located. The first terminal includes the screen of the user side camera and the screen of the business manager side camera, and also solicits user opinions and displays product words; the second terminal is the terminal where the user who needs to handle the business is located. The second terminal is installed with a preset application (APP). The second terminal includes the screen of the user side camera and the screen of the business manager side camera, and also solicits user opinions and displays product words, etc.; the preset server is deployed with a remote dual recording system, which is used to transfer data between the first terminal and the second terminal and generate dual recording video files. The remote dual recording system includes an appointment module, a file management module, a product words library module, an audio and video call module, a message notification module, a text-to-speech module, and a signature module.
[0041] In this step, the business personnel accesses the remote dual recording system and enters the page of the remote dual recording system. Based on the input operation of the business personnel on the page of the first terminal, the first terminal displays the dual recording interface and generates a sending request according to the user information in the input operation. The input operation inputs the user information of the target object, and the user information includes the product to be traded and the mobile phone number; the sending request includes the target object and the online room number of the target object.
[0042] Step 102: Based on the sending request, the online room number is sent to the second terminal; wherein the online room number is used to enter the dual recording interface of the second terminal.
[0043] Exemplarily, based on the sending request, the first terminal sends the online room number to the remote dual recording system of the server. The remote dual recording system sends the online room number to the second terminal based on the message notification module. When the second terminal receives the online room number, the user can click on the online room number to enter the dual recording interface of the second terminal.
[0044] Step 103, dual recording is performed on the dual recording interface of the first terminal and the dual recording interface of the second terminal; during the dual recording process, the transaction product is explained based on the preset speech template and user information; and the audio and video data stream generated in the process is sent to the preset server, so that the server generates a dual recording video file according to the received audio and video data stream.
[0045] Exemplarily, since the first terminal and the second terminal both enter their respective dual recording interfaces, the dual recording interface of the first terminal includes the camera window of the business personnel and the camera window of the user, that is, the user-side camera screen of the first terminal and the camera screen of the business personnel side of the second terminal are displayed at the same time. At this time, the first terminal performs dual recording on its own dual recording interface, and dual recording can be performed on the dual recording interface of the first terminal and the dual recording interface of the second terminal at the same time. In the process of dual recording, based on the preset speech template and user information, product speech is generated, and the transaction product is explained according to the product speech; at the same time, the audio and video data stream generated in the process is sent to the preset server. The server receives the audio and video data stream, and generates a dual recording video file based on the audio and video data stream at the end of recording.
[0046] In an embodiment of the present application, in response to an input operation, a dual recording interface is displayed, and a sending request is generated; wherein the input operation is used to input user information of the target object, and the user information includes the product to be traded; the sending request includes the target object and the online room number of the target object. Based on the sending request, the online room number is sent to the second terminal; wherein the online room number is used to enter the dual recording interface of the second terminal. Dual recording is performed on the dual recording interface of the first terminal and the dual recording interface of the second terminal; during the dual recording process, the product to be traded is explained based on the preset speech template and user information; and the audio and video data stream generated in the process is sent to the preset server, so that the server generates a dual recording video file based on the received audio and video data stream. In this solution, the preset speech template and real-time user information are equivalent to the dynamically generated product speech, and the product to be traded is explained based on the product speech, and a dual recording video file is generated. Therefore, compared with other remote dual recordings, the dual recording of this application is more flexible and convenient, and realizes cross-platform remote online dual recording with dynamic scripts, which solves the problems of poor customer experience, low efficiency and high cost caused by on-site dual recording requiring customers to go to the on-site offline dual recording, and is used to solve the technical problems of the inflexibility and poor effect of online dual recording.
[0047] exist Figure 1 Based on the embodiment shown, Figure 3 A flowchart of another product-based online dual recording processing method provided in an embodiment of the present application is shown in FIG. Figure 3 As shown, the method includes:
[0048] Step 201, in response to an input operation, displaying a dual recording interface and generating a sending request; wherein the input operation is used to input user information of a target object, the user information including the product to be traded; the sending request includes the target object and the online room number of the target object.
[0049] In one example, step 201 includes: in response to an input operation, entering a dual recording interface within a preset reservation time period; wherein the reservation time period is a time period manually input by the user at the second terminal, or a time period determined by the user through other channels.
[0050] Exemplarily, first, the user of the second terminal needs to determine the appointment time period. During the appointment time period, the business personnel of the first terminal log in to enter the dual recording interface to assist the user of the second terminal to complete the online dual recording. Specifically, when the user logs in to the application (APP) installed on the second terminal to purchase financial products, an online transaction request is generated based on the user's trigger operation on the transaction button, and the second terminal sends the online transaction request to a preset server; wherein the online transaction request includes the product code and user identity (ie, ID) of the product to be purchased. When the server receives the online transaction request, it will access the archive management module according to the online transaction request, and query the archive management module whether there is a dual recording record of the product according to the product code and user ID. If there is no dual recording record, the APP does not allow the purchase to continue, and prompts to make an appointment for remote dual recording information.
[0051] Based on the appointment remote dual recording information, the user clicks the appointment button on the dual recording interface of the second terminal to generate an appointment request. The second terminal sends the appointment request to the server. The APP accesses the appointment module according to the appointment request and sends the current mobile phone location information carried in the appointment request to the server. The server selects several outlets within the preset range closest to the current mobile phone location information and sends several outlets to the second terminal. The dual recording interface of the second terminal displays these outlets, and the user can select any outlet; or the user fuzzily queries the outlet list by the outlet name in the dual recording interface, and displays the searched outlets in the dual recording interface, and the user can select any outlet. The user selects an outlet in the dual recording interface, and based on the selection operation, a selection request is generated. The second terminal sends the selection request to the server, and the remote dual recording system of the server returns the list of business personnel of the outlet. The second terminal receives and displays the list of business personnel of the outlet. The user selects a business person and manually enters the appointment time period. The APP of the second terminal automatically enters the user's mobile phone number and product code, and sends the appointment time period, user mobile phone number, and product code to the remote dual recording system. The remote dual recording system records the above three types of information to the reservation module, and the message notification module of the remote dual recording system sends a text message to notify the business personnel and users.
[0052] It should be noted that filling in the appointment time period on the second terminal is not a necessary operation. If the user has the contact information of the business personnel, he can directly contact the business personnel according to the contact information and confirm the appointment time period. The contact method can be a variety of methods such as telephone and email, and there is no limitation on this. Therefore, this application is more convenient, and users can make appointments by themselves or directly contact business personnel for remote dual recording.
[0053] In this step, the business personnel accesses the remote dual recording system in the server within the reservation time period, enters the page of the remote dual recording system, and based on the input operation of the business personnel on the page of the first terminal, the first terminal displays the dual recording interface and generates a sending request according to the user information in the input operation. The input operation inputs the user information of the target object, and the user information includes the product to be traded and the mobile phone number; the sending request includes the target object and the online room number of the target object.
[0054] Furthermore, when the remote dual recording system detects that the login is successful, the product script library module reads the script template corresponding to the product code, processes it according to the preset script processing rule information combined with the user information, the business personnel information, and the product information corresponding to the product code, generates the product script of the product to be traded, and sends the product script to the first terminal. Among them, the product script generally includes several large paragraphs such as soliciting user opinions, indicating identity, product attributes and issuing entities, investment scope and risk suitability, risk warnings, and operation prompts, and each large paragraph contains several small paragraphs.
[0055] Furthermore, when the first terminal logs into the dual recording interface, it also initializes the audio and video call. Figure 4 A flowchart of another product-based online dual recording processing method provided in an embodiment of the present application is shown as follows: Figure 4 As shown, the first terminal is pre-installed with a C-end audio and video call module. In order to support cross-platform, different C-end programs need to be installed on Windows and Linux systems. The web page where the dual recording interface of the PC is located calls a unified JS (JavaScript) interface to communicate with the C-end program. The JS interface shields the differences between different C-end programs. In terms of specific implementation, if it is a Windows system, JS calls the C-end method through OCX control technology; if it is a Linux system, the C-end program will start a local socket server, and JS accesses the server through websocket to call the C-end method. Therefore, compared with other remote dual recordings, this application is more compatible and supports cross-platform. The PC side supports Windows and Linux, and the mobile phone side supports Android and IOS, etc., and is suitable for various scenarios.
[0056] Furthermore, when the dual recording interface on the PC side calls the C-side program to automatically initialize the audio and video call, the C-side performs two processes: 1. Figure 5 A flowchart of another product-based online dual recording processing method provided in an embodiment of the present application is as follows: Figure 5 As shown, the C end drives the external or built-in camera of the PC end and displays the camera preview window (i.e. Figure 2The "business personnel side camera" of the dual recording interface on the PC side drives the external or built-in microphone and speaker on the PC side, and the C side pushes these audio and video streams to the audio and video call module S side (i.e., the server); 2. Figure 4 As shown, the C end obtains a unique room number from the S end. It should be noted that the C end and the S end communicate via the TCP protocol.
[0057] For example, the processing logic of the speech processing rule information is to match the string in the following column A in the speech template and process the column B, as shown in Table 1 below:
[0058] Table 1
[0059]
[0060] According to Table 1, an example of a conversion script template is: #{user name}#{user title}, hello! Is the last digit of your #{user ID name} the same as #{user ID last digit}? According to the regulations of the regulatory authorities, in order to standardize sales behavior and better protect your legitimate rights and interests, we will record the key links of my sales process by audio and video. Do you agree?"
[0061] Example of converted processing result: Hello, Ms. Li XX! Is the last number of your ID card 3333? According to the regulations of the regulatory authorities, in order to standardize sales behavior and better protect your legitimate rights and interests, we will record the key links of my sales process by audio and video. Do you agree? "
[0062] Step 202, receiving the product words of the product to be traded sent by the server; and displaying the product words on the dual recording interface; wherein the product words include multiple paragraphs, and each paragraph corresponds to a voice broadcast button; the product to be traded is generated by the server when it detects that the first terminal has logged into the dual recording interface, obtaining the user information of the second terminal and the user information of the first terminal; and according to the user information of the second terminal, the user information of the first terminal, a preset words template, and preset words processing rule information.
[0063] Exemplarily, the product script of the product to be traded sent by the server is received, and the product script is displayed in the dual recording interface. Among them, the product script includes multiple paragraphs, and each paragraph corresponds to a voice broadcast button; the product to be traded is generated when the server detects that the first terminal logs into the dual recording interface, obtains the user information of the second terminal and the user information of the first terminal, and is generated according to the user information of the second terminal, the user information of the first terminal, the preset script template, and the preset script processing rule information. It should be noted that the process of generating product scripts refers to step 202 and will not be repeated here. Therefore, since the product script is dynamically generated by the script template + various information (user information, business personnel information, product information, etc.), the present application can perform dual recording operations for different users during the recording process, which is more flexible.
[0064] Step 203: Based on the sending request, the online room number is sent to the second terminal; wherein the online room number is used to enter the dual recording interface of the second terminal.
[0065] For example, based on the sending request, the first terminal sends the online room number to the remote dual recording system of the server. The remote dual recording system sends the online room number to the second terminal based on the message notification module. When the second terminal receives the online room number, the user can click on the online room number to enter the dual recording interface of the second terminal, that is, Figure 4 The H5 page of the user's mobile APP dual recording interface.
[0066] Furthermore, if Figure 4 As shown, the dual recording interface of the second terminal calls up the SDK plug-in of the audio and video call module integrated in the APP through bridging, and the SDK plug-in supports Android and IOS. Figure 5 As shown, the SDK plug-in drives the camera of the second terminal and displays the camera preview window (i.e. Figure 2 The "user-side camera" on the dual recording interface of the mobile phone APP drives the microphone and speaker of the second terminal, and the SDK plug-in pushes these audio and video streams + online room numbers to the S end where the audio and video call module is located. Figure 5 As shown, it includes: the screen recording video stream 1 of the dual recording interface of the PC, the camera video stream 2 of the PC, the PC microphone audio stream 3, the camera video stream 4 of the second terminal, the microphone audio stream 5 of the second terminal, the speech paragraph text and the signature confirmation command 6, and the signature picture 7; the S end identifies the second terminal and the PC end to be paired through the online room number, displays the camera video stream 4 of the second terminal on the "user side camera" of the dual recording interface of the PC end, plays the microphone audio stream 5 of the second terminal through the speaker of the PC end, displays the camera video stream 2 of the PC end on the "business staff side camera" of the dual recording interface of the APP of the second terminal, and plays the microphone audio stream 3 of the PC end through the speaker of the second terminal.
[0067] Step 204: The dual recording interface includes a start recording button and an end recording button; in response to a triggering operation of the start recording button, dual recording is performed on the dual recording interface of the first terminal and the dual recording interface of the second terminal.
[0068] Exemplarily, the dual recording interface includes a start recording button and an end recording button. Based on the user's trigger operation on the start recording button, dual recording is performed on the dual recording interface of the first terminal and the dual recording interface of the second terminal. The trigger operation can be a single click, a double click, or other operations, etc., which are not limited to this.
[0069] Specifically, Figure 5 As shown in the figure, the business personnel confirm to start recording on the dual recording interface of the PC side, and the C side where the audio and video call module is located starts recording the screen for the dual recording interface of the PC side, and pushes Figure 5 The screen recording video stream 1 in the video call module is sent to the S terminal where the audio and video call module is located. It should be noted that the video stream is not pushed to the second terminal, because the dual recording interface on the PC side includes the user side camera screen, the business personnel side camera screen and the dual recording speech, and the screen recording video stream 1 is the screen recording of the dual recording interface on the first terminal side, which will also include these contents.
[0070] Step 205: During the dual recording process, the transaction product is explained based on the preset speech template and user information.
[0071] In one example, step 205 includes: displaying the product sales pitch of the product to be traded on the dual recording interface of the first terminal; the product sales pitch includes multiple paragraphs, each paragraph corresponds to a voice broadcast button; the product sales pitch is generated based on a preset sales pitch template and user information; during the dual recording process, in response to the triggering operation of the voice broadcast button, voice data is generated according to the corresponding paragraph according to the triggered voice broadcast; the voice data is played, and the voice broadcast sound of the voice data is sent to the second terminal through the microphone and speaker installed on the first terminal, and the product to be traded is explained through the voice broadcast sound.
[0072] In one example, step 205 also includes: if the currently triggered voice broadcast is played according to the corresponding voice data, receiving the second voice data of the user of the second terminal; and / or, receiving the first voice data of the user of the first terminal, and sending the first voice data to the second terminal, to provide additional explanation of the product to be traded.
[0073] In one example, step 205 also includes: if it is detected that each voice broadcast has been played according to the corresponding voice data, a signature confirmation request is generated in response to the signature confirmation operation, and the signature confirmation request is sent to the second terminal through the server; a signature image sent by the second terminal is received; wherein the signature image is synthesized based on the user's signature operation on the signature plate by calling a preset plug-in according to the signature confirmation request and popping up a signature board.
[0074] Exemplarily, during the dual recording process, the product to be traded can be explained through synthesized voice and artificial voice. Specifically, during the recording process, the product script of the product to be traded is displayed on the dual recording interface of the first terminal; the product script generally includes several large paragraphs such as soliciting customer opinions, stating identity, product attributes and issuing entity, investment scope and risk suitability, risk warnings, and operation prompts. Each large paragraph contains several small paragraphs, and there is a voice broadcast button next to each small paragraph. Business personnel can click the button corresponding to each paragraph in the order of the paragraphs, based on the triggering operation of the voice broadcast button, according to the corresponding paragraph of the triggered voice broadcast, generate voice data, play voice data, and send the voice broadcast sound of the voice data to the second terminal through the microphone and speaker installed on the first terminal, and explain the product to be traded through the voice broadcast sound.
[0075] Furthermore, when the business personnel clicks the voice broadcast button, two processes are performed: 1. The dual recording interface on the PC side accesses the text-to-speech module, and transmits the short paragraph of text to the module for synthesis into voice data. The module transmits the voice data back to the dual recording interface on the PC side for automatic playback. In addition, the business personnel can also speak on their own to supplement the product script and answer customer questions. The voice broadcast sound of the voice data and the voice of the business personnel will be picked up by the microphone on the PC side, and then pushed to the second terminal for playback by the S side where the audio and video call module is located; 2. Figure 5 As shown, the dual recording interface on the PC transmits the small paragraph text to the "Dual Recording Script" section of the dual recording interface of the APP on the second terminal through the audio and video call module. The "Dual Recording Script" on the dual recording interface on the PC displays all script paragraphs, and the "Dual Recording Script" on the dual recording interface of the APP only displays the small paragraph currently broadcast. Therefore, through speech synthesis + artificial voice, business personnel can control the entire dual recording process, meet user needs in a timely manner, and the dual recording process is more reliable.
[0076] Furthermore, at the end of the explanation, an online signature confirmation is conducted. Figure 5As shown, if it is detected that each voice broadcast has been played according to the corresponding voice data, a signature confirmation request is generated based on the triggering operation of the signature confirmation button by the business personnel, and the signature confirmation request is sent to the server. The server sends the received signature confirmation request to the second terminal through the audio and video call module. The dual recording interface of the APP of the second terminal evokes the SDK plug-in of the signature module integrated in the APP, and pops up the signature board. After the user signs on the signature board, the signature is sent to the server. The signature module of the server synthesizes the signature image based on the SDK plug-in, and transmits the signature image back to the dual recording interface of the PC through the audio and video call module for confirmation by the business personnel. It should be noted that the signature confirmation button is in a gray and unclickable state during the explanation process. When it is detected that each voice broadcast has been played according to the corresponding voice data, it will change from an unclickable state to a valid click state, and there is no limitation on this.
[0077] Step 206: Send the audio and video data stream generated in the process to a preset server, so that the server generates a dual-recording video file according to the received audio and video data stream.
[0078] Exemplarily, the audio and video data stream generated in the process is sent to a preset server. The server receives the audio and video data stream and generates a dual-recording video file based on the received audio and video data stream when the recording is finished.
[0079] Step 207: In response to the triggering operation of the end recording button, the dual recording of the dual recording interface of the first terminal and the dual recording interface of the second terminal is ended.
[0080] For example, the business personnel checks the signature in the signature picture on the dual recording interface of the PC. If there is no problem with the signature, the business personnel triggers the end recording button to confirm the end of recording. The C end where the audio and video call module is located notifies the S end to end recording. The S end combines the screen recording video stream 1, the microphone audio stream 3 of the PC end, and the microphone audio stream 5 of the second terminal into a video file, which is sent to the archive management module for archiving and storage. The trigger operation can be a single click, a double click, or other operations, etc., which are not limited to this.
[0081] Furthermore, business personnel can also access the remote dual recording system through a browser, enter the dual recording archive query page, access the archive management module on this page, and then view the dual recording records and play the dual recording video files.
[0082] In an embodiment of the present application, in response to an input operation, a dual recording interface is displayed, and a sending request is generated; wherein the input operation is used to input user information of the target object, and the user information includes the product to be traded; the sending request includes the target object and the online room number of the target object. The product words of the product to be traded sent by the server are received; and the product words are displayed on the dual recording interface; based on the sending request, the online room number is sent to the second terminal; wherein the online room number is used to enter the dual recording interface of the second terminal. The dual recording interface includes a start recording button and an end recording button; in response to the triggering operation of the start recording button, the dual recording interface of the first terminal and the dual recording interface of the second terminal are dual recorded. During the dual recording process, the product to be traded is explained based on the preset wording template and user information. The audio and video data stream generated in the process is sent to the preset server, so that the server generates a dual recording video file according to the received audio and video data stream. In response to the triggering operation of the end recording button, the dual recording of the dual recording interface of the first terminal and the dual recording interface of the second terminal is ended. Therefore, compared with other remote double recordings, this application can make self-service appointments for double recording time, and conduct double recording explanations through a combination of speech synthesis and artificial voice. Double recording is more flexible and convenient, and realizes cross-platform remote online double recording with dynamic speech. It solves the problems of poor customer experience, low efficiency, high cost, etc. caused by on-site double recording requiring customers to go to the on-site offline double recording, and is used to solve the technical problems of the inflexibility and poor effect of online double recording.
[0083] Figure 6 The overall flow diagram of a product-based online dual recording processing method provided in an embodiment of the present application is as follows: Figure 6 As shown, it includes: based on the remote two-way system deployed in the server, the user can make an appointment for remote dual recording on the second terminal; the second terminal generates product scripts; initializes audio and video calls; starts recording; voice broadcast (synthetic voice combined with artificial voice); signature confirmation; ends recording; and file query.
[0084] Figure 7 A schematic diagram of the structure of a product-based online dual recording processing device provided in an embodiment of the present application, such as Figure 7 As shown, the device comprises:
[0085] The display module 31 is used to display the dual recording interface and generate a sending request in response to an input operation; wherein the input operation is used to input user information of the target object, and the user information includes the product to be traded; the sending request includes the target object and the online room number of the target object;
[0086] A first sending module 32, configured to send the online room number to the second terminal based on the sending request; wherein the online room number is used to enter the dual recording interface of the second terminal;
[0087] A dual recording module 33, configured to perform dual recording on the dual recording interface of the first terminal and the dual recording interface of the second terminal;
[0088] An explanation module 34 is used to explain the product to be traded based on a preset speech template and the user information during the dual recording process;
[0089] The second sending module 35 is used to send the audio and video data stream generated in the process to a preset server, so that the server generates a dual-audio video file according to the received audio and video data stream.
[0090] The device of this embodiment can execute the technical solution in the above method. Its specific implementation process and technical principles are the same and will not be repeated here.
[0091] exist Figure 7 On the basis of the illustrated embodiment, the embodiment of the present application provides another product-based online dual recording processing device, comprising: displaying the product script of the product to be traded on the dual recording interface of the first terminal; the product script includes a plurality of paragraphs, each paragraph corresponds to a voice broadcast button; the product script is generated based on a preset script template and the user information;
[0092] Explanation module 34, specifically for:
[0093] In the process of dual recording, in response to the triggering operation of the voice broadcast button, voice data is generated according to the corresponding paragraphs of the triggered voice broadcast;
[0094] The voice data is played, and the voice broadcast sound of the voice data is sent to the second terminal through the microphone and the speaker installed in the first terminal, and the product to be traded is explained through the voice broadcast sound.
[0095] In one example, the device is further specifically used for:
[0096] If the currently triggered voice broadcast is finished playing the corresponding voice data, the second voice data of the user of the second terminal is received; and / or, the first voice data of the user of the first terminal is received and the first voice data is sent to the second terminal to provide additional explanation on the product to be traded.
[0097] In one example, the device is also specifically used for:
[0098] If it is detected that each voice announcement has been played according to the corresponding voice data, a signature confirmation request is generated in response to the signature confirmation operation, and the signature confirmation request is sent to the second terminal through the server;
[0099] Receive the signature image sent by the second terminal; wherein the signature image is synthesized and generated by the second terminal calling a preset plug-in according to the signature confirmation request, popping up a signature board, and based on the user's signature operation on the signature board.
[0100] In one example, the device is also specifically used for:
[0101] After the dual recording interface is displayed in response to the input operation, the product words of the product to be traded are received from the server; and the product words are displayed on the dual recording interface;
[0102] Among them, the product script includes multiple paragraphs, each paragraph corresponds to a voice broadcast button; the product to be traded is obtained by the server when it detects that the first terminal logs into the dual recording interface, and the user information of the second terminal and the user information of the first terminal are obtained; and it is generated according to the user information of the second terminal, the user information of the first terminal, the preset script template, and the preset script processing rule information.
[0103] In one example, the dual recording interface includes a start recording button and an end recording button; the dual recording module 33 is specifically used to:
[0104] In response to the triggering operation of the start recording button, dual recording is performed on the dual recording interface of the first terminal and the dual recording interface of the second terminal;
[0105] The device is also specifically used for:
[0106] After the audio and video data streams generated in the process are sent to a preset server, in response to the triggering operation of the end recording button, the dual recording of the dual recording interface of the first terminal and the dual recording interface of the second terminal is ended.
[0107] In one example, the display module 31 is specifically used for:
[0108] In response to the input operation, the dual recording interface is entered within a preset reservation time period; wherein the reservation time period is a time period manually input by the user at the second terminal, or a time period determined by the user through other channels.
[0109] The device of this embodiment can execute the technical solution in the above method. Its specific implementation process and technical principles are the same and will not be repeated here.
[0110] Figure 8 This is a schematic diagram of the structure of the first terminal provided by this application. Figure 8As shown, the first terminal 50 provided in this embodiment includes: at least one processor 501 and a memory 502. Optionally, the terminal 50 also includes a communication component 503. The processor 501, the memory 502 and the communication component 503 are connected via a bus 504.
[0111] In a specific implementation process, at least one processor 501 executes the computer-executable instructions stored in the memory 502, so that at least one processor 501 executes the above method.
[0112] The specific implementation process of the processor 501 can be found in the above method embodiment, and its implementation principle and technical effect are similar, so this embodiment will not be repeated here.
[0113] In the above embodiments, it should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the invention may be directly implemented as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.
[0114] The memory may include a high-speed memory (Random Access Memory, RAM), and may also include a non-volatile memory (Non-volatile Memory, NVM), such as at least one disk memory.
[0115] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.
[0116] The embodiment of the present application also provides a non-temporary computer-readable storage medium. When the instructions in the storage medium are executed by the processor of the first terminal, the first terminal can execute the method provided in the above embodiment.
[0117] An embodiment of the present application also provides a computer program product, which includes: a computer program, the computer program is stored in a readable storage medium, at least one processor of the first terminal can read the computer program from the readable storage medium, and at least one processor executes the computer program so that the first terminal executes the solution provided by any of the above embodiments.
[0118] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present application.
[0119] It should be further noted that, although the various steps in the flowchart are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless there is a clear description in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowchart may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these sub-steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
[0120] It should be understood that the above-mentioned device embodiments are only illustrative, and the device of the present application can also be implemented in other ways. For example, the division of units / modules in the above-mentioned embodiments is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units, modules or components can be combined, or can be integrated into another system, or some features can be ignored or not executed.
[0121] In addition, unless otherwise specified, each functional unit / module in each embodiment of the present application may be integrated into one unit / module, each unit / module may exist physically separately, or two or more units / modules may be integrated together. The above-mentioned integrated unit / module may be implemented in the form of hardware or in the form of a software program module.
[0122] If the integrated unit / module is implemented in the form of hardware, the hardware may be a digital circuit, an analog circuit, etc. The physical implementation of the hardware structure includes but is not limited to transistors, memristors, etc. If not specifically stated, the processor may be any appropriate hardware processor, such as a CPU, a GPU, an FPGA, a DSP, an ASIC, etc. If not specifically stated, the storage unit may be any appropriate magnetic storage medium or magneto-optical storage medium, such as a resistive random access memory RRAM (Resistive Random Access Memory), a dynamic random access memory DRAM (Dynamic Random Access Memory), a static random access memory SRAM (Static Random-Access Memory), an enhanced dynamic random access memory EDRAM (Enhanced Dynamic Random Access Memory), a high-bandwidth memory HBM (High-Bandwidth Memory), a hybrid memory cube HMC (Hybrid Memory Cube), etc.
[0123] If the integrated unit / module is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several instructions for a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the various embodiments of the present application. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.
[0124] In the above embodiments, the description of each embodiment has its own emphasis. For the part not described in detail in a certain embodiment, please refer to the relevant description of other embodiments. The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0125] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.
[0126] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.
Claims
1. A product-based online dual recording processing method, characterized in that: Applied to a first terminal; the method comprises: In response to the input operation, a dual recording interface is displayed, and a sending request is generated; wherein the input operation is used to input user information of the target object, and the user information includes the product to be traded; the sending request includes the target object and the online room number of the target object; Based on the sending request, the online room number is sent to the second terminal; wherein the online room number is used to enter the dual recording interface of the second terminal; Dual recording is performed on the dual recording interface of the first terminal and the dual recording interface of the second terminal; during the dual recording process, the product to be traded is explained based on a preset speech template and the user information; and the audio and video data streams generated in the process are sent to a preset server, so that the server generates a dual recording video file based on the received audio and video data streams.
2. The method according to claim 1, characterized in that On the dual recording interface of the first terminal, the product script of the product to be traded is displayed; the product script includes a plurality of paragraphs, each paragraph corresponds to a voice broadcast button; the product script is generated based on a preset script template and the user information; During the dual recording process, the product to be traded is explained based on the preset speech template and the user information, including: In the process of dual recording, in response to the triggering operation of the voice broadcast button, voice data is generated according to the corresponding paragraphs of the triggered voice broadcast; The voice data is played, and the voice broadcast sound of the voice data is sent to the second terminal through the microphone and the speaker installed in the first terminal, and the product to be traded is explained through the voice broadcast sound.
3. The method according to claim 2, characterized in that The method further comprises: If the currently triggered voice broadcast is finished playing the corresponding voice data, the second voice data of the user of the second terminal is received; and / or, the first voice data of the user of the first terminal is received and the first voice data is sent to the second terminal to provide additional explanation on the product to be traded.
4. The method according to claim 2, characterized in that: The method further comprises: If it is detected that each voice announcement has been played according to the corresponding voice data, a signature confirmation request is generated in response to the signature confirmation operation, and the signature confirmation request is sent to the second terminal through the server; Receive the signature image sent by the second terminal; wherein the signature image is synthesized and generated by the second terminal calling a preset plug-in according to the signature confirmation request, popping up a signature board, and based on the user's signature operation on the signature board.
5. The method according to claim 1, characterized in that After displaying the dual recording interface in response to the input operation, the method further includes: receiving the product words of the product to be traded sent by the server; and displaying the product words on the dual recording interface; Among them, the product script includes multiple paragraphs, each paragraph corresponds to a voice broadcast button; the product to be traded is obtained by the server when it detects that the first terminal logs into the dual recording interface, and the user information of the second terminal and the user information of the first terminal are obtained; and it is generated according to the user information of the second terminal, the user information of the first terminal, the preset script template, and the preset script processing rule information.
6. The method according to any one of claims 1 to 5, characterized in that: The dual recording interface includes a start recording button and an end recording button; Performing dual recording on the dual recording interface of the first terminal and the dual recording interface of the second terminal includes: In response to the triggering operation of the start recording button, dual recording is performed on the dual recording interface of the first terminal and the dual recording interface of the second terminal; After sending the audio and video data stream generated in the process to a preset server, the method further includes: In response to the triggering operation of the end recording button, the dual recording of the dual recording interface of the first terminal and the dual recording interface of the second terminal are ended.
7. The method according to any one of claims 1 to 5, characterized in that: The step of displaying the dual recording interface in response to the input operation includes: In response to the input operation, the dual recording interface is entered within a preset reservation time period; wherein the reservation time period is a time period manually input by the user at the second terminal, or a time period determined by the user through other channels.
8. A product-based online dual recording processing device, comprising: A display module is used to display a dual recording interface and generate a sending request in response to an input operation; wherein the input operation is used to input user information of a target object, the user information includes a product to be traded; the sending request includes a target object and an online room number of the target object; A first sending module, configured to send the online room number to the second terminal based on the sending request; wherein the online room number is used to enter the dual recording interface of the second terminal; A dual recording module, used for performing dual recording on the dual recording interface of the first terminal and the dual recording interface of the second terminal; An explanation module, used to explain the product to be traded based on a preset speech template and the user information during the dual recording process; The second sending module is used to send the audio and video data streams generated in the process to a preset server, so that the server generates a dual-audio video file according to the received audio and video data streams.
9. A first terminal, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 7 when executed by a processor.
11. A computer program product, characterized in that The invention comprises a computer program, which implements the method according to any one of claims 1 to 7 when being executed by a processor.
Citation Information
Patent Citations
Double-recording service broadcasting method and device and storage medium
CN112423094A
Method and device for generating double-recording video file
CN115086586A
Method for designing double-recording task and terminal equipment
CN115775186A
Insurance double recording system and method based on real-time audio and video communication
CN117097856A