Cloud mobile phone call data processing method and system based on big data technology

Through big data technology, the automatic analysis and display of call content on cloud mobile phones is solved, and the problem of incomplete call records and unintuitive presentation of cloud mobile phones is provided, and the intuitive interface and in-depth analysis results are provided, which meets the company's call content Record and analyze requirements.

CN119110022APending Publication Date: 2024-12-10CHINA UNICOM ONLINE INFORMATION TECHNOLOGY CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411462549.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-18
Publication Date
2024-12-10

AI Technical Summary

Technical Problem

The existing technology has problems such as insufficient content analysis, intuition in presentation and incomplete content in terms of cloud mobile phone call recording and analysis, which cannot meet the content recording and in-depth analysis needs of employee work calls within the enterprise.

Method used

Adopt cloud mobile phone call data processing methods based on big data technology, and automatically analyze and display the call content through voice recognition, natural language processing and graphical user interface technology, including topic recognition, sentiment analysis and recording playback, providing user-friendly Interface and relationship map display.

Benefits of technology

It realizes complete recording and intelligent analysis of cloud mobile phone work calls, improves the analysis quality and efficiency of call content, and provides an intuitive user interface, allowing users to easily view and understand call analysis results.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119110022A_ABST
    Figure CN119110022A_ABST
Patent Text Reader

Abstract

The invention relates to a cloud mobile phone call data processing method and system based on the big data technology, and belongs to the technical field of computers. A request obtaining step; a user relation graph display step; a call recording step; a call record returning step; a call analysis step; a call result returning step; and a result display step. According to the invention, the working call of the cloud mobile phone can be analyzed and recorded, the intelligent analysis result of the call relation and the call content is presented in a relation graph mode, the accuracy of the call record is improved, and meanwhile, the provided intelligent analysis result improves the analysis quality and efficiency of the call content.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a method and system for processing cloud phone call data based on big data technology. Background Art

[0002] As an emerging service model, cloud-based virtual Android phones provide users with a solution to run the Android operating system without physical devices. Users can access virtual phones through cloud services to install, use and manage applications. However, existing technologies mainly focus on providing virtualized mobile phone environments and basic device management functions, but are relatively lacking in call records and analysis.

[0003] The existing technology provides the ability to record and record calls, but there are the following problems: Insufficient content analysis: Although some systems may provide call recording capabilities, they usually do not include automatic analysis of call content, such as advanced features such as topic identification and sentiment analysis; Unintuitive presentation: The existing system is not intuitive enough in terms of user interface and interaction design. It is difficult for users to quickly review call recordings, obtain analysis results, and deeply understand the content of calls directly in the call logs. Incomplete content: The cloud phone's incoming and outgoing calls based on work numbers mostly rely on the communication capabilities of real machines. If you receive calls from other people, the call record content cannot be recorded and cannot be presented in the cloud phone call APP.

[0004] Therefore, at the current level of technology, it is still unable to meet the needs of recording and in-depth analysis of the content of work calls of employees within the enterprise. Summary of the invention

[0005] The present invention intends to provide a method and system for processing cloud phone call data based on big data technology to solve the deficiencies in the prior art. The technical problem to be solved by the present invention is achieved through the following technical solutions.

[0006] A first aspect of the present invention provides a method for processing cloud phone call data based on big data technology, the method comprising the following steps: Steps to establish a connection: When the user opens the relationship map function of the cloud phone address book, the cloud phone initiates a request to obtain all contacts of the user's work number, and establishes a call connection with the contacts through the work number; Obtaining request step: responding to the call contact's request, transmitting the information of all contacts of the user's work number to the cloud phone end; User relationship map display step: displaying the user relationship map on the interface according to all contact information of the user work number received; Recording call steps: The voice call platform receives a request to record a call and requests to obtain the contact's call records; Call record return step: the voice call platform returns the corresponding call records to the cloud phone service end and the cloud phone end; Call analysis step: the cloud phone terminal requests the voice call platform to analyze the content in the call record; Call result return step: the voice call platform returns the analyzed content to the cloud phone service end and the cloud phone end; Result display step: After receiving the analysis-related information, the cloud phone terminal displays the analysis content.

[0007] In combination with the first aspect, further, the analysis object of the call analysis step is the analysis of the call content, theme, emotion and recording playback; Analysis of the call content: using speech recognition technology to convert the audio content of both parties of the call into text for further analysis; Analysis of the topic: using natural language processing technology to perform topic analysis on the call content and extract key topics; The emotional analysis: emotional analysis of the call content to determine the emotional state of both parties; Analysis of the recording playback: the cloud phone terminal requests to obtain the recording file corresponding to the call record, and the cloud server terminal responds by returning the recording file to the cloud phone terminal for playback.

[0008] In combination with the first aspect, further, the call analysis step further includes: using a speech recognition algorithm to convert the call audio into text data in real time; using a large language model to perform topic analysis on the call text, identify and extract key topics and information points in the call, and output a summary of the call content, which is specifically achieved by the following steps: Call content segmentation step: Based on the transcribed text content, mark the start and end of each turn to segment the call content into individual turns; Context association step: First, use Python and Jieba to perform Chinese word segmentation and data cleaning, remove noise characters, punctuation marks, and stop words to ensure data cleanliness; adopt a hierarchical encoder-decoder structure, use two encoders to encode each turn and the entire conversation context respectively, to model the relationship between turns; Vectorization step: Input the segmented conversation content into the fine-tuned large model and output the embedding vector of each turn; Information extraction step: Use clustering algorithms to analyze the embedding vectors, identify key topics in the call, and output the topic of the call content; use named entity recognition technology to identify and extract key information points in the call; Summary generation step: A sequence-to-sequence model is used to generate a summary word by word through a decoder based on the extracted key topics and information points; the decoder uses the output of the previous step and the context information of the encoder to predict the next word at each time step; a beam search decoding strategy is used to generate a coherent and informative summary; Post-processing step: Improve readability and accuracy by correcting grammar and removing redundant information, and finally output the call summary.

[0009] In combination with the first aspect, further, the result display step further includes, after the cloud phone receives call-related information, using graphical user interface technology to dynamically generate and display the user's relationship map; the relationship map uses a data visualization algorithm to intelligently adjust the size and layout of each contact's avatar according to weight parameters of the number of calls and call duration, and after the user clicks on any contact's avatar, he can gradually drill down to view the call record data, the call content, summary and emotions of each call, and can listen to the recording again.

[0010] In combination with the first aspect, further, the step of establishing a connection further includes, when the user opens the address book relationship map function through the cloud phone, automatically triggering an asynchronous request, passing the mobile phone number to obtain all call record data associated with the user's work number, including contact information and call information.

[0011] In combination with the first aspect, further, the step of establishing a connection further includes a data synchronization processing step: after the data is synchronized, after the voice call platform receives the request, it screens out the contacts and call records who have made calls with the work number within a certain period of time, and transmits the information to the cloud phone server through the data synchronization mechanism, and further synchronizes it to the cloud phone.

[0012] A second aspect of the present invention provides a cloud phone call data processing system based on big data technology, the system comprising: Connection establishment module: When the user opens the relationship map function of the cloud phone address book, the cloud phone initiates a request to obtain all contacts of the user's work number and establishes a call connection with the contacts through the work number; Obtaining request module: responding to the call contact's request, transmitting the information of all contacts of the user's work number to the cloud phone end; User relationship map display module: display the user relationship map on the interface according to all contact information of the user work number received; Call recording module: The voice call platform receives a request to record a call and requests to obtain the contact's call records; Call record return module: the voice call platform returns the corresponding call records to the cloud phone service end and the cloud phone end; Call analysis module: the cloud phone terminal requests the voice call platform to analyze the content in the call record; Call result return module: the voice call platform returns the analyzed content to the cloud phone service end and the cloud phone end; Result display module: After receiving the analysis-related information, the cloud phone terminal displays the analysis content.

[0013] The embodiments of the present invention include the following advantages: the present invention can realize the analysis and recording of cloud phone work calls, and present the intelligent analysis results of call relationships and call content, including presenting the most recent call character relationships, as well as the corresponding call content, recordings, topic analysis and sentiment analysis, improving the content of incoming and outgoing call records, and conducting in-depth analysis of call content, including but not limited to topic identification, sentiment analysis, etc. In addition, the present invention provides a user-friendly application interface, allowing users to easily view and understand call analysis results. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 It is a system architecture diagram of an embodiment of a cloud phone call data processing method based on big data technology of the present invention; Figure 2 It is a flow chart of a cloud phone call data processing method based on big data technology of the present invention; Figure 3 This is a schematic diagram of a cloud phone call record page based on big data technology of the present invention; Figure 4 A schematic diagram of a call record analysis page of a cloud mobile client based on big data technology of the present invention; Figure 5 It is an internal structure diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0015] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0016] Figure 1 An exemplary system architecture of a system to which the present invention can be applied is shown; Figure 1 As shown, the system architecture includes a cloud phone client, an Internet network and a cloud server. The Internet network is used to provide a medium for a communication link between the cloud phone client and the cloud server. The Internet network can include various connection types, such as wired, wireless communication links or optical fiber cables, etc. The present invention can be applied to China Unicom's online privacy communication cloud phone business system.

[0017] The cloud phone client can establish a communication link with the cloud server to perform various operations, such as watching videos, listening to music, etc. Information can also be exchanged. The cloud server carries and runs various Android applications.

[0018] As an emerging service model, cloud virtual Android phones provide users with a solution to run the Android operating system without physical devices. The call APP in the cloud phone will provide basic call recording and call record functions, usually including basic information such as the date, time, duration and participants of the call.

[0019] The cloud phone call APP provides a basic call recording function, which automatically records the call content during the call. Call recording usually includes the following steps: Step 1: Sound capture. During a call, the audio signal is first captured by a microphone and converted into an analog signal; Step 2: Analog to digital conversion. The analog signal is then converted to a digital signal through an analog-to-digital converter; Step 3: Audio encoding. The digital audio signal needs to be encoded to reduce the file size while maintaining the audio quality; Step 4: Data storage. The encoded audio data is stored in the storage medium of the device; Step 5: Data synchronization. If the system is designed to store recordings in the cloud, the recording data needs to be synchronized with the cloud server to ensure data backup and accessibility.

[0020] In addition, you can also record the call while you are on the phone. The call record usually includes the following steps: Step 1: Data capture. Capture call data by monitoring phone events (such as dialing, answering, and hanging up); Step 2: Data storage. The captured data is stored in a database for subsequent query and analysis; Step 3: Data retrieval. Users can retrieve call records by entering specific search criteria (such as date, phone number); Step 4: Data display. The system displays the retrieved call records on the interface in a user-friendly manner.

[0021] Figure 2 The flowchart of a cloud phone call data processing method based on big data technology of the present invention is shown; Figure 2 As shown, the call record includes the following steps: 1. The user establishes a call connection with a contact through the work number; when the user opens the relationship map function of the cloud phone address book, the cloud phone initiates a request to obtain all contacts of the user's work number; 2. The cloud server responds to the call contact acquisition request and transmits all contacts of the user's work number to the cloud phone; 3. The cloud phone displays the user relationship map on the interface based on the received contact information, such as Figure 3 As shown, the graph shows the information relationship with each contact in the form of a graph based on the weight of the call; 4. Further, when the user clicks on a contact's avatar, the cloud phone initiates a request to obtain the contact's call records; 5. After receiving the above call record request, the cloud phone service end requests the voice call platform to obtain the call record of the contact; 6. The voice call platform returns the corresponding call records to the cloud phone server, and further returns the call records to the cloud phone; 7. Based on its actual needs, the cloud phone client can request the cloud phone server to obtain call recording files, audio-to-text records, sentiment analysis, and topic analysis, etc. The cloud phone server will send the corresponding request to the voice recording platform; 8. The voice recording platform returns the results of the analysis: the analyzed call recording file, recording-to-text record, sentiment analysis, and topic analysis are returned to the cloud phone server, and the cloud phone server returns the analysis content to the cloud phone again; 9. Based on demand, the cloud phone terminal displays text records, sentiment and topic analysis data.

[0022] The cloud server responds to the call record acquisition request and transmits the contact's call record to the cloud phone for display. Figure 4 As shown, the present invention provides recording playback and call content analysis for each call record. The specific analysis objects may be call content analysis, call summary analysis, sensitive word analysis, and a summary of the call.

[0023] Call content analysis: Use speech recognition technology to convert the audio content of both parties in the call into text for further analysis.

[0024] Topic analysis: Use natural language processing technology to perform topic analysis on call content and extract key topics.

[0025] Sentiment analysis: Analyze the sentiment tendency of the call content to determine the emotional state of both parties.

[0026] Recording playback: The cloud phone requests the recording file corresponding to the call record, and the cloud server responds by returning the recording file to the cloud phone for playback.

[0027] Call content display: The cloud phone requests the call content text, call topic, and call sentiment analysis content, and displays them on the cloud phone.

[0028] The present invention implements cloud phone call records through the following modules: 1. User interface activation module: responsible for initiating data acquisition requests. When a user opens the address book relationship map function through a cloud phone, the system automatically triggers an asynchronous request and passes the mobile phone number to obtain all call record data associated with the user's work number, including contact information, call information, etc. 2. Data synchronization and processing module: responsible for synchronizing processed data. After receiving the request, the voice call platform will filter out the contacts and call records that have made calls with the work number within a certain period of time, and transmit the information to the cloud phone server through the data synchronization mechanism, and further synchronize it to the cloud phone; 3. Call analysis module: responsible for in-depth analysis of call content. Including: speech recognition technology (ASR), using speech recognition algorithm to convert call audio into text data in real time; large language model, using large language model to perform topic analysis on call text, identify and extract key topics and information points in the call, and output call content summary; sentiment analysis, based on the call text content, evaluate the emotional state of both parties, such as friendly, negative, etc., and output the emotional state of both parties; When conducting call analysis, the analysis is mainly centered around the call text and content summary, and the following technologies are used to implement call analysis: Call content segmentation. Based on the transcript content, mark the start and end of each turn to segment the call content into individual turns; Context association. First, use Python and Jieba to perform Chinese word segmentation and data cleaning, remove noise characters, punctuation marks, stop words, etc. to ensure that the data is clean; adopt a hierarchical encoder-decoder structure, use two encoders to encode each turn and the entire conversation context respectively, to model the relationship between turns; Vectorization. Input the segmented conversation content into the fine-tuned large model and output the embedding vector of each turn. Information extraction. Use a clustering algorithm (K-means) to analyze the embedding vector, identify key topics in the call, and output the topic of the call content; apply named entity recognition (NER) technology to identify and extract key information points in the call, such as names, locations, time, etc. Summary generation. A sequence-to-sequence (Seq2Seq) model is used to generate a summary word by word through the decoder based on the extracted key topics and information points. The decoder uses the output of the previous step and the context information of the encoder to predict the next word at each time step. This process uses decoding strategies such as beam search to generate a coherent and informative summary; Post-processing. Improve readability and accuracy through grammar correction, redundant information removal, etc. Finally, output the call summary.

[0029] In addition, visualization functions can also be provided. The relationship map visualization module is responsible for the intelligent and visual presentation of data. After receiving call-related information, the cloud phone uses graphical user interface (GUI) technology to dynamically generate and display the user's relationship map. The map uses a data visualization algorithm to intelligently adjust the size and layout of each contact's avatar based on weight parameters such as the number of calls and call duration. After the user clicks on any contact's avatar, he can gradually drill down to view the call record data, the content, summary, emotions, etc. of each call, and can listen to the recording again.

[0030] The work call acquisition and presentation system of the present invention provides filterable work call record content and information based on the user's work number call records, and presents them by person relationship; and can view call details, recordings, call summaries and other analysis results in depth with one click.

[0031] (1) Acquisition of call records: The system obtains the call records of the work number, including but not limited to the call time, call duration, call recipient, etc.

[0032] (2) Presentation of character relationships: The system can identify the identity of the caller and classify and present the relationships between the characters (such as colleagues, customers, suppliers, etc.), helping users better understand the context and importance of the call.

[0033] (3) View call details: Users can view the details of a call with just one click, including call time, duration, and detailed information about the caller.

[0034] (4) Call summary analysis: The system can automatically generate a call summary, extract the key information and main points of the call, and help users quickly grasp the core content of the call.

[0035] (5) User-friendly interface: The system will have an intuitive and easy-to-use user interface that allows users to easily manage and analyze call records.

[0036] Furthermore, the screening range of work calls can be set and modified by the user.

[0037] The present invention can be applied to any device with an Android operating system, including a cloud virtual phone or a physical phone.

[0038] The present invention can analyze and record the working calls of the cloud phone, and present the intelligent analysis results of the call relationship and call content in the form of a relationship graph, thereby improving the accuracy of the call records. At the same time, the intelligent analysis results provided improve the analysis quality and efficiency of the call content, thereby avoiding users from manually analyzing the call voice manually.

[0039] Figure 5 An example of a physical structure diagram of an electronic device is shown. The electronic device may be a smart terminal, and its internal structure diagram may be as follows: Figure 5 As shown. The electronic device includes a processor, an internal memory and a network interface connected via a system bus. The processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the electronic device is used to communicate with an external terminal via a network connection.

[0040] Those skilled in the art will understand that Figure 5 The structure shown in the figure is only a block diagram of a part of the structure related to the scheme of the present invention, and does not constitute a limitation on the electronic device to which the scheme of the present invention is applied. The specific electronic device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0041] It should be noted that the terms used herein are only for describing specific embodiments and are not intended to limit the exemplary embodiments according to the present application.

[0042] In the above detailed description, reference is made to the accompanying drawings, which form a part of this document. In the accompanying drawings, similar symbols typically identify similar components unless the context indicates otherwise. The illustrated embodiments described in the detailed description, drawings, and claims are not meant to be limiting. Other embodiments may be used, and other changes may be made, without departing from the spirit or scope of the subject matter presented herein.

[0043] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A cloud phone call data processing method based on big data technology, characterized in that: The method comprises the following steps: Steps to establish a connection: When the user opens the relationship map function of the cloud phone address book, the cloud phone initiates a request to obtain all contacts of the user's work number, and establishes a call connection with the contacts through the work number; Obtaining request step: responding to the call contact's request, transmitting the information of all contacts of the user's work number to the cloud phone end; User relationship map display step: displaying the user relationship map on the interface according to all contact information of the user work number received; Recording call steps: The voice call platform receives a request to record a call and requests to obtain the contact's call records; Call record return step: the voice call platform returns the corresponding call records to the cloud phone service end and the cloud phone end; Call analysis step: the cloud phone terminal requests the voice call platform to analyze the content in the call record; Call result return step: the voice call platform returns the analyzed content to the cloud phone service end and the cloud phone end; Result display step: After receiving the analysis-related information, the cloud phone terminal displays the analysis content.

2. A cloud phone call data processing method based on big data technology as claimed in claim 1, characterized in that: The call analysis step is performed on the content, theme, emotion and playback of the call. Analysis of the call content: using speech recognition technology to convert the audio content of both parties of the call into text for further analysis; Analysis of the topic: using natural language processing technology to perform topic analysis on the call content and extract key topics; The emotional analysis: emotional analysis of the call content to determine the emotional state of both parties; Analysis of the recording playback: the cloud phone terminal requests to obtain the recording file corresponding to the call record, and the cloud server terminal responds by returning the recording file to the cloud phone terminal for playback.

3. A cloud phone call data processing method based on big data technology as claimed in claim 2, characterized in that: The call analysis step further includes: using a speech recognition algorithm to convert the call audio into text data in real time; using a large language model to perform topic analysis on the call text, identify and extract key topics and information points in the call, and output a summary of the call content, which is specifically achieved through the following steps: Call content segmentation step: Based on the transcribed text content, mark the start and end of each turn to segment the call content into individual turns; Context association step: First, use Python and Jieba to perform Chinese word segmentation and data cleaning, remove noise characters, punctuation marks, and stop words to ensure data cleanliness; adopt a hierarchical encoder-decoder structure, use two encoders to encode each turn and the entire conversation context respectively, to model the relationship between turns; Vectorization step: Input the segmented conversation content into the fine-tuned large model and output the embedding vector of each turn; Information extraction step: Use clustering algorithms to analyze the embedding vectors, identify key topics in the call, and output the topic of the call content; use named entity recognition technology to identify and extract key information points in the call; Summary generation step: A sequence-to-sequence model is used to generate a summary word by word through a decoder based on the extracted key topics and information points; the decoder uses the output of the previous step and the context information of the encoder to predict the next word at each time step; a beam search decoding strategy is used to generate a coherent and informative summary; Post-processing step: Improve readability and accuracy by correcting grammar and removing redundant information, and finally output the call summary.

4. The method for processing cloud phone call data based on big data technology as claimed in claim 1, characterized in that: The result display step further includes that after the cloud phone receives call-related information, it uses graphical user interface technology to dynamically generate and display the user's relationship map; the relationship map uses a data visualization algorithm to intelligently adjust the size and layout of each contact's avatar according to weight parameters of the number of calls and call duration, and after the user clicks on any contact's avatar, he can gradually deepen his view of the call record data, the content, summary and emotions of each call, and can listen to the recording again.

5. The method for processing cloud phone call data based on big data technology as claimed in claim 1, characterized in that: The step of establishing a connection further includes, when the user opens the address book relationship map function through the cloud phone, automatically triggering an asynchronous request, passing the mobile phone number to obtain all call record data associated with the user's work number, including contact information and call information.

6. A cloud phone call data processing method based on big data technology as claimed in claim 5, characterized in that: The step of establishing a connection further includes a data synchronization step: after the data is synchronized, after the voice call platform receives the request, it screens out the contacts and call records that have had calls with the work number within a certain period of time, and transmits the information to the cloud phone server through the data synchronization mechanism, and further synchronizes it to the cloud phone.

7. A cloud phone call data processing system based on big data technology, characterized in that: The system comprises: Connection establishment module: When the user opens the relationship map function of the cloud phone address book, the cloud phone initiates a request to obtain all contacts of the user's work number and establishes a call connection with the contacts through the work number; Obtaining request module: responding to the call contact's request, transmitting the information of all contacts of the user's work number to the cloud phone end; User relationship map display module: display the user relationship map on the interface according to all contact information of the user work number received; Call recording module: The voice call platform receives a request to record a call and requests to obtain the contact's call records; Call record return module: the voice call platform returns the corresponding call records to the cloud phone service end and the cloud phone end; Call analysis module: the cloud phone terminal requests the voice call platform to analyze the content in the call record; Call result return module: the voice call platform returns the analyzed content to the cloud phone server and the cloud phone; Result display module: After receiving the analysis-related information, the cloud phone terminal displays the analysis content.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the cloud phone call data processing method based on big data technology described in any one of claims 1 to 6 are implemented.

9. A computer device, characterized in that: include: Memory for storing computer programs; A processor is used to execute the computer program to implement the steps of the cloud phone call data processing method based on big data technology as described in any one of claims 1 to 6.

Citation Information

Cited By

  • Call processing method, device and equipment

    CN120600025A