Systems and methods for videoconferencing analysis and optimization - Patents.com
The communication guidance system addresses non-verbal communication limitations in video conferencing by using AI to analyze and optimize presentations, offering real-time feedback and adjustments for improved engagement.
Patent Information
- Application Number
- JP2024531454
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-11-23
- Filing Date
- 2022-11-23
- Publication Date
- 2024-11-28
AI Technical Summary
The lack of non-verbal communication insights in video conferencing hinders effective communication, and existing systems fail to provide real-time feedback and optimize video call presentations accurately.
A communication guidance system that uses natural language processing and machine learning to analyze audio and video data during and after video conferences, providing real-time feedback and optimizing presentations by identifying issues, adjusting hardware settings, and generating recommendations based on KPIs.
Enhances communication effectiveness by providing personalized feedback to presenters, optimizing video call presentations, and improving engagement through real-time and post-call analysis.
Smart Images

Figure 2024544176000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to communications, and more particularly to systems and methods for understanding how communications are being received and for providing real-time behavioral feedback to understand how communications are being received so that quantitative analysis can be performed to determine KPIs for optimizing video call presentations. [Background technology]
[0002] As more and more meetings are held via online video communication, some of the typical non-verbal means of communication are hindered as a result of limited insight, lack of physical presence or visibility of each participant. This can be further impaired by the quality of audiovisual equipment and internet speed and processing. However, as a result of communicating via video conferencing, additional data can be tracked, and done so in real-time, which can not only help offset some of the limitations of non-verbal communication but also provide advances and deeper insight into how the communication is being received. This can be done using machine learning and artificial intelligence, using metrics not previously tracked and analyzed, thereby resulting in improved communication. Tracking / analysis of metrics can provide personalized feedback to the presenter, thereby providing instant feedback to improve communication between the recipient and the presenter, to better understand how the messaging is being received and responded to. Providing solutions to this and other problems will become apparent through the description and examples provided below.
[0003] As these new metrics are tracked, systems and methods are also needed to update the accuracy and relevance of those metrics, particularly to generate key performance indicators (KPIs) and understand how those KPIs can optimize video call presentations. Summary of the Invention [Means for solving the problem]
[0004] Using a communication guidance system to identify talking points during video conference calls In one embodiment, the communication guidance system is used to set up talking points that will be used by a presenter to communicate and effectively present material in an organized and efficient manner.
[0005] In another embodiment, a communication guidance system comprises a non-transitory computer-readable medium, an input recognition interface, and processing circuitry operably connected to the non-transitory computer-readable medium and the input recognition interface, the processing circuitry configured to perform tasks of receiving one or more points of discussion, analyzing utterances from a user or recipient, identifying whether any of the utterances correlate to one or more points of discussion, and modifying the one or more points of discussion in a manner indicative of the points of discussion.
[0006] In another embodiment, the processing circuitry may further analyze the completed video conference taking into account one or more points and perform an analysis to determine at least one of the following: the order in which each point was presented, the amount of time spent discussing each point, and the feedback received from the recipient regarding each point.
[0007] In another embodiment, a method for tracking topics during a video conference call includes receiving one or more topics into a communications guidance system, categorizing and displaying the topics during the video conference call, analyzing speech of all parties participating in the video conference, calling to determine if any of the one or more topics have been mentioned, and updating the display of the one or more topics based on the analysis of the speech.
[0008] In another embodiment, the method for tracking issues further includes pre-processing one or more issues using a natural language algorithm.
[0009] In another embodiment, the issue tracking method further includes analyzing the completed video conference call considering one or more issues, and performing the analysis to determine at least one of the following: the order in which each issue was presented, the amount of time spent discussing each issue, and the feedback received from the recipient regarding each issue.
[0010] Use of the call guidance system for pre-call analysis of video conference calls In another embodiment, the communication guidance system is used to perform a number of pre-call analyses of various aspects related to the manner in which the presenter communicates information. Some of these analyses include consistency of voice levels, appropriate intonation, appropriate gestures, timing relative to content, recognition of the recipient's verbal and non-verbal feedback, and numerous other aspects.
[0011] In another embodiment, a communication guidance system includes a non-transitory computer-readable medium, an input recognition interface, and processing circuitry operably connected to the non-transitory computer-readable medium and the input recognition interface, the processing circuitry configured to analyze both audio and video data from a user and a recipient, determine an assessment of whether a user achieved a goal based on a predetermined goal, and provide improvement recommendations based on the assessment.
[0012] In another example, the recommendations may include any of the following: changing speech inflection, monitoring for appropriate gestures, displaying content in a timely manner, modifying camera or audio equipment, updating background or lighting, and identifying opportunities to enable the recipient to provide additional input.
[0013] Use of a Communications Guidance System for Post-Call Analysis of Video Conference Calls In another embodiment, the communication guidance system is used to perform a number of post-call analyses of various aspects related to the manner in which the presenter communicates information. Some of these analyses include consistency of voice levels, appropriate intonation, appropriate gestures, timing relative to content, recognition of the recipient's verbal and non-verbal feedback, and numerous other aspects.
[0014] In another embodiment, a method of analyzing a presentation is disclosed comprising the steps of: recording audio and visual data of both the presenter and the recipients associated with the presentation each time the presentation is presented; and analyzing the received audio and visual data based on predetermined objectives to determine the extent to which the predetermined objectives have been met.
[0015] In another embodiment, the method of analyzing a presentation further comprises categorizing the audio and video data by region or area.
[0016] In another embodiment, the method of analyzing a presentation further includes comparing the aggregated analyzed audio and video data associated with each region or area to each region or area.
[0017] In another embodiment, the method of analyzing the presentation further includes modifying the presentation of any areas or regions that are statistically significant below a predetermined threshold.
[0018] In another embodiment, a statistically significant range for a method of analyzing a presentation is at least one standard deviation from a predefined threshold.
[0019] Using Communication Guidance Systems to Measure Return on Investment In another embodiment, a communication guidance system comprises: a non-transitory computer readable medium; an input recognition interface; and a processing circuit component operably connected to the non-transitory computer readable medium and the input recognition interface, the processing circuit component configured to perform the tasks of analyzing both audio and video data from a user and a recipient; determining an assessment of whether a user achieved a goal based on a predetermined goal; and providing improvement recommendations based on the assessment.
[0020] In another embodiment, the communication guidance system recommendations may include one or more of the following: changing speech inflection, monitoring for appropriate gestures, displaying content in a timely manner, modifying camera or audio equipment, updating background or lighting, and identifying opportunities to enable the recipient to provide additional input.
[0021] In another embodiment, a method for tracking issues includes the steps of receiving one or more issues into a communications guidance system, categorizing and displaying the issues during a video conference call, analyzing speech of all parties participating in the video conference call to determine whether any of the one or more issues were mentioned, and updating the display of the one or more issues based on the analysis of the speech.
[0022] In another embodiment, a method for determining sales team ROI is disclosed comprising the steps of: recording audio and visual data from each video conference sales call using a communications guidance system; receiving CRM data; analyzing the audio and visual data in light of the CRM data to build a profile associated with each recipient of the video conference sales call; identifying key moments and moments of accomplishment in each recorded video conference sale; developing demographic data based on the generated profile and associating both the key moments and moments of accomplishment with the demographic data; associating the sales data with the demographic data; comparing the sales data with the moment of accomplishment data for at least one demographic area of the demographic data; determining a sales team associated with the compared sales data; and comparing the determined sales teams and their costs to average sales data across each demographic area.
[0023] In another embodiment, the method for determining ROI for a sales team further includes determining an estimated cost associated with a new product launch to a particular demographic using the identified key moment and moment of accomplishment information in conjunction with the sales data for the particular demographic.
[0024] System and method for updating a communication guidance system - Patents.com In another embodiment, a method for updating a communications guidance system includes recording audio and visual data from each videoconference sales call using the communications guidance system, analyzing the audio and visual data in view of a baseline behavioral database for each recipient of the videoconference sales call to determine behavioral indicators, comparing sales data associated with each recipient to the behavioral indicators, and updating the baseline behavioral database based on the compared sales data and behavioral indicators.
[0025] In another embodiment, the method of updating a communications guidance system further includes collecting sales representative notes related to the video conference sales call and updating the baseline behavior database with the information.
[0026] In another embodiment, the method of updating the communications guidance system further includes collecting recipient sales agent notes associated with the video conference sales call, using the notes to build individual profiles associated with each of the one or more recipients, and updating the baseline behavioral database with each of the individual profiles.
[0027] System and database for generating behavioral recommendations In another embodiment, a method for recommending industry tools to be used includes receiving input regarding one or more desired behavioral outcomes and analyzing the input using a levers and lenses taxonomy framework, where levers represent industry tools and lenses represent cognitive factors influencing engagement, and the framework is enabled using a plurality of recorded video conference presentations categorized by industry to confirm or update relevant levers or lenses used during a particular video conference presentation, and further developing a weighting algorithm to enable remaining lenses and levers identified in the framework that must be further enabled by the recorded video conference presentation.
[0028] Systems and methods for providing video call optimization recommendations and sales team optimization - Patents.com In another embodiment, a method for generating one or more key performance indicators and recommending action items based on the one or more key performance indicators includes generating industry specific insights using a design recommendation engine that compares current journal research with a cognitive feedback framework including a database of levers representing industry tools and lenses representing cognitive factors influencing engagement; generating post-call analysis and insight information using a communications guidance system based on recorded audio and visual data from a plurality of video conference presentations; analyzing the post-call analysis and insight information taking into account the industry specific insights to generate one or more key performance indicators relevant to a user query; and generating recommendations based on the one or more key performance indicators.
[0029] Systems and methods for real-time behavioral feedback Contemplated herein are systems and methods for providing real-time feedback (and guidance prompts) during live video conference meetings. Some of the feedback is generated from machine learning analysis of variables including: attention analysis, voice attributes, body posture, eye engagement, and behavior analysis. Each form of feedback may be guided through moments of unusual performance with feedback during the live video conference call in the form of color indicators, scales, graphs, percentages, or other numbers.
[0030] As the provider engages with the recipient, the recipient's feedback in the form of non-verbal and verbal communications is monitored and analyzed to provide various indicators regarding the level of engagement from the recipient. [Brief description of the drawings]
[0031] [Figure 1] 1 illustrates a flowchart of one methodology for using a communications guidance system to identify issues. [Diagram 2]An overview diagram of integrating the topic into a communication guidance system is shown. [Diagram 3] 1 shows an example screenshot of a communication guidance system that monitors and tracks issues. [Figure 4] An overview of a methodology that can support the proposed goals through pre-call analysis using a communication guidance system is presented. [Diagram 5] Figure 4 shows a schematic diagram of the communication guidance system. [Figure 6] 1 shows a schematic diagram of some objectives to be achieved during a practice video conference presentation. [Figure 7] 1 shows an overview diagram of a methodology for conducting post-call analysis using a communications guidance system. [Figure 8] FIG. 1 shows a schematic diagram of various aspects of a post-call analysis process and information that may be obtained. [Figure 9] 1 illustrates various user and usage ROI flow charts that may be used in conjunction with the communications guidance system. [Figure 10] 1 shows a flow chart for updating the content, analysis and weighting of the communication guidance system. [Figure 11] 1 shows a flowchart of a methodology for generating KPIs and recommendations for several areas related to video conference calls. [Figure 12A] 1 illustrates various views of a real-time feedback interface for use with video conference meetings. [Figure 12B] 1 illustrates various views of a real-time feedback interface for use with video conference meetings. [Figure 12C] 1 illustrates various views of a real-time feedback interface for use with video conference meetings. [Figure 12D] 1 illustrates various views of a real-time feedback interface for use with video conference meetings. [Figure 12E]1 illustrates various views of a real-time feedback interface for use with video conference meetings. [Figure 12F] 1 illustrates various views of a real-time feedback interface for use with video conference meetings. [Figure 12G] 1 illustrates various views of a real-time feedback interface for use with video conference meetings. [Figure 12H] 1 illustrates various views of a real-time feedback interface for use with video conference meetings. [Figure 13] 1 shows a flowchart for receiving various types of data from participants in a video conference call, analyzing the data, and displaying feedback based on the analyzed data. [Figure 14] This presents an overview of communication guidance systems and methodologies. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0032] Using a communication guidance system to identify talking points during video conference calls This disclosure relates generally to a communications guidance system and related methods designed to receive, track and analyze talking points during a live or recorded video meeting presentation. This application focuses on this and other potential pre-call analysis tasks to assist users in improving their communication skills and overall presentation.
[0033] One of the objectives of any meeting is to attempt to communicate a list of items to be discussed. These items may be referred to as "talking points." It is contemplated herein that a platform may be run as an app or via a browser to assess and support whether those talking points have been communicated during a given call. The platform may be configured to receive each of the talking points that a user or presenter wishes to address during a video conference and store them in memory. When a video conference is beginning, the platform may display a reference indicator, such as a number or letter of the talking point or each talking point, and highlight identified talking points. Identification of talking points may be accomplished using a natural language processing engine.
[0034] FIG. 1 shows a flow chart 10 of one methodology of using the communication guidance system to identify talking points. In step 110, a user or presenter can input a list of talking points into the system and order the talking points to be displayed in a particular manner. The user / presenter can also select a style in which to display the talking points as well as a style associated with the talking points once they are achieved. The system then stores the talking points in a database in step 112 and can optionally perform a pre-processing analysis of the talking points using text recognition and natural language processing algorithms. For example, the system can prompt the user to read each talking point orally to match the particular user's voice to the talking points entered, thereby allowing the system to perform efficiently and accurately. If the user is aware that the recipient has participated in a previously recorded presentation, additional NLP analysis of the user will be performed to update the algorithm for future presentations to identify talking points efficiently and accurately again when the talking points are identified or discussed from the recipient's side.
[0035] Once the points are entered into the system and analyzed based on the identified users and recipients for the upcoming video conference call, the points may then be displayed during the actual video conference call in step 116. As the system 114 identifies each point, it then marks the displayed points as having been accomplished in a user-specified style. It is possible.
[0036] FIG. 2 shows an overview diagram 20 of integrating talking points 210 into the communication guidance system. As previously mentioned, these talking points can be customizable 212 based on the particular presentation to be maintained and determined by user and / or customer input. These talking points can also be imported from a list of talking points from a previous presentation where a particular talking point was not discussed. These talking points can be used as part of a pre-call practice 220 where they are displayed and the user rehearses the presentation, for example with a colleague. During the pre-call, the system can again identify when each talking point was achieved. As previously mentioned, 230 shows how talking points can be used during the video conference call and how they are highlighted 232. After the call is achieved, additional post-call analysis 240 can be performed to further analyze each of the talking points that were discussed. For example, at what point during the conversation certain talking points were introduced, the order in which they were introduced, the time spent on each talking point, the amount of commentary, questions, or attention each talking point received from the presentation recipients, and other analyses.
[0037] FIG. 3 shows an example screenshot 30 of a communication guidance system that monitors and tracks points of discussion. The presentation recipient's view 320 may be the primary focus of the display, with the user / presenter's view 322 being a smaller, less focal point of the overall display. Points of discussion 310 may be positioned or relocated to various areas on the display, as they are shown on the right. As shown, various styles may be imported to identify when points have been achieved. For example, as shown, text may appear in red if the points have not been discussed, in contrast to green for those that have been discussed. Those points that have been discussed may also be cancelled or removed entirely.
[0038] Use of the call guidance system for pre-call analysis of video conference calls FIG. 4 shows an overall overview 40 of how the methodology can support the proposed goal 420 through pre-call analysis 430 and by utilizing a communication guidance system 50. As shown, the left-most column 410 shows several user types, including a sales representative 412. Other user types will become apparent in other applications that build upon and relate to this application. As a sales representative 412, a person often has several goals or objectives that are aimed at being achieved. Listed are a sample of some of these objectives, including performance, focus, interest, engagement, relationship, connection, trust, and agreement. The pre-call training and analysis portion of the communication guidance system can help improve and ultimately achieve these stated objectives. In one basic example, the sales representative 412 practices a presentation with a colleague, such as the one shown in the overview diagram 60 of FIG. 6.
[0039] Referring back to column 430, various aspects of the presenter are recorded and analyzed to achieve some of the objectives set forth in column 420. For example, to ensure optimal performance from the sales representative 412, the communication guidance system can analyze the microphone levels and the positioning of the camera displaying the sales representative. If the levels are too low or the positioning is off, the system 50 can make recommendations to adjust them accordingly. The system can analyze the hardware used for the camera and optimize the camera settings. The system can also recommend changes to the lighting or background settings that can be based on the type of presentation to be given, the presenter's hardware, and the intended audience receiving the presentation. It is known that lighting can affect an individual's mood. Understanding the presenter and, if possible, the user's display setup can also aid in this analysis. For example, if the presenter uses a dual monitor system, the system can help determine which screen should be the main screen and which screen should be the supporting screen. The system can also provide recommendations for information or resources to be used in one screen that will be displayed during certain parts of the call on the main screen. In another variation, the system can determine whether the user should switch sharing modes to present content as opposed to verbally conveying information.
[0040] For example, if a sales representative is quoting or listing a set of statistics that they have on their secondary monitor, the recipient of the presentation will now be looking at the presented statistics on the screen and will not be so focused on where or how the sales representative is looking at that moment, so the system can recommend that those statistics become part of the slide that is added to the play queue when that part of the presentation is to be presented, thereby allowing the sales representative to focus on the accuracy of the statistics as opposed to making proper eye contact with the recipient, thus reducing potential distractions and maintaining the recipient's focus, which may be one of the objectives.
[0041] After the practice conference call is completed, the system can also determine the user's speech intonation, the flow of the presentation, and analyze whether the user missed any verbal or visible cues where the recipient was attempting to engage or respond. For example, sometimes a sales representative may feel they need to finish the content of a section they are presenting before they can ask any questions. The communication guidance system can be configured to analyze the recipient's body posture along with the sounds the recipient makes to determine whether the sales representative missed an opportunity to allow the recipient to speak. Some instances of this include the recipient's mouth being open for a period of time, which may indicate they are waiting for a pause to say something. Nodding, hand gestures, or non-verbal sounds, such as those indicating excitement, confusion, disagreement, etc., can all be analyzed to determine the number of missed opportunities to allow the recipient to respond. The system can also pick up the number of times the user or recipient talks too much or interrupts others.
[0042] The communication guidance system 50 can be configured in both pre-call analysis and live analysis aspects. Some of the following will describe both, but the primary focus of this application will be on many of the post-call analysis aspects that are not always easily accessible during a call, such as the percentage of who is talking, responses to different speech patterns or tones or inflections of the sales representative, etc. Additional aspects of post-call analysis include updating parameters, such as background, lighting, camera angle, and speech inflections, based on the targeted audience.
[0043] FIG. 5 shows a schematic diagram of the communication guidance system 50 portion of FIG. 4. Under the data points column 500 is a list of various inputs that the communication guidance system 50 can receive and use for analysis. Many of these inputs can be received by microphones and cameras already associated with the participant's computer system used to conduct the video conference call. This includes laptops, desktops, smartphones, tablets, and the like. Some of the inputs require initial analysis such as eye tracking, head and body movements. These movements are first defined by a movement analysis algorithm that can determine the user's body parts and the movements each part is performing. This can be seen as the first layer of analysis from the raw camera visual data. After this initial analysis is performed, the movements can then be further analyzed against thresholds, examples of which are shown under the data points condition column 510. For example, as shown, the eye tracking data from column 500 can then be further analyzed against the eye blink threshold in column 510.
[0044] One or more of these conditioned data results under column 520 may be used to provide a type of feedback under column 530, such as some of the feedback indicators discussed above. For example, "nodding" conditioned data combined with "breathing in and holding mouth open" conditioned data may indicate that the participant is highly engaged and looking for an opportunity to respond. Thus, an attention indicator may go high, while another feedback indicator may indicate that the presenter should stop speaking because the participant is ready to respond to the information being conveyed. This may appear in the form of an emoji or a blinking border.
[0045] Referring back to column 500, some of the inputs relate to previously acquired details about each participant and may even include data from the presentation about to be given, the purpose or goal of the call, etc. These data points may then be used to identify keywords, using natural language processing algorithms to determine if those keywords and phrases were mentioned and by which participant. For example, if a presenter delivers one of their talking points, that talking point goal may be achieved and an indicator may be displayed indicating the number / percentage of the type of talking points that were achieved during the presentation. Furthermore, if a recipient repeats or confirms a talking point in a particular manner, for example, by repeating the talking point, with a nod (positive or negative), then another indicator may be displayed regarding "agreement" regarding that talking point, referring to whether they agreed or not.
[0046] Referring again to FIG. 6, when a sales representative utilizes the communication guidance system described herein, the communication guidance system allows them, the presenter 602, to check audio and video parameters 612 and practice with their colleagues, the recipients 604, thereby improving retention of the presentation, reviewing talking points, analyzing timing, and adjusting the layout 614.
[0047] Use of a Communications Guidance System for Post-Call Analysis of Video Conference Calls FIG. 7 shows a schematic diagram of a methodology for implementing a post-call analysis 70 using a communication guidance system. As mentioned above, a natural language processing algorithm 700 can be running during the call and processing in the background to process any spoken text. This NLP algorithm can be configured to recognize all participants and transcribe the dialogue. Every sentence appears with a confidence value and a timestamp. As mentioned in the related application, this real-time recognition of the speech can be used to identify the entered talking points with confidence values based on a predefined threshold to ensure that the talking points are relevant and not just part of a subordinate clause. This NLP algorithm can also be used for post-analysis of the call 702 so that the user can easily jump to various parts of the video. For example, the transcribed dialogue with timestamps can also be matched with various detected verbal and non-verbal captured data that is analyzed using a behavioral response algorithm that can also timestamp and match various behavioral response types so that the post-analysis can be further classified and analyzed or reviewed. This may include categorizing by all times during the call when the recipient was agitated and playing back those sections or alternatively displaying text associated with the dialogue that occurred around the times the recipient was agitated.
[0048] This type of analysis and other analyses can be done on a single call, but more can be done when the analysis is performed across several video recorded calls where the same or different presenters were presenting a particular presentation. FIG. 8 shows a schematic diagram 70 of various aspects of post-call analysis processing and information that can be obtained, including multiple call analysis. Through this multiple call analysis, it can be used to train a design recommendation engine 800 that utilizes continuously updated journal insights of people's behavior and responses to everything from tone, lighting, gestures, etc. When combined and analyzed, the communication guidance system 50 can be optimized to more easily identify and make recommendations to modify the current presentation or analyze future presentations before they are presented.
[0049] Post-call analysis can also include determining the extent to which presenters are aligned with their pre-flight or pre-call plans 802. Some of this includes talking points, as discussed above, but can also include objectives and goals entered into the system, such as reaching a certain level of engagement or understanding.
[0050] Also shown in Figure 8 is analysis related to regions and regions 804. For example, a presentation is received differently based on the region it is presented in. It can analyze differences between sales teams as well as differences between individuals, the amount of time they have as a salesperson or the internal training they have received.
[0051] All of this information can also be used to generate and build profiles of individual sales team members and regular recipients, for example, physicians and managers who regularly listen to sales presentations, to further refine the behavioral recognition aspects and customize the best way to present materials.
[0052] Using Communication Guidance Systems to Measure Return on Investment FIG. 9 illustrates an ROI flow chart 90 for various uses 9000 and users 902 that may be used in conjunction with the communication guidance system 50. Conventional mechanisms for determining the ROI of sales teams and, in particular, those selling pharmaceuticals or other medical-based products, typically involve collecting data on the number of scripts written per zip code, the number of scripts written per pharmacy, doctors, and the like. Some of this data must be honed and obtained from third party sources. By using the communication guidance system 50 as described above, in addition to using call data to generate engagement and response quality metrics, the ability to capture some of this information via direct calls can also be used to predict trends in sales. This can then be used to determine the effectiveness of a given campaign, the effectiveness of the sales team, and how the management team overseeing such is performing, which can then be compared to costs, time, and revenue.
[0053] For example, as shown in the Inputs 904 column of Figure 9, data may be collected and analyzed from multiple sources including scientific journal data, communication guidance system data, which may be raw or pre-processed, and longitudinal and CRM data. Each of these types of input data may then be manipulated using some of the techniques displayed in the Operations 906 column of Figure 9 to produce one of several outputs displayed in the Outputs 908 column. Some of these operations incorporate data from one or more of the input sources that may be analyzed to generate additional information that may be used as an output or used for additional analysis and combined with other raw or manipulated data to produce an output.
[0054] One such example involves using CRM data further recorded from the call guidance system based on one or more calls with a particular physician. This information can be used to build a profile of the physician's individual behavior and performance. As more and more profiles are built, further analysis can be performed using demographic information associated with each profile to determine if there is more difficulty selling to one demographic than another. The types of questions or concerns each demographic conveys can also be used, where this information is tagged from each video sales call using the call guidance system. Those concerns can then be categorized by demographic, i.e., which region or sales team (or individual) received those concerns, and then compared to sales in a particular region as well as across several regions. From here, an analysis of the costs spent on the teams and the management supporting each of these teams can be performed to determine one of a number of ROI metrics. This information can then be used as part of a predictive analysis to try to improve sales or launch new products in new areas.
[0055] System and method for updating a communication guidance system - Patents.com 10 illustrates a flow chart 100 for updating the content, analysis and weightings of a communication guidance system. As previously mentioned, some of the advantages of having a communication guidance system revolve around the ability to capture and analyze several types of data that may be captured during a video conference sales call, which may be used to determine various behavioral metrics, such as determining agreement, confusion, approval, acceptance, etc.
[0056] The need for communication guidance system feedback and updating methodologies and systems can be partially illustrated with the following examples. Each recipient has verbal and physical tendencies that may be unique to that individual. In poker and other games, individuals often try to determine what their opponent's "tell" is, including any indication that may tip off others as to what kind of hand they are currently holding. In baseball, signs are often intercepted to understand the next pitch that is being used and is about to be delivered. Therefore, it can also be important to understand how the recipient of a sales presentation is thinking, which can be learned through building a user profile and understanding their reactions. To further illustrate, if a recipient has recently had back surgery that causes them to present themselves in a "stiffer" manner, the positive or negative response may be significantly different than another user who has not had back surgery or back problems for that matter.
[0057] One way to achieve this is through building a profile of each recipient and updating those profiles with learned information. This can be seen in FIG. 10, where an algorithm receives various inputs 1010 that can be used to update the user's profile as well as generate other outputs 1020 and updates 10030. An initial recipient baseline can be generated using a database of other recipient behaviors and responses. This database can be augmented with updated research, e.g., journal articles. As the communication guidance system continues to be used, other information including sales data can be used to confirm the learned positive and negative indicators. With respect to individual profiles, user notes and previous call analysis can also be used to update the individual user's base profile. Additional information including responding more positively or negatively to a particular sales team member can also be recommended. For example, a particular recipient may have interacted with multiple members of the sales team in the same call and / or across several calls, either individually or in combinations of calls. The system can make recommendations based on the responses the user gives to each user to introduce or update new products, as well as make decisions regarding which members of the sales team are best suited to resolve any issues or get involved in some matters.
[0058] System and database for generating behavioral recommendations Another aspect related to the above embodiments is the creation, updating, enabling and using a Lever and Lens Taxonomy framework that can analyze desired behavioral outcomes to achieve those desired results or, alternatively, analyze the presentation and make recommendations regarding how to predict likely behavioral outcomes.
[0059] In its simplest form, the Lever and Lens Taxonomy Framework is comprised of Lenses, which are a compilation of cognitive factors that influence engagement, and Levers, which are a compilation of industry tools available for use influencing the Lenses. These Lenses and Levers can be further arranged by industry, further reducing the Levers and Lenses to those appropriate or relevant to a particular industry.
[0060] This lever and lens taxonomy framework can be generated by analyzing scientific journal articles and using natural language processing algorithms to parse the information into lever or lens buckets. Below is a sampling of what each of these buckets can contain: lens: ·attention ·Important points ·Distraction Expectations Priming · What sparked attention -Multitasking Task Performance ·search Default Mode Network Task-positive network -Mind wandering Vigilance · Sustained Attention ·Divided attention ·feeling Tasting Emotion prediction ·excitement ·Positive influence ·Negative impact Memorized Fun The pleasure of consumption Emotional arousal Satisfaction Motivational Affordances ·Enjoyable ·awe Pride ·fear Cognitive processes and biases Persuasion Storytelling -Transportation of Narratives ·way of thinking ·context ·Friendliness Willingness to pay Product evaluation Brand loyalty ·Consumer behavior User behavior · Content and format consistency ·decision making ·foothold Door-in-the-face Elaboration possibility model ·framework ·Credibility Cognitive load and fatigue Participation Cognitive taxation Working memory load Perception Threshold Sensory overload Motivation and Action Brand loyalty ·Consumer behavior User behavior Motivation Involvement Approach behavior Avoidance behavior Purchase Intention ·attitude Group Dynamics ·Social norms Social Motivation Participation Social evaluation Privacy Personal space In-group favoritism ·Social behavior ·Compatible Social pressure Group cohesion ·Autonomy -Identity reinforcement Relationship building Groupthink Social loafing ·Retention Chunking Brand awareness Brand recall ·scaffold ·Forgetting curve ·Recall practice -Interval training ·Recall ·recognition ·Friendliness lever: Audience Priming Before communication Agenda Pre-show ·sound ·Sonic Branding Sound effects Music Selection ·BPM Genre sonic logo Soundscaping Incentives Gamification Awards and badges Contest Leaderboards ·payment Presentation Design Narration Video Feed Stage design Slide Format Presenter Habits Virtual webcam settings ·power point Web-based instructions Blended learning ·Multimedia learning Educational Strategy ·image ·color ·face Posing ·photograph Illustration Visual Design Branding ·Interactivity ·Interaction design Chat rooms Chatbots Group Size Video Formats and Performance ·Technical quality Picture-in-Picture Stickers Speaker Framing and Setup Continuity ·edit Synchronized Video Dynamic 2D Video Player Speaker Interview Layout Speaker Framing and Setup ·introduction Lectures Eye Contact ·Note placement Recap ·face to face Charisma Presentation skills Digital Content Multimedia Online Video Blog Vlog Tweet Streaming Content Social Media Posts Online courses ·Webpage design ·advertisement ·notification Smartphone ·scent Fragrance type Diffusion options Fragrance strength Ambient scents ·break Nature Break Micro Break Lunch break Active Break Passive Break Break duration Break Type ·audio ·Voice training Audio pitch ·Tone of voice Audio volume Breathing Pattern Voice Tone ·Oral presentation Navigation Visual markers User Journey Wayfinding Crowd Density ·Workplace culture ·feedback ·Positive feedback ·Performance evaluation Feedback Search Effective feedback ·measurement Experience Sampling How to Reconstruct an Event Biofeedback Wearables Wristbands Emotional biofeedback Survey design Sense of presence and inventory ·write ·advertisement Op Ed Sales campaigns Sales calls
[0061] Once a predefined number of these buckets are filled, they can start to be validated using recorded post-call analysis from the communication guidance system to validate the efficacy of individual lenses and levers related to a particular industry. For example, if a video conference sales call is about a new delivery mechanism for a pharmaceutical compound, the lever and lens taxonomy framework can sift through the available lens and lever buckets available with that industry and then analyze the recorded video conference sales call based on them. If one of the lenses is an attention with multiple sub-attention elements, it can be cross-analyzed with the lever presentation design and the respective presentation design sub-elements and validated based on the recipient response to each of the sub-elements. This analysis can then be used to update those specific lenses and levers for that industry.
[0062] As more of the lenses and levers are enabled via the recorded videoconferencing data, a weighting algorithm can be developed to determine whether updates should be made to other lenses and levers that were not enabled.
[0063] When the Lever and Lens Taxonomy framework has been established, users can now input desired action outcomes for a particular industry, and the framework can generate recommendations regarding the types of levers to use, as well as their impact on the various lenses.
[0064] Systems and methods for providing video call optimization recommendations and sales team optimization - Patents.com FIG. 11 illustrates a flow chart 110 of a methodology for generating KPIs and recommendations for several areas related to video conference calling. As previously described, a communications guidance system may be used to understand various behavioral aspects from recipients and to help track various goals and objectives. However, additional key performance indicators (KPIs) may be generated using an optimization communications engine as illustrated in FIG. 11. These KPIs may relate to modular training, custom training, knowledge management and intelligence contacts, design and marketing messaging, and maximizing flight planning (presentation flow).
[0065] How this is accomplished is that the design recommendation engine analyzes the journal articles and the cognitive feedback framework to generate industry specific insights. The cognitive feedback framework may consist of multiple databases that can be automatically checked against industry know-how, latest journal research, and experience data that may be collected using the communication guidance system. This database may consist of multiple levers and lenses, where the levers are the industry tools available to the user and the lenses are the cognitive factors that influence engagement, both of which may be further defined by the particular industry. For example, the architecture industry is going to have different industry tools available than the pharmaceutical industry. Similarly, the lenses or cognitive factors that influence engagement for each may differ based on industry norms. Once compiled, checked, and updated, the design recommendation engine can generate industry specific insights using the cognitive feedback framework and latest journal research. This information may be combined with post-call analysis and live feedback from the communication guidance system and used by the optimization communication engine to generate various KPIs.
[0066] In one instance, the trainer's voice and speed used in combination with periodic breaks and background lighting and color can affect the trainee's engagement level, resulting in a positive experience but reducing retained knowledge. Thus, the optimization communication engine can define KPIs based on goals or objectives to be met. For example, starting a training course or a particular module in a manner that increases the likelihood of retention or completing the course while varying various aspects of the training to move towards knowledge retention later in the course. Building brand loyalty can also be an objective of the training and an understanding of the best tools to utilize to build brand loyalty can be identified.
[0067] In one use of the optimization communications engine, a user can input an objective, for example, increasing brand loyalty, and the engine can generate KPIs as to how to best achieve that. Additionally, if multiple objectives are to be achieved, the engine can generate a flight plan that acts as a roadmap for a particular presentation. This flight plan can include signposts of how to achieve the various objectives and KPIs related to optimizing the ability to do so.
[0068] Another way to use the optimizing communication engine is that of analyzing the performance of an individual member, for example, a sales team. The system can use the performance of other sales team members, broken down by territory and product, as well as several other factors including years of experience, amount of training, supervisory team, salary, etc. After the analysis of the performance data is generated, the system can select one or more of the measured metrics to determine how to improve. This is accomplished by the optimizing communication engine considering exogenous factors or causes, which may include call recipients, territory, demographics of the population served, weather and time of year, as well as internal factors or causes, which may include workspace environment, training, administrative support, salary, etc., to identify specific areas where the individual may improve. For example, if an individual sells heart medications, where a determination is made that their knowledge of competing heart medications and their effects is limited, a recommendation can then be made to receive training or conduct further research on competing heart medications. This can be identified when comparing how individual sales members respond to questions received about a competitor's product, which is then compared and contrasted with others responding to similar questions and how the recipient in those situations was or was not satisfied with the response. The engine can generate a list of facts around a competitor's cardiac drug by discarding responses from other sales team members during a video conference call as a starting point.
[0069] Another way the engine can make recommendations is by analyzing the appropriate sales team members and their styles against the recipient and their behavioral profile. In this way, the engine can make a recommendation as to who should then call a particular recipient and generate a signpost or flight plan for how that call should be accomplished based in part on that recipient's profile and the industry-specific insights generated from the design recommendation engine.
[0070] Systems and methods for real-time behavioral feedback The present disclosure relates generally to a communications guidance system 30 and related methods designed to provide behavioral and other types of feedback based on live or recorded video meeting presentations.
[0071] 12A-H show various views of real-time feedback interfaces 120A-H for use with video conference meetings. The real-time feedback interfaces 120A-H can be standalone interfaces or alternatively the interfaces can be integrated into other current video conference platforms. The currently shown real-time feedback interfaces 120A-H are intended to convey a view from a presenter or provider view. As shown, there is a main video area 1202 for viewing the recipient or other party with whom the presenter or user is communicating. The viewing section 1220 can be the view of the presenter or user conducting the video conference call. A control settings and features section 1230 is provided that can be minimized to favor a larger or less cumbersome viewing experience. Similarly, a notes section 1222 is provided that can enable taking notes during the call or displaying the talking points of the call. The feedback indicators 1210, 1212, 1214, and 1216 can be configured in various locations and formats as shown through the various interfaces 120A-H. For example, the indicators may be in the form of numbers, percentages, words, colors, gradient scales, or combinations thereof. The indicators may also increase or decrease in intensity or flash at a given time.
[0072] Some of the feedback indicators may include an attention indicator 1210, a voice indicator 1212, a behavioral indicator 1214, and a "natural indicator" 1216. The attention indicator 1210 may be analyzed using various data inputs described in FIG. 14 to indicate the level of attention the recipient is giving during the call. This level may vary based on data inputs related to the recipient. This attention indicator may be a rotating indicator that is constantly updated. An overall attention indicator at the end of the call may also be provided.
[0073] The audio indicator 1212 may be analyzed using various data inputs as described in FIG. 14 and specific audio levels, fluctuations, etc., to indicate the level of attention the recipient is giving during the call. Similar to the other feedback indicators, this may also vary throughout the video conference call. This indicator shown focuses primarily on the resulting analysis of the recipient's audio. However, a separate user / presenter audio feedback indicator may focus on how well the presenter's audio is being received. Again, the audio indicator 1214 like the others may be a rotating or changing indicator that is constantly updated. A comprehensive audio indicator analysis may be provided at the end of the call.
[0074] The behavioral indicator 1214 can be analyzed using various data inputs described in FIG. 14 to indicate the type of behavioral response the recipient is giving during the call. This response type can also vary based on the data inputs associated with the recipient. This behavioral indicator 1114 can be a rotating or changing indicator that is constantly updated. A comprehensive behavioral analysis can be provided at the end of the call.
[0075] The naturalness indicator 1116 can analyze the emotional qualia from the recipient, for example, natural vs. neutral. Other variables involved in this naturalness indicator could be happy, sad, angry, bored, allowing the presenter to overcome or meet the recipient's needs during the call.
[0076] FIG. 13 illustrates a flow chart 130 of receiving various types of data from participants in a video conference call, analyzing the data, and displaying feedback based on the analyzed data. As illustrated, both audio 1310 and visual data 1312 are collected from the giver or presenter of the video conference call. Similarly, audio 1320 and visual data 1322 are collected from the recipient. As this information is being collected, it begins to be analyzed by a behavioral database at step 1314 for the giver / presenter and step 1324 for the recipient. The collected and analyzed information for each participant is used to generate a baseline for each other. After the baseline is generated, information may be combined from both participants to generate feedback indicators. These feedback indicators may then be displayed, for example, those previously described in FIGS. 12A-HA-H. It should be understood that these are not the only types of indicators that may be generated based on audio and visual data input from participants.
[0077] FIG. 14 shows an overview of the communication guidance system 30 and methodology. Under the data points column 1400 is a list of various inputs that the communication guidance system 140 can receive and use for analysis. Many of these inputs can be received by microphones and cameras already associated with the participant's computer system used to conduct the video conference call. This includes laptops, desktops, smartphones, tablets, etc. Some of the inputs require initial analysis such as eye tracking, head and body movements. These movements are first defined by a movement analysis algorithm that can determine the user's body parts and the movements each part is performing. This can be seen as the first layer of analysis from the raw camera visual data. After this initial analysis is performed, the movements can then be further analyzed against thresholds, examples of which are shown under the data point conditions column 1410. For example, as shown, the eye tracking data from column 1400 can then be further analyzed against the eye blink threshold in column 1410.
[0078] One or more of these conditioned data results under column 1420 may be used to provide a type of feedback under column 1430, such as some of the feedback indicators discussed above. For example, "nodding" conditioned data combined with "breathing in and holding mouth" conditioned data may indicate that the participant is highly engaged and looking for an opportunity to respond. Thus, an attention indicator may be high, while another feedback indicator may indicate that the presenter should stop speaking because the participant is ready to respond to the information conveyed. This may appear in the form of an emoji or a blinking border.
[0079] Referring back to column 1400, some of the inputs relate to previously acquired details about each participant and may even include data from the presentation about to be given, the purpose or goal of the call, etc. These data points may then be used to identify keywords using natural processing language algorithms to determine if those keywords and phrases were stated and even by which participant. For example, if a presenter delivers one of their talking points, that talking point purpose may be achieved and an indicator may be displayed indicating the number / percentage of the type of talking points that were achieved during the presentation. Additionally, if a recipient repeats or confirms a talking point in a particular manner, e.g., repeating a talking point, nodding (positively or negatively), then another indicator may be displayed regarding "agreement" regarding that talking point, whether they agreed or not.
[0080] Various embodiments and options that are exemplary of the present invention have been described, and those skilled in the art will recognize additional embodiments within the spirit and scope of the invention. Modifications and changes may be made to the disclosed embodiments without departing from the scope of the present disclosure. Those skilled in the art will appreciate that the application of the embodiments disclosed herein may vary. Thus, additions and modifications may be made without departing from the principles of the present disclosure. In this regard, it is intended that such modifications will still be within the scope of the present disclosure. Thus, the present disclosure is not limited to the specific embodiments as shown, but is intended to encompass modifications within the spirit and scope of the present disclosure.
Claims
1. a non-transitory computer readable medium; An input recognition interface; processing circuitry operably connected to the non-transitory computer-readable medium and to the input recognition interface; said processing circuitry comprising: Conducting analysis of audio and video data from users and recipients; Analyzing communication quality of the user based on historical data; Providing feedback based on said analysis A communication guidance system configured to perform the task of:
2. 2. The system of claim 1, wherein recommendations can include any of changing speech inflection, monitoring for appropriate gestures, displaying content in a timely manner, modifying camera or audio equipment, updating background or lighting, and identifying opportunities to enable the recipient to provide additional input.
3. receiving one or more points of discussion into a communication guidance system; receiving one or more points of discussion into a communication guidance system; categorizing and displaying said points of discussion during a video conference call; analyzing the speech of all parties participating in the video conference call to determine if any of the one or more points were mentioned; updating a representation of the one or more points based on the analysis of the utterance; How to track points during a video conference call, including:
4. The method of claim 3 further comprising pre-processing the one or more points using a natural language processing algorithm.
5. 4. The method of claim 3, further comprising: analyzing the completed video conference call taking into account the one or more issues, and performing an analysis to determine at least one of the order in which each issue was presented, the amount of time spent discussing each issue, and feedback received from the recipient regarding each issue, if any.
6. recording user and recipient audio and visual data during said presentation; performing an analysis of the recorded audio and video data; analyzing communication quality of the user based on historical data; providing feedback based on said analysis; How to analyze a presentation, including:
7. 7. The method of analyzing a presentation of claim 6, further comprising the step of classifying the audio and video data by region or area.
8. 8. The method of analyzing a presentation of claim 7, further comprising the step of comparing the aggregated analyzed audio and video data associated with each region or area with each region or area.
9. 10. The method of analyzing a presentation of claim 8, further comprising the step of modifying the presentation in any area or region that falls within a statistically significant range below a predetermined threshold.
10. 10. The method of claim 9, wherein the statistically significant range is at least one standard deviation from the predetermined threshold.
