Method of analyzing electronic responses to determine perception patterns

Abstract

A computer based method of determining perceptions from electronic communications may be disclosed. An input electronic communication may be received from a user. An analysis of the input electronic communication may be created for perception indicators. Based on the analysis of the input, an electronic response to the user may be formulated. The electronic response in an electronic response database may be formulated. The electronic response database may be analyzed to create a response analysis and based on the response analysis, at least one perceptual pattern for one or more users may be determined.

Description

METHOD OF ANALYZING ELECTRONIC RESPONSES TO DETERMINEPERCEPTION PATTERNSCROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims the benefit of U.S. Provisional Application No.63 / 557,986, entitled “METHOD OF ANALYZING ELECTRONIC RESPONSES TO DETERMINE PERCEPTION PATTERNS”, filed February 26, 2024, reference of which is hereby incorporated in its entirety.BACKGROUND

[0002] Marketers have long desired to know the wants and needs of individuals so that they can sell those individuals relevant goods and services. However, individuals are leery of being tracked and marketers having too much personal information. Further, laws have been passed reducing the ability of retailers to track the habits of consumers. As a result, retailers are limited in their ability to legally and effectively market goods and services to the individuals that would actually buy the goods and services.

[0003] At an even more specific level, retailers have created emotion indexes to try to read the emotions of consumers by reviewing images taken in a store. Again, consumer do not desire to have their emotions tracked and analyzed by a retailer while retailers find important information in the emotion index which could lead to more sales.SUMMARY OF THE DISCLOSURE

[0004] A computer based method of determining perceptions from electronic communications is disclosed. An input electronic communication may be received from a user. An analysis of the input electronic communication may be created for perception indicators. The input electronic communication may be deleted. Based on the analysis of the input, an electronic response to the user may be formulated. The electronic response in an electronic response database may be formulated. The electronic response database may be analyzed to create a response analysis and based on the response analysis, at least one perceptual pattern for one or more users may be determined.BRIEF DESCRIPTION OF THE DRAWINGS

[0005] Fig. 1 may be an illustration of computer based learning system;

[0006] Fig. 2 may be an illustration of a method in accordance with the claims;

[0007] Fig. 3 may be an illustration of a convolutional neural network; and

[0008] Fig. 4 may be an illustration of a computer that may be physically transformed to execute the method.

[0009] Persons of ordinary skill in the art will appreciate that elements in the figures are illustrated for simplicity and clarity so not all connections and options have been shown to avoid obscuring the inventive aspects. For example, common but well-understood elements that are useful or necessary in a commercially feasible embodiment are not often depicted in order to facilitate a less obstructed view of these various embodiments of the present disclosure. It will be further appreciated that certain actions and / or steps may be described or depicted in a particular order of occurrence while those skilled in the art will understand that such specificity with respect to sequence is not actually required. It will also be understood that the terms and expressions used herein are to be defined with respect to their corresponding respective areas of inquiry and study except where specific meanings have otherwise been set forth herein. All dimensions specified in this disclosure may be by way of example only and are not intended to be limiting. Further, the proportions shown in these Figures may not be necessarily to scale. As will be understood, the actual dimensions and proportions of any system, any device or part of a system or device disclosed in this disclosure may be determined by its intended use.SPECIFICATION

[0010] Persons of ordinary skill in the art will appreciate that elements in the figures are illustrated for simplicity and clarity so not all connections and options have been shown to avoid obscuring the inventive aspects. For example, common but well-understood elements that are useful or necessary in a commercially feasible embodiment are not often depicted in order to facilitate a less obstructed view of these various embodiments of the present disclosure. It will be further appreciated that certain actions and / or steps may be described or depicted in a particular order of occurrence while those skilled in the art will understand that such specificity with respect to sequence is not actually required. It will also be understood that the terms and expressions used herein are to be defined with respect to their corresponding respective areas of inquiry and study except where specific meanings have otherwise been set forth herein. All dimensions specified in this disclosure may be by way of example only and are not intended to be limiting. Further, the proportions shown in these Figures may not be necessarily to scale. As will be understood, the actual dimensions and proportions of any system, any device or part of a system or device disclosed in this disclosure may be determined by its intended use.

[0011] Marketers have long desired to know the wants and needs of individuals so that they can sell those individuals relevant goods and services. However, individuals are leery of being tracked and marketers having too much personal information. Further, laws have been passed reducing the ability of retailers to track the habits of consumers. As a result, retailers are limited in their ability to legally and effectively market goods and services to the individuals that would actually buy the goods and services.

[0012] At an even more specific level, retailers have created emotion indexes to try to read the emotions of consumers by reviewing images taken in a store. Again, consumer do not desire to have their emotions tracked and analyzed by a retailer while retailers find important information in the emotion index which could lead to more sales.

[0013] A computer based method of determining perceptions from electronic communications is disclosed. An input electronic communication may be received from a user. An analysis of the input electronic communication may be created for perception indicators. The input electronic communication may be deleted. Based on the analysis of the input, an electronic response to the user may be formulated. The electronic response in an electronic response database may be formulated. The electronic response database may be analyzed to create a response analysis and based on the response analysis, at least one perceptual pattern for one or more users may be determined.

[0014] It should also be noted that the perceptual pattern analysis may not be limited to just retail environments. The perceptual pattern analysis may have many uses including education where the perceptual patterns may indicate the ability of a student to understand material. Similarly, the reaction of movie viewers may indicate the appreciation for a movie. Of course, other applications are possible and are contemplated.

[0015] The system and method attempt to address the technical problem of how to design a computer system to understand humans and their purchase desires without tracking individual humans and / or violating relevant laws. The technical solution is to use artificial intelligence to analyze response to human inputs and create preference inferences from analyzing the responses. Products with similar preference inferences may be promoted in a conversation with a Al enabled chatbot that is trained to make conversation and offer products in a non-offensive way as will be discussed.

[0016] Methods and devices that may implement the embodiments of the various features of the invention will now be described with reference to the drawings. The drawings and the associated descriptions may be provided to illustrate embodiments of the invention and not to limit the scope of the invention. Reference in the specification to “oneembodiment” or “an embodiment” may be intended to indicate that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least an embodiment of the invention. The appearances of the phrase “in one embodiment” or “an embodiment” in various places in the specification may not necessarily be referring to the same embodiment.

[0017] Throughout the drawings, reference numbers may be re-used to indicate correspondence between referenced elements. As used in this disclosure, except where the context requires otherwise, the term “comprise” and variations of the term, such as “comprising”, “comprises” and “comprised” may not be intended to exclude other additives, components, integers or steps.

[0018] In the following description, specific details may be given to provide a thorough understanding of the embodiments. However, it may be understood by one of ordinary skill in the art that the embodiments may be practiced without these specific details. Well-known circuits, structures and techniques may not be shown in detail in order not to obscure the embodiments. For example, circuits may be shown in block diagrams in order not to obscure the embodiments in unnecessary detail.

[0019] Also, it is noted that the embodiments may be described as a process that is depicted as a flowchart, a flow diagram, a structure diagram, or a block diagram. The flowcharts and block diagrams in the figures may illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer programs according to various embodiments disclosed. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, that may include one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures.

[0020] Although a flowchart may describe the operations as a sequential process, many of the operations may be performed in parallel or concurrently. In addition, the order of the operations may be rearranged. A process may be terminated when its operations are completed. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc. When a process corresponds to a function, its termination may correspond to a return of the function to the calling function or the main function. Additionally, each block of the block diagrams and / or flowchart illustration, and combinations of blocks in the block diagrams and / or flowchart illustration, may be implemented by special purposehardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

[0021] Moreover, a storage may represent one or more devices for storing data, including read-only memory (ROM), random access memory (RAM), magnetic disk storage mediums, optical storage mediums, flash memory devices and / or other non-transitory machine readable mediums for storing information. The term "machine readable medium" may include, but is not limited to portable or fixed storage devices, optical storage devices, wireless channels and various other non-transitory mediums capable of storing, comprising, containing, executing or carrying instruction(s) and / or data.

[0022] Furthermore, embodiments may be implemented by hardware, software, firmware, middleware, microcode, or a combination thereof. When implemented in software, firmware, middleware or microcode, the program code or code segments to perform the necessary tasks may be stored in a machine-readable medium such as a storage medium or other storage(s). One or more than one processor may perform the necessary tasks in series, distributed, concurrently or in parallel. A code segment may represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a class, or a combination of instructions, data structures, or program statements. A code segment may be coupled to another code segment or a hardware circuit by passing and / or receiving information, data, arguments, parameters, or memory contents. Information, arguments, parameters, data, etc. may be passed, forwarded, or transmitted through a suitable means including memory sharing, message passing, token passing, network transmission, etc. and are also referred to as an interface, where the interface is the point of interaction with software, or computer hardware, or with peripheral devices.

[0023] Referring to Fig. 2, a computer based method of determining perceptions from electronic communications may be disclosed. At block 200, an input electronic communication may be received from a user. In some embodiments, the communication may be part of a conversation between the user and a chat application. In addition, the communication may be non-verbal communication such as physical movements. In yet additional embodiments, the input may include text input, voice input, biometric inputs, neural inputs and visual input. The electronic inputs may be stored only long enough to be analyzed at which point the inputs may be deleted.

[0024] At block 210, an analysis of the input electronic communication for perception indicators may be created. As mentioned, the electronic communication may be part of aconversation such as with a chat hot. The conversation may be typed or may be verbal. In other embodiments, the input may be, or also include, physical movements.

[0025] The analysis may submit the input to one or more large language models to determine a response. The large language model may be a generic large language model or may be specifically designed for a purpose. For example, the large language model may be trained with medical literature to be able to answer medical questions. In other embodiments, the large language model may be trained on the facial movements of individuals.

[0026] At block 220, the input electronic communication may be deleted. On one hand, the electronic input may be needed to create a thoughtful and useful result. Further, computers store inputs very briefly to be assigned an order to be executed by the processor. On the other hand, users may not want the inputs to be stored and analyzed now or in the future. To ensure personal information is not stored and analyzed, the input communication may be promptly deleted.

[0027] At block 230, based on the analysis of the input, an electronic response to the user may be formulated. The response may be created using machine learning and a large language model such as the model described in relation to Fig. 1. The response may be in virtually real time.Machine Learning

[0028] Machine learning may be used to recognize patterns. The machine learning model may be trained on a model on an existing dataset and using the model to predict whether the movement in the new video matches known patterns. The machine learning model may be used to predict future actions based on past pattern recognition. The machine learning model may also be used to determine pattern deviation. Logically, pattern deviation may be used to determine future actions.

[0029] A framework for machine learning algorithm like a large language model may involve a combination of one or more components, sometimes three components: (1) representation, (2) evaluation, and (3) optimization components. Representation components refer to computing units that perform steps to represent knowledge in different ways, including but not limited to as one or more decision trees, sets of rules, instances, graphical models, neural networks, support vector machines, model ensembles, and / or others.Evaluation components refer to computing units that perform steps to represent the way hypotheses (e.g., candidate programs) are evaluated, including but not limited to as accuracy, prediction and recall, squared error, likelihood, posterior probability, cost, margin, entropy k- L divergence, and / or others. Optimization components refer to computing units that performsteps that generate candidate programs in different ways, including but not limited to combinatorial optimization, convex optimization, constrained optimization, and / or others. In some embodiments, other components and / or sub-components of the aforementioned components may be present in the system to further enhance and supplement the aforementioned machine learning functionality.

[0030] Machine learning algorithms sometimes rely on unique computing system structures. Machine learning algorithms may leverage neural networks, which are systems that approximate biological neural networks (e.g., the human brain). Such structures, while significantly more complex than conventional computer systems, are beneficial in implementing machine learning. For example, an artificial neural network may be comprised of a large set of nodes which, like neurons in the brain, may be dynamically configured to effectuate learning and decision-making.

[0031] Machine learning tasks are sometimes broadly categorized as either unsupervised learning or supervised learning. In unsupervised learning, a machine learning algorithm is left to generate any output (e.g., to label as desired) without feedback. The machine learning algorithm may teach itself (e.g., observe past output), but otherwise operates without (or mostly without) feedback from, for example, a human administrator. Meanwhile, in supervised learning, a machine learning algorithm is provided feedback on its output. Feedback may be provided in a variety of ways, including via active learning, semisupervised learning, and / or reinforcement learning. In active learning, a machine learning algorithm is allowed to query answers from an administrator. For example, the machine learning algorithm may make a guess in a face detection algorithm, ask an administrator to identify the photo in the picture, and compare the guess and the administrator's response. In semi-supervised learning, a machine learning algorithm is provided a set of example labels along with unlabeled data. For example, the machine learning algorithm may be provided a data set of 100 photos with labeled human faces and 10,000 random, unlabeled photos. In reinforcement learning, a machine learning algorithm is rewarded for correct labels, allowing it to iteratively observe conditions until rewards are consistently earned. For example, for every face correctly identified, the machine learning algorithm may be given a point and / or a score (e.g., “75% correct”). An embodiment involving supervised machine learning is described herein.

[0032] As elaborated herein, in practice, machine learning systems and their underlying components are tuned by data scientists to perform numerous steps to perfect machine learning systems. The process is sometimes iterative and may entail looping througha series of steps: (1) understanding the domain, prior knowledge, and goals; (2) data integration, selection, cleaning, and pre-processing; (3) learning models; (4) interpreting results; and / or (5) consolidating and deploying discovered knowledge. This may further include conferring with domain experts to refine the goals and make the goals more clear, given the nearly infinite number of variables that can possible be optimized in the machine learning system. Meanwhile, one or more of data integration, selection, cleaning, and / or preprocessing steps can sometimes be the most time consuming because the old adage, “garbage in, garbage out,” also reigns true in machine learning systems.

[0033] By way of example, FIG. 1 illustrates a simplified example of an artificial neural network 100 on which a machine learning algorithm may be executed. FIG. 1 is merely an example of nonlinear processing using an artificial neural network; other forms of nonlinear processing may be used to implement a machine learning algorithm in accordance with features described herein.

[0034] In FIG. 1, each of input nodes 110 a-n is connected to a first set of processing nodes 120 a-n. Each of the first set of processing nodes 120 a-n is connected to each of a second set of processing nodes 130 a-n. Each of the second set of processing nodes 130 a-n is connected to each of output nodes 140 a-n. Though only two sets of processing nodes are shown, any number of processing nodes may be implemented. Similarly, though only four input nodes, five processing nodes, and two output nodes per set are shown in FIG. 1, any number of nodes may be implemented per set. Data flows in FIG. 1 are depicted from left to right: data may be input into an input node, may flow through one or more processing nodes, and may be output by an output node. Input into the input nodes 110 a-n may originate from an external source 160. Output may be sent to a feedback system 150 and / or to storage 170. The feedback system 150 may send output to the input nodes 110 a-n for successive processing iterations with the same or different input data.

[0035] In one illustrative method using feedback system 150, the system may use machine learning to determine an output. The output may include anomaly scores, heat scores / values, confidence values, and / or classification output. The system may use any machine learning model including xgboosted decision trees, auto-encoders, perceptron, decision trees, support vector machines, regression, and / or a neural network. The neural network may be any type of neural network including a feed forward network, radial basis network, recurrent neural network, long / short term memory, gated recurrent unit, auto encoder, variational autoencoder, convolutional network, residual network, Kohonen network, and / or other type. In one example, the output data in the machine learning systemmay be represented as multi-dimensional arrays, an extension of two-dimensional tables (such as matrices) to data with higher dimensionality.

[0036] The neural network may include an input layer, a number of intermediate layers, and an output layer. Each layer may have its own weights. The input layer may be configured to receive as input one or more feature vectors described herein. The intermediate layers may be convolutional layers, pooling layers, dense (fully connected) layers, and / or other types. The input layer may pass inputs to the intermediate layers. In one example, each intermediate layer may process the output from the previous layer and then pass output to the next intermediate layer. The output layer may be configured to output a classification or a real value. In one example, the layers in the neural network may use an activation function such as a sigmoid function, a Tan h function, a ReLu function, and / or other functions.Moreover, the neural network may include a loss function. A loss function may, in some examples, measure a number of missed positives; alternatively, it may also measure a number of false positives. The loss function may be used to determine error when comparing an output value and a target value. For example, when training the neural network the output of the output layer may be used as a prediction and may be compared with a target value of a training instance to determine an error. The error may be used to update weights in each layer of the neural network.

[0037] In one example, the neural network may include a technique for updating the weights in one or more of the layers based on the error. The neural network may use gradient descent to update weights. Alternatively, the neural network may use an optimizer to update weights in each layer. For example, the optimizer may use various techniques, or combination of techniques, to update weights in each layer. When appropriate, the neural network may include a mechanism to prevent overfitting — regularization (such as LI or L2), dropout, and / or other techniques. The neural network may also increase the amount of training data used to prevent overfitting.

[0038] Once data for machine learning has been created, an optimization process may be used to transform the machine learning model. The optimization process may include (1) training the data to predict an outcome, (2) defining a loss function that serves as an accurate measure to evaluate the machine learning model's performance, (3) minimizing the loss function, such as through a gradient descent algorithm or other algorithms, and / or (4) optimizing a sampling method, such as using a stochastic gradient descent (SGD) method where instead of feeding an entire dataset to the machine learning algorithm for the computation of each step, a subset of data is sampled sequentially. In one example,optimization comprises minimizing the number of false positives to maximize a user's experience. Alternatively, an optimization function may minimize the number of missed positives to optimize minimization of losses from exploits.

[0039] In one example, FIG. 1 depicts nodes that may perform various types of processing, such as discrete computations, computer programs, and / or mathematical functions implemented by a computing device. For example, the input nodes 110 a-n may comprise logical inputs of different data sources, such as one or more data servers. The processing nodes 120 a-n may comprise parallel processes executing on multiple servers in a data center. And, the output nodes 140 a-n may be the logical outputs that ultimately are stored in results data stores, such as the same or different data servers as for the input nodes 110 a-n. Notably, the nodes need not be distinct. For example, two nodes in any two sets may perform the exact same processing. The same node may be repeated for the same or different sets.

[0040] Each of the nodes may be connected to one or more other nodes. The connections may connect the output of a node to the input of another node. A connection may be correlated with a weighting value. For example, one connection may be weighted as more important or significant than another, thereby influencing the degree of further processing as input traverses across the artificial neural network. Such connections may be modified such that the artificial neural network 100 may learn and / or be dynamically reconfigured. Though nodes are depicted as having connections only to successive nodes in FIG. 1, connections may be formed between any nodes. For example, one processing node may be configured to send output to a previous processing node.

[0041] Input received in the input nodes 110 a-n may be processed through processing nodes, such as the first set of processing nodes 120 a-n and the second set of processing nodes 130 a-n. The processing may result in output in output nodes 140 a-n. As depicted by the connections from the first set of processing nodes 120 a-n and the second set of processing nodes 130 a-n, processing may comprise multiple steps or sequences. For example, the first set of processing nodes 120 a-n may be a rough data filter, whereas the second set of processing nodes 130 a-n may be a more detailed data filter.

[0042] The artificial neural network 100 may be configured to effectuate decisionmaking. As a simplified example for the purposes of explanation, the artificial neural network 100 may be configured to detect faces in photographs. The input nodes 110 a-n may be provided with a digital copy of a photograph. The first set of processing nodes 120 a-n may be each configured to perform specific steps to remove non-facial content, such as largecontiguous sections of the color red. The second set of processing nodes 130 a-n may be each configured to look for rough approximations of faces, such as facial shapes and skin tones. Multiple subsequent sets may further refine this processing, each looking for further more specific tasks, with each node performing some form of processing which need not necessarily operate in the furtherance of that task. The artificial neural network 100 may then predict the location on the face. The prediction may be correct or incorrect.

[0043] The feedback system 150 may be configured to determine whether or not the artificial neural network 100 made a correct decision. Feedback may comprise an indication of a correct answer and / or an indication of an incorrect answer and / or a degree of correctness (e.g., a percentage). For example, in the facial recognition example provided above, the feedback system 150 may be configured to determine if the face was correctly identified and, if so, what percentage of the face was correctly identified. The feedback system 150 may already know a correct answer, such that the feedback system may train the artificial neural network 100 by indicating whether it made a correct decision. The feedback system 150 may comprise human input, such as an administrator telling the artificial neural network 100 whether it made a correct decision. The feedback system may provide feedback (e.g., an indication of whether the previous output was correct or incorrect) to the artificial neural network 100 via input nodes 110 a-n or may transmit such information to one or more nodes. The feedback system 150 may additionally or alternatively be coupled to the storage 170 such that output is stored. The feedback system may not have correct answers at all, but instead base feedback on further processing: for example, the feedback system may comprise a system programmed to identify faces, such that the feedback allows the artificial neural network 100 to compare its results to that of a manually programmed system.

[0044] The artificial neural network 100 may be dynamically modified to learn and provide better input. Based on, for example, previous input and output and feedback from the feedback system 150, the artificial neural network 100 may modify itself. For example, processing in nodes may change and / or connections may be weighted differently. Following on the example provided previously, the facial prediction may have been incorrect because the photos provided to the algorithm were tinted in a manner which made all faces look red. As such, the node which excluded sections of photos containing large contiguous sections of the color red could be considered unreliable, and the connections to that node may be weighted significantly less. Additionally or alternatively, the node may be reconfigured to process photos differently. The modifications may be predictions and / or guesses by theartificial neural network 100, such that the artificial neural network 100 may vary its nodes and connections to test hypotheses.

[0045] The artificial neural network 100 need not have a set number of processing nodes or number of sets of processing nodes, but may increase or decrease its complexity. For example, the artificial neural network 100 may determine that one or more processing nodes are unnecessary or should be repurposed, and either discard or reconfigure the processing nodes on that basis. As another example, the artificial neural network 100 may determine that further processing of all or part of the input is required and add additional processing nodes and / or sets of processing nodes on that basis.

[0046] The feedback provided by the feedback system 150 may be mere reinforcement (e.g., providing an indication that output is correct or incorrect, awarding the machine learning algorithm a number of points, or the like) or may be specific (e.g., providing the correct output). For example, the machine learning algorithm 100 may be asked to detect faces in photographs. Based on an output, the feedback system 150 may indicate a score (e.g., 75% accuracy, an indication that the guess was accurate, or the like) or a specific response (e.g., specifically identifying where the face was located).

[0047] The artificial neural network 100 may be supported or replaced by other forms of machine learning. For example, one or more of the nodes of artificial neural network 100 may implement a decision tree, associational rule set, logic programming, regression model, cluster analysis mechanisms, Bayesian network, propositional formulae, generative models, and / or other algorithms or forms of decision-making. The artificial neural network 100 may effectuate deep learning.

[0048] A large language model may be a language model characterized by its large size. Their size is enabled by Al accelerators, which are able to process vast amounts of text data, mostly scraped from the Internet. The artificial neural networks which are built can contain from tens of millions and up to billions of weights and are (pre-)trained using selfsupervised learning and semi-supervised learning. Transformer architecture contributed to faster training.

[0049] As language models, they work by taking an input text and repeatedly predicting the next token or word. Up to 2020, fine tuning was the only way a model could be adapted to be able to accomplish specific tasks. Larger sized models, such as GPT-3, however, can be prompt-engineered to achieve similar results. They are thought to acquire embodied knowledge about syntax, semantics and "ontology" inherent in human language corpora large language models are trained using self-supervised learning or semi-supervisedlearning. This means that they are trained on large amounts of unlabeled text. Large language models can adjust their internal parameters and learn from new inputs from users over time.

[0050] Large language models are trained to predict the next word in a sentence based on the previous input sentence. This is a self-supervised learning task because you are not defining separate output labels. The process is repeated until the model reaches an acceptable level of accuracy. Some large language models, like InstructGPT and ChatGPT, use both supervised learning and reinforcement learning. The combination of the two is crucial for optimal performance.

[0051] Referring again to Fig. 2, at block 240, the electronic response may be stored in an electronic response database. The database may be designed to store the variety of responses that may be possible. For example, a chatbot may include an animated character that expresses responses in verbal responses and in illustrated actions.

[0052] The responses may be stored in a format that always for easier analysis. Random data formats and file types may take unnecessary time and processor cycles to convert into something that may be easily understood. Therefore the files and responses may be normalized into desired formats to make analysis faster and more efficient.

[0053] At block 250, the electronic response database may be analyzed to create a response analysis. The analysis may be toward an individual or toward groups. The identity of individuals may not be known but pseudo names may be created for easy of tracing responses for the individual in the future. For example, a specific user may be extremely opposed to smoking and future responses may not include smoking which may upset the specific user.

[0054] At block 260, based on the response analysis, at least one perceptual pattern may be determined for one or more users. Perception may be defined generally as the ability to see, hear, or become aware of something through the senses. It also may mean a way of regarding, understanding, or interpreting something; a mental impression. It may also involve memories for users which may be positive or negative. In one embodiment, the method and system are attempting to predict the input to the system by analyzing the output of the system and the related perception patterns. In some embodiments, additional data may be used to create the perception patterns. If an animated character providing an output including excited physical actions, the excitement may be noted.

[0055] Patterns are generally thought of as a sequence of events that have some predictability. In the system, predictability may be useful in determining the electronic inputsthat were received and may be useful in predicting how users may respond to certain prompts such as product offers.

[0056] The determination may be made virtually in real time using sufficient computing power as contemplated in the system and method. As will be explained, a retailer may create desired perceptual patterns and if the determined perceptual patterns for an individual match the desired perceptual patterns of a retailer, the match may be noted and a series of actions may be taken to see if the individual may want to buy what the retailer is selling.

[0057] The patterns for the user may be stored in a database along with a pseudo name for the user. The pseudo name may simply be a number of any series of characters. The pseudo name may be used to ensure perceptual patterns for an individual are noted and can be recalled. The database may be any appropriate database that is efficient at storing the data in a desired format.

[0058] The processor may be physically configured to analyze the database for common perception patterns of the users. Some users may have a similar perception pattern toward running shoes and these users may be noted or placed in a virtual cluster. In addition, some users may have similar preference patterns toward smoking and these users may be noted or placed in a virtual cluster.

[0059] In addition to study may user, the perception patterns of individuals may be analyzed. For example, some perception patterns may be more important than others. For example, a user may love tacos and the love for tacos may be more important than any other perceptual pattern for the user. In some embodiments, weights are placed on the perceptual patterns of the user to indicate the relative importance of the perceptual patterns. Using the above example, the love of tacos may be given a higher weight while the love of running marathons may be given a lower weight. The weights take into account perception patterns that match a known pattern or behavior that deviates from a known pattern.

[0060] Logically, the weights may also be assigned to groups or clusters of users with similar perception patterns. The weights may be created using an artificial intelligence model which may study a significant amount of relevant data over time to better adjust the weights.

[0061] More specifically, referring to Fig. 3, the learning algorithm may include a convolutional neural network 510 (CNN) and a transformer 320. In one embodiment, the CNN 310 may determine one or more features 351-354 for each user 341-344. In one example, the CNN may determine the features 351-354 which may be a set of numbers but the amount of features 351-354 may be varied up or down depending on many factors.

[0062] The CNN may be trained on millions of responses of people and may have learned to understand the perception pattern of the person. This CNN may be novel because it has been created and trained on perception patterns. Logically, other types of learning algorithms in the may be used. For example, the learning algorithm may be a fully connected neural network (FCN) in one embodiment.

[0063] In training, the transformer 320 may take the features 351-354 of multiple perception patterns 341-344 of the same person (the outputs of the CNN) as well as additional data such as the stated perception pattern of the individual 360 to create a model. Once the model is trained, the transformer may generate predictions of the perception pattern process of the individual 370. In some embodiments, the estimation of the perception pattern 370 may be in real time. The transformer 320 used in this invention may be trained on a dataset specifically created for predicting perception patterns 370.

[0064] The trained model which may be in the transformer 320 may take the features of users-344 as well as outside information in order to predict the perception patterns of the user. The learning algorithm also may analyze other relevant information about the user.

[0065] Retailers may find the perception patterns useful. If the perception patterns of a user and of a retail are similar, there may be an opportunity to match the user and the retailer. In implementation, the products of the retailer may be added to the database file for the user if there is a perception pattern match and the product may be presented to the user. If the user is using a chat bot, the chat bot may wait for an opportune time to ask the user if the user if interested in a product from the retailer. The opportune time may take minutes, days, weeks or even months. If the user indicates they are not interested in the good of the retailer, feedback may be provided to the retailer and the system such that the analysis of future perception patterns may be improved.

[0066] In an additional aspect, retailers may add a file of retailer perception patterns related to products to the system. In real time, the perception patterns of a user may be compared to the perception pattern file and if there is a match, the system may attempt to ask the user if they have interest in the good at an opportune time. In some embodiments, if the user states they are interested in the good, a link may be provided for the user to proceed to the retailers web site and purchase the good. Further, if the user does purchase the good, the user identity may be passed back to the system and the actual name may be used along with the pseudo name. With sufficient permissions from the user, the identification data may be used to provide additional recommendations to the user based on perceptions patterns in the future.

[0067] Logically, additional users may be analyzed to determine users with similar perception patterns over a threshold and place them in a cluster. In some embodiments, if one member of a cluster is suggested a retailer perception pattern, the retailer perception pattern may be added to all members of the cluster. As members of the cluster respond to the prompt about the goods, the perception patterns of the members of the cluster may be updated.

[0068]

[0069] Computing devices are used through the method and system. As shown in Fig. 4, the computing device 401 that executes the method may include a processor 402 that is coupled to an interconnection bus. The processor 402 may include a register set or register space 404, which is depicted in Fig. 4 as being entirely on-chip, but which could alternatively be located entirely or partially off-chip and directly coupled to the processor 402 via dedicated electrical connections and / or via the interconnection bus. The processor 402 may be any suitable processor, processing unit or microprocessor. Although not shown in Fig. 4, the computing device 401 may be a multi-processor device and, thus, may include one or more additional processors that are identical or similar to the processor 402 and that are communicatively coupled to the interconnection bus.

[0070] The processor 402 of Fig. 4 may be coupled to a chipset 406, which includes a memory controller 408 and a peripheral input / output (I / O) controller 410. As is well known, a chipset may typically provide I / O and memory management functions as well as a plurality of general purpose and / or special purpose registers, timers, etc. that are accessible or used by one or more processors coupled to the chipset 406. The memory controller 408 may perform functions that enable the processor 402 (or processors if there are multiple processors) to access a system memory 412 and a mass storage memory 414, that may include either or both of an in-memory cache (e.g., a cache within the memory 412) or an on-disk cache (e.g., a cache within the mass storage memory 414).

[0071] The system memory 412 may include any desired type of volatile and / or nonvolatile memory such as, for example, static random access memory (SRAM), dynamic random access memory (DRAM), flash memory, read-only memory (ROM), etc. The mass storage memory 414 may include any desired type of mass storage device. For example, the computing device 401 may be used to implement a module 416 (e.g., the various modules as herein described). The mass storage memory 414 may include a hard disk drive, an optical drive, a tape storage device, a solid-state memory (e.g., a flash memory, a RAM memory, etc.), a magnetic memory (e.g., a hard drive), or any other memory suitable for mass storage.As used herein, the terms module, block, function, operation, procedure, routine, step, and method refer to tangible computer program logic or tangible computer executable instructions that provide the specified functionality to the computing device 401, the systems and methods described herein. Thus, a module, block, function, operation, procedure, routine, step, and method can be implemented in hardware, firmware, and / or software.

[0072] In one embodiment, program modules and routines may be stored in mass storage memory 414, loaded into system memory 412, and executed by a processor 402 or may be provided from computer program products that are stored in tangible computer- readable storage mediums (e.g. RAM, hard disk, optical / magnetic media, etc.).

[0073] The peripheral I / O controller 410 may perform functions that enable the processor 402 to communicate with a peripheral input / output (I / O) device 424, a network interface 426, a local network transceiver 428, (via the network interface 426) via a peripheral I / O bus. The I / O device 424 may be any desired type of I / O device such as, for example, a keyboard, a display (e.g., a liquid crystal display (LCD), a cathode ray tube (CRT) display, etc.), a navigation device (e.g., a mouse, a trackball, a capacitive touch pad, a joystick, etc.), etc. The I / O device 424 may be used with the module 416, etc., to receive data from the transceiver 428, send the data to the components of the system 100, and perform any operations related to the methods as described herein. The local network transceiver 428 may include support for a Wi-Fi network, Bluetooth, Infrared, cellular, or other wireless data transmission protocols. In other embodiments, one element may simultaneously support each of the various wireless protocols employed by the computing device 401. For example, a software-defined radio may be able to support multiple protocols via downloadable instructions. In operation, the computing device 401 may be able to periodically poll for visible wireless network transmitters (both cellular and local network) on a periodic basis. Such polling may be possible even while normal wireless traffic is being supported on the computing device 401. The network interface 426 may be, for example, an Ethernet device, an asynchronous transfer mode (ATM) device, an 802.11 wireless interface device, a DSL modem, a cable modem, a cellular modem, etc., that enables the system 100 to communicate with another computer system having at least the elements described in relation to the system 100.

[0074] While the memory controller 408 and the I / O controller 410 are depicted in Fig. 4 as separate functional blocks within the chipset 406, the functions performed by these blocks may be integrated within a single integrated circuit or may be implemented using two or more separate integrated circuits. The computing environment 400 may also implementthe module 416 on a remote computing device 430. The remote computing device 430 may communicate with the computing device 401 over an Ethernet link 432. In some embodiments, the module 416 may be retrieved by the computing device 401 from a cloud computing server 434 via the Internet 436. When using the cloud computing server 434, the retrieved module 416 may be programmatically linked with the computing device 401. The module 416 may be a collection of various software playgrounds including artificial intelligence software and document creation software or may also be a Java® applet executing within a Java® Virtual Machine (JVM) environment resident in the computing device 401 or the remote computing device 430. The module 416 may also be a “plug-in” adapted to execute in a web-browser located on the computing devices 401 and 430. In some embodiments, the module 416 may communicate with back end components 438 via the Internet 436.

[0075] The system 400 may include but is not limited to any combination of a LAN, a MAN, a WAN, a mobile, a wired or wireless network, a private network, or a virtual private network. Moreover, while only one remote computing device 430 is illustrated in Fig. 6 to simplify and clarify the description, it is understood that any number of client computers may be supported and may be in communication within the system 400.

[0076] Additionally, certain embodiments may be described herein as including logic or a number of components, modules, blocks, or mechanisms. Modules and method blocks may constitute either software modules (e.g., code or instructions embodied on a machine- readable medium or in a transmission signal, wherein the code is executed by a processor) or hardware modules. A hardware module may be a tangible unit capable of performing certain operations and may be configured or arranged in a certain manner. In example embodiments, one or more computer systems (e.g., a standalone, client or server computer system) or one or more hardware modules of a computer system (e.g., a processor or a group of processors) may be configured by software (e.g., an application or application portion) as a hardware module that operates to perform certain operations as described herein.

[0077] In various embodiments, a hardware module may be implemented mechanically or electronically. For example, a hardware module may comprise dedicated circuitry or logic that is permanently configured (e.g., as a special-purpose processor, such as a field programmable gate array (FPGA) or an application-specific integrated circuit (ASIC)) to perform certain operations. A hardware module may also comprise programmable logic or circuitry (e.g., as encompassed within a processor or other programmable processor) that is temporarily configured by software to perform certain operations. It will be appreciated thatthe decision to implement a hardware module mechanically, in dedicated and permanently configured circuitry, or in temporarily configured circuitry (e.g., configured by software) may be driven by cost and time considerations.

[0078] Accordingly, the term “hardware module” may be understood to encompass a tangible entity, be that an entity that is physically constructed, permanently configured (e.g., hardwired), or temporarily configured (e.g., programmed) to operate in a certain manner or to perform certain operations described herein. As used herein, “hardware-implemented module” may refer to a hardware module. Considering embodiments in which hardware modules are temporarily configured (e.g., programmed), each of the hardware modules need not be configured or instantiated at any one instance in time. For example, where the hardware modules include a processor configured using software, the processor may be configured as respective different hardware modules at different times. Software may accordingly configure a processor, for example, to constitute a particular hardware module at one instance of time and to constitute a different hardware module at a different instance of time.

[0079] Hardware modules may provide information to, and receive information from, other hardware modules. Accordingly, the described hardware modules may be regarded as being communicatively coupled. Where multiple of such hardware modules exist contemporaneously, communications may be achieved through signal transmission (e.g., over appropriate circuits and buses) that connect the hardware modules. In embodiments in which multiple hardware modules are configured or instantiated at different times, communications between such hardware modules may be achieved, for example, through the storage and retrieval of information in memory structures to which the multiple hardware modules have access. For example, one hardware module may perform an operation and store the output of that operation in a memory device to which it is communicatively coupled. A further hardware module may then, at a later time, access the memory device to retrieve and process the stored output. Hardware modules may also initiate communications with input or output devices, and can operate on a resource (e.g., a collection of information).

[0080] The various operations of example methods described herein may be performed, at least partially, by one or more processors that are temporarily configured (e.g., by software) or permanently configured to perform the relevant operations. Whether temporarily or permanently configured, such processors may constitute processor- implemented modules that operate to perform one or more operations or functions. Themodules referred to herein may, in some example embodiments, comprise processor- implemented modules.

[0081] The methods or routines described herein may be at least partially processor- implemented. For example, at least some of the operations of a method may be performed by one or processors or processor-implemented hardware modules. The performance of certain of the operations may be distributed among the one or more processors, not only residing within a single machine, but deployed across a number of machines. In some example embodiments, the processor or processors may be located in a single location (e.g., within a home environment, an office environment or as a server farm), while in other embodiments the processors may be distributed across a number of locations.

[0082] The one or more processors may also operate to support performance of the relevant operations in a “cloud computing” environment or as a “software as a service” (SaaS). For example, at least some of the operations may be performed by a group of computers (as examples of machines including processors), these operations being accessible via a network (e.g., the Internet) and via one or more appropriate interfaces (e.g., application program interfaces (APIs).)

[0083] The performance of certain of the operations may be distributed among the one or more processors, not only residing within a single machine, but deployed across a number of machines. In some example embodiments, the one or more processors or processor-implemented modules may be located in a single geographic location (e.g., within a home environment, an office environment, or a server farm). In other example embodiments, the one or more processors or processor-implemented modules may be distributed across a number of geographic locations.

[0084] Some portions of this specification may be presented in terms of algorithms or symbolic representations of operations on data stored as bits or binary digital signals within a machine memory (e.g., a computer memory). These algorithms or symbolic representations may be examples of techniques used by those of ordinary skill in the data processing arts to convey the substance of their work to others skilled in the art. As used herein, an “algorithm” may be a self-consi stent sequence of operations or similar processing leading to a desired result. In this context, algorithms and operations may involve physical manipulation of physical quantities. Typically, but not necessarily, such quantities may take the form of electrical, magnetic, or optical signals capable of being stored, accessed, transferred, combined, compared, or otherwise manipulated by a machine. It is convenient at times, principally for reasons of common usage, to refer to such signals using words such as “data,”“content,” “bits,” “values,” “elements,” “symbols,” “characters,” “terms,” “numbers,” “numerals,” or the like. These words, however, may be merely convenient labels and are to be associated with appropriate physical quantities.

[0085] Unless specifically stated otherwise, discussions herein using words such as “processing,” “computing,” “calculating,” “determining,” “presenting,” “displaying,” or the like may refer to actions or processes of a machine (e.g., a computer) that manipulates or transforms data represented as physical (e.g., electronic, magnetic, or optical) quantities within one or more memories (e.g., volatile memory, non-volatile memory, or a combination thereof), registers, or other machine components that receive, store, transmit, or display information.

[0086] As used herein any reference to “embodiments,” “some embodiments” or “an embodiment” or “teaching” may mean that a particular element, feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. The appearances of the phrase “in some embodiments” or “teachings” in various places in the specification may not necessarily all be referring to the same embodiment.

[0087] Some embodiments may be described using the expression “coupled” and “connected” along with their derivatives. For example, some embodiments may be described using the term “coupled” to indicate that two or more elements are in direct physical or electrical contact. The term “coupled,” however, may also mean that two or more elements are not in direct contact with each other, but yet still co-operate or interact with each other. The embodiments may not be limited in this context.

[0088] Further, the figures depict preferred embodiments for purposes of illustration only. One skilled in the art may be readily recognize from the following discussion that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles described herein.

[0089] Upon reading this disclosure, those of skill in the art may appreciate still additional alternative structural and functional designs for the systems and methods described herein through the disclosed principles herein. Thus, while particular embodiments and applications have been illustrated and described, it is to be understood that the disclosed embodiments may not be limited to the precise construction and components disclosed herein. Various modifications, changes and variations, which may be apparent to those skilled in the art, may be made in the arrangement, operation and details of the systems andmethods disclosed herein without departing from the spirit and scope defined in any appended claims.

Claims

CLAIMS1. A computer based method of determining perceptions from electronic communications comprising: receiving an input electronic communication from a user; creating an analysis of the input electronic communication for perception indicators; deleting the input electronic communication; based on the analysis of the input, formulating an electronic response to the user; storing the electronic response in an electronic response database; analyzing the electronic response database to create a response analysis; and based on the response analysis, determining at least one perceptual pattern for one or more users.

2. The computer based method of claim 1, wherein the communication is part of a conversation between the user and a chat application.

3. The computer based method of claim 1, wherein the communication is non-verbal communication.

4. The computer based method of claim 1, wherein the input comprises at least one of: text input; voice input; biometric input; neural input; and visual input.

5. The computer based method of claim 1, wherein the electronic responses to the user are stored in a database.

6. The computer based method of claim 1, wherein the electronic response to the user is analyzed determine perception patterns for the user.

7. The computer based method of claim 5, wherein the perception patterns for the user are stored in a database along with a pseudo name for the user.

8. The computer based method of claim 1, wherein the processor is physically configured to analyze the database for common perception patterns of the users.

9. The computer based method of claim 1, wherein retailers analyze the database perception patterns and add products to the database file for the user if there is a perception pattern match.

10. The computer based method of claim 1, wherein retailers add a file of retailer perception patterns.

11. The computer based method of claim 1, wherein perception patterns recognize body movements as representing perception patterns.

12. The computer based method of claim 1, wherein perception patterns for a plurality of users to determine weights for perception patterns.

13. The computer based method of claim 1, wherein an artificial intelligence model determines the weights for the perception patterns.

14. The computer based method of claim 1, wherein weights take into account behavior that matches a known pattern or behavior that deviates from a known pattern.

15. The computer based method of claim 1, wherein user responses are analyzed and if a response perception pattern matches one of the retailer perception pattern, providing a prompt to the user to visit the retailer web site.

16. The computer based method of claim 15, wherein if a user makes a purchase on the retailer web site, communicating the user purchase information to the database.

17. The computer based method of claim 16, wherein user responses are analyzed and if a response perception patterns matches one of the retailer perception patterns, communicating the purchase information to the retailer.

18. The computer based method of claim 17, wherein additional users are analyzed to determine users with similar perception patterns over a threshold and place them in a cluster.

19. The computer based method of claim 18, wherein if one member of a cluster is suggested a retailer perception pattern, adding the retailer perception pattern to all members of the cluster.

Images