Interactive electronic evaluation system and method

Provide self-assessment and peer assessment services through interactive computer applications, solving the problem that traditional performance evaluation processes cannot support employee growth and development, and achieving employee skills improvement and organizational performance improvement.

CN118922845APending Publication Date: 2024-11-08NEXT JUMP INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380028970.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-01-27
Filing Date
2023-01-26
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Traditional performance evaluation processes fail to provide interactive tools for employee growth and development, lack of standardized digital measurements, resulting in managers and employees being dissatisfied and unable to achieve the goal of improving individual and organizational performance.

Method used

An interactive computer application developed that provides self-assessment and peer assessment services that allow employees to perform automated self-assessment through private spaces, select coaches or peers for anonymous assessments, detect rating patterns using an algorithm library, generate structured reports and radar maps , support employees' self-development and skills improvement.

Benefits of technology

It provides a substantial improvement to improve employees' decision-making skills and self-awareness through interactive tools, helping employees identify strengths and weaknesses, and achieving personalized skills development and organizational performance improvement.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118922845A_ABST
    Figure CN118922845A_ABST
Patent Text Reader

Abstract

Systems, methods, and computer readable media related to digital human resource technology improvements are provided. An automated system may be provided in which a user may have a digital interactive private space and use that space to interact evaluate five features, and select to collect additional data from others regarding the five features of the user, and includes an automated algorithm that allows the user to interact with the five features of the user. The algorithm may, for example, classify and detect patterns of digital data using interrelationships between different types of data. The system is configured to record information in a private space, provide evaluations, and allow a user to keep the information private to the user while being configured to be able to hold the information to allow the user to later return to the private space (as configured by applications, services, and servers) to perform interactive evaluation and classification detection. Embodiments combine interactive visual radar maps with classification and reporting.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to U.S. Provisional Patent Application No. 63 / 303,930, filed on January 27, 2022, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present invention generally relates to the field of digital interactive human resource technology, including employee assessment, evaluation, development and decision-making training systems. Background Art

[0004] Employees are perhaps an organization's most valuable asset. Retaining and attracting employees often requires that organizations invest resources in developing their employees. For example, evaluating an organization's employees is an important and valuable activity for better managing employees and the organization as a whole. It can take many forms: evaluations of subordinate employees by supervisors, peer evaluations, so-called "360" evaluations (where people are evaluated by supervisors, subordinates, and peers), and many others. Organizations that implement evaluations also vary, and evaluations may be conducted in written form, as part of a face-to-face meeting, electronically, or some combination of these or other forms. The use of the completed evaluations also varies, and the results of the evaluations may be used to develop, promote, discipline, reassign, train, or otherwise influence the management of the person being evaluated and the organization.

[0005] Traditional performance evaluation processes are often provided by managers to their employees on an annual basis. Evaluation data may be objective (based on measurable criteria such as productivity and quality levels), subjective (based on the manager's perceptions and observations), or a combination of objective and subjective criteria. This type of performance evaluation is often flawed, resulting in both dissatisfied managers and employees and failing to achieve the primary goal of improving individual and organizational performance. A common problem with traditional performance management processes is that these processes fail to provide interactive tools for employee growth and development. The problem can be further compounded by the fact that there are no real and identifiable numeric measurements that are standardized across the organization to accurately and objectively measure employee performance and growth. Those of ordinary skill in the art will appreciate that there are other shortcomings and deficiencies.

[0006] In the area of ​​interactive assessment applications, such applications are designed to provide annual assessments to company management (e.g., HR departments). Such assessments typically restrict employee access to the assessments, such as providing access during an assessment meeting and only involving those selected by the company to submit the assessment. Such applications can be used to be assessed for job promotions or advancement by the company, but do not provide the ability for employees to self-assess and develop improvements by interacting with the tool.

[0007] There are also deficiencies in providing effective assessment and decision-making tools, which are very important for companies and for having a high-performing workforce.

[0008] Therefore, there are deficiencies that need to be addressed and improvements sought on existing digital interactive HR technology tools and systems. Summary of the invention

[0009] According to the principles of the present invention, an embodiment of a system, method or computer-readable medium for realizing technological advancement of human resources is provided, which provides an automated private tool for individual users to improve the personal skills of users at least through indirect operation and guidance. In some embodiments, a computer-implemented method is provided, which is a guided interactive self-assessment service. An application program that can be run on a server can be implemented. The application program is configured to provide services to employees of a company. The method may include implementing the application program to provide an interactive user interface to employees, wherein the interactive user interface is suitable for providing an automated self-assessment process to individual users, and implementing the application program to establish a private space, which an individual user can configure to limit other employees' access to the user's private space, wherein the application program is configured to provide access to the private space to the individual user through a browser, and is configured to invite one or more other users to have access rights to the individual user's private space.

[0010] The Application may be configured to allow an individual user to use the Application to perform an automated self-assessment that includes a numeric rating on five attributes and a free-style text narrative. The Application may be configured to allow an individual user to use the Application to have other employees of their own choice perform a peer assessment of the individual user on the Service that includes a numeric rating on five attributes and one or more additional free-style text narratives. The Application may be configured to receive and store the numeric rating and free-style text narrative on the five attributes.

[0011] The application can be configured to store a library of algorithms, each of which is configured to detect classifications by detecting patterns in the numeric ratings that satisfy one of the algorithms. The application can be configured to detect one or more classifications for an individual user using numeric ratings of five attributes received from a self-assessment of the individual user and a plurality of peer assessments of the individual user.

[0012] The application may use a graphical user interface (e.g., by transmitting data to a mobile device or browser, or running locally and remotely, etc.) to provide individual users with the ability to: view a structured report based on numeric ratings from self-assessment and peer assessments in the individual user's private space, the report including classifications detected for the individual user, and in conjunction with providing the structured report, display an interactive radar chart that displays the combination of the numeric ratings of the self-assessment and other assessments for the individual user, respectively, as connected polygonal shapes.

[0013] The application can be configured to store structured reports including detected classifications of individual users; and to allow the user to return to perform self-assessments and peer assessments again using the application at a later time, and to allow the user to view historical data from previous reports in a private space.

[0014] The application may include anonymizing the assessments so that they are not associated with the identities of one or more peers. Anonymization may include, as part of storing the assessments, removing identifying information from the received assessments.

[0015] The service may be implemented on a company's enterprise network, and users may interact with it using, for example, a web browser.

[0016] The application can be configured with a list of company employees for users to choose from to request a peer evaluation.

[0017] The configured service updates the algorithms on the server at a later date, such as improving the algorithm for a particular classification or adding a new algorithm for a new classification.

[0018] The data used in the algorithm can be data from the individual user's self-assessment or the assessment of the individual user by others (e.g., numerical ratings), and can include representative data or data based on the date. For example, an average of multiple numerical ratings of an attribute or other formula can be used. Patterns in the numbers are detected by, for example, evaluating the data or such processed data and / or the interrelationships between the data to detect defined patterns corresponding to the classification. An individual can have a coach who can view all or some of the information in the individual user's private space. The user can select one or more coaches.

[0019] As the reader will appreciate, relevant non-transitory computer-readable media and systems are included in the description herein. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Various features of examples according to the principles described herein may be more readily understood by reference to the following detailed description taken in conjunction with the accompanying drawings, wherein like reference numerals represent like structural elements, and wherein:

[0021] Figure 1 One embodiment of a system for evaluating employees according to some embodiments of the present invention is shown;

[0022] Figure 2 Another embodiment of a system for evaluating employees according to some embodiments of the present invention is shown;

[0023] Figure 3 shows a flow of communication between a display assessment software application and an assessment processing software application according to some embodiments of the present invention;

[0024] Figure 4 shows a portion of an exemplary user interface that allows an assessed user to select options according to some embodiments of the present invention;

[0025] Figure 5A shows a portion of an exemplary user interface that allows an assessee to solicit an assessment from a peer or coach in accordance with some embodiments of the present invention;

[0026] Figure 5B-5C The process of soliciting evaluation according to some embodiments of the present invention is shown;

[0027] Figure 5D shows a portion of an exemplary user interface allowing a registered evaluator to access an evaluation form according to some embodiments of the present invention;

[0028] Figure 5E shows a portion of an exemplary user interface that allows unregistered evaluators to access an evaluation form according to some embodiments of the present invention;

[0029] Figure 6 shows a portion of an exemplary user interface for an assessment software application that allows a user to complete a self-assessment according to some embodiments of the present invention;

[0030] Figure 7 shows a portion of an exemplary user interface of an assessment software application that allows an assessor to create a peer / coach assessment in accordance with some embodiments of the present invention;

[0031] Fig. 8A (Due to size limitations, provided as a set of drawings, including Fig. 8A , Figure 8A-1 ) shows a portion of a user interface that allows an assessed user to view a submitted assessment and a corresponding assessment analysis according to some embodiments of the present invention;

[0032] Figure 8B (Due to size limitations, provided as a set of drawings, including Figure 8B , Figure 8B-1 , Figure 8B-2 , Figure 8B-3 ) shows a detailed assessment report according to some embodiments of the present invention;

[0033] Fig. 9 A flow chart describing the process of identifying and deriving a personality profile of an assessee in accordance with the present invention is shown. DETAILED DESCRIPTION

[0034] According to the principles of the present invention, advances in human resource technology improve upon existing employee evaluation techniques through interactive computer-implemented tools, software processes and systems. This technology has many advantages and valuable aspects, some of which are discussed first.

[0035] Based on the research conducted, there is a need for digital interactive tools to substantially promote employee self-development, and in particular, to substantially improve employees' decision-making skills. Decision-making is a key aspect of employee performance, but has long been underdeveloped and difficult to assess. There are also difficulties in identifying and implementing successful and viable solutions that benefit employees. The system developed according to an embodiment of the present invention provides a viable and efficient interactive tool through interactive assessment applications and related features, thereby providing substantial improvements in this area. Through research, it was found that certain (limited) attributes are closely related to assessing and improving decision-making skills. These attributes include: (1) looking to the future, (2) measuring progress, (3) discipline in hard work, (4) speed and courage, and (5) authenticity, which attributes are further described or applied below. The system is configured to implement an assessment software tool that integrates these attributes and related features to develop the user's decision-making skills (e.g., over time, by repeatedly using the tool and learning from interactions). Assessment tools in the workplace can be a useful tool for employees to understand their strengths and weaknesses and improve the identified strengths and weaknesses through self-awareness. Other applications or attributes (in addition to decision-making attributes and / or specified attributes) are also considered. Preliminary studies have shown that various direct and indirect interactions with the tool provide particularly beneficial improvements in employee performance, while also providing a very convenient and efficient software solution. Thus, in some respects, the system and software described herein develop a new form of technology for implementing decision-making training systems.

[0036] Embodiments of the present invention provide a quantitative assessment (to improve accuracy) of an individual's decision-making-related skills by analyzing input from interactive questions provided by the individual and his or her peers, coaches, and / or family members. The quantitative assessment can be used by the individual to develop a training plan (e.g., selecting specific training modules) - with or without a coach - for improving and / or developing his or her skills (e.g., decision-making skills). For example, if the assessment analysis determines that the individual has a reckless trait greater than a threshold, the system can identify and / or help the individual identify exercises or training plans for improving that attribute. Specifically, the tools of embodiments of the present invention are based on input to quantify current behavioral characteristics (interpreted by the system using data), such as an individual's thinking patterns, awareness gaps, and areas of balance / imbalance, which directly impact decision making. Questions involve the following five factors or attributes: (1) Future Vision (as a measure of effectiveness in establishing and motivating others to move toward goals); (2) Measuring Progress (as a measure of effectiveness in identifying trends, maintaining perspective, learning from the past, etc.); (3) Discipline in Hard Work (as a measure of consistency and discipline in solving difficult work); (4) Speed ​​and Courage (as a measure of speed and courage in action, taking into account the individual's ability to make trade-offs); and (5) Authenticity - not lying, not hiding, not falsifying (as a measure of how truthful an individual is in communicating with others and his / her ability to seek authenticity). An embodiment of the present invention relates to a structured system that uses a combination of software, hardware, data structures, security, and constraints to provide an advanced interactive electronic assessment system. For example, an application can be implemented that provides employees of a company with an interactive user interface that is suitable for providing users with the ability to self-assess on a set of attributes (preferably a set of five attributes): Future Vision, Measuring Progress, Discipline in Hard Work, Speed / Courage, and Authenticity. The application is preferably configured to establish a private online space (e.g., accessible via a mobile application or website user interface) that can be configured by individual users to restrict access to their private space. The space is where users can view their self-assessment ratings (numerical ratings for each attribute, free text evaluations), and can be configured to allow others - particularly one or more invited coaches - to access the information in the private space. The application is configured to allow users to also self-select peers (including, for example, peers, supervisors, etc.), family members (e.g., friends, family, or anyone who is not a peer or coach), and / or allow coaches to conduct the same evaluation of the user, provide a numerical evaluation for each attribute, and provide an interface for users to write an evaluation of one or more attributes or an overall evaluation in a free style. If desired, the system can be configured to limit the length of the text evaluation so that peers are forced to condense their thoughts into a short and meaningful message and know that it will be shared with the user.The application is configured to receive peer and / or coach evaluations and provide peer evaluations to the user when requested (subject to certain conditions or restrictions, such as whether all peers have completed the evaluation), preferably in an anonymous state. In other words, the application can strip or delete the identity of the peers and / or coaches before sending the evaluation to the user's private space. In some implementations, the application can implement an operation that only retrieves data from the evaluation information when reporting peer evaluations, but does not identify peers (retrieve the information) when generating reports for users. Specific rules can be implemented so that access to anonymous evaluations (e.g., from peers) is not enabled until at least a threshold number (e.g., 3, 4, 5, etc.) of evaluators submit their comments / evaluations. Other measures to maintain anonymity securely are also described herein. Privacy and control over data access can be implemented through a form that specifies the information that the logged-in individual user has the authority to receive (e.g., whether the user is a coach of another user will be checked based on the form record, and the self- and peer evaluations of the user in the coach's private space will be retrieved and displayed based on the permissions in the form). It should be noted that although the following disclosure describes the present invention in the form of a mobile application, it is not limited thereto and can be implemented as a website including an interactive user interface. It can be implemented as a web application in conjunction with a mobile application.

[0037] The application can be configured to allow the user to select only peers within the company by integrating the company's enterprise computer system into the operation to only provide colleagues as selectable options. If desired, the user can be provided with the option to select people outside the company by specifying their email address in order to have them access the application to provide input to the user. Generally, further reflecting that in some embodiments, the self-guided process is controlled as a user's selection of peers and coaches.

[0038] The application may include an analysis and reporting system or software engine and a reporting component. As background, typically company assessment or self-assessment systems provide direct ratings for specific, concrete questions, while the meaning of the combination of assessment information is left to the subjective interpretation of employees and human resources departments. Conventional tools do not implement advanced features that allow self-assessment analysis and detection of indirect information that is a function of the interrelationships of different attributes that are consistent across multiple companies and / or within a company. For example, through a software engine, a system is implemented that stores a library of algorithms, each algorithm having a corresponding classification and stored data associated when a classification or status is detected. The software engine is configured to apply the library of algorithms in a manner such as, for example, evaluating a numerical score for each attribute and detecting whether one or more algorithms are completed / satisfied, such as detecting a classification. The algorithm may include many levels of complexity, such as being able to detect interrelationships between certain attributes. For example, whether the average of the first and third attributes results in a number that is higher than the score of the second attribute. Or, for example, whether the average of the first and third attributes results in a number that is higher than the score of the second attribute, while the score of the second attribute is lower than each of the fifth and fourth attributes. Complex analysis that can detect and classify many different patterns from automatic data analysis based on the corresponding information library. The classifications performed by the algorithm and the stored classification information can be used to display the detected classifications or other automatic assessments to the user through a structured report displayed to the user in the application. The report can be displayed in conjunction with a radar chart, which provides an interactive radar display. When a classification is detected, the classification and reporting process provides the same data to (all) users in the company and only provides the classification to the user's private space and selected coaches (the software restricts access to the data).

[0039] The process is structured to have a specific set of (different) classification categories that are detected and reported by the software engine, such as a set of predetermined separate sections in the report that are configured to provide a structured view of the report. The system provides an objective assessment system in a consistent manner for all employees.

[0040] There may be a provider of the application which may maintain a library of categorized and retrieved data locally or remotely. The provider may periodically update the tool to improve accuracy and content based on additional employee interactions. With this information, employees may self-direct personal skill development to improve attributes to a certain degree relative to others in the company. The application is further configured to be available for users to perform self-assessments and select peer-requested assessments over time (e.g., once every three months), and the application may maintain a history of each iteration so that users may also benefit from viewing historical information through charts and reports. A web interface may be provided for various features, such as in conjunction with a mobile application. Various embodiments are contemplated, for example, individual features may have critical implementation value by themselves, or may have it in various combinations of features herein.

[0041] Embodiments of the present invention relate to a system for implementing an enterprise employee assessment tool. In at least some embodiments, the system implements an interactive structure that establishes an employee assessment system that allows employees to conduct self-assessments, solicit assessments from peers, and solicit assessments from coaches or family / friends. The employee assessment system provides the additional advantage of providing employees with a personalized platform that displays only the solicited assessments to the corresponding employees and / or employee coaches, allowing employees to identify potential areas of improvement and / or develop strategies to improve identified areas using specific electronic interfaces provided in the system. As part of the system, assessment applications (e.g., assessment software applications) are implemented on personal mobile devices or through a web interface, and these applications are configured to provide users with interactive assessment tools on the display screen of the mobile device or other electronic device.

[0042] The assessment application is configured to send login and password information to a personal identity service, wherein the personal identity service receives and authenticates the user, provides or sends an electronic security token to the assessment application, and the assessment application sends the electronic security token to the assessment service (e.g., an assessment processing software application) to obtain authorization to operate in the service. The authentication and system are configured to use the authorization token to allow access to other services provided on the company's enterprise network or other services provided by the enterprise that employs the user to access other services (e.g., access all other services or join the enterprise network and access enterprise applications, such as the assessment processing software application). This process provides efficiency because the user and the system do not need to log in separately for each enterprise's application to access the corresponding service. In addition, it can protect anonymity because it can separate the assessor's login name or name from the interactive process in the assessment service. The interactive process in the assessment service can communicate with the service (in a data packet or message) using numeric or alphanumeric identifiers (or other non-descriptive identifiers) that cannot be visually understood or otherwise easily used to identify the user of the mobile device. In addition, based on the security token used in identity authentication and messaging, the use of the security process and token establishes a highly secure inter-system relationship and connection (e.g., a trusted connection using communication and security protocols). For example, the assessment service may be the assessment processing software application described below.

[0043] The assessment application (e.g., an assessment software application) is configured to provide interactive tools to the user, which are available from one or more display screens displayed by the assessment application on the user's mobile device, or as a web application on other electronic devices. The assessment application is configured to display options for soliciting assessments from evaluators, preparing and sending assessments to evaluees, and receiving and viewing assessments (assessment messages) and corresponding analyses.

[0044] The system is configured to provide employees with an interface on their mobile devices, wherein the interface provides or consists essentially of options for creating and submitting self-assessments, selecting assessors for peer assessments, family member assessments, and / or coach assessments, and viewing assessments and various graphical outputs.

[0045] The system is further configured to provide an interface to the assessor, either via the assessor's mobile device or as a web application on other electronic devices, wherein the interface provides or consists essentially of options for selecting an assessment grade and a text area that allows free entry of their assessment using text input. The system is configured to provide the interface on a user's personal mobile phone by running an application on the mobile phone. This can provide security, speed of use and other benefits, such as reducing hardware resources for employees.

[0046] The system (e.g., usable on an employee's mobile phone, which is almost always with the user) allows for quick entry of evaluations. The system is configured to provide employee-to-employee evaluations (one-on-one), and preferably without restrictions such as seniority or role. The system is also configured to maintain the identity of the evaluator who has made an anonymous evaluation. In addition, the system is configured to have evaluations that are only accessible to the evaluee or a coach invited by the evaluee, and not to other employees of the company.

[0047] The mobile application (e.g., an assessment software application) is preferably configured as a lightweight application that has minimal processing or storage requirements on a personal mobile phone. The mobile application generates an interactive display screen that provides interactive tools. After the user opens the application (from a closed state) and runs it on the mobile phone, the information displayed in the mobile application will be retrieved. The mobile application will request this information in response to the user selecting an interactive option (e.g., selecting to give an assessment, retrieving a list of employee names). HTTP GET commands may be used for this process. For example, when a user selects an option to view a queue or report of employee-to-employee assessments given in an enterprise, the mobile application responds with a command to send a request message. The service (e.g., an assessment processing software application) responds by sending a set of updated messages, which are received and stored in the enterprise search platform (e.g., implemented in the service). Figure 1 The service may respond by sending a first set of messages, and in response to the user scrolling or searching for messages, the service may send supplemental messages to allow the user to view other messages in the information feed. Preferably, the service and mobile device operate in this incremental process rather than transmitting all or most messages to the mobile application in a manner that could slow down the mobile phone and service and potentially raise security issues.

[0048] The mobile application (e.g., an assessment software application) stores information, such as an assessment message queue in a company, on the mobile device using the mobile device's local volatile memory (e.g., a cache or memory buffer) to support the operation of the application, including the ability to present a display screen containing the received information. Preferably, when the user closes the mobile application on the device, the received information is no longer accessible because it is part of the non-volatile memory and it frees up storage space on the mobile phone for use by other applications.

[0049] The mobile application (e.g., an assessment software application) is configured to communicate with an assessment service (e.g., an assessment processing software application) implemented on a server using interactive data messages (e.g., by using HTTP GET and HTTP POST messages). The use of email protocol messages or chat messages is preferably avoided and is external to and / or independent of the mobile application. The mobile application prepares messages to interact with the service by creating a data portion of the message and associating relevant tags, and further prepares communication messages (or data packets) on the mobile device using JSON on the mobile phone, which are transmitted by the mobile device over a wireless network (e.g., WiFi or a mobile phone network).

[0050] Another application that can be configured to work on or in conjunction with the system is an assessment processing application.Data collected by the system from the assessment process can be saved and used for analysis by the assessment processing application.

[0051] Implementing an electronic system for distributing anonymous employee evaluations to other employees builds upon an existing platform used by company employees. It is possible (e.g., for operational or system efficiency reasons) that other systems or objectives will be integrated or merged into the operation of this electronic system. How to achieve this integration without negatively impacting the operation and effectiveness of the evaluation system is a technical problem for developers. By integrating a second application into the evaluation system, a company can avoid having to develop and / or build separate systems or software for other objectives. In at least one aspect, an embodiment of the present invention integrates an electronic employee evaluation system into an evaluation system in a seamless and efficient manner. The evaluation system is integrated with a user interface for entering evaluations of other employees using a specific interface that allows users to freely write evaluation text (e.g., without specifying rating criteria for multiple categories or without providing preset language that they can reuse) and specify ratings for a set of attributes.

[0052] The assessment system implements interactive tools that users can use to assess various behavioral attributes, which are then analyzed to quantify insight characteristics of the employee (such as mindset, awareness gaps, and balanced / imbalanced areas). Known techniques or algorithms do not use or implement such techniques and are unable to accurately determine such behaviors because they do not take into account situations where the employee is unwilling or unable to provide accurate responses. By soliciting and combining peer / coach assessments with self-assessments provided by the employee, the system implements algorithms such as assessing employee behavior, which can accurately determine how the employee behaves towards his or her peers or coaches and the employee's own perception of the behavior / behavior pattern. The system is configured to apply the algorithm to the feed assessment messages (and the data contained therein) and determine the behavior / behavior pattern as a quantifiable characteristic. The radar chart can provide a reliable and accurate assessment of the employee's behavior. The automatic classification and report generation process relies on the software engine and underlying rules.

[0053] Implementations and embodiments of such systems, interactive tools, applications or interfaces (etc.) according to the principles of the present invention are further described below. The discussion includes other relevant details depending on the embodiments, and also describes or understands advantages and technical benefits from the explanations. The term "assessment system" is sometimes used to recognize that the described system involving assessment is directed to an electronic interactive system involving assessment and skill development.

[0054] Embodiments of the present invention relate to systems and methods for evaluating employees. The envisioned system mainly includes an evaluation application and an evaluation processing application. The evaluation application can be installed on a mobile device and / or provided as a web interface on an electronic device and used by an individual to solicit peer / coach evaluations, submit self-evaluations, and view evaluation data or results. The evaluation application allows an individual (evaluator) to freely write an evaluation in his or her own language. The evaluation is displayed in the evaluation data and results anonymously without showing the identity of the evaluator. The evaluation processing application provides the data displayed in the evaluation data and results. The evaluation processing application is installed on a server for providing anonymous evaluations to the evaluation application. The evaluation application sends the evaluation to the evaluation processing application. The evaluation processing application processes the evaluation to retain information identifying the evaluator and provides the evaluation without the evaluator information to one of the recipients and / or data feeds. The evaluation application can also send a request to the evaluation processing application to retrieve data from other feeds. The evaluation processing application includes a first database containing sender information and a data cache and retrieval system that does not contain sender information or encrypts sender information (generally speaking, it should be understood that various combinations are considered). The first database is protected by security measures or security configurations so that no one (except authorized users) can access it to determine the identity of its evaluators. The evaluation system may also include an analytical application for analyzing user evaluations and outputting various indicators in the form of graphical representations (e.g., radar charts).

[0055] Technical improvements compared to the prior art may include, for example:

[0056] Flexible tools that allow users to write their own, authentic assessments without being restricted to certain terms or choices, or filtered or otherwise modified. Flexible tools can limit the amount of text that assessors may include in their assessments;

[0057] Software applications and systems that can process and provide anonymous raw assessments to recipients;

[0058] Classification engine, which uses radar charts and various rule sets to determine the behavior patterns or personality traits of the person being assessed;

[0059] Software applications and systems that can limit the access provided to those being assessed until a sufficient number of assessments have been collected;

[0060] Software applications and systems that can restrict access to certain corporate resources until an employee performs certain actions under assessment;

[0061] Private self-development space based on self-assessment and automated analysis by peers, coaches and / or family members;

[0062] Use assessments and automated analytics to develop or improve one or more skills of the person being assessed (e.g., decision-making skills);

[0063] A virtual container system for providing bundled software, libraries, and configuration files to execute the systems and methods of embodiments of the present invention in a manner isolated from other virtual machine instances / applications / data to protect the security and integrity of the information contained therein; and

[0064] Structured reports and visual graphics.

[0065] Other improvements of the invention will become apparent by consideration of the drawings and ensuing description.The contemplated system and method provides a truly anonymous assessment mechanism that can be used securely and effectively to promote improvement in decision-making skills, teamwork, and quality.

[0066] The personnel may include all or part of the personnel of the organization, and the personnel are divided into two groups: evaluators and assessees. Evaluators are personnel who can evaluate other personnel (including themselves) (i.e., can perform self-assessment). Assessees are personnel that the evaluators are to evaluate. There may be one or more personnel in the evaluator group, and there may be one or more personnel in the assessee group. In various embodiments, the evaluator group may overlap with the assessee group in whole or in part. Optionally, the two groups may be separate and different. Although the current disclosure describes the evaluators as belonging to the organization, the disclosure is not so limited, and in various cases, some evaluators may be personnel who are not employees of the organization (e.g., family members or friends of the assessee who are asked to provide peer assessments).

[0067] As used herein, a "self-assessment" refers to an assessment where the assessor and the assessee are the same person; a "peer assessment" refers to an assessment provided by an assessor who has not been invited by the assessee to coach or train the assessee (e.g., another employee of the same company, a supervisor, a friend, or a family member); a "coach assessment" refers to an assessment provided by an assessor who is or will be a coach selected by the assessee to coach or train the assessee. A "family assessment" refers to an assessment provided by an assessor who is related to the assessee, such as a spouse and / or someone who is not a coach or peer. Although some of the disclosures below describe peer, coach, and self-assessments as examples, the disclosures are not so limited. For example, family assessments can be solicited, provided, and analyzed (including anonymization) like peer assessments.

[0068] Figure 1One embodiment of a system 100 for soliciting, analyzing, and using employee evaluations is shown. The system includes an evaluation software application or assessment software application (referred to herein as an evaluation application for simplicity) 105 installed on a first electronic device 101(a), and at least one second electronic device 101(b) that can communicate with the evaluation software application 105 (collectively referred to as an evaluation portal system). The first electronic device 101(a) can be used by an assessee, for example, to select peers and / or coaches, solicit evaluations from peers and / or coaches, provide self-evaluations, review evaluations (or corresponding analyses), develop skills, and / or receive training based on the evaluations (self or with a coach), etc. The second electronic device 101(b) can be used by an assessor (e.g., a peer or coach), for example, to receive evaluation requests, provide secure and anonymous evaluations, and / or assist the assessee in developing skills and / or training (e.g., as a coach), etc., through the evaluation software application 105. The system also includes an assessment processing software application 110 (assessment processing system) implemented on one or more servers, an analysis software application 115 (assessment analysis system) implemented on one or more servers, and a training software application 120 (training system) implemented on one or more servers. The electronic device is preferably a handheld mobile smart phone that can download and install mobile applications, which can communicate with the server via a mobile network or other wireless network through a mobile phone. Optionally, the electronic device can be a personal computer, a server, a mainframe, a virtual machine, a container, a game system, a television, and a mobile electronic device such as a tablet computer, a laptop computer, etc. Each of these electronic devices and servers is a computer system that includes a microprocessor and volatile and non-volatile memory to configure the computer system. The computer system also includes a network connection interface that allows the computer system to communicate with another computer system via a network. The assessment processing software application 110, the analysis software application 115, and the training software application 120 can be implemented on the same server or on different servers. The system can include one or more of the above-mentioned software applications, but not all three. Each software application can also be used independently or in combination with another software application (a software application other than the above-mentioned three software applications) to enhance or supplement the function of another software application.

[0069] The assessment software application 105 includes a login interface and performs a user authentication process to allow users (registered assessors and / or assessees) to access the assessment software application. It should be noted that the assessee can be provided with a first class of access rights, allowing them to solicit assessments, review assessments or assessment analyses, and use assessments for skill development / training with or without a coach. In other words, the first class of access rights allows the assessee to access his / her private space. On the other hand, the assessor can be provided with a second level of access rights, allowing them to submit only the solicited assessments (e.g., when the assessor is a peer), and / or a third level of access rights, allowing them to submit the solicited assessments and review the assessments or perform skill development / training with the assessee (e.g., when the assessor is a coach). Different access levels can be automatically configured (e.g., using a rule set) based on the role of the user (i.e., assessee, peer, or coach) using the assessment software application, and / or can be configured by the assessee. The application may also be configured to condition such access on the user performing certain tasks in the assessment system (e.g., soliciting assessments, submitting self-assessments, submitting peer / coach assessments, etc.). For example, the application may require a user to submit a self-assessment and receive a certain number of peer and coach assessments before the assessed user is able to view their assessment and related analytics for the first time. The system may also be used to unlock access to other information in the application and / or other applications enterprise-wide. The system may be configured with permissions to prevent an individual user's employer, supervisor, HR department, or others from accessing an individual user's assessment data (e.g., a private space for their own, peers', and coaches' assessments and reports) unless the user authorizes access, such as as a coach selected by the user.

[0070] The assessment software application is also configured to send reminders or notifications, either within the assessment software application or via email. In some embodiments, notifications are generated, for example, to solicit an assessment, submit a solicited assessment, view an assessment, review training, etc. The notification can be provided by the assessment software application, for example, via a push notification, a pop-up window, a sound or vibration, or by the system or EMS sending an email with a reminder.

[0071] The user can enter his login credentials from the login interface through the electronic device, and the input information is transmitted to another computer system by the electronic device through the network. The computer system that receives the user credentials can be an authentication system 125, which can be part of the system 100. For example, the login credentials of an employee can be his company login credentials, which include information indicating that the user is an employee of the company, such as an email address based on the company's email domain, an employee identification number or other employee identifier. After receiving the credentials, the authentication system checks whether they (e.g., email address and password) match the credentials stored in the authentication system (e.g., email address and password pre-stored in the authentication system). The credentials stored in the authentication system can be created and stored in the authentication system when a person joins the company, and the company's human resources department creates an email address and password for the person through the company's computer system. When the user changes his credentials (e.g., password), the credentials stored in the authentication system can be updated. The authentication system is configured to store the login credentials of employees employed by the company. The authentication implementation is configured to use an authorization token to allow access to services provided on the company's enterprise network or services provided by the enterprise that employs the user to access services (e.g., access all other services or join the enterprise network and access enterprise applications, such as evaluation software applications and employee databases). The process provides efficiency because the user or the system implementing each enterprise application does not need to log in separately for each enterprise software application on the user's electronic device to access the corresponding service. At the same time, the process also establishes highly secure inter-system relationships and connections based on identity authentication and security tokens, such as trusted connections using communication and security protocols to ensure that unauthorized individuals or individuals outside the enterprise cannot access enterprise applications. This security implementation provides a simplified authentication process or a single authentication process that can simultaneously verify whether the user is a company employee and allow the user to access all enterprise applications on the enterprise network. In contrast, traditional systems require a separate authorization process for each program, such as an authentication process for verifying whether the individual is an employee, a separate authentication process for granting access to one of the enterprise applications after verifying that the individual is an employee, another separate authentication process for granting access to another enterprise application after verifying that the individual is an employee, and so on. In some applications, employees use their own personal mobile phones at the employer or remotely, which will implement the mobile application and then connect to the enterprise software platform through the authentication process. For example, the device can be an external device that obtains the benefits of enterprise resources by logging in via cellular data, another company's WiFi, or the company's WiFi.

[0072] Optionally, the login credentials may be different from the company login credentials. In such an example, for a first-time user, the user's credentials may be generated by the authentication system 125. In some embodiments, first-time users may also create their own credentials from the login interface.

[0073] After receiving the credentials, the authentication system 125 checks whether they match the credentials stored in the authentication system (stored as a result of the authentication system generating credentials for the user who first created the credentials). If they match, the authentication system 125 generates an authorization or security token and sends it to the electronic device 100 over the network. The assessment software application 105 incorporates the token into all of its data or communicates with the assessment processing software application 110. The token is required to communicate with these software applications, and the token is checked and verified by these software applications before the assessment software application 105 can access the functions and data in the assessment processing software 110 and / or the employee database 112. The authentication system 125 can generate a user identifier in response to the match and transmit it to the assessment software application 105 over the network. The user identifier can also be included in some or all of the data of the assessment software application 105 or communicate with other software applications and / or electronic devices. The token is required to communicate with these systems and databases, and the token is checked and verified by these systems and databases before the assessment software application can access the functions and data provided by these systems and databases. The user identifier can be a code or number that only the system or software application knows as the user's identity. For example, when a code or number is provided to a user, another user or technician, the identity of the user is not known. If the credentials do not match, the user (or electronic device) is blocked from accessing the evaluation software application 105 and other software applications, and an invalid message is sent to the user.

[0074] Similarly, the authentication system 125 can control access to the assessment software application 105 by other unregistered users (e.g., non-employee users) through the second electronic device. For example, when the assessee selects these unregistered users as assessors, the assessment software application can provide a token to the second electronic device to allow the unregistered users access to provide an assessment for the assessee.

[0075] Once the assessee is granted access to the assessment software application 105, the assessment software application 105 provides a user interface (e.g., on the first electronic device 101(a)) that allows the assessee to perform a number of functions, such as requesting an assessment from a peer or coach, completing a self-assessment, viewing assessment progress, viewing assessment results, conducting skills or training development, etc. For example, Figure 4A portion of a user interface 400 is shown that allows the assessee user to select an option to proceed, such as a self-assessment user interface (using command 410), an assessor selection user interface (using command 412 or 414), viewing assessment results (using command 416), etc. Figure 4 As shown, the user interface can be configured to display a progress bar 450 that displays the progress of the assessee in the assessment process. A command can be a button (physical or digital), icon, tab, window, etc. that allows a user to activate a function of a software application or computer system.

[0076] Figure 5A A portion of a first user interface 500 is shown, which allows the assessee to request an assessment from a peer or coach by searching for an assessor who is already a registered user from a list of registered users (501) or by providing an assessor's email address (502). This screen may be displayed in response to the assessee user clicking an assessor selection command ( Figure 4 The registered user list may be employees of the company (the same company). Figure 5B and 5C Flowcharts 501 and 502 are shown, respectively illustrating communications between an evaluation software application and a second electronic device 101 ( b ) for soliciting evaluations from registered users and unregistered users. Figure 5A 5 shows how an assessed user 505 requests a list of registered users 510 (e.g., in an organization) from a user interface of an assessment software application 515. In response, the assessment software application sends a list of registered users 520 (e.g., from a relevant database) to the assessed user and receives a selection of an evaluator 525 from the assessed user. The assessment software application 515 is configured to communicate with an employee database ( Figure 1, 112) communication, and obtain employee identity information from the employee database. The assessment software application 515 can display all employees of the company (regardless of level, title or role) or a limited set of employees, such as employees who are determined to be employed at the same location, employees belonging to the same department, employees belonging to the same subgroup (or set) as the assessee, supervisors of the assessee, etc. The assessment software application then uses the assessor user identifier to retrieve more information 530 about the selected assessor (e.g., name, email, etc.). The information 530 is retrieved from a database storing information about previously registered users. Specifically, the employee identity information can include the employee name and an identifier for each employee, which the system will use to provide messages to the appropriate personnel. For example, when "Michael" is selected from the employee list, the assessment software application determines that "Michael" is associated with the identifier "0020" and presents the message to the identifier "0020" so that Michael can view the message. The identifier can be an internal identifier used by the system and the employee database to identify the employee. The identifier can be called a recipient identifier. Updates to the employee database will also update the employee list in option 520 accordingly. The evaluation software application can then send a message 535 including the evaluation invitation template to a message transmission service 340 (e.g., an email service) for transmission to the selected evaluator 350. The evaluation invitation can, for example, include the identity of the user being evaluated, information about how the evaluator submits the evaluation (e.g., by accessing the evaluation software application), etc. Such an evaluation invitation can be automatically associated with the evaluator's account in the evaluation software application. Specifically, in some embodiments, the employees in the list are also individuals who can access the evaluation software application. If the employee has not yet installed the application on the electronic device using his login credentials, the message sent to him will be saved on the electronic message processing system, and the employee can view it after he installs the application. In an embodiment, the list may not display individuals who have not yet installed the application (only individuals who have installed the application are displayed).

[0077] For clarity, in Figure 1 In the figures, for example, the application is shown as a mobile application, but these figures may also illustrate a web server implementation, by implementing a web server as part of the application environment and running a service application. The evaluation application may be configured to be implemented as software as a cloud-type application on a browser on a mobile phone or other type of device. The application provided by the web server is provided via a communication network, which may include the Internet. Other networks or types of implementations are contemplated.

[0078] For example, Figure 5DA portion of an exemplary user interface of an evaluation software application for a registered evaluator is shown showing a requested evaluation as a pending evaluation request 510 .

[0079] Figure 5C 510 from an unregistered user. For example, the user being evaluated 505 may provide an email address of the unregistered user. In response, the evaluation software application generates a secure unique token 520 for the received email address and then sends a message 525 including the evaluation invitation template and the generated token to a message transmission service 330 (e.g., an email service) for transmission to a selected evaluator 340. The evaluation invitation template may include, for example, an identification of the user being evaluated, information about how the evaluator submits the evaluation (e.g., a URL link for accessing the evaluation software application), login credentials (e.g., based on the generated unique token), etc. For example, Figure 5E A portion of an exemplary user interface for inviting an unregistered user to provide an evaluation is shown, including an embedded link 510 for accessing an evaluation form without accessing the evaluation software application itself.

[0080] Figure 6 A portion of a user interface of an assessment software application that allows a user to complete a self-assessment is shown. As an example, the assessed user can click on a self-assessment command 410 to access a self-assessment form user interface. Figure 6 600 includes a portion of a user interface for an assessment software application that allows a user to create and submit a self-assessment. The self-assessment creation area 600 includes: Figure 6 The self-assessment may be composed of a free-style message writing area 605 (shown in Figure 605 as "Future Outlook" 625) that allows the user to write an assessment message in their own language; a multi-level rating scale 610 that allows the user to select a numeric assessment rating; a save command 615 for saving an unfinished draft of the self-assessment; and a submit command 620 for submitting the completed self-assessment for transmission to another computing device and / or for local storage. Optionally, a separate self-assessment creation area may be displayed in sequence for each assessment criterion until the assessed user completes the self-assessment for each assessment criterion. The assessed user may also access his / her past self-assessments. In various embodiments, if the user completes only one or two of the three information columns, and / or does not complete all information columns for all available assessment criteria, the submit command 620 may be disabled and the user will not be able to submit the self-assessment. It is best to use only five or a small group (e.g., 4-6) of attributes, and the specific attributes are designated attributes. The assessment software application also records the time when the self-assessment was created (i.e., when the user selects the send option 620).

[0081] A free-style text area is an area where a user can enter a message by typing in his or her own language on a QWERTY keyboard of an electronic device. The user can also enter such a message in other ways, such as by speaking or using gestures to transmit his or her own language to the electronic device. The message entered by the user is a message transmitted to the assessment processing software application. The user's ability to enter the words he or she needs is not limited or constrained by the assessment software application (e.g., when forced to select only certain options or predetermined messages), and the user can enter any words he or she wants. Optionally, a free-style text area can be associated with a maximum allowed message length. For example, a digital assessment rating can be constructed as a 1-4 rating, where 1 represents below expectations, 2 represents in line with expectations, 3 represents exceeding expectations, and 4 represents greatly exceeding expectations. Multi-level and multi-type rating scales are also considered. In some aspects, the assessment is designed to be brief, such as a digital rating and text assessment (limited in size) with only a small group of assessments, and almost no or no other questions or prompts (almost no reference to a question) are required to make the assessment error-free.

[0082] Figure 7 A portion of a user interface of an assessment software application is shown that allows an assessor to complete a peer assessment or a coach assessment. For example, an assessor (peer or coach) can access the user interface 700 by clicking on a URL link included in an email received with an invitation to provide an assessment (for unregistered assessors) or by accessing the assessment software application (for registered assessors). Figure 7 A portion of a user interface of an assessment software application is shown that allows assessors to create and submit peer / coach assessments. Figure 6 Similarly, the assessment creation area 700 includes: Figure 7725) to allow the user to write an assessment message in their own language; a multi-level rating scale 710 that allows the user to select a numerical assessment rating; a save command 715 for saving an unfinished draft assessment; and a submit command 720 for submitting the completed assessment for transfer to another computing device and / or for local storage. Optionally, a separate assessment creation area may be displayed in sequence for each assessment criterion until the assessor completes the assessment for each assessment criterion. In various embodiments, if the assessor completes only one or two of the three information columns, and / or does not complete all information columns for all available assessment criteria, the submit command 720 may be disabled and the user will not be able to submit the assessment. The assessment software application also records the time when the assessment was created (i.e., when the user selects the send option 720). The system can be configured to make the peer and coach assessment processes identical to provide a comparative reference (i.e., with the same attributes, numerical ratings, and / or free text areas). Optionally, the self-assessment can be identical, but without text input.

[0083] Fig. 8A A portion of a user interface is shown to allow an assessed user to view a submitted assessment and corresponding assessment analysis. As an example, an assessed user can click on the View Assessment command 416 ( Figure 4 ) to access a user interface for viewing assessments (free form and numeric assessment ratings and corresponding analytics). The user interface 800 displays an assessee identifier 810, their average score for each assessment type (802: self / peer / coach) 815, and an overview 820 of their assessments for each assessment type according to the assessment criteria (801). The assessment software application also provides an option that can be selected to view each submitted assessment in detail. A graphical output (e.g., a radar chart) 850 is also displayed and discussed in more detail below. Other information may also be included in the user interface, such as identified behavioral patterns or behaviors, related descriptions, training or skill development recommendations, and / or training links. The user interface 800 is interactive, allowing the assessee to filter, compress, expand (e.g., by hovering), change the information contained in the graphical output, or otherwise manipulate the displayed information.

[0084] In various embodiments, if the self-assessment and / or solicited assessment is incomplete, the Submit Review Assessment command 416 may be disabled and the user will not be able to view the self-assessment and / or solicited assessment. Fig. 8Auser interface. Only the assessee can view the completed assessment and corresponding assessment analysis; other users or employees using the assessment software application cannot access them (e.g., the assessment and corresponding assessment analysis are only available as a private space on the assessee's assessment software application). Optionally, the assessee can invite or authorize the coach to view at least a portion of their private space so that the assessee can review their assessment and develop a self-development plan (e.g., training) with the coach. This can be achieved by providing the coach with access to the data via the application, which displays the information to the coach in the coach's interactive space generated by the application. The assessee can only view the assessment from the assessment software application installed on their electronic device, and if the assessee has not yet logged in or has logged out in order to use the application, they need to log in to the application (see the login and authentication process described above).

[0085] Figure 8B A detailed report is shown, including, for example (but not limited to), an assessment progress bar 861, an overall score in the form of a radar chart 862, an analysis report 863 (including sub-sections, such as 863 (a), 863 (b) and 863 (c)), and an assessment review section 864 that allows the user to view the combined ratings and free text assessments for each attribute. These will be described in more detail below. It is important to emphasize that the system is configured to perform certain processing and generate reports in a certain structure in response. Specifically, sub-sections 863 (a), (b) and (c) are configured to report corresponding algorithm groups. In the first group, in this example, the relationship gap in consciousness, the algorithm group is configured to analyze the data gap between the self and peers and between the self and the coach. This can be a geometric area type algorithm to determine geometric differences or area differences. The system reports the identified classifications and generates display information corresponding to the specific classifications. The second group, imbalance, corresponds to using algorithms configured to evaluate the data generated by the self, peers and coaches and identify each data pattern classification. The third group corresponds to the total score, and the algorithm is configured to generate the total score. As shown in the example, there is a score generated by the coach from the five numerical ratings, which is determined by grouping and averaging. This structure can further facilitate the user's process.

[0086] In various embodiments, using the methods discussed below, displayed assessments can be anonymized so that no identifying information is provided to the assessee regarding the assessor associated with each individual assessment. Alternatively, peer and / or family assessments can be anonymized while coach assessments are not. A trusted anonymity feature is achieved.

[0087] The assessment software application 105 is configured to generate an assessor identifier for identifying the assessor, a message identifier for identifying the composed assessment message, and optionally a time identifier (temporal information) for identifying when the assessment was sent (e.g., date and time) and an assessment type identifier (e.g., peer assessment, coach assessment, self-assessment, etc.). The system may also identify the assessee associated with the assessment and create an assessee identifier. For example, the assessee may be identified using a token associated with the assessment that is sent to the assessor along with the assessment invitation (e.g., see Figure 5B and 5C ). These identifiers may be generated in response to the evaluator user selecting a submit command for the evaluee (after the evaluator user completes the evaluation message and selects a numeric evaluation rating). After the user selects the send command, the evaluation software application 105 transmits the evaluation (including the evaluation message and rating) and the generated identifiers to another computer system (e.g., a server implementing the evaluation processing software application 110) via the network connection interface of the electronic device 100 over a network.

[0088] With respect to the assessment processing software application 110, a server implementing the assessment processing software application 110 is configured to receive the assessment and the generated identifier over a network via a network connection interface of the server. The assessment processing software application 110 also checks whether an authorization token exists and verifies whether the token is valid to determine the identity of the assessee, associate the received assessment with the assessee, and / or verify whether the assessment was solicited by the assessee. The assessment processing software application 110 includes two environments, namely an application environment 130 and a reporting environment 135. The received data and token are input from the application environment 130.

[0089] In some implementations, the anonymity aspect can be implemented with a database (e.g., first database 145), and a software process can be used as a software module and / or authorization information in a table can be stored to limit the information provided in the peer evaluation report to maintain anonymity. In other cases, additional or alternative anonymity features can be implemented.

[0090] In one embodiment, the application environment 130 includes a service (or service application) 140 that processes received data, a first (primary) database 145 for storing received data, a data cache and retrieval system 150 for storing a portion of received data, and a second database 155 for storing a portion of received data. Upon receiving the data, the service 140 stores the received data in the first database 145. The service 140 may store the entire received data (i.e., the evaluation and the generated identifier) ​​in the first database 145. In other words, the service 140 stores the content received by the application environment 130 in the first database 145. In some embodiments, the service 140 stores at least the evaluation (evaluation message and rating), the evaluator identifier, the evaluation type identifier, and the evaluee identifier in the first database. Other combinations are also contemplated. The data stored in the first database is raw data, which means that the received data is the same as the stored data, or no additional procedures are applied to delete, add, or modify (e.g., encrypt) any data in the received data, except for those basic or inherent data in the operation of the software application and the server, such as decoding, analog to digital conversion, etc.

[0091] The service 140 also copies the received data, deletes or erases the evaluator identifier from the copied data, and stores the remaining data in the copied data (or the copied data without the identifier) ​​in the data cache and retrieval system 150. The service 140 may copy the received data as it is received, or copy the received data from the data in the first database 145. The data 150 in the data cache and retrieval system 150 does not have the evaluator identifier, and optionally includes an evaluation type identifier. The evaluee can use the evaluee identifier (i.e., the evaluee's evaluation and rating) to retrieve the data 150 in the data cache and retrieval system 150, and can only retrieve it after the evaluee is authenticated.

[0092] In addition, the evaluator identifiers in the first database 145 may be replicated and stored in the second database 155. The second database 155 is not linked to the data caching and retrieval system 150. The database 155 and the system 150 are two separate independent systems. The replication may be achieved through an asynchronous job. The evaluator identifiers in the second database 155 may be further encrypted. The time information in the first database 145 may also be replicated, diluted, and stored in the second database 155. For example, the time information may show the exact date and time that the evaluation was sent, such as 2:00 p.m. on May 2, 2018. The information may be summarized or downgraded (e.g., reducing the time resolution) so that the modified time information only indicates that the evaluation was sent on May 2, 2018, the first week of May 2018, or May 2018. The time information can be modified by eliminating only the time portion (e.g., 2:00 p.m.), eliminating the time portion and changing the date portion to a lower resolution (e.g., changing from May 2 to the first week of May), or changing the time portion to a lower resolution (e.g., changing from 2:00 p.m. to p.m.) and changing the date portion to a lower resolution. Similarly, the assessment type can be eliminated to obtain a lower resolution. A higher time resolution means that the time information is more specific, while a lower time resolution means that the time information is less specific. Similarly, the assessment type identifier can be eliminated to obtain a lower resolution. A higher assessment type resolution means that the assessment type information is more specific, while a lower assessment type resolution means that the assessment type information is less specific. Encryption and dilution are used to anonymize the identity of the assessor. Copying, encryption, and dilution can be performed according to instructions given by the service 140. The time / assessment type information in the system 150 is saved with the original time resolution.

[0093] For the sake of clarity, the process performed by the service 140 refers to one or more of the above-mentioned storage step (relative to the first database 145), copying step, deletion step and storage step (relative to the data cache and retrieval system 150). They may also include the step of copying the evaluator identifier and storing it in the second database 155.

[0094] Reporting environment 135 accesses data in data caching and retrieval system 150 to perform evaluation analysis.

[0095] In addition to removing the evaluator identifier from the raw data before saving it to the data cache and retrieval system 150, the assessment processing software application 110 can also be implemented using asymmetric encryption. In this embodiment, the application environment 130 is equipped with a public key configured to encrypt the evaluator identifier. The application environment 130 can encrypt the evaluator identifier of each assessment sent by the same person differently (e.g., using different codes), but it is understood that different codes are associated with the same evaluator identifier or person. For example, when both assessment messages are sent by the same person, the application environment 130 can encrypt the evaluator identifier of assessment message A using XXXX and encrypt the evaluator identifier of assessment message B using YYYY. After encryption, the encrypted evaluator identifier and other data (e.g., assessment messages, ratings, and other identifiers) are stored in the data cache and retrieval system 150. The reporting environment 135 accesses the data in the data cache and retrieval system 150 and uses it to perform assessment analysis. The reporting environment 135 is equipped with a private key to decrypt the encrypted evaluator identifier so that it can perform assessment analysis on the user corresponding to the identifier or provide sentiment analysis to the user. The encrypted assessor identifier can only be decrypted using the private key.

[0096] Each environment and service can be referred to as a system or subsystem in the assessment process software application.

[0097] Identifier deletion embodiment or asymmetric encryption, the data in the first database 145 and the data cache and retrieval system 150 can be stored as a table. The received data can be converted into a different data structure, such as a table, by the service 140 before it is saved, or converted by the database 145 or the data cache and retrieval system 150 after the service 140 provides the data. For example, the service 140 (or the first database 145 / data cache and retrieval system 150) can create a table by dividing the evaluation message, identifier and rating into at least two categories, and store each category as a table. The evaluation message, evaluation type identifier, the evaluated identifier, the message identifier and the rating can be classified into one category and stored in one table, while the evaluator identifier can be classified into a separate category and stored in another table. The dual table format is stored in the first database and the data cache and retrieval system. As described above, the evaluator identifier can be deleted or encrypted before it is saved in the data cache and retrieval system. Therefore, the two tables in the first database include the evaluator identifier, while the two tables in the data cache and retrieval system either do not have the evaluator identifier or encrypt the evaluator identifier. The data in the dual table format may be accessed by the reporting environment 135. The evaluator identifiers in the second database 155 may be copied from the data in the dual table format in the first database 145.

[0098] The service 140 uses the data caching and retrieval system 150 to retrieve the necessary data in response to a request sent by the evaluation software application 105 (e.g., the evaluation software application 105 used by the evaluatee when authenticating the evaluatee login credentials). The service 140 uses the data caching and retrieval system 150 to keep the identity of the evaluatee anonymous because the evaluater identifier is not available or is encrypted. The reporting environment 135 uses the evaluater identifier in the second database 155 or decrypts the encrypted evaluater identifier only in limited circumstances when required for analysis. In addition, the service 140 uses the data caching and retrieval system 150 so that the evaluatee can only access their evaluations and ratings without the evaluater identifier.

[0099] The data cache and retrieval system 150 (or retrieval system for simplicity) is a system including a cache mechanism, an index mechanism and a database. The cache mechanism can be based on Redis or memcached technology and is used to cache data in the retrieval system 150, especially data that has been previously found or retrieved. For example, when the service 140 queries the database in response to a request sent by the evaluation software application 105, and the retrieval system 150 returns the result, the result will be stored in the cache for a period of time so that the result can be quickly accessed when called (for example, the result can be retrieved in a few milliseconds instead of seconds). The index mechanism searches the data in the retrieval system 150 and indexes it in the index mechanism. The index mechanism enables fast search of data in the retrieval system 150. The data searched by the index mechanism can be data that has not been searched before, or data that has been stored for a time longer than the cache allows and is cleared from the cache. The index mechanism can be the default mechanism for the retrieval system 150 to search for data, and if the data to be searched is already in the cache mechanism, the retrieval system 150 can use the cache mechanism. For the database, the cache mechanism and the index mechanism operate on the data in the database to retrieve the necessary data. For example, the indexing mechanism may inversely index each evaluation message and rating in the database. When a search is performed, such as by the reporting environment 135 or the evaluation software application 105 searching for evaluation types in evaluation messages stored in the retrieval system 150, the indexed format allows the environment 135 or the software application 105 to quickly identify and retrieve these messages. Other techniques and platforms related to searching are also contemplated.

[0100] The retrieval system 150 also includes two security measures or configurations to protect the identity of the evaluator and the evaluation information of the evaluee. One security measure is that the retrieval system 150 uses the evaluator identifier to find the evaluation messages and ratings given by the evaluator stored in the retrieval system 150. This identifier only allows this specific user (through its evaluation software application and retrieval system) to find the evaluations given by it. The user (and the evaluation software application and retrieval system) cannot use it for other purposes, such as finding the evaluations given by others to the evaluee or the identity of other evaluators and their evaluations (unless the user is the evaluee himself). Similarly, the retrieval system 150 uses the evaluee identifier to find the evaluation messages and ratings corresponding to the evaluee stored in the retrieval system 150. This identifier only allows this specific user (through its evaluation software application and retrieval system) to find the evaluations it received (without the evaluator identifier-i.e. anonymous). The user (and the evaluation software application and retrieval system) cannot use it for other purposes, such as finding the evaluations given by others to other evaluees or the identity of the evaluator. Another security measure is that the retrieval system 150 provides public-private key encryption, or is configured to work with a system that implements such encryption. When the system does not have asymmetric encryption, the retrieval system 150 can provide such functionality, and the system can operate as described above (alternative embodiment). When the system already has this feature, the encrypted evaluator identifier is indexed by the retrieval system, and the encrypted evaluator identifier is used to anonymously and quickly look up the evaluations given by the individual with that identifier (also indexed).

[0101] The data caching and retrieval system 150 may be referred to as an enterprise search and indexing engine that is capable of retrieving information from many different databases, including those in the system 150 and other databases. The system 150 provides faster, more responsive capabilities in the context of an assessment system. For example, the system's user interface simplifies the assessment information to be saved, and due to the simplified structure, the system 150 can quickly index, save, search, and retrieve data. In systems other than the assessment system or assessment systems that do not provide a simple user interface, the amount of information received from a Word or PDF document may be so large that using the system 150 in indexing, saving, searching, and / or retrieving data may not be as fast and efficient.

[0102] The first database 145 storing the original data or all received data (including the assessor identifier) ​​is constructed with security measures or configurations to prevent unauthorized access. The first database 145 can be implemented in another private network and located behind a firewall that is different from the private network and firewall that implements the assessment process software application (excluding the first database 145). For example, access to the first database 145 may require a different login process or credentials than the assessment software application (separate portal). The first database 145 can be referred to as a production database server. Security measures or configurations can be implemented at two levels, namely, the application level and the database level.

[0103] In one embodiment, the first database 145 is strictly restricted so that only specific software and service applications can access the first database 145 (application level). The first database 145 is also strictly restricted so that only specific individuals can access the first database 145 (database level), and the specific individuals have full access rights to the first database 145 or at least have access rights to the assessor identifier in the first database 145. At the application level, the first database 145 can grant permissions to the assessment software application 105 and the service application 140 (and only these applications) to allow them to write and read the first database 145. The assessment software application 105 and the service application 140 can be configured so that they write data to the first database 145 and read data from the data cache and retrieval system 150. At the database level, only the first database creator and individuals approved by the first database creator have access rights. The creator and authorized applications and personnel can view or retrieve the original data from the first database 145, including the assessor identifier and the actual assessment. The original data is not encrypted. The creator and the allowed individuals access the first database 145 through a two-step security process. First, they need to log in to the private network where the first database is located, which is different from the private network where the assessment process software application (excluding the first database) is located. Secondly, if they want to access the data in the first database 145, the first database 145 will check their credentials to determine whether they have the right to access the data. In some embodiments, the second step may involve submitting another login credential that is different from the first step. Both are privileged access and require the permission of the creator. Only individuals who pass these two steps can access or view the original data in the first database 145. Some individuals may only be granted the first privileged access so that these individuals can modify or update the hardware and software of the first database 145, or perform other purposes on the first database 145 (such as testing and network-related issues). However, these individuals do not have access to the original data in the first database 145.

[0104] A database management software application 160 is implemented to interact with the first database 145. The database management software application 160 may be accessible only to the first database creator. The database management software application 160 provides a user interface that allows the first database creator to grant first database access permissions to software applications (e.g., assessment and service applications 105, 140) and individuals (e.g., users granted first privileged access and users granted second privileged access). Users granted second privileged access are users granted first and second privileged access.

[0105] A user access log system 165 (or software application) is also implemented to interact with the first database 145. The log system 165 can be part of the first database 145 or the assessment processing software application 110. The log system 165 is configured to record each authorized user's access to the first database 145, including the activities of the first database creator. The log system 165 can record activities that occur under the first privileged access and the second privileged access. For example, activities that occur under the first privileged access may include the identity of the authorized user, the hardware, software, data, and network modified by the authorized user, the date and time of the authorized user's operation, and other information. Activities that occur under the second privileged access may include the identity of the authorized user, the original data accessed by the authorized user, such as the assessor identifier and the actual assessment, the corresponding assessee identifier, the date and time of the user's operation, and other information. The log system 165 is configured by the first database creator or other professionals (e.g., technicians, engineers, network administrators, IT experts, etc.) to be accessible only to a limited number of users so that they can check whether anyone (including the creator) has accessed the data in the first database 145. Since the system is configured to keep the identity of the evaluator anonymous, the logging system 165 is intended to check whether anyone has accessed the data in the first database 145, which may compromise the identity of the evaluator, jeopardize the evaluation information, etc., and authorized individuals should not have access to this information.

[0106] Another embodiment of the security measures or configuration of the first database 145 can also be implemented. The second embodiment is also implemented at the application level and the database level. At the application level, it involves two entities, the software application and the service application, and the application administrator. The software application and the service application (or one of the applications) are equipped with a security key or hash that enables them to encrypt the evaluation and access the first database 145 only for authorized users (e.g., the corresponding assessee) (e.g., store the encrypted evaluation in the first database and retrieve the encrypted evaluation from the first database). The same security key can also allow the software application and the service application to decrypt the retrieved evaluation, or the software application and the service application can be equipped with a second key to decrypt the data (so that the actual message and rating and the assessor identifier can be seen or otherwise obtained). The application administrator, such as a professional who manages or controls the evaluation software application and the service application, can also have a decryption key and may be the only individual who has such a key. The first database 145 and the database administrator (described below) do not have a decryption key and cannot decipher the encryption.

[0107] At the database level, it also involves two entities, namely the first database and the database administrator. The first database 145 is equipped with a security mechanism that can check whether the user who attempts to access the first database 145 has the necessary security key (the first database 145 itself may also have such a key). The database administrator (e.g., a professional who manages or controls the first database 145) may be the only individual who has such a key. The security key of the first database is different from the encryption / decryption key at the application level. Software applications and service applications, as well as application administrators (as described above), do not have the security key of the first database 145 and cannot access the first database 145.

[0108] Based on the above, both the decryption key and the security key of the first database are needed to access and decrypt the evaluation in the first database 145 so that the actual message, rating and assessor identifier can be seen or otherwise obtained. When the second embodiment of the security measure or configuration is installed, these two keys can be generated and provided to their respective administrators. The second embodiment can be used to implement the platform to allow administrators to submit their keys. The administrator can access the data in the first database 145 and decrypt the data in the first database 145 from the platform. In order to further strengthen the security level of the second embodiment, the application administrator and the database administrator can be limited to individuals who hold the most senior position (in terms of ranking) or executive level positions in the organization, or individuals who can make executive decisions on behalf of the organization (e.g., CEO, CFO and CTO). For example, the application administrator can be the chief technology officer (CTO) and is provided with a decryption key, while the database administrator can be the chief executive officer (CEO) and is provided with a security key for the first database. Therefore, both the CTO and the CEO need to submit their respective keys to the platform in order to access and decrypt the data in the first database (in order to view the actual evaluation and identity of the assessor). Therefore, the first database creator may not have any keys and cannot access or decrypt the data in the first database 145 even if he designs and installs the first database and its technology (eg, its security measures or configuration).

[0109] The second embodiment may be referred to as a foolproof security model with distributed security access (e.g., between application administrators and database administrators). Security measures or configurations based on a combination of the above two embodiments are also contemplated. Security measures or configurations based on a combination of one or more features in the first embodiment and one or more features in the second embodiment are also contemplated.

[0110] The assessment software application 105 and the analysis software application 115 may not have access to the first database 145. Both applications may be directed to the data caching and retrieval system 150 to obtain the necessary data.

[0111] Implementing the above services, databases, data caching and retrieval systems and security measures allows the assessment system to maintain the anonymity of the assessor's identity while still being able to analyze the assessment given by the assessor in a limited, private manner (without compromising the assessor's identity). Embodiments of the present disclosure ensure the highest level of access restrictions and data protection, particularly for information identifying the assessor, and only allowing the assessee to access his or her assessment. The first database and related applications and systems constructed using the above features improve the operation or security operation of the first database. In some embodiments, they can also improve the storage and organization of received information in the assessment processing software application.

[0112] However, in some embodiments this level of security may not be achieved. For example, control over which data is accessible or displayed to a user may be controlled using the table of specified user permissions described above, and this may not have application-level or database-level security. For example, it may also not perform the more complex anonymization process described.

[0113] Figure 3 Flow 300 is shown, which shows the communication between the assessment software application and the assessment processing software application. Specifically, Figure 3It is shown how submitted evaluations are saved in an application environment of an evaluation processing software application and how submitted evaluations are provided to the evaluation software application. An evaluated user 305 solicits an evaluation (310) from an evaluator (315) from a user interface of an evaluation software application 320, wherein the solicitation is associated with an evaluee identifier. The evaluation software application (320) sends an evaluation invitation (325) to the evaluator (315), which is also associated with the evaluee identifier and optionally includes a token of an unregistered user. The evaluator 315 enters the solicited evaluation 330 (including an evaluation message and a rating) from the user interface of the evaluation software application 320. In response to the evaluator selecting a send command, the evaluation software application sends a request or request payload 335 containing an evaluation, an evaluee identifier, an evaluation type identifier, and an evaluator identifier (collectively referred to as evaluation data 340) to a service application 345 of the application environment. The service application 345 can then save the evaluation data 340 or raw data in a suitable format in a first database 355 (step 350) as data 360. Then, the first database 355 responds to the service application 345 with a success or error message (step 365), indicating whether the original data is successfully saved. The service application 345 can also copy the same original data, delete the assessor identifier from the copied data, and store the copied data without the assessor identifier in the data cache and retrieval system 375 (step 370). The copied data without the assessor identifier can be saved as 380. Then, the data cache and retrieval system 375 responds to the service application 345 with a success or error message (step 385), indicating whether the copied data without the assessor identifier is successfully saved. Once the data without the identifier is successfully saved, the service application 345 will provide the data, i.e. the data that the user selects to send but without the assessor identifier, to the assessment software application (step 390). For example, the service application 345 can provide the data to the analysis system for analysis, and / or provide the assessment software application to display to the assessed user 305. The assessment software application shows the assessment and corresponding analysis he or she received to the assessee once it is authenticated. Other users are not allowed to access the assessment or analysis of the assessee. Specifically, the service application 345 determines the evaluee identifier corresponding to the evaluee, retrieves the evaluation message and rating from the retrieval system using the determined evaluee identifier, and provides the retrieved evaluation message and average rating to the evaluee. The evaluation software application continuously updates the data to display the latest evaluation (and previous evaluations) received by the evaluee, such as the evaluation submitted in step 310. In some embodiments, the system is configured to send and receive evaluation messages from the server using HTTP GET and HTTP POST messages.

[0114] It should be noted that although the above description describes keeping the evaluator's identity anonymous, the present disclosure is not so limited, and in some embodiments, the system may not use this anonymization feature. For example, the evaluator may instruct the system not to keep his identity anonymous and share it with the evaluee. In such an example, the system can directly use the raw data in the first database 145 for reporting and analysis purposes.

[0115] The assessment can be an overall analysis (taking into account all messages and numerical ratings), assessment type specific, or attribute specific. The assessment analysis software application includes a computer algorithm and artificial intelligence programmed to perform the above operations. The assessment analysis software application is also configured to use the received assessment messages and numerical ratings to identify the characteristics of the person being assessed. The assessment analysis software application uses data in the system 150 to make such determinations and assessments. In some embodiments, the learning behavior identification process can also take into account the assessments given by the user. The assessment analysis software application 110 uses data in the system 150 so that the identity of the assessor remains anonymous. However, in some embodiments, the assessment analysis software application 110 can further consider data in the second database 155 when necessary.

[0116] Reference now Fig. 9 , the flowchart describes the overall flow chart involved in identifying and classifying multi-dimensional data patterns including attribute relationships (e.g., data relationships between attribute pairs or attribute groups, such as further dimensions of inter-assessor relationships, such as coach-to-self) according to an embodiment of the present invention, and can be performed by an assessment application and / or an assessment processing software application in combination with a software engine and reporting component. For example, a system is implemented that stores a library of algorithms, each algorithm having a corresponding classification and associated stored data when a classification or state is detected. Optionally, the software engine may include Figure 1The software engine is configured to apply the algorithm library (as a whole, individually or in combination), such as by evaluating the numerical score of each attribute and detecting whether one or more algorithms are completed / satisfied, such as the way of detecting classification. The algorithm can include many levels of complexity, such as the ability to detect the relationship between certain attributes. For example, whether the average of the first and third attributes results in a number higher than the score of the second attribute. Or for example, whether the average of the first and third attributes results in a number higher than the score of the second attribute, while the score of the second attribute is lower than each of the fifth and fourth attributes. Complex analysis of many different patterns can be detected and classified from the automatic data analysis based on the corresponding information library. The classification by the algorithm and the stored classification information can be used to display the detected classification or other automatic evaluation to the user through a structured report displayed to the user in the application. The report can be displayed in combination with a radar chart that provides an interactive radar display. When a classification is detected, the classification and reporting process provides the same data to (all) users in the company, and the classification is only provided (the software restricts access to the data) to the user's private space and selected coaches. "Same" data refers to the ability to report and display the detected classification to each user in the same way.

[0117] refer to Fig. 9 , receiving self-assessments and peer / coach assessments for multiple attributes (905). As discussed, the self-assessments and peer / coach assessments include numeric ratings and free-style text assessments for the attributes. For example, the assessment provides evaluations related to the following five factors or attributes: (1) Future Vision (as a measure of effectiveness in establishing and motivating others to achieve goals); (2) Measuring Progress (as a measure of effectiveness in identifying trends and maintaining perspective); (3) Discipline in Hard Work (as a measure of consistency and discipline in handling difficult work); (4) Speed ​​and Courage (as a measure of speed and courage in action, taking into account the individual's ability to make trade-offs); and (5) Authenticity - not lying, not hiding, not falsifying (as a measure of how truthful the individual is in communicating with others and his / her ability to seek the truth). The assessment processing software application (e.g., a service application) is also configured to, for example, average the numeric assessment ratings for each assessment criterion (in each assessment category - e.g., peer assessments and coach assessments) of the assessee and present the results to the assessee through the assessment application software user interface (e.g., as shown in the figure). Fig. 8A and 8B The service application can access the evaluation messages and ratings stored in the data cache and retrieval system to provide the evaluation messages and average ratings to the evaluatee upon the evaluatee's request. As described above, the identity of the evaluator of each evaluation message remains anonymous.

[0118] The software engine then begins analyzing the assessment by generating one or more scores based on the received numeric ratings in the assessment (910). For example, but not limited to, the software engine can calculate an overall attribute score received by the assessee (e.g., by adding all values ​​for the attribute), an average attribute score received by the assessee (e.g., by averaging all values ​​for the attribute), an overall self-, peer-, and / or coach score (e.g., by adding the scores in the self-assessment, peer-assessment, and / or coach assessment), the difference in the self-assessment value relative to the value provided by peers and / or coaches (e.g., by averaging the values ​​for the attribute provided by peers and / or coaches and determining the difference to the self-assessment value for the attribute), an average score and / or an overall score for a combination of one or more attributes and / or a comparison of such scores to other scores, etc.

[0119] Then, the software engine performs multi-level classification and analysis (915) of the current behavior of the assessee based on the calculated scores by detecting the interrelationships between certain attributes. For example, the software engine can analyze the assessment and the calculated scores to determine or detect certain patterns observed in a given assessment message and a numerical assessment rating, and convey visual instructions to the assessee based on the determined patterns. When determining the pattern, the assessment analysis application 115 can parse the free style assessment message based on a large number of words and synonyms, and / or determine additional scores based on the free style message. The software can analyze each score (e.g., the calculated score and / or additional score), such as by traversing the analysis point by point to identify the classification from the library. In the case of a self-assessment intended to improve decision-making attributes, the software engine can use the calculated scores to classify the imbalance of the assessee and the gap in the relationship with peers and / or coaches. As for the total score, for example, for foundation, sense making, and action, the indicator can classify the decision of the assessee (e.g., average, exceeding expectations, meeting expectations, needing improvement, etc.). The overall score may optionally take into account only the numerical scores provided by the coach-assessors for the various attributes and categorize them into various traits and corresponding scale levels. As for imbalances, the determined indicators may indicate or highlight biases that may distort the assessee's decision making. As for relationship gaps, the automated analysis may assess the gap between the assessee's self-understanding and that of their peers and coaches. For example, the indicator may indicate that a user is reticent when the user does not give any evaluations or does not receive enough evaluations (e.g., below a threshold). This may also be understood as an automated interpretation engine that is consistent for everyone in the company, which can be updated remotely and is private to the users. It may also identify and categorize based on the scores behind the indirect information that the algorithm library understands through the evaluation system (and / or other information in the evaluation).

[0120] In various embodiments, the relationship gap between the assessee and his / her peers is determined by comparing the self-assessment numerical rating to the average numerical rating of the peers, and the relationship gap between the assessee and his / her coach is determined by comparing the self-assessment to the average numerical rating of the coach according to the assessment criteria. For example, the average score of the peer assessment according to the assessment criteria is compared with the corresponding self-assessment score for the criteria to determine the gap for the criteria. The gaps for each assessment criteria are combined to determine an overall relationship gap in awareness. This overall relationship gap in awareness can be compared to one or more thresholds, for example, to determine whether the assessee's gap relative to his / her peers or coach is high, medium, low, etc.

[0121] Example

[0122] Step 1:

[0123] For example, peer assessment A: 1, 2, 2, 2, 1

[0124] Peer Assessment B: 1, 1, 1, 1, 1

[0125] Peer average rating card: 1, 1.5, 1.5, 1.5, 1

[0126] Step 2:

[0127] For example, self-assessment: 2, 2, 2, 2, 2

[0128] Total gap with peers = 1 + 0.5 + 0.5 + 0.5 + 1 = 3.5

[0129] Step 3:

[0130] Since the total peer gap is 3.5, this user would be classified as "High Gap".

[0131] High Gap: Total Peer Gap > 3

[0132] Medium gap: total peer gap > 1 and <= 3

[0133] Low gap: total peer gap <= 1

[0134] The gaps and relative shapes of pentagons 857, 858, and 859 may provide the assessee with an indication of their alignment with peers and coaches and a corresponding description.

[0135] The assessee's self-imbalance is determined by averaging the numerical ratings of peers, coaches, and self-assessments for each assessment criterion and comparing them. For example, the following three sets of imbalances can be identified:

[0136] ○ Micro-tactician vs. empty-talking professor

[0137] ■Micro-Tactician: The average combined scores for Future Vision and Measuring Progress attributes are lower than the average scores for Discipline, Speed / Grit, and Authenticity in Hard Work.

[0138] ■The Empty Talk Professor: The average scores for the Future Vision and Measuring Progress attributes are higher than the average scores for the Discipline, Speed / Grit, and Authenticity attributes in Hard Work.

[0139] ○ Recklessness: The average combined scores for Future Vision and Measuring Progress attributes are lower than the average scores for Speed / Grit attributes.

[0140] ○ No signal: All attributes are rated <= 1.5 by peers or coaches.

[0141] The total score is determined using the average numeric ratings of the assessments (including a combination of self-, peer-, and coach-assessments). For example, the total score can be broken down into categories such as foundational score (average composite score of the attributes of discipline and authenticity in hard work), meaningfulness (average composite score of the attributes of future vision and measuring progress), and action (average score of the attributes of speed / aggression). All three categories can be converted to expectations using thresholds, such as below expectations (score <= 1.5); meets expectations (score > 1.5 and <= 2.5); exceeds expectations (score > 2.5 and <= 3.5); and far exceeds expectations (score > 3.5).

[0142] The generated information represents an assessment of the user and may be presented in the form of a report and / or a graphical representation indicating the identified behavioral patterns (920).

[0143] For example, the assessment analysis application 115 can create a smart radar chart (e.g., Fig. 8A850 shown in ), which includes a graphical user interface (GUI) to facilitate near real-time, interactive visualization of multidimensional data. In the smart radar chart GUI, multiple dimensional data are shown radially from a center point. For example, when there are multiple evaluation items for a certain measurement target, a radar chart is used. The circle (or other shape) is divided into parts with equal space according to the number of each evaluation item, and the space to be measured is concentrically divided at equal intervals starting from the center of the circle, and points are marked at corresponding positions according to the quantitative scores of each evaluation item, and these points are connected between the evaluation items to generate lines to represent the balance between the evaluation items. The advantage of the radar chart is that since multiple measurement targets are superimposed on each other, the trend of each item can be easily noticed. For example, as shown in FIG8 , a radar chart 850 shows the superposition of the self-assessment of the assessee with the average of the numerical ratings of one or more peer assessments and the average of the numerical ratings of one or more coach assessments in the form of pentagons 857, 858, and 859 for five assessment criteria (i.e., future outlook 851, measuring progress 852, discipline in hard work 853, speed / vigor 854, and authenticity 855). A radar chart can be created using methods known now or later. For example, a circle around a center point identifies the average of the numerical ratings corresponding to each assessment criterion, and uses color, shading, and / or other appropriate visual indications to indicate whether a particular value is greater than or less than the average of that dimension, as well as to distinguish between self-assessment, peer assessment, and coach assessment. Visualization enables a user (e.g., assessee or coach) to perceive anomalies in the data very quickly and easily, even if there are a large number of visualization dimensions and / or the display area available for visualization is small. Data points are plotted / displayed along their corresponding data dimensions. The plotted data is normalized to a 50% circle so that data points with normal values ​​will be plotted on a normal circle. The normal value can be, for example, the mean, expected value, or expected value of the data. Data with values ​​greater than the normal value (positive anomalies) will be plotted on one side of the normal circle, and data with values ​​less than the normal value (negative anomalies) will be plotted on the other side of the normal circle.

[0144] Next, a report is generated by identifying characteristics and features or behavioral capabilities identified from the radar chart and / or interpretation of the assessment (925). Figure 8B A specific example of a report (801) for making a decision on an evaluated person based on a radar chart 850 is shown in FIG. Figure 8BAs shown, section 861 includes the generated (interactive) radar chart, and section 862 includes the identified classifications and characteristics (e.g., including relationship gaps in awareness of peer and coach relationships, imbalances, and overall coaching scores), as well as explanations for each identified characteristic. The user can see the radar chart and the explanations / classifications, for example, that the assessee has extremely low self-awareness because he has a large relationship gap with his peers / coaches; is a micro-tactician and scores high in recklessness (imbalance); and has foundation, meaning, and action scores that exceed expectations. These results are not subject to subjective analysis and can be used by the assessee for self-development (e.g., by selecting appropriate training modules).

[0145] The system is configured to operate in real time. When the assessee selects an assessor and solicits an assessment, a solicitation invitation with the assessee identifier is sent to a server implementing the assessment analysis software application, and the assessment analysis software application processes the received information to solicit an assessment. Similarly, when the assessor selects a send command from an electronic device to send an assessment message and a digital assessment rating, the assessment message, the digital assessment rating, and the identifier are sent to a server implementing the assessment analysis software application, and the assessment analysis software application processes the received information (e.g., the assessment message, the digital assessment rating, and the identifier) ​​and provides it to the assessee. After the assessee solicits the assessment and / or the assessor clicks the send button, each user (assessed and / or assessor) immediately, for example, within 2, 3, 5, or 10 seconds or less (including milliseconds), sees the solicitation and / or assessment message and the average assessment rating. The process performed by the assessment analysis software application refers to one or more of the above-mentioned storage steps (relative to the first database 145), the copying step, the deletion step, the storage step (relative to the data cache and retrieval system 150), and the updating step. They can also include the steps of copying and storing the assessor identifier in the second database 155. The system may perform all of these steps in real time in response to the assessment giver selecting to send a command. This paragraph also applies to other commands and feeds selected by the user.

[0146] In some embodiments, an interactive training link (not shown here) may be displayed on the Fig. 8A and 8B The user interface is used to navigate to training, development tools (or skill development suggestions) and corresponding scores for improving various gap areas. The software application can identify and / or develop such training or development tools based on the identified behavioral patterns, classifications, or reporting information.

[0147] In some other embodiments, only the person being evaluated and / or people invited by the person being evaluated (e.g., a coach) are allowed to access the person being evaluated's personal space or access the person being evaluated's personal assessment information (data in their private space), such as viewing it in the coach's own interface. In some such embodiments, other personnel may be allowed to view aggregated and / or anonymous assessment data associated with at least a threshold number of persons being evaluated (e.g., at least three or more) in a manner such that the viewing personnel cannot associate the aggregated data with a single person being evaluated. For example, a person may be allowed to view the overall (or average) self-assessment and / or peer / coach assessment scores associated with attributes for a group of at least a threshold number of persons being evaluated in the form of a radar chart. One method of anonymization is to aggregate the data by averaging the attributes of three or more persons and removing personal identifiers such as names.

[0148] Real-time means that the speed at which an electronic device, server, or other computer system performs an operation appears to be instantaneous or nearly instantaneous (from a human sense of time) relative to the device receiving input for the operation (e.g., a composed evaluation message, a selected numeric evaluation rating, etc.). The device, server, or computer system operates in such a way that when the device receives input or generates data, or is selected to send received input or generated data, the user of the device, server, or computer system (e.g., the author or recipient of the evaluation message) perceives the output (e.g., the evaluation message and average numeric evaluation rating posted and displayed) as being generated instantaneously (e.g., the user does not perceive a noticeable delay). This also applies to sending a request from an electronic device, server, or other computer system to receiving a result in response to the request in the electronic device, server, or other computer system. When the user sends a request from the device, server, or computer system, the user of the device, server, or computer system will immediately perceive the result generated.

[0149] The assessment analysis software application and its server are configured as a service within an enterprise's internal data network or domain (e.g., the server is a company's enterprise server). The assessment software application is configured to be installed and run on a mobile application, for example, as an application installed using a mobile phone provider's application store. In some embodiments, the company can have employees download the application, and the application is supported by a vendor, such as using a cloud service, which stores the submitted assessments and provides the functionality as a service to the company (e.g., rather than installing software on the company's enterprise server).

[0150] The assessment analysis software application is configured as an arrangement in which the assessment software application is primarily configured as an interface for viewing and interacting with the assessment analysis software application implemented on an enterprise server. Preferably, the processing or analysis functionality is primarily or substantially only configured on the server implementing the assessment analysis software application, and the assessment software application operates as an interactive viewer and data entry software client (allowing interaction with the server and underlying data volume).

[0151] The schema is configured with relationally linked data elements that the evaluation analysis software application can use to quickly assemble different messages, ratings, or responses based on specific circumstances. For example, a received request can be converted into a specific query to the service application to obtain the evaluations received by a single employee, and the data can be retrieved from the retrieval system and a second database and converted into one (or more) messages that are transmitted to the requesting evaluation analysis software application.

[0152] The evaluation and analysis software application and gateway can be implemented using a cloud application service provider. For example, a cloud provider such as Amazon can be used, and relevant applications, databases, and systems can be implemented on Amazon's cloud (for example, simply put, a data center where a cloud provider hosts a server that runs an application for a cloud provider's customers, for example, a company wants to run its company's evaluation system in the cloud and provide the installation and operation of the software as a service to these customers). Cloud-based software applications, servers, or other computer systems allow electronic devices to communicate with applications, servers, or systems without relying on an enterprise network or an intranet. Users of electronic devices can write evaluation messages and select evaluation ratings, and send both to applications, servers, or systems from locations different from or far away from the buildings and / or locations where the activities are performed by individuals implementing the enterprise network or the intranet. Users can use the evaluation software application to communicate with the evaluation and analysis software application and other applications using a local network and / or a telecommunications network (for example, GSM, CDMA, 4G, etc.). Optionally, a virtual container system can be provided for some enterprises to provide bundled software, libraries, and configuration files to perform embodiments of the system and method of the present invention in a manner isolated from other virtual machine instances / applications / data / containers to protect the security and integrity of the information contained therein. For example, refer to Figure 1, the application environment can be configured as an operating service on a cloud service provider and supporting infrastructure (such as Amazon's AWS), and in some cases, as an additional security measure, separate application environments (sometimes called containers (docker) or virtual machines) are implemented for the corresponding clients of the service (the evaluation service is provided and managed by multiple clients / companies). Otherwise, the application environment is configured to serve multiple corporate / enterprise customers. In the case of an enterprise-specific instance, the application and data are separated by a cloud infrastructure that runs and supports only that company. This instance does not support other clients. The service provider of the evaluation application will configure the system so that the algorithm and corresponding information are updated for the customer through the cloud when new patterns or classifications are developed.

[0153] The system is configured to work on an individual's smartphone and allows them to log into an assessment software application from their smartphone based on the system verifying and authenticating that they are an employee of the enterprise. This will then provide a security token authorizing the user to use the assessment software application on their smartphone. Communications for login and subsequent application use are configured to use existing smartphones and available network capabilities, such as communicating over a public network (such as the Internet) (for example, rather than limiting communications to the enterprise's private network). The ability to create a trusted environment for a user is one of the features provided by embodiments of the present invention. Through this feature, the user knows that his communications are secure and that the individuals on the system or who have access to the system are not random people from the public. Examples of authorization processes and systems for establishing a trusted environment are exemplarily described in the attached application.

[0154] Assessment software applications can also be coaching software applications. Coaching software applications provide a platform for employees to engage in collaborative training and skill development with a selected coach. Coaching software applications allow the user to share his assessment, goals, and skill development strategies with someone he trusts, such as a coach. By sharing, it allows the coach to understand the current assessment of the individual and provide the right suggestions and advice. Coaching software applications provide a safe and trusted environment.

[0155] The electronic device of the assessment recipient may notify the recipient when the recipient receives the assessment, such as through a push notification in the electronic device status bar, email, text message, or other form of notification.

[0156] Anonymous means that the identity of the evaluator is kept secret from the evaluator recipient. The evaluator recipient cannot identify the evaluator provider from the evaluator software application or the data provided to the evaluator software application by the evaluator processing software application. The evaluator recipient also cannot trace the evaluator delivery process to identify the evaluator provider. The data provided to the evaluator software application by the evaluator processing software application does not contain a sender identifier or the sender identifier is encrypted.

[0157] The evaluator identifier may also include any other information that identifies the user or sender other than the identifier, number or code itself.

[0158] Unless otherwise indicated, the term "system" refers to the overall system for soliciting, collecting, and analyzing individual evaluations, and not to the systems within that system (eg, the evaluation processing system).

[0159] It should be understood that in the current field, there is a distinction between feedback and evaluation. Feedback solutions involve providing feedback on a specific behavior or work product of an individual, while evaluation refers to an overall assessment of attributes rather than specifically targeting a specific behavior or work product of that individual.

[0160] The illustrative systems and methods described herein include embodiments that provide a trusted anonymity system. Achieving this is important because it provides a secure way to allow users to "enter" the assessment environment of a particular company, organization, or group while remaining anonymous within the system. For example, this combination can provide anonymity while also maintaining a trusted environment. This gives users peace of mind that the other users are their colleagues, not the general public who can view assessments or comment on (or tease) system participants. This may involve checking the current employee directory before providing access to the assessment software application or other applications described in this disclosure.

[0161] The electronic device may be a desktop computer, a laptop computer, a tablet computer, a cellular device, a mobile device, a smartphone, a personal digital assistant (PDA), or other similar computer system having a microprocessor and memory.

[0162] The microprocessor may include an application specific integrated circuit (ASIC), a programmable logic array (PLA), a digital signal processor (DSP), a field programmable gate array (FPGA), or any other integrated circuit. The microprocessor may also include one or more other suitable processors, such as a system-on-chip that combines one or more CPUs, application processors, or reduced instruction set computing (RISC) processors.

[0163] The memory may include volatile memory, nonvolatile (non-transient) memory, or both. Volatile memory may include cache memory, semi-permanent memory (e.g., RAM), and / or one or more types of memory for temporarily storing computer data and instructions. Non-volatile memory may include read-only memory (ROM) or other static storage devices for storing static information and instructions of the microprocessor. The software applications (e.g., assessment software applications, assessment processing software, etc.) described in this application are implemented as computer instructions that can be stored in memory and can be executed by a microprocessor or a microprocessor can be configured to perform the functions or steps described herein.

[0164] The electronic device also includes a storage device. The storage device may include a hard disk drive and / or a removable storage drive, representing a floppy disk drive, a tape drive, an optical disk drive, etc.

[0165] The network can be a communication network using any suitable communication protocol, such as Wi-Fi, 802.11, Bluetooth, radio frequency systems (e.g., 900MHz, 1.4GHz, and 5.6GHz communication systems), infrared, GSM, GSM plus EDGE, CDMA, quad-band and other cellular protocols, VOIP, or any other suitable protocol. Cables such as optical fiber or Ethernet cables can also be used to establish the network. The network connection interface can be a hardware device configured to support the above communication protocols, such as an integrated services digital network (ISDN) card, a local area network (LAN) card, an Ethernet card, a cable modem, a satellite modem, or a modem for providing a data communication connection to a corresponding type of telephone line.

[0166] A server refers to a computer system or communication-oriented computer that includes the above computer components and typically includes faster processors, larger memory, larger storage capacity, and the general ability to maintain concurrent data communications with multiple end users, client devices, or electronic devices.

[0167] A computer system may refer to an electronic device, a server, or other computer including a microprocessor and a memory in this application.

[0168] Although some of the disclosures relate solely to software applications, it should be understood that they also apply to the underlying computer systems that implement the software applications.

[0169] Corresponding method and computer readable medium embodiments may be understood from the foregoing and overall disclosure.In addition, wider, narrower or different combinations of the features described may be contemplated, such that, for example, features may be removed or added in an expanded or narrowed manner.

[0170] It can be understood from the above description that the functions and features of the system, device or method of the embodiments of the present invention include generating and sending signals to complete actions.

[0171] It should be understood that variations, clarifications or modifications may be considered. It is also possible to consider applying this technology to other fields.

[0172] For illustrative purposes, exemplary systems, devices and methods are described. In addition, since those of ordinary skill in the art will readily appreciate many modifications and variations, it is not desirable to limit the present invention to the exact structures shown in this disclosure. Therefore, all suitable modifications and equivalents may be adopted to fall within the scope of the present invention.

[0173] Thus, for example, any order and / or chronological order of the steps of the various processes or methods (or the order in which devices are connected or operated) described herein are illustrative and should not be construed as limiting. Therefore, it should be understood that although the steps of the various processes or methods or the order of connection or operation can be shown and described as being performed in sequence or chronological order, they are not necessarily limited to being performed in any particular order or sequence. For example, the steps in these processes or methods can generally be performed in a variety of different orders and sequences while still falling within the scope of the present invention. In addition, in some discussions, it is apparent to one of ordinary skill in the art that a subsequent action, process, or feature is a response to a previous action, process, or feature.

[0174] It is also implicitly and understood that the applications or systems illustratively described herein provide computer-implemented functionality that automatically performs a process or process steps unless the specification explicitly describes user intervention or manual operation.

[0175] While this specification primarily discusses systems or devices, corresponding methods and non-transitory computer-readable medium embodiments may be understood from the foregoing and the overall disclosure. The computer-readable medium may be a permanent or semi-permanent memory, such as a hard drive, a floppy disk drive, an optical disk, a flash memory, a ROM, an EPROM, an EEPROM, etc., as known to those of ordinary skill in the art. The computer-readable medium stores computer instructions that are executable by a microprocessor, and execution of the instructions causes the microprocessor to perform the steps or functions described in the present disclosure. In addition, wider, narrower, or different combinations of the features described are also contemplated, such that, for example, features may be removed or added in a wider or narrower manner.

[0176] It should be understood that embodiments of the present invention also contemplate claims with fewer restrictions, broader claims, such as claims that do not require specific features or process steps in the appended claims or the description, clarifications of claim elements, different combinations, and alternative implementations or different uses based on the description.

[0177] It should be understood that combinations of features or steps are contemplated even if they are not directly described together or in the same context.

[0178] The terms or words used herein are intended for persons of ordinary skill in the art, and the meaning of these terms or words will be understood from the terms used in the art, or can be reasonably interpreted based on the plain English meaning of the words combined with the knowledge of the art. This includes the understanding of implicit features, for example, these features may involve multiple possibilities, but for persons of ordinary skill in the art, reasonable or basic understanding or meaning can be understood.

[0179] The software may be implemented as distinct modules or software applications, or may be integrated together into an overall application, such as an application that includes a user interface and handles other features to provide functionality to a user.

[0180] It is intended that the specification and examples be considered exemplary only, with a true scope being indicated by the following claims and their equivalents.

Claims

1. A computer-implemented method for providing a guided interactive self-assessment service, The following steps are involved: implementing an application on a server, wherein the application is configured to provide the service to employees of the company; implementing the application to provide an interactive user interface to the employee, wherein the interactive user interface is adapted to provide an automated self-assessment process to an individual user; implementing the application to establish a private space that the individual user can configure to limit access to the user's private space by other employees, wherein the application is configured to provide the individual user with access to the private space via a browser and is configured to invite one or more other users to access the individual user's private space; allowing the individual user to use the application to perform an automated self-assessment including a numerical rating of five attributes and a free-style text narrative; allowing said individual user to use said application to have other employees of his or her own choice conduct a peer assessment of said individual user on said service, said peer assessment comprising a numerical rating of said five attributes and one or more additional free-style text narratives; receiving and storing, using the server, the numerical ratings of the five attributes and the free-style textual narrative; configuring the application to store a library of algorithms, each of the library of algorithms being configured to detect classifications by detecting patterns in the numerical ratings that satisfy one of the algorithms; detecting one or more classifications of the individual user using the numerical ratings of the five attributes received from the individual user's self-assessment and the individual user's plurality of peer assessments; providing, using a graphical user interface, an individual user with the ability to view a structured report in a private space of the individual user, the structured report being based on the numerical ratings from the self-assessment and the peer-assessment, and the structured report including the detected classification of the individual user, and in conjunction with providing the structured report, displaying an interactive radar chart, the radar chart displaying a combination of the numerical ratings of the self-assessment and the other assessments of the individual user each as a connected polygonal shape; storing the structured report including the detected classifications of the individual users; and The application is configured to allow the user to return to perform the self-assessment and peer assessment again at a later time using the application, and to allow the user to view historical data from previous reports in the private space.

2. The method according to claim 1, in, The method includes anonymizing the evaluation so that the evaluation is not associated with an identification of one or more peers.

3. The method according to claim 2, in, The anonymization includes removing identifying information from the received assessments as part of storing the assessments.

4. The method according to claim 1, in, The method includes implementing the application on a company's enterprise network.

5. The method according to claim 1, in, The method includes providing a list of employees of a company from which a user may select to request a peer evaluation.

6. The method according to claim 1, in, The method includes updating the algorithm at a later date.

7. A non-transitory computer-readable medium storing one or more software applications that cause a computer system to execute a method for implementing a guided interactive self-assessment service, the method include: implementing an application on a server, wherein the application is configured to provide the service to employees of the company; implementing the application to provide an interactive user interface to the employee, wherein the interactive user interface is adapted to provide an automated self-assessment process to an individual user; implementing the application to establish a private space that the individual user can configure to limit access to the user's private space by other employees, wherein the application is configured to provide the individual user with access to the private space via a browser and is configured to invite one or more other users to access the individual user's private space; allowing the individual user to use the application to perform an automated self-assessment including a numerical rating of five attributes and a free-style text narrative; allowing said individual user to use said application to have other employees of his or her own choice conduct a peer assessment of said individual user on said service, said peer assessment comprising a numerical rating of said five attributes and one or more additional free-style text narratives; receiving and storing, using the server, the numerical ratings of the five attributes and the free-style textual narrative; configuring the application to store a library of algorithms, each of the library of algorithms being configured to detect classifications by detecting patterns in the numerical ratings that satisfy one of the algorithms; detecting one or more classifications of the individual user using the numerical ratings of the five attributes received from the individual user's self-assessment and the individual user's plurality of peer assessments; providing, using a graphical user interface, an individual user with the ability to view a structured report in a private space of the individual user, the structured report being based on the numerical ratings from the self-assessment and the peer-assessment, and the structured report including the detected classification of the individual user, and in conjunction with providing the structured report, displaying an interactive radar chart, the radar chart displaying a combination of the numerical ratings of the self-assessment and the other assessments of the individual user each as a connected polygonal shape; storing the structured report including the detected classifications of the individual users; and The application is configured to allow the user to return to perform the self-assessment and peer assessment again at a later time using the application, and to allow the user to view historical data from previous reports in the private space.

8. The non-transitory computer readable medium of claim 7, in, The method includes anonymizing the evaluation so that the evaluation is not associated with an identification of one or more peers.

9. The non-transitory computer readable medium of claim 8, in, The anonymization includes removing identifying information from the received assessments as part of storing the assessments.

10. The non-transitory computer readable medium of claim 7, in, The method includes implementing the application on a company's enterprise network.

11. The non-transitory computer readable medium of claim 7, in, The method includes providing a list of employees of a company from which a user may select to request a peer evaluation.

12. The non-transitory computer readable medium of claim 7, in, The method includes updating the algorithm at a later date.

13. A computer-implemented system for providing a guided interactive self-assessment service, include: one or more computers configured using computer-readable instructions stored in a non-transitory computer memory to provide said service using an application, wherein said application is configured on a server and provides said service to employees of the company; The application is configured to provide an interactive user interface to the employee, wherein the interactive user interface is adapted to provide an automated self-assessment process to an individual user; The application is configured to establish a private space, and the individual user can configure the private space to limit access to the user's private space by other employees, wherein the application is configured to provide the individual user with access to the private space through a browser and is configured to invite one or more other users to access the individual user's private space; The application is configured to allow the human user to use the application to perform an automated self-assessment including a numerical rating of five attributes and a free-style text narrative; The application is configured to allow the individual user to use the application to have other employees of their choice conduct a peer assessment of the individual user on the service, the peer assessment comprising a numerical rating of the five attributes and one or more additional free-style text narratives; The application is configured to, using the server, receive and store the numerical ratings of the five attributes and the free-style textual narrative; The application is configured to store a library of algorithms, each of the library of algorithms being configured to detect classifications by detecting patterns in the numerical ratings that satisfy one of the algorithms; The application is configured to detect one or more classifications of the individual user using the numerical ratings of the five attributes received from the individual user's self-assessment and the individual user's plurality of peer assessments; The application is configured to, using a graphical user interface, provide an individual user with the ability to view a structured report in a private space of the individual user, the structured report being based on the numerical ratings from the self-assessment and the peer-assessment, and the structured report including the detected classification of the individual user, and in conjunction with providing the structured report, display an interactive radar chart, the radar chart displaying a combination of the numerical ratings of the self-assessment and the other assessments of the individual user each as a connected polygonal shape; The application is configured to store the structured report including the detected classification of the individual user; and The application is configured to allow the user to return to perform the self-assessment and peer assessment again at a later time using the application, and to allow the user to view historical data from previous reports in the private space.

14. The computer-implemented system of claim 13, in, The application is configured to anonymize the evaluation so that the evaluation is not associated with an identity of one or more peers.

15. The computer-implemented system of claim 14, in, The application is configured to, as part of storing the assessments, anonymize the received assessments by removing identifying information from the assessments.

16. The computer implemented system of claim 13, in, The application is implemented on the company's enterprise network.

17. The computer implemented system of claim 13, in, The application is configured to provide a list of employees of a company from which a user may select to request a peer evaluation.

18. The computer implemented system of claim 13, in, The application is configured to update the algorithm and apply it at a later date.