System, method, and program for evaluating company
The AI Index system evaluates employee and AI agent capabilities and compatibility to predict stock price trends, addressing the lack of comprehensive indicators in existing methods, enhancing investment decisions and promoting sustainable growth.
Patent Information
- Application Number
- PCT/JP2026/018154
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-05-14
- Filing Date
- 2026-05-13
- Publication Date
- 2026-11-19
AI Technical Summary
Existing methods for evaluating enterprises for investment purposes lack a comprehensive indicator that considers the capabilities of both human employees and AI agents within a company, as well as their compatibility, which is crucial for predicting stock price trends and overall company performance.
A system and method for evaluating companies using an AI Index that combines evaluations of employee capabilities, AI agent capabilities, and their compatibility, incorporating physical and mental characteristics, technical and ethical indicators, and monitoring AI outputs to derive a comprehensive score for predicting stock price trends.
The AI Index provides an objective evaluation of a company's intellectual capital, enabling better investment decisions and promoting sustainable growth by enhancing AI strategies and employee health, leading to improved productivity and stock performance.
Smart Images

Figure JP2026018154_19112026_PF_FP_ABST
Abstract
Description
System, method, and program for evaluating enterprises
[0001] The present invention relates to a system, method, and program for evaluating enterprises.
[0002] Efforts have been made to evaluate enterprises for investment by investors (for example, Patent Document 1).
[0003] Japanese Unexamined Patent Application Publication No. 2024-32071
[0004] The present invention aims to evaluate enterprises using a new indicator. The present invention also aims to provide a system and the like that make it possible to predict the trend of an enterprise's stock price based on the new indicator.
[0005] The present invention evaluates the capabilities of a company's employees, the capabilities of AI agents within the company, the compatibility between employees and AI agents, and derives a new index for evaluating a company, the AI Index, based on these evaluations. The present invention provides, for example, the following items: (Item 1) A system for evaluating a company, comprising: a first evaluation means for evaluating the capabilities of at least one employee of the company; a second evaluation means for evaluating the capabilities of a plurality of AI agents used by the company; a third evaluation means for evaluating the compatibility between the at least one employee and the plurality of AI agents; and a derivation means for deriving an AI Index based on the capabilities of the at least one employee, the capabilities of the plurality of AI agents, and the compatibility. (Item 2) The system according to item 1, wherein the first evaluation means is configured to acquire data relating to the physical characteristics of the at least one employee and to estimate the intellectual productivity of the at least one employee based on the data relating to the physical characteristics. (Item 3) The system according to any one of the above items, wherein the first evaluation means is further configured to acquire data relating to the mental characteristics of the at least one employee, and the first evaluation means estimates the intellectual productivity based on the data relating to the physical characteristics and the data relating to the mental characteristics. (Item 4) The system according to any one of the above items, wherein the second evaluation means is configured to assign a score to each of the plurality of AI agents and to derive an overall score from the scores of each of the plurality of AI agents. (Item 5) The system according to any one of the above items, wherein the second evaluation means is configured to monitor the output from the plurality of AI agents, evaluate the monitored output with respect to at least one indicator, and assign a score based on the result of the evaluation. (Item 6) The system according to any one of the above items, wherein the at least one indicator includes at least one of an ethical indicator, a technical competence indicator, and a performance indicator.(Item 7) The system according to any one of the above items, wherein the third evaluation means is configured to acquire the frequency of use of the plurality of AI agents by the at least one employee and the degree of contribution by the plurality of AI agents, and to evaluate the degree of contribution to the frequency of use. (Item 8) The system according to any one of the above items, wherein the degree of contribution is determined based on the degree of efficiency improvement of the work by the plurality of AI agents, the amount of ideas generated by the plurality of AI agents, and the degree to which the at least one employee has grown through interaction with the plurality of AI agents. (Item 9) The system according to any one of the above items, further comprising a prediction means for predicting the trend of the company's stock price or performance based on the AI index. (Item 10) A method for evaluating a company, comprising: evaluating the competence of at least one employee of the company; evaluating the competence of a plurality of AI agents used by the company; evaluating the compatibility between the at least one employee and the plurality of AI agents; and deriving an AI index based on the competence of the at least one employee, the competence of the plurality of AI agents and the compatibility. (Item 10A) The method of Item 10, comprising the features described in any one of the above items. (Item 11) A program for evaluating a company, the program being executed on a computer having a processor, the program causing the processor to perform a process that includes: evaluating the competence of at least one employee of the company; evaluating the competence of a plurality of AI agents used by the company; evaluating the compatibility between the at least one employee and the plurality of AI agents; and deriving an AI index based on the competence of the at least one employee, the competence of the plurality of AI agents and the compatibility. (Item 11A) A program as described in Item 11, which includes the characteristics described in any one of the above items. (Item 11B) A computer-readable storage medium for storing the program as described in Item 11 or Item 11A.
[0006] The present invention provides a new indicator for evaluating companies. This indicator evaluates the potential capabilities of a company itself. This indicator may correlate with fluctuations in a company's stock price or performance and can be used for investment purposes. By clarifying the relationship between the capabilities of AI agents within a company and / or the compatibility between employees and AI agents and fluctuations in a company's stock price or performance, the present invention can encourage companies to introduce or improve the performance of AI agents, and ultimately lead to improvements in the field of AI agents.
[0007] Diagrams showing an example of the service flow for deriving a new indicator AI index Diagrams showing an example of the configuration of system 100 for evaluating companies Diagrams showing an example of the specific configuration of system 100 for evaluating companies Diagrams showing an example of the configuration of processor unit 120 Diagrams showing another example of the configuration of processor unit 120 Diagrams flowchart showing an example of processing (process 50) by system 100 for evaluating companies
[0008] (Definition) In this specification, "AI agent" means an autonomously operating artificial intelligence (AI). An AI agent is designed to act as a substitute for a human (i.e., an agent) and to satisfy requirements such as autonomy, cooperativeness, security, privacy, and / or accountability. In particular, the AI agent covered by the present invention is designed to satisfy the requirement of accountability, at least so that the AI agent can be evaluated from an ethical standpoint. For example, to satisfy the requirement of autonomy, it is necessary to have the ability to act autonomously, such as setting goals, planning, executing, recognizing situations, and learning and adapting. To satisfy the requirement of cooperativeness, it is necessary to have the ability to work cooperatively with other agents, such as communicating, coordinating, negotiating, and building trust. To satisfy the requirement of security, it is necessary to have advanced security measures such as authentication / authorization, confidentiality, integrity, and availability. To satisfy the requirement of privacy, it is necessary to have privacy protection measures such as protection of personal information, anonymity, and transparency. To satisfy the requirement of accountability, it is necessary to have the ability to be accountable, such as explaining decision-making, auditing actions, and pursuing responsibility. Other requirements that may be considered include energy efficiency, scalability, and reliability. The AI agent can autonomously and appropriately respond to tasks given by the user.
[0009] In this specification, "task" refers to an operation or job that an AI agent should perform. Tasks may be given in the form of a question, in which case the term "task" may be used synonymously with "query." The AI agent will output the result of performing the task.
[0010] In this specification, "employee" means a person engaged in business at a company, and includes not only those employed by the company, but also company officers and dispatched workers.
[0011] In this specification, "intellectual productivity" refers to human-specific abilities that are difficult to replace with machines or AI, and specifically, may be qualitative, creative, ethical, or social abilities, or the ability to wisely utilize AI. In contrast, AI specializes in quantitative and speedy abilities. Intellectual productivity can be subdivided into the following abilities, for example: (1) Ability to formulate questions and set goals: While AI is good at answering given questions, it is the role of humans to set the fundamental questions or goals, such as "what should be asked" and "what should be aimed for." The ability to discover truly valuable issues for society or individuals and to provide direction may be at the core of intellectual productivity. (2) Creativity and originality (the ability to create something from nothing): This is the ability to generate entirely new ideas, art, concepts, and visions that are not based on existing data or patterns. This is an area that involves intuition, sensibility, aesthetic sense, playfulness, etc. (3) Critical thinking and multifaceted perspective: The ability to not blindly accept information, to question assumptions, and to discern the essence of things, including the output of AI, to evaluate its validity, bias, and limitations, to view things from diverse perspectives, and to gain deeper insights. (4) Ability to understand complex contexts and utilize tacit knowledge: The ability to understand complex contexts such as nuances that have not been quantified or verbalized, the atmosphere of a situation, culture, and historical background, and to make judgments by integrating one's own experience or tacit knowledge (knowledge or intuition that is difficult to put into words). (5) Ethics and value judgments: The ability to make judgments and act based not only on efficiency or correctness, but also on values such as "good and evil," "beauty and ugliness," and "humanity." In particular, decision-making when faced with ethical dilemmas is something only humans can do. (6) Empathy and communication skills: The ability to understand and empathize with the feelings or intentions of others, to build trust, and to work together to move things forward. The ability to lead a team and bring together the wisdom of diverse people is a uniquely human ability. (7) Learning and adaptation through embodiment and the five senses: The ability to learn through physical experiences in the real world or through the five senses, to adapt flexibly to unexpected situations, and to respond on the fly. (8) Ability to collaborate and utilize AI: The ability to not only use AI as a tool, but also to understand its characteristics and limitations, collaborate in the most optimal way, and extend human capabilities.The skill of giving appropriate instructions to AI, interpreting and evaluating its output, and ultimately contributing to value creation. From the above, intellectual productivity can be said to be the ability to create and realize original, contextual, ethical, and human-centered value by utilizing cognitive abilities, sensibilities, ethics, and social skills, and effectively using AI.
[0012] (1. A New Indicator for Evaluating Companies: "AI Index") The inventors of this invention have developed a new indicator for evaluating companies. This indicator can visualize the "intelligence" that is a fusion of a company, its human resources, and AI, and the inventors of this invention call this indicator the "AI Index." The AI Index is an indicator that comprehensively evaluates the potential capabilities of a company, i.e., "intellectual capital," by combining the evaluation of human resources capabilities (human brain), AI capabilities (AI brain), and collaboration levels (synergy brain). In one example, the AI Index may be a stepped evaluation indicator, and in another example, it may be a continuous indicator. The AI Index may be a one-dimensional indicator or a multi-dimensional indicator. In a specific example, the AI Index may be a one-dimensional stepped indicator derived from the evaluation of human resources capabilities (human brain), AI capabilities (AI brain), and collaboration levels (synergy brain). In another specific example, the AI index could be a multidimensional indicator whose components include an evaluation of human capabilities (human brain), an evaluation of AI capabilities (AI brain), and an evaluation of collaboration level (synergy brain).
[0013] The inventors of this invention further considered that companies with higher AI indices have greater intellectual capital and are expected to grow in the future. Through diligent research, they conceived the idea that the AI index can correlate with a company's stock price or performance. In other words, the inventors of this invention found that the AI index can be used to predict trends in a company's stock price or performance.
[0014] Figure 1 shows an example of the service flow derived from the new AI index.
[0015] In this example, we will explain the situation using a company C that has multiple employees E, and where these employees E utilize multiple AI agents A to assist with their work. For example, the multiple employees E improve work efficiency by interacting with multiple AI agents A to extract information, generate ideas, and perform tasks. User U uses this service to find out the company's evaluation results.
[0016] In step S1, information for evaluating human capabilities (human brain) is provided to system 100.
[0017] The evaluation of human resource capabilities can be based, for example, on the intellectual productivity of a company's employees. Intellectual productivity, as mentioned above, is a uniquely human ability that is difficult to replace with machines or AI, and can also be expressed by the efficiency with which deliverables are produced through intellectual work. Intellectual productivity can be influenced by the employee's inherent abilities as well as their health status or health risks. High intellectual productivity may be associated with a high level of human resource capability, while low intellectual productivity may be associated with a low level of human resource capability.
[0018] Information used to evaluate employee capabilities may include, for example, data on employee E's physical characteristics. This data on physical characteristics may include, for example, health data, which could be, for example, health checkup results.
[0019] Information used to evaluate employee capabilities may include, for example, data on employee E's mental characteristics. Data on mental characteristics may include, for example, at least one of the following: data on emotions, data on values or ethics, or data on knowledge or experience. Data on knowledge or experience may include data indicating employee E's qualifications.
[0020] The information used to evaluate employee capabilities may be data acquired periodically and / or automatically within the company, or it may be data measured by the employee's device (for example, a device worn by employee E or IoT devices around employee E).
[0021] In step S2, information for evaluating the AI capabilities (AI brain) is provided to the system 100.
[0022] The evaluation of AI capabilities can be based, for example, on a score assigned to an AI agent. The score assigned to an AI agent represents the characteristics of the AI agent, and will represent the characteristics of the AI agent using at least one indicator. The at least one indicator will include at least one of the following: a technical capability indicator, a performance indicator, or an ethical indicator.
[0023] Information for evaluating AI capabilities may include, for example, data for assigning a score to each of several AI agents. This data for assigning a score to each of several AI agents may be, for example, data obtained by monitoring the output from several AI agents, that is, it may be all or part of the output from several AI agents.
[0024] In step S3, information for evaluating the collaboration level (synergy brain) is provided to system 100. The collaboration level may be an indicator of the compatibility between multiple employees E and multiple AI agents A.
[0025] The level of collaboration can be determined, for example, based on the frequency of use of AI agent A by employee E and the level of contribution made by AI agent A. In other words, the level of collaboration can be determined based on the level of contribution relative to the frequency of use.
[0026] Information for evaluating the level of collaboration may include, for example, data on the interaction between multiple employees E and multiple AI agents A. Interaction data may include, for example, at least one of the following: dialogue data between multiple employees E and multiple AI agents A, outcome data of multiple employees E, and outcome data of multiple AI agents A. Information for evaluating the level of collaboration may also include data on the emotions of the employees E.
[0027] Once this information is provided, system 100 performs an evaluation of human resource capabilities, AI capabilities, and collaboration levels.
[0028] System 100 estimates intellectual productivity in order to evaluate human resource capabilities.
[0029] System 100 estimates intellectual productivity based, for example, on data regarding the physical characteristics of employee E. For example, it estimates intellectual productivity from the risk of disease, typically the risk of cognitive impairment. For example, employee E, who has a risk of cognitive impairment, is estimated to have low intellectual productivity.
[0030] System 100 estimates intellectual productivity based, for example, on data relating to the mental characteristics of employee E. For example, it estimates intellectual productivity from data relating to emotions. For example, employee E with a calm mental state is estimated to have higher intellectual productivity than employee E who is restless. For example, employee E experiencing joy or happiness is estimated to have higher intellectual productivity than employee E experiencing anger or sadness.
[0031] System 100 assigns scores to AI agents in order to evaluate their AI capabilities. The score assigned to each of the multiple AI agents is a score that represents the characteristics of the AI agent using at least one indicator. The at least one indicator includes at least one of the following: a technical capability indicator, a performance indicator, or an ethical indicator.
[0032] Technical capability metrics are indicators that evaluate the technical capabilities of an AI agent. Technical capability metrics may be evaluated from the perspective of at least one of the following: processing power, learning ability, emotional handling ability, and algorithmic complexity. Performance metrics are indicators that evaluate the past performance of an AI agent. Performance metrics may be evaluated from the perspective of at least one of the following: past transaction history, success rate, and customer satisfaction. Performance metrics may also be past performance with customers who have specific emotions. Ethical metrics are indicators that evaluate the ethical correctness of an AI agent. Ethical metrics may be evaluated from the perspective of at least one of the following: transparency, fairness, safety, and accountability.
[0033] The score representing the characteristics of the AI agent preferably represents the characteristics of the AI agent from the standpoint of ethical indicators. The inventors of the present invention believe that even if an AI agent has high capabilities or a proven track record, the output from an AI agent with ethical problems may cause harm to third parties and / or may be inappropriate output based on an illegal source, and therefore believe that ethical indicators are particularly important for an AI agent to be appropriate for use by a company. Based on this idea, system 100 evaluates the capabilities of the AI by assigning a score that represents the characteristics of the AI agent, at least from the standpoint of ethical indicators.
[0034] System 100 evaluates the contribution of AI agent A to the frequency of use by employee E in order to assess the level of collaboration. For example, if employee E uses AI agent A frequently and also makes a high contribution, the level of collaboration can be evaluated as high. For example, if employee E uses AI agent A frequently but makes a low contribution, the level of collaboration can be evaluated as low. For example, if employee E uses AI agent A infrequently, the level of collaboration can also be evaluated as low.
[0035] The degree of contribution can be determined based on at least one of the following: the degree to which the work is made more efficient by multiple AI agents A; the amount of ideas generated by multiple AI agents A; and the degree to which employee E has grown through interaction with multiple AI agents. For example, if employee E's work becomes more efficient by using AI agents A, the degree of contribution will be evaluated higher in proportion to the degree of efficiency improvement compared to when employee E did not use them. For example, if employee E's use of AI agents A generates many ideas from the AI agents, the degree of contribution will be evaluated higher in proportion to the amount of ideas generated. For example, if employee E grows by using AI agents A, the degree of contribution will be evaluated higher in proportion to the degree of growth compared to when employee E did not use them.
[0036] The level of contribution may be adjusted, for example, by the emotions of employee E. For instance, an employee E with relaxed emotions is considered to have no resistance to using the AI agent, meaning they are considered to have good compatibility with the AI agent. In this case, a positive weight may be assigned to their level of contribution. Conversely, an employee E with dissatisfied emotions is considered to have resistance to using the AI agent, meaning they are considered to have poor compatibility with the AI agent. In this case, a negative weight may be assigned to their level of contribution. In this way, the level of contribution can be positively weighted or increased when employee E has positive emotions, and negatively weighted or decreased when employee E has negative emotions. This allows emotions to be reflected in the compatibility between employee E and the AI agent.
[0037] System 100 will derive an AI index based on the evaluation of human resource capabilities, AI capabilities, and collaboration levels. System 100 can, for example, use machine learning to derive the AI index.
[0038] For example, system 100 can derive an AI index as a multidimensional index having human resource capability evaluation, AI capability evaluation, and collaboration level evaluation as components. In this case, the AI index may be a three-dimensional index, or it may have additional components other than those mentioned above, for example, components derived from human resource capability evaluation, AI capability evaluation, and collaboration level evaluation. Each component may be a continuous value, a stepped value, or a level.
[0039] For example, system 100 can derive an AI index as a one-dimensional index having components derived from the evaluation of human resource capabilities, the evaluation of AI capabilities, and the evaluation of collaboration levels.
[0040] In step S4, the system 100 outputs the AI index or information based on the AI index to user U.
[0041] For example, by providing the AI index to the user U, the user U can know the objective evaluation of the company's "intellectual capital". The user U can use the AI indices of a plurality of companies for various purposes. For example, the user U may refer to the AI indices of a plurality of companies in investment activities, or may refer to the AI indices of a plurality of companies in job-hunting activities. The user U may be the manager of the company, and can objectively understand the intellectual capital of the company through the AI index of the company itself.
[0042] A company with a high AI index can be said to be a company where employees E actively use the AI agent A. This can imply that an improvement in the productivity of the company can be expected. In addition, a company with a high AI index can be said to have advanced or practical AI agents A used by employees E. This can imply that an improvement in the speed of new business or product development using the company's AI agents can be expected. Furthermore, a company with a high AI index can be said to be a company where employees E appropriately manage their health. This can imply high employee satisfaction.
[0043] Information based on the AI indices of a plurality of companies (for example, stock price trends predicted based on the AI indices) can also be used for various purposes. For example, the user U may refer to the information based on the AI indices of a plurality of companies in investment activities, or may refer to the information based on the AI indices of a plurality of companies in job-hunting activities.
[0044] As described above, the new indicator provided by the present invention enables objective evaluation of intellectual capital. The AI index can provide companies with objective guidelines for AI strategies, and provide investors with clear criteria for selecting attractive investment destinations. Furthermore, it can provide employees with motivation to improve their health while maximizing their own abilities. This creates a positive cycle of intellectual capital in which companies, AI agents, and employees mutually enhance each other, and can promote sustainable growth. The AI index is expected to contribute to the development of companies and society.
[0045] The above-described system 100 can be implemented by, for example, a system for evaluating a company which will be described later.
[0046] (2. Configuration of System for Evaluating Company) FIG. 2 shows an example of the configuration of the system 100 for evaluating a company.
[0047] The system 100 is connected to a database unit 200. The system 100 is also connected to at least one employee terminal device 300 via a network N. The system 100 is also connected to at least one server device 400 via the network N. The system 100 is further connected to at least one user terminal device 500 via the network N.
[0048] Here, the employee terminal device 300 is a terminal device used by an employee of the company. The employee uses the terminal device to perform duties in the company. Further, the employee uses the terminal device to access the server device 400 and utilize an AI agent.
[0049] The server device 400 can be a device capable of implementing an AI agent. The server device 400 has a respective database, holds respective knowledge or information, and / or holds a respective large language model (LLM). The server device 400 may be provided inside the company, or may be external to the company.
[0050] One example of system 100 may be a computer (e.g., a server) installed by a provider that provides an AI index provision service, and another example of system 100 may be a computer (e.g., a server) installed by a provider that provides a service that predicts the stock prices of companies. One example of user terminal device 500 is a computer (e.g., a terminal device) used by a user of the service, but is not limited to this. Here, the computer (server device or terminal device) can be any type of computer. For example, the terminal device can be any type of terminal device such as a smartphone, tablet, personal computer, smart glasses, or smartwatch.
[0051] Although Figure 2 shows two employee terminal devices 300, the number of employee terminal devices 300 is not limited to these. Any number of employee terminal devices 300 can be connected to the system 100 via the network N. Similarly, although Figure 2 shows two server devices 400, the number of server devices 400 is not limited to these. Any number of server devices 400 can be connected to the system 100 via the network N. Also, although Figure 2 shows two user terminal devices 500, the number of user terminal devices 500 is not limited to these. Any number of user terminal devices 500 can be connected to the system 100 via the network N.
[0052] The database unit 200 may store data on employees and data on AI agents for each of several companies. The database unit 200 may also store various information used to assign scores that represent the characteristics of the AI agents.
[0053] Figure 3 shows an example of a specific configuration of the system 100 for evaluating companies.
[0054] The system 100 comprises an interface unit 110, a processor unit 120, and a memory unit 130.
[0055] The interface unit 110 exchanges information with the outside of the system 100. The processor unit 120 of the system 100 can receive information from the outside of the system 100 via the interface unit 110 and can transmit information to the outside of the system 100. The interface unit 110 can exchange information in any format.
[0056] The interface unit 110 includes, for example, an input unit that enables information to be input to the system 100. The manner in which the input unit enables information to be input to the system 100 is not limited. For example, if the input unit is a receiver, the receiver may input information by receiving it from outside the system 100 via a network. Alternatively, if the input unit is a data reading device, it may input information by reading it from a storage medium connected to the system 100.
[0057] The interface unit 110 includes, for example, an output unit that enables information to be output from the system 100. The mode by which the output unit enables information to be output from the system 100 is not limited. For example, if the output unit is a transmitter, the information may be output by the transmitter transmitting information to the outside of the system 100 via a network. Alternatively, if the output unit is a data writing device, the information may be output by writing the information to a storage medium connected to the system 100.
[0058] System 100 can, for example, transmit information to and / or receive information from the database unit 200 via the interface unit 110. System 100 can, for example, transmit information to and / or receive information from the employee terminal device 300 via the interface unit 110. System 100 can, for example, transmit information to and / or receive information from the server device 400 via the interface unit 110. System 100 can, for example, transmit information to and / or receive information from the user terminal device 500 via the interface unit 110.
[0059] System 100 can receive, for example, information for deriving an AI index via the interface unit 110 (e.g., information about the company's employees, information about the company's AI agents, and information about the interaction between the company's employees and the AI agents).
[0060] System 100 can transmit information including the derived AI index via, for example, the interface unit 110. System 100 can transmit information including the predicted stock price via, for example, the interface unit 110.
[0061] The processor unit 120 executes the processing of the system 100 and controls the operation of the entire system 100. The processor unit 120 reads the program stored in the memory unit 130 and executes the program. This makes it possible to make the system 100 function as a system that executes desired steps. The processor unit 120 may be implemented by a single processor or by multiple processors.
[0062] The memory unit 130 stores programs necessary for executing the processes of the system 100, as well as data necessary for executing those programs. The memory unit 130 may also store programs (for example, programs that implement the processes shown in Figure 5, which will be described later) that cause the processor unit 120 to perform processes for evaluating companies (i.e., processes for deriving an AI index). Here, it is not specified how the programs are stored in the memory unit 130. For example, the programs may be pre-installed in the memory unit 130. Alternatively, the programs may be stored in a non-transient computer-readable storage medium and installed by reading the storage medium. Alternatively, the programs may be installed in the memory unit 130 by being downloaded via a network. In this case, the type of network is not specified. The memory unit 130 can be implemented using any storage means.
[0063] The database unit 200 stores various types of information used to assign scores that represent the characteristics of the AI agent.
[0064] Here, the score representing the characteristics of the AI agent is represented by at least one indicator. The at least one indicator includes at least one of the following: a technical competence indicator, a performance indicator, or an ethical indicator. The database unit 200 may store past outputs from the AI agent, associated with each of the technical competence indicators, performance indicators, or ethical indicators.
[0065] In the examples shown in Figures 2 and 3, the database unit 200 is located outside the system 100, but the present invention is not limited thereto. It is also possible to provide at least a portion of the database unit 200 inside the system 100. In this case, at least a portion of the database unit 200 may be implemented by the same storage means as the storage means implementing the memory unit 130, or by storage means different from the storage means implementing the memory unit 130. In any case, at least a portion of the database unit 200 is configured as a storage unit for the system 100. The configuration of the database unit 200 is not limited to a specific hardware configuration. For example, the database unit 200 may be composed of a single hardware component or multiple hardware components. For example, the database unit 200 may be configured as an external hard disk drive for the system 100, as cloud storage connected via a network, or as a distributed network utilizing blockchain technology or the like.
[0066] For example, information about the AI agent is stored in a database unit 200 configured as a decentralized network utilizing blockchain technology, and in this case, the information about the AI agent becomes virtually impossible to tamper with. This ensures the reliability of the information about the AI agent. Information about the agent can also be stored in a database unit 200 configured as a decentralized network utilizing blockchain technology.
[0067] Figure 4A shows an example of the configuration of the processor unit 120.
[0068] The processor unit 120 includes a first evaluation means 121, a second evaluation means 122, a third evaluation means 123, and a derivation means 124.
[0069] The first evaluation means 121 is configured to evaluate the abilities of at least one employee of a company. The first evaluation means 121 can evaluate the employee's abilities based on the employee's intellectual productivity. If the employee's intellectual productivity is high, the first evaluation means 121 can evaluate the employee's abilities as high, and if the employee's intellectual productivity is low, the employee's abilities can be evaluated as low.
[0070] To estimate the intellectual productivity of employees, the first evaluation means 121 acquires data on the employees' physical characteristics. The first evaluation means 121 can acquire data on the employees' physical characteristics via the interface unit 110, for example, from the database unit 200 or from the employee terminal device 300.
[0071] Data relating to physical characteristics may include, for example, health data, which may be, for example, health checkup results. Health checkup results may preferably include assessments of cognitive function risk. Data relating to physical characteristics may include, for example, physiological data. Physiological data may be, for example, data measured by a device that employee E can wear or IoT devices around employee E, and may typically be data such as body temperature, blood pressure, heart rate, sweating, and electroencephalogram. The first evaluation means 121 can automatically receive data relating to physical characteristics in response to the acquisition of such data.
[0072] The first evaluation means 121 can further acquire data relating to the mental characteristics of employee E. The first evaluation means 121 can acquire data relating to the mental characteristics of the employee via the interface unit 110, for example, from the database unit 200 or from the employee terminal device 300.
[0073] Data relating to mental characteristics includes, for example, data relating to emotions. Data relating to emotions can be any data that allows an employee's emotions to be read, and may include, for example, linguistic data (e.g., text data, voice data) or nonverbal data (e.g., image data representing facial expressions or gestures, physiological data such as heart rate or sweating). System 100 has prior knowledge for reading emotions, which may include, for example, cultural background data (e.g., differences in emotional expression in a particular culture, emotions that are considered taboo, etc.), research data (e.g., past counseling cases, psychological research cases, etc.), data recording the circumstances or causes that give rise to emotions (e.g., data showing what events or thoughts triggered emotions such as joy, sadness, anger, and fear), or data showing the relationship between emotions and behavior (e.g., data recording what behaviors are linked to specific emotions). Based on this prior knowledge, the first evaluation means 121 can read the employee's emotions from the linguistic or nonverbal data.
[0074] Data relating to mental characteristics may include, for example, data relating to values or ethics. Data relating to values or ethics may represent the values or ethics held by a specific employee E, or it may represent values or ethics commonly held by humanity. Data representing the values or ethics held by a specific employee may, for example, be data describing the employee's worldview, beliefs, goals, etc., or data analyzing the values behind the employee's actions or decision-making.
[0075] Data relating to mental characteristics may include, for example, data relating to knowledge or experience. This data may represent the knowledge or experience of a specific employee E, a person in a specific field of expertise, or a person from a specific cultural background. The knowledge or experience data may also include data indicating the employee's qualifications, AI tool utilization skills, and AI training completion status.
[0076] The first evaluation means 121 can estimate intellectual productivity based on data relating to the physical characteristics of employees. The first evaluation means 121 can estimate intellectual productivity, for example, using a pre-trained model. The pre-trained model is a model that has learned the relationship between data relating to the physical characteristics of multiple individuals and their intellectual productivity. When data relating to the physical characteristics of an employee is input to the pre-trained model, it can estimate and output the intellectual productivity of that employee. In particular, data relating to the physical characteristics of employees may be biometric data and may have complex components. Even biometric data with complex components can be used to estimate intellectual productivity by using a pre-trained model.
[0077] Alternatively, the first evaluation means 121 can estimate intellectual productivity based on data relating to the employee's physical characteristics and data relating to the employee's mental characteristics. The first evaluation means 121 can estimate intellectual productivity, for example, using a trained model. The trained model is a model that has learned the relationship between data relating to the physical characteristics and mental characteristics of multiple individuals and their intellectual productivity. When the trained model is input with data relating to the employee's physical characteristics and mental characteristics, it can estimate and output the intellectual productivity of that employee.
[0078] The evaluation of the employee's abilities by the first evaluation means 121 is passed to the derivation means 124.
[0079] The second evaluation means 122 is configured to evaluate the capabilities of multiple AI agents used by the company. The second evaluation means 122 can evaluate the capabilities of the AI agents based on the scores of the AI agents. If the score of the AI agent is high, the second evaluation means 122 can evaluate that the AI agent has high capabilities, and if the score of the AI agent is low, the second evaluation means 122 can evaluate that the AI agent has low capabilities.
[0080] To assign a score to an AI agent, the second evaluation means 122 monitors the output from multiple AI agents and obtains all or part of the output from each of the multiple AI agents. The second evaluation means 122 can, for example, continuously monitor the output from multiple AI agents. Alternatively, the second evaluation means 122 may, for example, automatically monitor the output from multiple AI agents as it is generated. For example, continuous or automatic monitoring of the output from multiple AI agents may be performed by a dedicated monitoring device, in which case the second evaluation means 122 can receive the output from the monitoring device. The second evaluation means 122 can automatically assign a score based on the results of the continuous monitoring by the monitoring device. The dedicated monitoring device may be located outside the system 100 or may be a component of the system 100.
[0081] The second evaluation means 122 can evaluate the output from each AI agent against at least one indicator and assign a score to each AI agent based on the evaluation results. The at least one indicator includes at least one of a technical capability indicator, a performance indicator, or an ethical indicator. Preferably, the at least one indicator includes an ethical indicator.
[0082] More preferably, at least one indicator includes a technical capability indicator or performance indicator and an ethical indicator. Even more preferably, at least one indicator includes a technical capability indicator, a performance indicator and an ethical indicator. By representing the characteristics of multiple AI agents with multiple indicators, the characteristics of each of the multiple AI agents can be represented more accurately.
[0083] Ethical indicators are metrics used to evaluate the ethical correctness of AI agents. These indicators may be evaluated from the perspective of at least one of the following: transparency, fairness, safety, and accountability.
[0084] Transparency indicates whether the rationale behind the judgment or decision-making process of an AI agent is clear. If the rationale can be clearly demonstrated when requested, transparency is high, and the ethical index score will be high. Even if the rationale cannot be clearly demonstrated, if the judgment process can be clearly shown, transparency can still be considered high.
[0085] Fairness indicates whether the output from the AI agent contains neither bias nor discrimination. If it contains neither bias nor discrimination, it can be said to be fair to all parties, and the ethical index score will be high.
[0086] Security indicates the level of cybersecurity provided by the AI agent. The higher the cybersecurity, the lower the risk of harm to trading partners or third parties, resulting in a higher ethical index score.
[0087] Accountability, also known as accountability, indicates whether it is possible to explain who is responsible for the output of an AI agent. If the responsibility can be clearly explained, the level of accountability is high, and the ethical index score will be high.
[0088] The second evaluation means 122 monitors the output from each of the multiple AI agents, detects words, phrases, sentences, etc. that may be related to at least one of transparency, fairness, safety, and accountability, and assigns a score from the perspective of ethical indicators based on the detection results. For example, if the second evaluation means 122 detects many phrases related to affirming transparency, it can assign a high score from the perspective of ethical indicators. For example, if it detects many phrases related to denying safety, it can assign a low score from the perspective of ethical indicators.
[0089] The second evaluation means 122 may assign scores based on rules or based on machine learning. When assigning scores based on machine learning, a trained model can be used that has learned the relationship between words, phrases, sentences, etc. that may be related to at least one of transparency, fairness, safety, and accountability, and scores from the perspective of ethical indicators. In particular, the output from each AI agent of multiple AI agents may be a huge amount of data. Even with a huge amount of data, it can be used to assign scores by using a trained model. The second evaluation means 122 can derive and assign scores as multidimensional vectors using, for example, embedding. For example, the second evaluation means 122 can calculate a score by summarizing the output from the AI agent from the perspective of ethical indicators and vectorizing the generated summary using embedding. The generation of the summary may be carried out using generative AI. The generated summary may be expressed in natural language. Representing the score as a multidimensional vector is preferable because it makes it easier to evaluate the similarity with the scores of other AI agents.
[0090] Technical competence metrics are indicators used to evaluate the technical capabilities of an AI agent. Technical competence metrics can be evaluated from the perspective of at least one of the following: processing power, learning ability, emotional handling ability, and algorithmic complexity.
[0091] Processing capability indicates the information processing speed or parallel computing capability of the system used to build the AI agent. The faster the information processing speed or the higher the parallel computing capability, the higher the value of the technical capability index.
[0092] Learning ability indicates the ability of a system that builds AI agents to acquire new knowledge or skills. The higher the learning ability, the more flexibly it can adapt to changes in the workforce, and therefore the higher the value of the technical competence index.
[0093] Emotional coping ability refers to the ability to respond effectively to individuals experiencing specific emotions. These specific emotions can be at least one of several, such as joy, anger, sadness, pleasure, love, or hate. For example, emotional coping ability could encompass abilities related to anger (i.e., the ability to respond effectively to individuals experiencing anger), sadness (i.e., the ability to respond effectively to individuals experiencing sadness), or excitement (i.e., the ability to respond effectively to individuals experiencing excitement). An AI agent with high emotional coping ability can generate outputs tailored to specific emotions. For example, an AI agent with high emotional coping ability for anger can generate outputs that include information or expressions to soothe anger. Similarly, an AI agent with high emotional coping ability for sadness can generate outputs that include information or expressions to comfort sadness. Similarly, an AI agent with high emotional coping ability for excitement can generate outputs that include information or expressions to calm or sustain excitement. For example, an AI agent with a high capacity for emotional processing regarding the emotion of joy can generate output that includes information or expressions that help sustain that joy.
[0094] Algorithmic complexity indicates the sophistication of the algorithms used by the system building the AI agent. The more complex the algorithm, the more sophisticated the decision-making it enables, and therefore the higher the score of the technical capability metric.
[0095] The second evaluation means 122 can assign scores from the perspective of technical capability indicators based on the performance or configuration of the system implementing each of the multiple AI agents.
[0096] The second evaluation means 122 may assign scores in a rule-based manner or in a machine learning-based manner. When assigning scores in a machine learning-based manner, a trained model can be used that has learned the relationship between the performance or configuration of the system implementing the AI agent and the score from the perspective of technical capability indicators. The second evaluation means 122 can, for example, derive and assign a score as a multidimensional vector using embedding. For example, the second evaluation means 122 can calculate a score by summarizing the output from the AI agent from the perspective of technical capability indicators and vectorizing the generated summary using embedding.
[0097] Performance metrics are indicators that evaluate the past performance of an AI agent. Performance metrics can be evaluated from, for example, at least one of the following perspectives: past transaction history, success rate, and customer satisfaction. Performance metrics may also represent past performance with customers who have specific emotional attachments.
[0098] Past transaction history shows the performance of the AI agent in past transactions. The more extensive the track record, the more reliable the AI agent is considered to be, and the higher the performance indicator value will be.
[0099] The success rate indicates the percentage of past trades in which the AI agent was successful. A higher success rate indicates a higher trading ability of the AI agent, resulting in a higher performance indicator value.
[0100] The "Party Satisfaction" metric indicates the satisfaction level of the trading partner with the AI agent. Higher satisfaction levels indicate a higher perceived trading capability of the AI agent, resulting in a higher performance metric value. For example, an AI agent with high satisfaction levels regardless of the trading partner's emotions may have a higher performance metric value than an AI agent that only receives high satisfaction from trading partners with specific emotions.
[0101] The second evaluation means 122 can assign a score to each of the multiple AI agents from the perspective of performance indicators, based on the past trading results of each AI agent.
[0102] The second evaluation means 122 may assign scores based on rules or based on machine learning. When assigning scores based on machine learning, a trained model that has learned the relationship between past trading results and scores from the perspective of performance indicators can be used. The second evaluation means 122 can, for example, derive and assign scores as multidimensional vectors using embedding. For example, the second evaluation means 122 can calculate scores by summarizing the output from the AI agent from the perspective of performance indicators and vectorizing the generated summary using embedding.
[0103] In the example described above, it was explained that each of the multiple indicators is independent. That is, the score can be a multidimensional score having each of the multiple indicators as an axis. However, the present invention is not limited to this, and the multiple indicators may be correlated to form a one-dimensional score. The second evaluation means 122 may, for example, assign a score in a rule-based manner based on the value of each of the multiple indicators, or it may assign a score in a machine learning-based manner. When assigning a score in a machine learning-based manner, a trained model that has learned the relationship between the value of each of the multiple indicators and the score can be used. By assigning a score in a machine learning-based manner, a score can be derived even for indicators that are too complex for human intelligence to handle. The second evaluation means 122 may, for example, derive and assign a score as a multidimensional vector using embedding. For example, the second evaluation means 122 may summarize the output from an AI agent and calculate a score by vectorizing the generated summary using embedding. In the example described above, the output from the AI agent was summarized and the generated summary was embedded. However, summarization is not mandatory. For example, the output from the AI agent could be used directly for embedding, or features of the AI agent could be extracted from the output and those extracted features could be used for embedding.
[0104] The second evaluation means 122 can derive an overall score from the scores of each of the multiple AI agents. For example, the second evaluation means 122 may derive an overall score by summing the scores of each of the multiple AI agents, or it may derive an overall score by taking the average of the scores of each of the multiple AI agents. The overall score can be considered an indicator of the advancedness or practicality of the AI technology possessed by the company, and can serve as an evaluation of the capabilities of the multiple AI agents.
[0105] The evaluation of the capabilities of multiple AI agents by the second evaluation means 122 is passed to the derivation means 124.
[0106] The third evaluation means 123 is configured to evaluate the compatibility between at least one employee of a company and multiple AI agents. The third evaluation means 123 can evaluate compatibility based on the contribution of the multiple AI agents to the frequency of use of the multiple AI agents by at least one employee of the company. The third evaluation means 123 can evaluate compatibility as good if the usage frequency is high and the contribution is also high. The third evaluation means 123 can evaluate compatibility as poor if the usage frequency is high but the contribution is low. The third evaluation means 123 can also evaluate compatibility as poor if the usage frequency is low.
[0107] The degree of contribution can be determined based on at least one of the following: the degree to which the work is made more efficient by multiple AI agents, the amount of ideas generated by multiple AI agents, and the degree to which the employee has grown through interaction with multiple AI agents. For example, if the employee's work becomes more efficient by using the AI agents, the third evaluation means 123 can determine a degree of contribution that is proportional to the degree of efficiency improvement compared to when the employee did not use the AI agents. For example, if the employee's use of the AI agents results in the generation of many ideas from the AI agents, the third evaluation means 123 can determine a degree of contribution that is proportional to the amount of ideas generated. For example, if the employee grows by using the AI agents, the third evaluation means 123 can determine a degree of contribution that is proportional to the degree of growth compared to when the employee did not use the AI agents.
[0108] The contribution may be adjusted, for example, by the employee's emotions. The third evaluation means 123 can adjust the contribution using emotion data obtained by the first evaluation means 121. The third evaluation means 123 can adjust the contribution to give a positive weight or increase it when the employee has positive emotions, and can adjust the contribution to give a negative weight or decrease it when the employee has negative emotions.
[0109] The compatibility evaluation by the third evaluation means 123 is passed to the derivation means 124.
[0110] The derivation means 124 is configured to derive an AI index based on the capabilities of at least one employee, the capabilities of multiple AI agents, and compatibility.
[0111] The derivation means 124 may derive the AI index using a rule-based method, but preferably, the AI index can be derived using machine learning, and in particular, using unsupervised learning.
[0112] In a preferred embodiment, the derivation means 124 can derive an AI index using a pre-trained model that has previously learned the relationship between the capabilities of employees of multiple companies, the capabilities of AI agents used by each company, the compatibility between employees of each company and AI agents, and the AI index. The pre-trained model has learned the relationships between multiple clusters classified by clustering analysis of the capabilities of employees of multiple companies, the capabilities of AI agents used by each company, and the compatibility between employees of each company and AI agents. These multiple clusters correspond to the stages represented by the AI index. For example, the derivation means 124 can derive an AI index by analyzing which of the multiple clusters the capabilities of at least one employee, the capabilities of multiple AI agents, and the compatibility belong to. This analysis is performed by calculating the similarity between the data points represented by the capabilities of at least one employee, the capabilities of multiple AI agents, and the compatibility, and each cluster.
[0113] In another preferred embodiment, the derivation means 124 can derive an AI index as a multidimensional index having the capabilities of at least one employee, the capabilities of a plurality of AI agents, and compatibility as components. The AI index may be a three-dimensional index or an index having more than three dimensions. In the case of an index having more than three dimensions, the derivation means 124 can derive additional components of the AI index from at least two of the capabilities of at least one employee, the capabilities of a plurality of AI agents, and compatibility. The additional components may be, for example, calculated values such as the sum, average, minimum, or maximum value of at least two of the capabilities of at least one employee, the capabilities of a plurality of AI agents, and compatibility.
[0114] The AI index derived in this way can be used for any purpose. For example, as will be discussed later, it can be used to predict trends in a company's stock price or performance.
[0115] Alternatively, the AI Index can be used for business strategy and internal control. For example, the AI Index can be used for benchmarking, allowing companies to objectively understand their level of AI utilization by comparing it with competitors and leading companies. This enables companies to analyze their strengths and weaknesses and identify areas for improvement. For example, the AI Index can be used to measure the progress of digital transformation (DX), and can be used as a KPI to measure the progress of AI utilization in the company-wide DX strategy. This allows companies to evaluate their achievement of goals and revise their strategies. For example, the AI Index can be used in investment decisions and resource allocation, and can help evaluate the return on investment (ROI) of AI-related projects. This enables companies to make effective resource allocation decisions. For example, the AI Index can be used for risk management, and can be used to evaluate or manage risks specific to companies with high levels of AI utilization (algorithm bias, operational troubles, cybersecurity, black box issues, etc.). This allows companies to determine their governance structure or audit priorities based on the index's score. For example, the AI index can be used in talent strategy to predict the demand for necessary personnel (AI developers, data scientists, AI-savvy business users, etc.) based on the level of AI utilization, and to reflect this in recruitment and training plans. The AI index can also be used as an indicator to measure the need to improve employees' AI literacy. For example, the AI index can be used in evaluating organizational culture, serving as an indirect indicator to measure the organization's acceptance of AI introduction or utilization, or employees' attitudes towards collaborating with AI.
[0116] Alternatively, AI indices can be used for external stakeholders. For example, AI indices can be used by investors to evaluate aspects other than stock price and performance. AI indices can be used as indicators to evaluate a company's ethical use of AI, governance structure, and impact on employees; as indicators to evaluate a company's future innovation capabilities, market adaptability, or long-term growth potential; or as indicators to evaluate a company's technological advancement, operational efficiency, and post-merger synergy potential. For example, AI indices can be used by financial institutions for credit decisions, where they can consider the AI index as one of the factors in evaluating a company's operational efficiency, competitiveness, and future potential, and reflect it in lending decisions or ratings. For example, AI indices can be used for supply chain management, serving as an indicator to evaluate suppliers' technological capabilities, efficiency, and risk resilience. For example, AI indices can be used by insurance companies for risk assessment, where they can use them as an indicator showing the degree of reliance on AI when evaluating operational risk or cyber risk, and reflect it in the calculation of insurance premiums. For example, an AI index can be used for industry analysis or market research, and consulting firms or research companies can use it as data to analyze industry-specific AI utilization trends, competitive environments, future predictions, etc. In this case, it is preferable that the AI index is managed on a decentralized network and that the source (province) of the data is verified.
[0117] Alternatively, the AI Index can be used for policymaking or social analysis. For example, the AI Index can be used for policymaking, allowing governments or local authorities to understand the status of AI adoption across industries and use it as basic data to consider AI dissemination support measures, human resource development policies, and regulatory needs, as well as for international competitiveness comparisons. For example, the AI Index can be used for labor market analysis, allowing governments or local authorities to analyze the correlation between the degree of AI utilization and employment trends, wage levels, and changes in required skill sets, and to investigate or predict the impact on the labor market. For example, the AI Index can be used for productivity analysis, allowing governments, local authorities, or research institutions to analyze the relationship between the degree of AI utilization at the firm or industry level and productivity improvements, and to study the impact of AI on economic growth.
[0118] Alternatively, the AI index can be used for team building, including AI agents. In particular, the AI index can be used to evaluate and determine how well, or likely to be, AI agents and employees are collaborating on routine tasks. For example, based on the AI index, it is possible to recommend or suggest teaming employees who are likely to collaborate with AI agents or other employees on a specific task (e.g., agile development), or to actually build and operate a team based on the AI index.
[0119] Alternatively, the AI index can be used to control computers or robots. For example, in a production environment, the AI index can correlate with macro-measured productivity and can therefore be used for long-term productivity optimization (e.g., daily, weekly, monthly, quarterly, or yearly optimization) rather than real-time optimization. For instance, the AI index can be used to control AI agents, computers, or robots in a production environment to improve long-term productivity. In particular, an AI agent can trigger actions to improve productivity or control robots when the AI index declines or deteriorates.
[0120] Figure 4B shows another example of the configuration of the processor unit 120. The processor unit 120 shown in Figure 4B has a configuration that uses an AI index to predict stock prices or performance. In the example shown in Figure 4B, the processor unit 120 has the same configuration as the example shown in Figure 4A, except that the processor unit 120 includes a prediction means 125. Therefore, the same reference numerals are used for configurations similar to those described above with reference to Figure 4A, and they will not be described in detail here.
[0121] The first evaluation means 121 is configured to evaluate the capabilities of at least one employee of the company. The evaluation of the employee's capabilities by the first evaluation means 121 is passed to the derivation means 124.
[0122] The second evaluation means 122 is configured to evaluate the capabilities of multiple AI agents used by the company. The evaluation of the capabilities of the multiple AI agents by the second evaluation means 122 is passed to the derivation means 124.
[0123] The third evaluation means 123 is configured to evaluate the compatibility between at least one employee of a company and multiple AI agents. The compatibility evaluation by the third evaluation means 123 is passed to the derivation means 124.
[0124] The derivation means 124 is configured to derive an AI index based on the capabilities of at least one employee, the capabilities of multiple AI agents, and compatibility. The AI index derived by the derivation means 124 is passed to the prediction means 125.
[0125] The prediction means 125 is configured to predict the trend of a company's stock price or performance based on the AI index. As mentioned above, the AI index is an indicator that objectively evaluates the potential capabilities that a company possesses, i.e., "intellectual capital," and is understood to be correlated with the company's future performance and, consequently, its stock price.
[0126] The prediction means 125 can predict the trend of stock price or performance using a trained model. The trained model is a model that has learned the relationship between each company's AI index and the trend of stock price or performance for multiple companies. When the AI index of a company is input to the trained model, it can predict and output the trend of that company's stock price or performance.
[0127] As an example, we will explain using a case where the AI index is a multidimensional index whose components include the capabilities of at least one employee, the capabilities of multiple AI agents, and compatibility.
[0128] The capability of at least one employee, as described above, is based on the employee's intellectual productivity and can be an indicator for evaluating the employee's AI literacy, AI tool utilization skills, ability to interpret and judge AI output, adaptability to AI implementation, and participation in relevant training. The capability of multiple AI agents, as described above, is based on a score assigned to the AI agents from at least one indicator and can be an indicator for evaluating the AI agents' processing power, accuracy, automation scope, reliability, and cost efficiency. Compatibility, as described above, is based on the contribution of the AI agents to the frequency of employee use of the AI agents and can be an indicator for evaluating the productivity improvement rate, error reduction rate, speed of new service development, contribution to customer satisfaction improvement, degree of interdepartmental collaboration, and workflow efficiency between humans and AI agents through collaboration between AI agents and human resources. These three indicators may be calculated and updated periodically.
[0129] These three indicators may correlate with company performance or stock prices, and these correlations can be analyzed based on historical data from multiple companies. In particular, historical data can be used to analyze or model how combinations or interactions of the three indicators affect future financial performance (growth, profitability, etc.) or stock price returns. For example, even if the capabilities of multiple AI agents are high, if the capabilities or compatibility of employees are low, their contribution to performance may be limited. For example, if all three indicators are balanced at a high level, there may be a tendency to show consistently high performance. These relationships or trends can be revealed using machine learning models (multivariate analysis, structural equation modeling, ensemble learning, etc.). Furthermore, a machine learning model can be constructed using the three indicators as input features and future performance or stock prices as output features. In this case, it is especially important to incorporate interaction terms between the indicators into the model. For example, if the latest AI index is input to the constructed machine learning model, the machine learning model will predict and output future performance or stock prices.
[0130] Company profiles can be classified according to the trends of the three indicators, and a machine learning model can be built for each profile classification. For example, a machine learning model specific to companies with high employee capabilities (talent-driven), a machine learning model specific to companies with high AI agent capabilities (AI brain-driven), and a machine learning model specific to companies with high compatibility (synergy-focused) can be built, and the appropriate machine learning model can be used for each profile classification.
[0131] Machine learning models can be improved by verifying the effectiveness of their predictions or the validity of three metrics. In particular, given the rapid advancements in AI technology, it is desirable to improve them to keep up with the latest technologies.
[0132] Users can, for example, refer to the displayed stock price or earnings trends to decide whether or not to invest in a company. Alternatively, they may consider company profile classifications, the AI index score itself (or rankings based on the score) when making investment decisions (e.g., stock selection, weighting, and investment timing decisions). For example, a user could adopt a strategy of prioritizing investments in companies that are predicted to have high stock prices or earnings, and that have a good balance of the three indicators of the AI index.
[0133] Alternatively, a user could, for example, refer to the displayed stock price or performance trends to decide whether or not to work for that company.
[0134] Alternatively, the system 100 itself may use the AI index to perform investment actions such as purchasing stocks. For example, by granting permission to the system 100 in advance, the system 100 can autonomously decide which companies to invest in and perform investment actions autonomously.
[0135] Thus, in this example, a company's AI utilization capability is viewed as a trinity of "technology," "people," and "collaboration," and stock prices are predicted from the perspective that the overall strength and balance of these elements determine the company's medium- to long-term value. This can enable a deeper evaluation of the soundness and sustainability of a company's AI strategy than evaluating it with a single indicator.
[0136] In the examples shown in Figures 4A and 4B above, each component of the processor unit 120 is provided within the same processor unit 120, but the present invention is not limited to this. A configuration in which each component of the processor unit 120 is distributed among multiple processor units is also within the scope of the present invention. In this case, the multiple processor units may be located within the same hardware component, or they may be located within separate hardware components that are nearby or far apart.
[0137] Furthermore, each component of the system 100 described above may consist of a single hardware component or multiple hardware components. If it consists of multiple hardware components, the manner in which each hardware component is connected is irrelevant. Each hardware component may be connected wirelessly or by wire. The system 100 of the present invention is not limited to a specific hardware configuration. Configuring the processor unit 120 with analog circuits instead of digital circuits is also within the scope of the present invention. The configuration of the system 100 of the present invention is not limited to those described above insofar as it can realize its functions.
[0138] (3. Processing in the system for evaluating companies) Figure 5 is a flowchart of an example of processing (process 50) by the system 100 for evaluating companies. Process 50 is performed in the processor unit 120 of the system 100.
[0139] In step S501, the first evaluation means 121 of the processor unit 120 evaluates the capabilities of at least one employee of the company. The first evaluation means 121 can evaluate the employee's capabilities based on the employee's intellectual productivity.
[0140] To this end, in step S501, the first evaluation means 121 acquires data on the physical characteristics of at least one employee and estimates intellectual productivity based on the data on the physical characteristics of at least one employee.
[0141] Alternatively, in step S501, the first evaluation means 121 acquires data relating to the physical characteristics of at least one employee and data relating to the mental characteristics of at least one employee, and estimates intellectual productivity based on the data relating to the physical characteristics of at least one employee and the data relating to the mental characteristics of at least one employee.
[0142] In step S502, the second evaluation means 122 of the processor unit 120 evaluates the capabilities of multiple AI agents used by the company. The second evaluation means 122 can evaluate the capabilities of the AI agents based on the scores of the AI agents.
[0143] To this end, in step S502, the second evaluation means 122 monitors the output from multiple AI agents, evaluates the monitored output with respect to at least one indicator, and assigns a score to each of the multiple AI agents based on the evaluation results. The at least one indicator includes at least one of a technical capability indicator, a performance indicator, or an ethical indicator.
[0144] Next, the second evaluation means 122 derives an overall score from the scores of each of the multiple AI agents. For example, the second evaluation means 122 may derive an overall score by summing the scores of each of the multiple AI agents, or it may derive an overall score by taking the average of the scores of each of the multiple AI agents.
[0145] In step S503, the third evaluation means 123 of the processor unit 120 evaluates the compatibility between at least one employee of the company and the multiple AI agents used by the company. The third evaluation means 123 evaluates the compatibility based on the contribution of the multiple AI agents to the frequency of use of the multiple AI agents by at least one employee of the company.
[0146] To this end, the third evaluation means 123 obtains the usage frequency of multiple AI agents and the contribution level of the multiple AI agents, and evaluates the contribution level relative to the usage frequency. The third evaluation means 123 can evaluate that the compatibility is good if the usage frequency is high and the contribution level is also high. The third evaluation means 123 can evaluate that the compatibility is poor if the usage frequency is high but the contribution level is low. The third evaluation means 123 can also evaluate that the compatibility is poor if the usage frequency is low.
[0147] In step S504, the derivation means 124 of the processor unit 120 derives the AI index based on the evaluations in step S501, step S502, and step S503. The derivation means 124 can preferably derive the AI index using machine learning, and in particular using unsupervised learning.
[0148] After step S504, the prediction means 125 of the processor unit 120 may predict the trend of a company's stock price or performance based on the AI index derived in step S504.
[0149] Referring to Figure 5, the above example explained that the processes are carried out in a specific order, but the order of each process is not limited to what has been explained and can be carried out in any logically possible order.
[0150] Referring to Figure 5, in the example described above, the processing of each step shown in Figure 5 can be realized by the processor unit 120 and the program stored in the memory unit 130, but the present invention is not limited thereto. At least one of the processing of each step shown in Figure 5 may be realized by a hardware configuration such as a control circuit.
[0151] The present invention is not limited to the embodiments described above. It is understood that the scope of the present invention should be interpreted solely by the claims. Those skilled in the art will understand that, based on the description of specific preferred embodiments of the present invention and common technical knowledge, an equivalent scope can be practiced.
[0152] This invention is useful as it provides a new indicator for evaluating companies.
[0153] C: Company E: Employee A: AI Agent U: User 100: System 200: Database Unit 300: Employee Terminal Device 400: Server Device 500: User Terminal Device
Claims
1. A system for evaluating a company, comprising: a first evaluation means for evaluating the capabilities of at least one employee of the company; a second evaluation means for evaluating the capabilities of a plurality of AI agents used by the company; a third evaluation means for evaluating the compatibility between the at least one employee and the plurality of AI agents; and a derivation means for deriving an AI index based on the capabilities of the at least one employee, the capabilities of the plurality of AI agents, and the compatibility.
2. The system according to claim 1, wherein the first evaluation means is configured to acquire data relating to the physical characteristics of the at least one employee, and to estimate the intellectual productivity of the at least one employee based on the data relating to the physical characteristics.
3. The system according to claim 2, wherein the first evaluation means is further configured to acquire data relating to the mental characteristics of the at least one employee, and the first evaluation means estimates the intellectual productivity based on the data relating to the physical characteristics and the data relating to the mental characteristics.
4. The system according to claim 1, wherein the second evaluation means is configured to assign a score to each of the plurality of AI agents and to derive an overall score from the scores of each of the plurality of AI agents.
5. The system according to claim 4, wherein the second evaluation means is configured to monitor the output from the plurality of AI agents, evaluate the monitored output with respect to at least one indicator, and assign a score based on the result of the evaluation.
6. The system according to claim 5, wherein the at least one indicator includes at least one of an ethical indicator, a technical competence indicator, and a performance indicator.
7. The system according to claim 1, wherein the third evaluation means is configured to acquire the frequency of use of the plurality of AI agents by at least one employee and the contribution of the plurality of AI agents, and to evaluate the contribution to the frequency of use.
8. The system according to claim 7, wherein the contribution is determined based on the degree to which the plurality of AI agents improve the efficiency of operations, the amount of ideas generated by the plurality of AI agents, and the degree to which the at least one employee has grown through interaction with the plurality of AI agents.
9. The system according to claim 1, further comprising a prediction means for predicting the trend of the stock price or performance of the company based on the AI index.
10. A method for evaluating a company, comprising: evaluating the capabilities of at least one employee of the company; evaluating the capabilities of a plurality of AI agents used by the company; evaluating the compatibility between the at least one employee and the plurality of AI agents; and deriving an AI index based on the capabilities of the at least one employee, the capabilities of the plurality of AI agents, and the compatibility.
11. A program for evaluating a company, the program being executed on a computer equipped with a processor, the program causing the processor to perform the following processes: evaluating the capabilities of at least one employee of the company; evaluating the capabilities of a plurality of AI agents used by the company; evaluating the compatibility between the at least one employee and the plurality of AI agents; and deriving an AI index based on the capabilities of the at least one employee, the capabilities of the plurality of AI agents and the compatibility.
