Information processing apparatus, information processing method, and information processing program

Abstract

To provide an information processing apparatus, an information processing method, and an information processing program capable of providing advertisement information to a user appropriately.SOLUTION: An information processing apparatus includes an acquisition unit, an estimation unit, and a providing unit. The acquisition unit acquires user information which is information on a user, and real-store information which is information on a real store. The estimation unit inputs, to an AI agent or a trained model configured to generate and output information according to input information, information including the user information and the real-store information acquired by the acquisition unit, as input information, and causes the AI agent or the trained model to estimate whether the user is to use the real store when advertisement information on the real store is provided to the user. When the estimation unit estimates that the user is to use the real store, the providing unit provides the advertisement information on the real store to the user.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] There is known a technology for providing advertising information via a network. For example, Patent Document 1 discloses a technology for providing advertising information including information on benefits available at a store to a user who is present within a predetermined range from the location of the store. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-71652 A Summary of the Invention [Problem to be solved by the invention]

[0004] The above-mentioned conventional technology can provide advertising information to users who are within a specified range of the store's location, but since advertising information is also provided to users who are unlikely to use the store, there is room for improvement in terms of providing advertising information to users appropriately.

[0005] The present application has been made in consideration of the above, and has an object to provide an information processing device, an information processing method, and an information processing program capable of appropriately providing advertising information to a user. [Means for solving the problem]

[0006] The information processing device according to the present application includes an acquisition unit, an estimation unit, and a provision unit. The acquisition unit acquires user information, which is information about a user, and physical store information, which is information about a physical store. The estimation unit inputs information including the user information and physical store information acquired by the acquisition unit as input information to an AI agent or a trained model that generates and outputs information according to the input information, and causes the AI ​​agent or the trained model to estimate whether the user will use the physical store when advertising information for the physical store is provided to the user. The provision unit provides the advertising information for the physical store to the user when the estimation unit estimates that the user will use the physical store. Effect of the Invention

[0007] According to one aspect of the embodiment, it is possible to provide advertising information appropriately to a user. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of information processing according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of an information processing system according to the embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of the configuration of a terminal device according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a chat screen including advertisement information displayed on the terminal device according to the embodiment. [Diagram 5] FIG. 5 is a diagram showing an example of a chat inquiry screen displayed on the terminal device according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of the configuration of a server device according to the embodiment. [Figure 7] FIG. 7 is a flowchart illustrating an example of information processing by the processing unit of the terminal device according to the embodiment. [Figure 8] FIG. 8 is a hardware configuration diagram showing an example of a computer that realizes the functions of the terminal device and the server device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the information processing device, the information processing method, and the information processing program according to the present application (hereinafter, referred to as "embodiments") will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to these embodiments. In addition, each embodiment can be appropriately combined as long as the processing contents are not contradictory. In addition, the same parts in each of the following embodiments are given the same reference numerals, and duplicated explanations will be omitted.

[0010] [1. An example of information processing] First, an example of information processing according to the embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of information processing according to the embodiment.

[0011] The server device 2 shown in Fig. 1 is a server device that cooperates with a terminal device 1 of a user U and provides various types of information to the user U online, and is realized, for example, by one or more servers or a cloud system. Note that, although one terminal device 1 is shown in the example shown in Fig. 1, the server device 2 cooperates with each of a plurality of terminal devices 1 and provides various services online to the user U of each terminal device 1. The terminal device 1 is an example of an information processing device.

[0012] The server device 2 accepts a budget setting request, which is a request for setting an advertising budget that is a budget necessary for distributing advertising information related to a physical store (step S1). For example, the server device 2 accepts the setting of the advertising budget included in the budget setting request by accepting the budget setting request transmitted from the terminal device 3 of the business operator O of the physical store. The advertising budget is a budget for each physical store, but may be a budget for multiple physical stores.

[0013] In addition to the budget setting request, the server device 2 can also receive a targeting setting request, which is a request for setting a target demographic, which is a target customer demographic. The target demographic is a user demographic to which advertising information is provided, and is defined by, for example, one or more of age, sex, family situation, interests, occupation, income, etc.

[0014] A terminal app, which is an application program (hereinafter, may be referred to as app) capable of displaying advertisements provided by an advertisement distribution service, is installed in the terminal device 1. The terminal app can transmit and receive information to and from the server device 2 via an API (Application Programming Interface), but may also transmit and receive information to and from the server device 2 without using an API.

[0015] The terminal device 1 periodically detects location information detected by a built-in location sensor, and periodically transmits the location information to the server device 2 by a function of a terminal application (step S2). The terminal device 1 is carried by a user U, and the location information is information indicating the current location of the user U.

[0016] The server device 2 periodically acquires location information transmitted from the terminal device 1, and transmits physical store information, which is information about physical stores within a predetermined range from the current location of the user U indicated by the location information, to the terminal device 1 (step S3). The predetermined range may be fixed, or may be a range that differs depending on the attributes or moving speed of the user U, or may be a range that differs depending on the business type of the physical store.

[0017] The physical store information is, for example, information generated by the server device 2, and may be information indicating the location of the physical store, information indicating the business format of the physical store, and information indicating the business hours of the physical store, but may be one or more of these pieces of information and is not limited to such examples. The business format of the physical store is, for example, the business type of the physical store, the type of products and services provided in the physical store, the target customer base, the price range of products and services provided in the physical store, the management format, the design and concept of the physical store, etc.

[0018] Examples of the types of physical stores include, but are not limited to, restaurants, bookstores, general stores, 100 yen shops, boutiques, department stores, electronics retailers, home centers, supermarkets, convenience stores, massage parlors, and the like.

[0019] For example, if the actual store is a restaurant, the types of products and services offered at the store may be Japanese, Chinese, French, Italian, etc., but more specific types may also be used. For example, instead of Japanese food, sushi, grilled meat, rice bowls, eel, udon, soba, tempura, etc. may be used, and instead of Chinese food, ramen, champon, gyoza, fried rice, etc. may be used, or other types or categories may also be used.

[0020] The target customer group is defined by one or more of, for example, age, sex, family situation, interests, occupation, income, etc. For example, the target customer group may be young people, middle-aged people, seniors, etc. in terms of age, or business people, students, self-employed people, etc. in terms of occupation.

[0021] The price ranges of products and services offered in physical stores may be, for example, a low price range, a mid price range, and a high price range, but are not limited to such examples and may be divided into four or more price ranges, or may be just two price ranges.

[0022] The operating form may be, for example, franchise, non-franchise, privately owned, large store, specialty store, etc., but is not limited to such examples. The design or concept of the physical store may be, for example, traditional design or concept, casual design or concept, modern design or concept, etc., but is not limited to such examples.

[0023] When the physical store information is transmitted from the server device 2 in step S3, the terminal device 1 acquires the physical store information transmitted from the server device 2 by a function of the terminal application (step S4).

[0024] In addition, in step S2, instead of the location information, the terminal device 1 can also transmit to the server device 2 information indicating a predetermined range from the current location of the user U or physical store identification information that identifies a physical store within a predetermined range from the current location of the user U.

[0025] In this case, the server device 2 transmits information about physical stores located within the range indicated by the information indicating a predetermined range to the terminal device 1 as physical store information, or transmits information about a physical store identified by the physical store identification information to the terminal device 1 as physical store information.

[0026] Next, the terminal device 1 acquires user information, which is information about the user U of the terminal device 1, from an internal storage unit or the like (step S5). The user information is, for example, one or more of attribute information of the user U, action history information of the user U, and context information of the user U.

[0027] The terminal device 1 can acquire user information, for example, by chat inquiry using a function of a terminal app, or can acquire user information from a sensor or a storage unit in the terminal device 1, the server device 2, or the like.

[0028] The attribute information of the user U is information indicating the attributes of the user U, and the attributes of the user U are, for example, the demographic attributes and psychographic attributes of the user U. The demographic attributes are demographic attributes, for example, age, sex, occupation, place of residence, annual income, family structure, etc. The psychographic attributes are psychological attributes, for example, lifestyle, values, interests, etc.

[0029] The behavioral history information of the user U is information indicating the past behavior of the user U, and includes information on the user U's past usage history of a physical store, information on the user U's past usage history of an online service, etc. The information on the user U's past usage history of a physical store is information on physical stores that the user U has used in the past, information on the names and prices of products and services that the user U purchased at the physical store, etc.

[0030] The information on the user U's behavioral history in the online service includes, for example, search history information, browsing history information, and transaction history information in the online service of the user U. The search history information of the user U includes, for example, information on the search history of content by the user U in a web search service. The browsing history information of the user U includes, for example, information on the browsing history of content by the user U in the online service. The transaction history information includes, for example, information on the transaction history of products by the user U in the online service.

[0031] The context information of the user U is information on the context related to the user U. The context related to the user U is, for example, the situation surrounding the user U. Such context includes the current time, the physical environment in which the user U is placed (for example, temperature, weather, etc.), the social environment in which the user U is placed (for example, the state of the economy, popular products and services, etc.), the exercise state of the user U (for example, walking, running, etc.), and the emotion of the user U (for example, laughing, angry, troubled, etc.). The context information is, for example, information acquired from the terminal device 1 or an external information providing device.

[0032] Next, the terminal device 1 uses an AI (Artificial Intelligence) agent or a trained model that generates and outputs information based on the input information to estimate whether the user U will use a physical store if advertising information for the physical store is provided to the user U (step S6).

[0033] For example, the terminal device 1 inputs information including the physical store information and user information acquired in steps S4 and S5 as input information to an AI agent or a trained model that generates and outputs information according to the input information, and has the AI ​​agent or trained model estimate whether or not user U will use the physical store if advertising information for the physical store is provided to user U.

[0034] The AI ​​agent or the learned model is provided, for example, in the server device 2 or another server device. The terminal device 1 inputs input information to the AI ​​agent or the learned model via an API or the like using a function of the terminal app, causes the AI ​​agent or the learned model to estimate whether or not the user U will use a physical store, and acquires the estimation result. Note that the AI ​​agent or the learned model may be configured to be provided in the terminal device 1, or may be included in the terminal app.

[0035] First, a description will be given of usage presence / absence estimation, which is an estimation of whether or not a user U uses a physical store using an AI agent. The AI ​​agent is, for example, an autonomous AI agent such as AutoGPT (Generative Pre-trained Transformer), but may also be an autonomous AI agent created specifically for usage presence / absence estimation.

[0036] For example, when an autonomous AI agent is given a goal, it causes a generative AI to generate tasks for achieving that goal, collects information for the generative AI to execute the generated tasks, and outputs information for achieving the goal by repeating the process of having the generative AI execute the tasks.

[0037] An example of a generative AI is a text generation AI. The text generation AI is a language model trained to estimate and output the next token from an input token string, such as an attenuation model or a transfer model.

[0038] Examples of transfer models include, but are not limited to, GPT (Generative Pre-trained Transformer) and BERT (Bidirectional Encoder Representations from Transformers). It is preferable that the input information is trained so that it is not used as a new answer, thereby concealing input information such as personal information. The generating AI may be trained (for example, fine-tuned) specifically for use in estimating the presence or absence of use by an AI agent.

[0039] For example, the terminal device 1 inputs to the AI ​​agent information including the string "Please estimate whether the user indicated by the user information shown below will use the physical store indicated by the physical store information shown below, and let us know the result," as well as the user information and the physical store information.

[0040] As a result, the AI ​​agent sets the input information as a goal, generates and executes a task according to the goal, and generates and outputs an inference result as to whether or not the user U will use the brick-and-mortar store. The input information input to the AI ​​agent is instruction information in natural language, and is also called a prompt.

[0041] In an AI agent, for example, a generative AI can generate a task in response to input information, and the information required to execute such a task can be collected from an internal memory unit or an external information providing device in response to a request from the generative AI, and the task can be executed by having the generative AI analyze the collected information.

[0042] The information collected by the AI ​​agent is, for example, user information of the user U or other users who used the physical store, but is not limited to such an example. For example, the information collected by the AI ​​agent may include, in addition to the user information of the user U or other users who used the physical store, user information of the user U or other users who used a physical store similar to the physical store, and may include an estimation result of whether or not the user U or other users have used the physical store, which was estimated by the AI ​​agent in the past. The user information is, for example, one or more of attribute information, behavior history information, and context information.

[0043] The information collected by the AI ​​agent may also include information on the delivery track record of advertisement distribution services provided by businesses that provide advertising information provision services, their group companies, and businesses with which they have entered into partner agreements (e.g., user U's track record of acquiring advertising information and user information about user U).The information collected by the AI ​​agent may also include information on the delivery track record of bonus distribution services provided by businesses that provide bonus information provision services, their group companies, and businesses with which they have entered into partner agreements (e.g., user U's track record of acquiring bonus information and user information about user U).

[0044] In addition, the input information input to the AI ​​agent may be user information and physical store information that has been summarized or processed by the generation AI to make it easier for the AI ​​agent to estimate whether or not the user information and physical store information are being used.

[0045] Next, we will explain the use presence / absence estimation using a trained model without using an AI agent. The trained model is, for example, the above-mentioned generation AI. Such a generation AI is, for example, a text generation AI.

[0046] The terminal device 1 has a trained model trained using learning information including, for example, user information, physical store information, and information indicating whether the user U has used the physical store for each combination of the user U and the physical store.

[0047] For example, the learning information is a dataset that takes user information and physical store information as input and targets information indicating whether or not user U has used a physical store, and learning is, for example, fine tuning, but is not limited to such an example.

[0048] In this case, the terminal device 1 inputs information including user information, physical store information, and information inquiring as to whether the user U will use the physical store as input information to the learned model, and generates information indicating whether the user U will use the physical store.

[0049] In addition, the input information input to the trained model may be user information and physical store information acquired by the acquisition unit 30 that have been summarized or processed by the generation AI to make it easier for the trained model to estimate whether or not the information is being used.

[0050] The trained model may be a model other than the generative AI. The model other than the generative AI may be, for example, a regression model, a neural network, or a gradient boosting decision tree (GBDT), but is not limited to such models and may be other models.

[0051] In this case, the trained model is a model trained using training information including, for example, user information of the user U to whom the advertising information was provided and physical store information of a physical store where a benefit can be obtained from the advertising information, for each piece of information indicating whether or not the user U has used the physical store where a benefit can be obtained from the advertising information, and may be incorporated into a terminal app of the terminal device 1.

[0052] The learning information is a dataset that takes as input information including user information of the user U who provided the advertising information and physical store information of the physical store where benefits can be obtained through the advertising information, and targets (labels) information indicating whether or not the user U who provided the advertising information used the store.

[0053] The information indicating whether the user U to whom the advertising information was provided used the store may be information indicating whether the user U changed his / her behavior and used the brick-and-mortar store by being provided with the advertising information. In this case, the user U who changed his / her behavior and used the brick-and-mortar store by being provided with the advertising information is, for example, the user U who selected "because there is a benefit" in the questionnaire when using the benefit, and such information is, for example, information collected by the server device 2 from the terminal device 1, etc.

[0054] The trained model is generated so as to output a high score when information including user information of a user U who has changed their behavior and used a physical store in response to the provision of advertising information and physical store information of a physical store where benefits can be obtained through the advertising information is input as input information.

[0055] In this case, the terminal device 1 inputs information including user information and physical store information into the trained model using the function of the terminal app, and if the score output from the trained model is above a threshold, it presumes that user U will use the physical store, and if not, it presumes that user U will not use the physical store.

[0056] In addition, the terminal device 1 has a benefit determination model that inputs information including user information and physical store information as input information and outputs information indicating the benefit that user U will obtain by using the benefit, and uses this benefit determination model to determine the benefit that user U will obtain by using the benefit.

[0057] Examples of rewards include, but are not limited to, coupons (e.g., discount coupons or free exchange coupons), increased points, the provision of limited products or services, cash back, etc.

[0058] The reward profit is, for example, the discount amount or discount rate indicated by the discount coupon when the reward is a discount coupon, and the price of purchasing the product or service eligible for free redemption without the coupon when the reward is a free redemption coupon. Note that the reward profit may be a profit converted into cash.

[0059] The benefit determination model is a data set that inputs, for example, information including user information and actual store information, and targets (labels) information indicating the benefit that user U will obtain from the benefit that he or she wishes to use. The information indicating the benefit that user U will obtain from the benefit that he or she wishes to use is, for example, information obtained by answering a questionnaire for user U (for example, "How much of a discount would make you go?"), but the target (label) data may also be information indicating the benefit that user U actually obtains from the benefit that he or she has used.

[0060] Next, when it is estimated in step S6 that the user U will use a physical store, the terminal device 1 transmits an advertisement provision request to the server device 2 by a function of the terminal app (step S7). The advertisement provision request includes information for identifying the user U (e.g., a user ID), information on the determined special benefit, and information for identifying the physical store estimated to be used by the user U (e.g., a physical store ID).

[0061] When the server device 2 receives the advertisement provision request transmitted from the terminal device 1, it transmits advertisement information of the brick-and-mortar store specified in the advertisement provision request to the terminal device 1 (step S8). The server device 2 subtracts the advertisement information provision fee in step S8 from the advertisement budget set and received in step S1.

[0062] The advertisement information includes, for example, benefit information that is information on a benefit that can be used by the user U in a physical store. The benefit information is information on a benefit that can be obtained by the user U, which is indicated by the benefit benefit information specified in the advertisement provision request.

[0063] The server device 2 has an AI (hereinafter, sometimes referred to as advertising generation AI) that generates advertising information, and inputs information including physical store information of the physical store identified in the advertising provision request and bonus information corresponding to the bonus benefit identified in the advertising provision request as input information to the advertising generation AI, causing the advertising generation AI to generate advertising information for the physical store.

[0064] The advertisement generation AI is, for example, an advertisement generation AI agent or a generative AI. The advertisement generation AI agent is an autonomous AI agent such as AutoGPT, but may also be an autonomous AI agent created specifically for generating advertisement information.

[0065] The generative AI includes, for example, a text generation AI and an image generation AI. The text generation AI is, for example, a language model such as the attenuation model or transfer model described above. The image generation AI is, for example, StackGAN (Generative Adversarial Networks), AttnGAN, T2I (Text-to-Image) with Transformers, DALL-E, etc.

[0066] The generative AI may be a multimodal generative AI, which is a model that generates images from text or generates text from images, such as CM3Leon (Chameleon Multimodal Model), but is not limited to such examples.

[0067] The server device 2 inputs, for example, input information including information on a physical store and information on benefits to the advertisement generation AI, and causes the advertisement generation AI to generate advertisement information for the physical store. The server device 2 inputs, for example, information including a character string "Please generate advertisement information for the physical store indicated by the physical store information below. Please include information on benefits indicated by the benefit information below in the advertisement information, and generate advertisement information that maximizes the possibility of using this benefit" and information including the physical store information and benefit information to the advertisement generation AI as input information, and causes the advertisement generation AI to generate advertisement information for the physical store.

[0068] In addition, the server device 2 can input input information including, for example, user information of the user U and physical store information of the physical store to the generation AI, and have the generation AI generate advertisement information for the physical store. In this case, the server device 2 inputs, for example, information including instruction information for generating advertisement information, physical store information, benefit information, and user information as input information to the advertisement generation AI, thereby causing the advertisement generation AI to generate advertisement information for the physical store.

[0069] The instruction information may be, for example, a string such as "Please generate advertising information for the physical store indicated in the physical store information below that will maximize the likelihood that the user indicated in the user information below will utilize the benefit indicated in the benefit information below. Please include information about the benefit indicated in the benefit information below in the advertising information.", but is not limited to such examples.

[0070] The AI ​​generating the advertisement information is generated by learning (for example, fine tuning) using learning information including advertisement information, actual store information, and user information when a user U uses a physical store provided with the advertisement information of the physical store, but is not limited to such an example. The advertisement information included in the learning information is used as a target (label).

[0071] In the above example, the privilege profit is determined by the terminal device 1, but the privilege profit may be determined by the server device 2. In this case, the server device 2, instead of the terminal device 1, uses the above-mentioned privilege determination model to determine the privilege profit, which is the profit that the user U can obtain by using the privilege.

[0072] The terminal device 1 acquires the advertising information transmitted from the server device 2, and provides the advertising information to the user U by outputting the acquired advertising information (step S9). For example, the terminal device 1 provides the advertising information to the user U by displaying the advertising information acquired from the server device 2 using characters, symbols, images, etc., or by outputting the advertising information acquired from the server device 2 by voice.

[0073] The terminal device 1 provides advertisement information to the user U using a screen of a chat application such as the LINE (registered trademark) application. For example, the terminal application can start the chat application and display the advertisement information on the screen of the chat application. Note that the terminal application may be a chat application or may have a configuration including a chat application.

[0074] In this way, the terminal device 1, as an information processing device, inputs information including user information that is information about the user U and physical store information that is information about the physical store as input information, causes an AI agent or a trained model to estimate whether the user U will use the physical store if advertising information of the physical store is provided to the user U, and provides the advertising information of the physical store to the user U if it is estimated that the user U will use the physical store. This allows the server device 2 to appropriately provide advertising information to the user U.

[0075] The configuration of an information processing system including the terminal device 1 and server device 2 that perform such processing will be described in detail below.

[0076] 2. Configuration of the Information Processing System 2 is a diagram showing an example of a configuration of an information processing system according to an embodiment. As shown in FIG. 2, the information processing system 100 according to the embodiment includes a plurality of terminal devices 1 and a server device 2.

[0077] The multiple terminal devices 1 are used by different users U. The terminal devices 1 are, for example, a notebook PC (Personal Computer), a desktop PC, a smartphone, a tablet PC, a wearable device, or a car navigation device compatible with AppleCarPlay (registered trademark). The wearable device is, for example, smart glasses or a smart watch, but is not limited to such examples.

[0078] The terminal device 1 and the server device 2 are connected to each other so as to be able to communicate with each other by wire or wirelessly via a network N. Note that the information processing system 100 shown in FIG.

[0079] The network N includes, for example, a Wide Area Network (WAN) such as the Internet and mobile communication networks such as Long Term Evolution (LTE), 4th Generation (4G), and 5th Generation (5G: fifth generation mobile communication system).

[0080] The terminal device 1 is capable of connecting to a network N and communicating with a server device 2 via short-range wireless communication such as a mobile communication network, Bluetooth (registered trademark), or a wireless LAN (Local Area Network).

[0081] [3. Terminal Device 1] Fig. 3 is a diagram showing an example of the configuration of the terminal device 1 according to the embodiment. As shown in Fig. 3, the terminal device 1 according to the embodiment includes a communication unit 10, a display unit 11, an operation unit 12, an audio input unit 13, an audio output unit 14, an imaging unit 15, a sensor unit 16, a storage unit 17, and a processing unit 18.

[0082] [3.1. Communication unit 10] The communication unit 10 is realized by, for example, a communication module, a NIC (Network Interface Card), etc. The communication unit 10 is connected to a network N by wire or wirelessly, and transmits and receives information to and from the server device 2 via the network N.

[0083] [3.2. Display section 11] The display unit 11 is, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) display.

[0084] [3.3. Operation section 12] The operation unit 12 includes, for example, a keyboard including keys for inputting letters, numbers, and spaces, an enter key, and arrow keys, a mouse, a power button, etc. When the display unit 11 is a display device that is a touch panel display, the operation unit 12 may include a touch panel.

[0085] [3.4. Audio input unit 13] The voice input unit 13 converts a voice signal, which is a signal of a voice uttered by the user U, into a digital signal, and outputs the converted digital signal, which is a voice digital signal, as voice information to the processing unit 18. The voice input unit 13 includes, for example, a microphone and an AD (Analog to Digital) converter that converts the voice signal, which is an electrical analog signal output from the microphone, into a digital signal.

[0086] [3.5. Audio output unit 14] The audio output unit 14 includes, for example, a DA (Digital to Analog) converter that converts a digital audio signal, which is the audio information output from the processing unit 18, into an analog audio signal, and a speaker that converts the analog audio signal output from the DA converter into sound and outputs it.

[0087] [3.6. Imaging unit 15] The imaging unit 15 is an image sensor (camera) that captures an image of a subject. For example, the imaging unit 15 is a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge-Coupled Device) image sensor. The imaging unit 15 is not limited to a built-in camera, and may be a wireless camera capable of communicating with the terminal device 1 or an external camera such as a Web camera.

[0088] [3.7. Sensor section 16] The sensor unit 16 includes a position sensor, a gyro sensor, an acceleration sensor, a geomagnetic sensor, an illuminance sensor, an atmospheric pressure sensor, a biosensor, etc. The position sensor detects, for example, the position of the terminal device 1, which is the current position of the user U, and outputs information indicating the detected current position of the user U to the processing unit 18. The position sensor receives a plurality of positioning signals transmitted from a plurality of positioning satellites in the Global Navigation Satellite System (GNSS), and detects the current position of the user U based on the received plurality of positioning signals.

[0089] The gyro sensor is a sensor that detects the attitude of the terminal device 1, such as the tilt and rotation. The acceleration sensor is a sensor that detects the acceleration of the terminal device 1. The geomagnetic sensor is a sensor that detects geomagnetism. The illuminance sensor is a sensor that detects illuminance indicating the brightness or darkness around the terminal device 1. The air pressure sensor is a sensor that detects the air pressure around the terminal device 1.

[0090] The biosensor is, for example, a heart rate sensor, a blood pressure sensor, etc. The heart rate sensor detects the heart rate and the like of the user U. The blood pressure sensor detects the blood pressure of the user U.

[0091] [3.8. Storage section 17] The storage unit 17 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk.

[0092] Various types of information are stored in the storage unit 17. For example, the storage unit 17 stores information on captured images captured by the imaging unit 15, information on the operation history of the user U, detection results by the sensor unit 16, and the like. The storage unit 17 also stores information transmitted from the server device 2 or other external devices and acquired by the processing unit 18 via the network N and the communication unit 10, and the like.

[0093] [3.9. Processing section 18] The processing unit 18 is a controller, and is realized, for example, by a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) executing various programs stored in a storage device inside the terminal device 1 using the RAM as a working area.

[0094] Furthermore, the processing unit 18 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The processing unit 18 includes an acquisition unit 30, an estimation unit 31, a determination unit 32, and a provision unit 33. The acquisition unit 30, the estimation unit 31, the determination unit 32, and the provision unit 33 are realized by, for example, a terminal application (corresponding to an example of an information processing program).

[0095] [3.9.1. Acquisition part 30] The acquisition unit 30 acquires various pieces of information. The acquisition unit 30 acquires various pieces of information from the storage unit 17. The acquisition unit 30 acquires a detection result by the sensor unit 16, and causes the storage unit 17 to store the acquired detection result.

[0096] The acquisition unit 30 can receive various information from an external information processing device via the communication unit 10. The acquisition unit 30 causes the storage unit 17 to store the various information received from the external information processing device.

[0097] For example, the acquisition unit 30 periodically acquires location information detected by a location sensor included in the sensor unit 16, and periodically transmits the acquired location information to the server device 2 via the communication unit 10. Then, the acquisition unit 30 acquires physical store information transmitted from the server device 2 in response to the transmission of the location information to the server device 2. Such physical store information is information about physical stores within a predetermined range from the current location of the user U indicated by the location information.

[0098] In addition, instead of location information, the acquisition unit 30 can also transmit to the server device 2 information indicating a predetermined range from the user U's current location or physical store identification information that identifies a physical store within a predetermined range from the user U's current location.

[0099] In this case, the acquisition unit 30 acquires information about physical stores within a range indicated by information indicating a predetermined range from the server device 2 as physical store information, or acquires information about physical stores identified by physical store identification information from the server device 2 as physical store information.

[0100] Furthermore, the acquisition unit 30 acquires user information of the user U and other users from the storage unit 17, the server device 2, an external information providing device, or the like. The user information is one or more of attribute information, action history information, and context information. For example, the acquisition unit 30 acquires, from the storage unit 17, information stored in the storage unit 17 among the user information, and acquires information not stored in the storage unit 17 from the server device 2, or the like.

[0101] Furthermore, when the estimation unit 31 estimates that the user U will use a physical store, the acquisition unit 30 transmits an advertisement provision request to the server device 2 and acquires advertisement information corresponding to the advertisement provision request from the server device 2. The advertisement provision request includes information for identifying the user U (e.g., a user ID), information on the privilege benefit determined by the determination unit 32 described below, and information for identifying the physical store estimated to be used by the user U (e.g., a physical store ID). The advertisement information corresponding to the advertisement provision request is advertisement information for the physical store generated based on the user information and the physical store information.

[0102] [3.9.2. Estimation section 31] The estimation unit 31 uses an AI agent or a trained model that generates and outputs information based on input information to estimate whether user U will use a physical store if advertising information for the physical store is provided to user U.

[0103] For example, the estimation unit 31 inputs information including physical store information and user information acquired by the acquisition unit 30 as input information to an AI agent or a trained model that generates and outputs information according to the input information, and has the AI ​​agent or trained model estimate whether or not user U will use the physical store if advertising information for the physical store is provided to user U.

[0104] The AI ​​agent or the learned model is provided, for example, in the server device 2 or another server device. The estimation unit 31 inputs input information to the AI ​​agent or the learned model via an API or the like using a function of the terminal app, causes the AI ​​agent or the learned model to estimate whether or not the user U will use a physical store, and acquires the estimation result. Note that the AI ​​agent or the learned model may be configured to be provided in the estimation unit 31, or may be included in the terminal app.

[0105] First, a description will be given of usage presence / absence estimation, which is an estimation of whether or not a user U uses a physical store using an AI agent. The AI ​​agent is, for example, an autonomous AI agent such as AutoGPT, but may also be an autonomous AI agent created specifically for usage presence / absence estimation.

[0106] For example, when an autonomous AI agent is given a goal, it causes a generative AI to generate tasks for achieving that goal, collects information for the generative AI to execute the generated tasks, and outputs information for achieving the goal by repeating the process of having the generative AI execute the tasks.

[0107] An example of a generative AI is a text generation AI. The text generation AI is a language model trained to estimate and output the next token from an input token string, such as an attenuation model or a transfer model.

[0108] The transfer model is, for example, GPT or BERT, but is not limited to such examples. It is preferable that the input information is trained so that it is not used as a new answer, thereby concealing the input information such as personal information. The generating AI may be trained (for example, fine-tuned) specifically for use in estimating the use or non-use of the AI ​​agent.

[0109] The estimation unit 31 inputs, for example, the following information to the AI ​​agent: a string of characters: "Please estimate whether the user indicated by the user information shown below will use the physical store indicated by the physical store information shown below, and let us know the result.", as well as information including the user information and the physical store information.

[0110] As a result, the AI ​​agent sets the input information as a goal, generates and executes a task according to the goal, and generates and outputs an inference result as to whether or not the user U will use the brick-and-mortar store. The input information input to the AI ​​agent is instruction information in natural language, and is also called a prompt.

[0111] In an AI agent, for example, a task can be generated by a generative AI in response to input information, and the information required to execute the task can be collected from memory unit 17 or an external information providing device in response to a request from the generative AI, and the generative AI can analyze the collected information to execute the task.

[0112] The information collected by the AI ​​agent is, for example, user information of the user U or other users who used the physical store, but is not limited to such an example. For example, the information collected by the AI ​​agent may include, in addition to the user information of the user U or other users who used the physical store, user information of the user U or other users who used a physical store similar to the physical store, and may include an estimation result of whether or not the user U or other users have used the physical store, which was estimated by the AI ​​agent in the past. The user information is, for example, one or more of attribute information, behavior history information, and context information.

[0113] The information collected by the AI ​​agent may also include information on the delivery track record of advertisement distribution services provided by businesses that provide advertising information provision services, their group companies, and businesses with which they have entered into partner agreements (e.g., user U's track record of acquiring advertising information and user information about user U).The information collected by the AI ​​agent may also include information on the delivery track record of bonus distribution services provided by businesses that provide bonus information provision services, their group companies, and businesses with which they have entered into partner agreements (e.g., user U's track record of acquiring bonus information and user information about user U).

[0114] In addition, the input information input to the AI ​​agent may be user information and physical store information acquired by the acquisition unit 30 that has been summarized or processed by the generation AI to make it easier for the AI ​​agent to estimate whether or not the information is being used.

[0115] Next, we will explain the use presence / absence estimation using a trained model without using an AI agent. The trained model is, for example, the above-mentioned generation AI. Such a generation AI is, for example, a text generation AI.

[0116] The trained model is a model trained using training information that includes, for example, user information, physical store information, and information indicating whether user U has used the physical store for each combination of user U and physical store.

[0117] For example, the learning information is a dataset that takes user information and physical store information as input and targets information indicating whether or not user U has used a physical store, and learning is, for example, fine tuning, but is not limited to such an example.

[0118] In this case, the estimation unit 31 inputs information including user information, physical store information, and information inquiring as to whether user U will use the physical store as input information to the learned model, and generates information indicating whether user U will use the physical store.

[0119] In addition, the input information input to the trained model may be user information and physical store information acquired by the acquisition unit 30 that have been summarized or processed by the generation AI to make it easier for the trained model to estimate whether or not the information is being used.

[0120] The trained model may be a model other than the generative AI, such as a regression model, a neural network, or a gradient boosting decision tree, but is not limited to such models and may be other models.

[0121] In this case, the trained model is a model trained using training information including, for example, user information of the user U to whom the advertising information was provided and physical store information of a physical store where a benefit can be obtained from the advertising information, for each piece of information indicating whether or not the user U has used the physical store where a benefit can be obtained from the advertising information, and may be incorporated into a terminal app of the terminal device 1.

[0122] The learning information is a dataset that takes as input information including user information of the user U who provided the advertising information and physical store information of the physical store where benefits can be obtained through the advertising information, and targets (labels) information indicating whether or not the user U who provided the advertising information used the store.

[0123] The information indicating whether the user U to whom the advertising information was provided used the store may be information indicating whether the user U changed his / her behavior and used the brick-and-mortar store by being provided with the advertising information. In this case, the user U who changed his / her behavior and used the brick-and-mortar store by being provided with the advertising information is, for example, the user U who selected "because there is a benefit" in the questionnaire when using the benefit, and such information is, for example, information collected by the server device 2 from the terminal device 1, etc.

[0124] The trained model is generated so as to output a high score when information including user information of a user U who has changed their behavior and used a physical store in response to the provision of advertising information and physical store information of a physical store where benefits can be obtained through the advertising information is input as input information.

[0125] In this case, the estimation unit 31 inputs information including user information and physical store information into the learned model using the function of the terminal app, and if the score output from the learned model is above a threshold, it estimates that user U will use the physical store, and if not, it estimates that user U will not use the physical store.

[0126] In addition, the estimation unit 31 estimates the context of the user U based on the information detected by the sensor unit 16 and the information acquired by the acquisition unit 30 from the server device 2, etc., and stores the information on the estimated context of the user U in the memory unit 17.

[0127] [3.9.3. Determination unit 32] The determination unit 32 determines the benefit that the user U can obtain by using the benefit, based on the user information and the physical store information acquired by the acquisition unit 30.

[0128] For example, the determination unit 32 has a benefit determination model that receives information including user information and physical store information as input information and outputs information indicating the benefit that user U will obtain by using a benefit, and uses this benefit determination model to determine the benefit that user U will obtain by using a benefit.

[0129] Examples of rewards include, but are not limited to, coupons (e.g., discount coupons or free exchange coupons), increased points, the provision of limited products or services, cash back, etc.

[0130] The reward profit is, for example, the discount amount or discount rate indicated by the discount coupon when the reward is a discount coupon, and the price of purchasing the product or service eligible for free redemption without the coupon when the reward is a free redemption coupon. Note that the reward profit may be a profit converted into cash.

[0131] The benefit determination model is a data set that inputs, for example, information including user information and actual store information, and targets (labels) information indicating the benefit that user U will obtain from the benefit that he or she wishes to use. The information indicating the benefit that user U will obtain from the benefit that he or she wishes to use is, for example, information obtained by answering a questionnaire for user U (for example, "How much of a discount would make you go?"), but the target (label) data may also be information indicating the benefit that user U actually obtains from the benefit that he or she has used.

[0132] [3.9.4.Providing Department 33] The providing unit 33 provides the user U with advertising information about the physical store when the estimating unit 31 estimates that the user U will use the physical store.

[0133] For example, when the estimation unit 31 estimates that the user U will use a physical store, the provision unit 33 provides the advertising information acquired from the server device 2 by the acquisition unit 30 to the user U. For example, the provision unit 33 provides information including information on a benefit according to the profit determined by the determination unit 32 as the advertising information.

[0134] The provision unit 33 provides advertising information to the user U by displaying the advertising information acquired from the server device 2 on the display unit 11 using characters, symbols, images, etc., or by outputting the advertising information acquired from the server device 2 as audio from the audio output unit 14.

[0135] The providing unit 33 provides advertisement information to the user U using a screen of a chat application such as the LINE (registered trademark) application. For example, the terminal application can start the chat application and display the advertisement information on the screen of the chat application. Note that the terminal application may be a chat application or may have a configuration including a chat application.

[0136] 4 is a diagram showing an example of a chat screen including advertisement information displayed on the terminal device 1 according to the embodiment, which is an example of a screen of a chat application. The chat screen 50 shown in FIG. 4 includes advertisement information 51, payment request information 52, and payment completion information 53.

[0137] The advertising information 51 is advertising information for a physical store "Beef Bowl Shop A" that the estimation unit 31 estimates that the user U will use, and in the example shown in Figure 4, it is the string "Would you like Beef Bowl Shop A? Regular size is 50 yen off!"

[0138] The payment request information 52 is information indicating the user U's response to the advertisement information 51, and in the example shown in FIG. 4, is information of the character string "I'm going. Please make payment." The user U operates the terminal device 1 to input the information of the character string "I'm going. Please make payment" in the input box 55, and selects the send button 56, whereby the payment request information 52 is displayed on the chat screen 50. The terminal device 1 also transmits the payment request information 52 to the server device 2.

[0139] When the server device 2 receives the payment request information 52 transmitted from the terminal device 1, the server device 2 performs a payment process for the product in the physical store indicated in the advertisement information 51 based on the payment request information 52. When the payment process is completed, the server device 2 transmits payment completion information 53, which is information indicating that the payment process has been completed, to the terminal device 1. When the terminal device 1 receives the payment completion information 53 transmitted from the server device 2, it displays the received payment completion information 53 on the chat screen 50.

[0140] The providing unit 33 can display a chat inquiry screen on the display unit 11 to acquire user information of the user U. Fig. 5 is a diagram showing an example of a chat inquiry screen displayed on the terminal device 1 according to the embodiment, which is an example of a screen of a chat application. The chat inquiry screen 60 shown in Fig. 5 includes question information 61, 63, and 65 and answer information 62 and 64.

[0141] The question information 61, 63, and 65 is information transmitted from the server device 2 and displayed on the terminal device 1. The answer information 62 and 64 is information displayed on the terminal device 1 when the user U operates the terminal device 1 to input information into an input box 67 and then selects a send button 68, and is transmitted from the terminal device 1 to the server device 2.

[0142] In this way, the providing unit 33 can display question information for the user U and obtain answer information indicating the answer of the user U to the question indicated by the question information in cooperation with the server device 2. The answer information is used by the server device 2 to identify a part or all of the user information of the user U.

[0143] 4. Configuration of Server Device 2 6 is a diagram showing an example of a configuration of the server device 2 according to the embodiment. As shown in FIG. 6, the server device 2 includes a communication unit 40, a storage unit 41, and a processing unit .

[0144] [4.1. Communication unit 40] The communication unit 40 is realized by, for example, a communication module or a NIC. The communication unit 40 is connected to a network N by wire or wirelessly, and transmits and receives information to and from various other devices. For example, the communication unit 40 transmits and receives information to and from the terminal device 1 and the terminal device 3 via the network N.

[0145] [4.2. Storage section 41] The storage unit 41 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 41 stores, for example, physical store information of each physical store, user information of each user U, advertisement-related information of each physical store, etc. The advertisement-related information includes, for example, advertising target information which is information on the physical store, product, or service to be advertised, and advertising budget information.

[0146] [4.3. Processing section 42] The processing unit 42 is a controller, and is realized by a processor such as a CPU or an MPU, for example, executing various programs stored in a storage device inside the server device 2 using a RAM or the like as a working area. The processing unit 42 is also a controller, and may be realized by an integrated circuit such as an ASIC, an FPGA, or a GPGPU.

[0147] The processing unit 42 accepts the setting of the advertising budget by accepting a budget setting request, which is a request to set an advertising budget that is a budget necessary for distributing advertising information related to a physical store. For example, the processing unit 42 accepts the setting of the advertising budget included in the budget information by accepting budget information transmitted from the terminal device 3 of the physical store operator O. The advertising budget is a budget for each physical store, but may be a budget for multiple physical stores. The processing unit 42 stores the accepted advertising budget information in the memory unit 41 as part of the advertising-related information.

[0148] In addition to the budget setting request, the processing unit 42 can also receive a targeting setting request, which is a request for setting a target demographic, which is a target customer demographic. The target demographic is a user demographic to which advertising information is provided, and is defined by, for example, one or more of age, sex, family situation, interests, occupation, income, etc.

[0149] When the processing unit 42 acquires the location information transmitted from the terminal device 1 via the communication unit 40, the processing unit 42 acquires physical store information, which is information about physical stores within a predetermined range from the current location of the user U indicated by the location information, from the storage unit 41. Then, the processing unit 42 transmits the acquired physical store information to the terminal device 1 via the communication unit 40. The predetermined range may be fixed, may be a range that differs depending on the attributes or moving speed of the user U, or may be a range that differs depending on the business type of the physical store.

[0150] When the processing unit 42 acquires location information transmitted from the terminal device 1 after accepting the targeting setting request, if the attributes of the user U of the terminal device 1 that transmitted the location information match (or are similar) to the target demographic indicated in the targeting setting request, the processing unit 42 acquires physical store information, which is information about physical stores within a predetermined range from the current location of the user U indicated by the location information, from the storage unit 41. Then, the processing unit 42 transmits the acquired physical store information to the terminal device 1 via the communication unit 40.

[0151] Furthermore, the processing unit 42 receives an advertisement provision request transmitted from the terminal device 1 via the communication unit 40. When the processing unit 42 receives an advertisement provision request, it transmits advertising information of a brick-and-mortar store specified in the advertisement provision request to the terminal device 1 via the communication unit 40. Furthermore, the processing unit 42 subtracts the provision fee for the advertising information from the advertising budget set and received from the terminal device of the brick-and-mortar store operator, and updates the advertisement-related information stored in the storage unit 41.

[0152] The advertisement information includes, for example, benefit information that is information on a benefit that can be used by the user U in a physical store. The benefit information is information on a benefit that can be obtained by the user U, which is indicated by the benefit benefit information specified in the advertisement provision request.

[0153] The processing unit 42 has an advertising generation AI, which is an AI that generates advertising information, and inputs information including physical store information of the physical store identified in the advertising provision request and bonus information corresponding to the bonus benefit identified in the advertising provision request as input information to the advertising generation AI, and causes the advertising generation AI to generate advertising information for the physical store.

[0154] The advertisement generation AI is, for example, an advertisement generation AI agent or a generative AI. The advertisement generation AI agent is an autonomous AI agent such as AutoGPT, but may also be an autonomous AI agent created specifically for generating advertisement information.

[0155] Generative AI includes, for example, text generation AI and image generation AI. Text generation AI is, for example, a language model such as the attenuation model or transfer model described above. Image generation AI is, for example, StackGAN, AttnGAN, T2I with Transormers, DALL-E, etc.

[0156] The generative AI may be a multimodal generative AI, which is a model that generates images from text or generates text from images, such as CM3Leon, but is not limited to such examples.

[0157] The processing unit 42 inputs input information including, for example, information on the actual store and information on the benefit to the advertisement generation AI, and causes the advertisement generation AI to generate advertisement information for the actual store. The server device 2 can cause the advertisement generation AI to generate multiple types of advertisement information.

[0158] The processing unit 42 causes the advertising generation AI to generate advertising information for a physical store by inputting information including the physical store information and the bonus information, for example, a string of characters such as "Please generate advertising information for the physical store indicated by the physical store information below. Please include in the advertising information information information about the benefits indicated by the bonus information below, and generate advertising information that maximizes the possibility of using this benefit.", as well as information including the physical store information and the bonus information, to the advertising generation AI as input information.

[0159] The processing unit 42 can also input input information including, for example, user information of the user U and physical store information of the physical store to the generation AI, and have the generation AI generate advertisement information for the physical store. In this case, the processing unit 42 inputs, for example, information including instructions for generating advertisement information, physical store information, benefit information, and user information as input information to the advertisement generation AI, thereby causing the advertisement generation AI to generate advertisement information for the physical store.

[0160] The instruction information may be, for example, a string such as "Please generate advertising information for the physical store indicated in the physical store information below that will maximize the likelihood that the user indicated in the user information below will utilize the benefit indicated in the benefit information below. Please include information about the benefit indicated in the benefit information below in the advertising information.", but is not limited to such examples.

[0161] The AI ​​generating the advertisement information is generated by learning (for example, fine tuning) using learning information including advertisement information, actual store information, and user information when a user U uses a physical store provided with the advertisement information of the physical store, but is not limited to such an example. The advertisement information included in the learning information is used as a target (label).

[0162] In the above example, the privilege profit is determined by the terminal device 1, but the privilege profit may be determined by the processing unit 42. In this case, the processing unit 42, instead of the terminal device 1, uses the above-mentioned privilege determination model to determine the privilege profit, which is the profit that the user U can obtain by using the privilege.

[0163] When the processing unit 42 receives the payment request information transmitted from the terminal device 1, the processing unit 42 performs a payment process for the product in the physical store indicated in the advertisement information based on the payment request information. When the payment process is completed, the processing unit 42 transmits payment completion information, which is information indicating that the payment process is completed, to the terminal device 1.

[0164] Furthermore, the processing unit 42 receives answer information (for example, information indicating an answer to a chat inquiry or an answer to a questionnaire) transmitted from the terminal device 1, and determines user information of the user U based on the received answer information. The processing unit 42 can store the determined user information in the storage unit 41, or transmit the determined user information to the terminal device 1.

[0165] 5. Processing Procedure Next, a procedure of information processing by the processing unit 18 of the terminal device 1 according to the embodiment will be described. Fig. 7 is a flowchart showing an example of information processing by the processing unit 18 of the terminal device 1 according to the embodiment.

[0166] 7, the processing unit 18 of the terminal device 1 determines whether or not the timing for an interview has arrived (step S10). The interview timing is, for example, the timing when the user U starts up the terminal app when the terminal app has not performed an interview process for the user U, or the timing that arrives at a predetermined cycle from the interview process when the terminal app has performed an interview process for the user U, etc.

[0167] When the processing unit 18 determines that the inquiry timing has arrived (step S10: Yes), it performs chat inquiry processing (step S11). When the processing unit 18 has finished the processing of step S11, or when it determines that the inquiry timing has not arrived (step S10: No), it determines whether the position of the terminal device 1 has been detected by the sensor unit 16 (step S12).

[0168] If the processing unit 18 determines that the position of the terminal device 1 has been detected by the sensor unit 16 (step S12: Yes), it transmits position information indicating the position detected by the sensor unit 16 to the server device 2 (step S13).

[0169] When the processing of step S13 is completed, or when it is determined that the position of the terminal device 1 has not been detected by the sensor unit 16 (step S12: No), the processing unit 18 determines whether or not the physical store information has been acquired from the server device 2 (step S14). When it is determined that the physical store information has been acquired from the server device 2 (step S14: Yes), the processing unit 18 acquires user information, which is information about the user U (step S15).

[0170] Then, the processing unit 18 inputs information including the physical store information acquired in step S14 and the user information acquired in step S15 as input information to an AI agent or a trained model that generates and outputs information according to the input information, and has the AI ​​agent or trained model estimate whether or not user U will use the physical store if advertising information for the physical store is provided to user U (step S16).

[0171] The processing unit 18 determines whether or not it is estimated that the user U will use the physical store if the advertising information of the physical store is provided to the user U (step S17). If the processing unit 18 determines that it is estimated that the user U will use the physical store if the advertising information of the physical store is provided to the user U (step S17: Yes), it acquires the advertising information of the physical store that is determined to be used by the user U from the server device 2 (step S18). Then, the processing unit 18 provides the advertising information acquired in step S18 to the user U (step S19).

[0172] When the processing of step S19 is completed, when it is determined that the brick-and-mortar store information has not been acquired (step S14: No), or when it is determined that the user U will not use the brick-and-mortar store (step S17: No), the processing unit 18 determines whether or not the operation end timing has arrived (step S20). The processing unit 18 determines that the operation end timing has arrived, for example, when the power of the terminal device 1 is turned off.

[0173] If the processing unit 18 determines that the operation end time has not arrived (step S20: No), it transitions the processing to step S10, and if the processing unit 18 determines that the operation end time has arrived (step S20: Yes), it terminates the processing shown in FIG. 7.

[0174] 6. Modifications A part or all of the processing of the terminal device 1 described above may be performed by the server device 2. In this case, the server device 2 has a part or all of the functions of the acquisition unit 30, the estimation unit 31, the determination unit 32, and the provision unit 33. The terminal device 1 may be configured to perform a part of the processing of the server device 2.

[0175] In addition, the processing unit 42 of the server device 2 can obtain information such as the level of congestion in the physical store, customer demographics, and length of stay from devices in the physical store, and can use the information including the level of congestion in the physical store, customer demographics, and length of stay as physical store information as input information to have the generative AI generate advertising information for the physical store.

[0176] In addition, the processing unit 42 of the server device 2 can also cause the generative AI to generate advertising information for the physical store using input information including information such as the time of day, the user U's schedule, the number and ratings of reviews of the physical store, the status of traffic lights around the physical store, railroad crossings around the physical store, and the user U's means of transportation (walking, bicycle, car, or train).

[0177] In addition, the acquisition unit 30 of the terminal device 1 can also transmit location information to the server device 2 to acquire brick-and-mortar store information only when the user U is operating the terminal device 1 or a terminal application.

[0178] Moreover, the providing unit 33 may be configured to generate the advertisement information using the above-mentioned advertisement generation AI, instead of causing the server device 2 to generate the advertisement information. The method of generating the advertisement information using the advertisement generation AI by the providing unit 33 is the same as the method of generating the advertisement information using the advertisement generation AI by the server device 2.

[0179] [7. Hardware Configuration] Each of the terminal device 1 and the server device 2 according to the embodiment described above is realized by a computer 80 having a configuration as shown in Fig. 8. Fig. 8 is a hardware configuration diagram showing an example of the computer 80 that realizes each function of the terminal device 1 and the server device 2 according to the embodiment. The computer 80 has a CPU 81, a RAM 82, a ROM (Read Only Memory) 83, an HDD (Hard Disk Drive) 84, a communication interface (I / F) 85, an input / output interface (I / F) 86, and a media interface (I / F) 87.

[0180] The CPU 81 operates and controls each part based on a program stored in the ROM 83 or the HDD 84. The ROM 83 stores a boot program executed by the CPU 81 when the computer 80 is started up, and programs that depend on the hardware of the computer 80.

[0181] The HDD 84 stores programs executed by the CPU 81, data used by such programs, etc. The communication interface 85 receives data from other devices via the network N (see FIG. 2) and sends it to the CPU 81, and transmits data generated by the CPU 81 to other devices via the network N.

[0182] The CPU 81 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 86. The CPU 81 acquires data from the input devices via the input / output interface 86. The CPU 81 also outputs data generated via the input / output interface 86 to the output devices.

[0183] The media interface 87 reads a program or data stored in a recording medium 88 and provides it to the CPU 81 via the RAM 82. The CPU 81 loads the program from the recording medium 88 onto the RAM 82 via the media interface 87 and executes the loaded program. The recording medium 88 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0184] For example, when the computer 80 functions as the terminal device 1 according to the embodiment, the CPU 81 of the computer 80 executes a program loaded onto the RAM 82 to realize the function of the processing unit 18. In addition, the data in the storage unit 17 is stored in the HDD 84. The CPU 81 of the computer 80 reads and executes these programs from a recording medium 88, but as another example, these programs may be obtained from another device via the network N.

[0185] Furthermore, when the computer 80 functions as the server device 2 according to the embodiment, the CPU 81 of the computer 80 executes the programs loaded onto the RAM 82 to realize the functions of the processing unit 42. Furthermore, the data in the storage unit 41 is stored in the HDD 84. The CPU 81 of the computer 80 reads and executes these programs from the recording medium 88, but as another example, these programs may be obtained from another device via the network N.

[0186] [8. Other] In addition, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.

[0187] In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.

[0188] For example, the above-mentioned terminal device 1 and server device 2 may be realized as information processing devices using a terminal device and a server computer, or multiple server computers. Furthermore, depending on the function, the configuration can be flexibly changed, such as by calling an external platform using an API or network computing.

[0189] Furthermore, the above-described embodiments and modifications can be appropriately combined as long as the processing contents are not contradictory.

[0190] [9. Effects] As described above, the terminal device 1 according to the embodiment is an example of an information processing device, and includes an acquisition unit 30, an estimation unit 31, and a provision unit 33. The acquisition unit 30 acquires user information, which is information about a user U, and physical store information, which is information about a physical store. The estimation unit 31 inputs information including the user information and physical store information acquired by the acquisition unit 30 as input information to an AI agent or a trained model that generates and outputs information according to the input information, and causes the AI ​​agent or trained model to estimate whether the user U will use the physical store when advertising information of the physical store is provided to the user U. The provision unit 33 provides advertising information of the physical store to the user U when it is estimated by the estimation unit 31 that the user U will use the physical store. This allows the terminal device 1 to appropriately provide advertising information to the user.

[0191] Furthermore, the providing unit 33 provides information on actual stores within a predetermined range from the current location of the user U as actual store information to the user U. This allows the terminal device 1 to appropriately provide advertising information to the user.

[0192] The advertisement information also includes benefit information that is information about benefits that can be used by the user U in a physical store. This allows the terminal device 1 to appropriately provide the advertisement information to the user.

[0193] The information processing device also includes a determination unit 32 that determines the benefit that the user U will obtain by using the benefit based on the user information and the actual store information, and the provision unit 33 provides, as advertising information, information including, as benefit information, information on the benefit according to the benefit determined by the determination unit 32. This allows the terminal device 1 to appropriately provide the advertising information to the user.

[0194] In addition, the acquisition unit 30 acquires information on advertisements for physical stores generated by AI based on the user information and the physical store information as advertisement information 51, and the provision unit 33 provides the advertisement information 51 acquired by the acquisition unit 30 to the user U. This allows the terminal device 1 to appropriately provide advertisement information to the user.

[0195] Furthermore, the user information includes one or more of information on attributes of the user U, information on the behavior history of the user U, and information on the context of the user U. This allows the terminal device 1 to appropriately provide advertisement information to the user.

[0196] Furthermore, the providing unit 33 uses the screen of the chat application to provide the advertisement information to the user U. This allows the terminal device 1 to appropriately provide the advertisement information to the user.

[0197] The above describes the embodiment of the present application in detail based on the drawings, but this is merely an example, and the present invention can be implemented in other forms that include various modifications and improvements based on the knowledge of those skilled in the art, including the forms described in the Disclosure of the Invention section.

[0198] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit", etc. For example, an acquisition section can be read as an acquisition means or an acquisition circuit. [Explanation of symbols]

[0199] 1,3 Terminal equipment 2. Server equipment 10,40 Communications Department 11 Display section 12 Control section 13 Audio input section 14 Audio output section 15 Imaging unit 16 Sensor section 17,41 Storage section 18,42 Processing section 30 Acquisition Department 31 Estimation part 32 Decision Section 33 Providing Department 100 Information Processing Systems N Network

Claims

1. An acquisition unit that acquires user information that is information about a user and physical store information that is information about a physical store; an estimation unit that inputs information including the user information and the physical store information acquired by the acquisition unit as input information to an AI agent or a trained model that generates and outputs information according to input information, and causes the AI ​​agent or the trained model to estimate whether the user will use the physical store when advertising information for the physical store is provided to the user; a providing unit that provides advertising information of the brick-and-mortar store to the user when the estimating unit estimates that the user will use the brick-and-mortar store.

23. An information processing apparatus comprising:

2. The providing unit is Provide the user with information about brick-and-mortar stores within a predetermined range from the user's current location as the brick-and-mortar store information.

2. The information processing apparatus according to claim 1,

3. The advertising information is Benefit information that is information about benefits that can be used by the user at the brick-and-mortar store 3. The information processing apparatus according to claim 2.

4. a determination unit that determines a benefit that the user can obtain by using the benefit based on the user information and the physical store information; The providing unit is Provide information including information on a benefit according to the profit determined by the determination unit as the benefit information as the advertisement information.

4. The information processing apparatus according to claim 3.

5. The acquisition unit is Acquire, as the advertisement information, information on an advertisement for the brick-and-mortar store generated based on the user information and the brick-and-mortar store information; The providing unit is The advertisement information acquired by the acquisition unit is provided to the user.

5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

6. The user information is The information includes at least one of information on the attributes of the user, information on the behavior history of the user, and information on the context of the user.

5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

7. The providing unit is The advertisement information is provided to the user using a chat application screen.

5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

8. 1. A computer-implemented information processing method, comprising: An acquisition step of acquiring user information which is information about a user and physical store information which is information about a physical store; an estimation process of inputting information including the user information and the physical store information acquired by the acquisition process as input information to an AI agent or a trained model that generates and outputs information according to the input information, and having the AI ​​agent or the trained model estimate whether the user will use the physical store when advertising information for the physical store is provided to the user; and a providing step of providing advertising information of the physical store to the user when the estimating step estimates that the user will use the physical store.

23. An information processing method comprising:

9. An acquisition step of acquiring user information, which is information about a user, and physical store information, which is information about a physical store; an estimation step of inputting information including the user information and the physical store information acquired by the acquisition step as input information to an AI agent or a trained model that generates and outputs information according to input information, and having the AI ​​agent or the trained model estimate whether the user will use the physical store when advertising information for the physical store is provided to the user; a providing step of providing advertising information of the brick-and-mortar store to the user when the estimating step estimates that the user will use the brick-and-mortar store.

2. An information processing program comprising:

Images