Information processing device and information processing program

Abstract

To provide an information processing device capable of flexibly performing promotional activities, and an information processing program.SOLUTION: An information processing device of an embodiment comprises: a receiving unit which receives surrounding environment information related to the surrounding environment of a store and customer information related to customers present in the store; a first acquisition unit which acquires text information in which the states of the store and customers represented in the surrounding environment information and customer information have been converted into text; a second acquisition unit which inputs the states of the store and customers represented in the text information into a large language model configured to generate promotional text for products corresponding to the states, and acquires the promotional text; and a providing unit which provides the customers with the promotional text acquired by the second acquisition unit.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] An embodiment of the present invention relates to an information processing device and an information processing program. [Background technology]

[0002] In recent years, a technology has been proposed for automatically creating sentences using an AI model called a large-scale language model (LLM). A large-scale language model is an AI model in the field of natural language processing that has been pre-trained with a large-scale corpus, and is configured to generate and output a response to the query (hereinafter also referred to as provided information) in the specified format when, for example, text describing the content of an inquiry is input together with instruction information (also referred to as a prompt) that indicates the output format.

[0003] Incidentally, in stores such as restaurants and supermarkets, a service of recommending products such as menu items to customers who visit the store may be provided in order to promote sales of the products.

[0004] For example, a technology has been proposed to create promotional content based on weather data obtained from an external server and the attributes of viewers viewing digital signage. However, with this technology, the promotional content created is in the form of a list of products being promoted, which makes it inflexible. Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the present invention is to provide an information processing device and an information processing program that enable flexible sales promotion activities. [Means for solving the problem]

[0006] The information processing device of the embodiment includes a receiving unit that receives surrounding environment information regarding the surrounding environment of a store and customer information regarding customers present in the store; a first acquisition unit that acquires text information that converts the status of the store and customer represented in the surrounding environment information and the customer information into text; a second acquisition unit that inputs the status of the store and customer represented in the text information into a large-scale language model that is functionalized to generate promotional text for a product corresponding to the status when the status of the store and customer is input, and acquires the promotional text; and a provision unit that provides the promotional text acquired by the second acquisition unit to customers. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a schematic diagram showing a schematic configuration of an information processing system according to this embodiment. [Figure 2] FIG. 2 is a block diagram showing an example of the hardware configuration of the information processing device according to this embodiment. [Figure 3] FIG. 3 is a block diagram showing an example of the functional configuration of the information processing device according to this embodiment. [Figure 4] FIG. 4 is a schematic diagram showing an example of promotional text according to this embodiment. [Figure 5] FIG. 5 is a flowchart showing an example of control processing of the information processing device according to this embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, an embodiment of an information processing system will be described with reference to the drawings. Furthermore, the present invention is not limited to the following embodiments, and the components in the following embodiments include those that would be easily conceived by a person skilled in the art, those that are substantially the same, and those that are within the scope of what is called equivalents. Furthermore, various omissions, substitutions, modifications, and combinations of the components can be made without departing from the spirit of the following embodiments.

[0009] 1 is a schematic diagram showing a general configuration of an information processing system 10 according to an embodiment. The information processing system 10 is a system including an input device 1, an information processing device 2, and a display device 3. The input device 1 includes a voice input device 11, a surrounding environment input device 12, and an IC reader 13. To explain the embodiment more specifically, the information processing system 10 will be described as being applied in a restaurant.

[0010] The voice input device 11 is, for example, a microphone that inputs the voice of a customer. The voice input device 11 acquires voice data of the customer and outputs the acquired voice data to the information processing device 2. The voice data includes conversations between customers present in the restaurant.

[0011] The surrounding environment input device 12 is, for example, a device that inputs the state of the surrounding environment inside a restaurant. The surrounding environment input device 12 is, for example, a camera, a thermometer, a hygrometer, etc. The camera acquires captured image data that captures, for example, the surrounding state of customers present in the restaurant or customers eating menu items provided by the restaurant, and outputs the captured captured image data to the information processing device 2. The captured image data includes, for example, the faces of customers present in the restaurant and the progress status of the menu items provided, such as how much is left.

[0012] The thermometer, for example, acquires temperature data at a location in a restaurant where a customer is present, and outputs the acquired temperature data to the information processing device 2. The hygrometer, for example, acquires humidity data at a location in a restaurant where a customer is present, and outputs the acquired humidity data to the information processing device 2. Data including at least the audio data of customer conversations output by the input device 1, captured image data of customer faces, temperature data within the store, and humidity data within the store is also collectively referred to as surrounding environment information.

[0013] IC reader 13 is, for example, a device that identifies a customer present in a restaurant. IC reader 13 acquires customer information from, for example, an IC card used by the customer at the restaurant, and outputs the acquired customer information to information processing device 2. The customer information includes at least an identification number that identifies the customer and information about the customer's past transactions at the store.

[0014] The input device 1 may be provided at each seat (or table) in the restaurant. In this case, the input device 1 may be provided at each table in the form of a tablet terminal or the like, and may also serve as an order receiving terminal that receives menu orders from customers. Also, for example, one or more thermometers and hygrometers among the input devices 1 may be provided inside and / or outside the restaurant.

[0015] The information processing device 2 is, for example, a store server or a server device managed by a company that operates a restaurant. In this embodiment, the information processing device 2 is, for example, a computer equipped with a generation AI that automatically generates text such as a large-scale language model (LLM). The large-scale language model generates promotional text for products and menus, and input text for generating promotional text to be provided to customers who use the store or restaurant. The information processing device 2 is composed of one or more computers.

[0016] The information processing device 2 supports sales promotion of products (also called menus) sold at restaurants based on various information acquired via the input device 1. The information processing device 2 is connected to the input device 1 via a communication line such as a mobile network. The information processing device 2 is also connected to the display device 3 via a communication line such as a mobile network.

[0017] The display device 3 is a device that the restaurant provides to customers within the store. The display device 3 is composed of one or more computers. The display device 3 is, for example, a device through which customers check the menu offered by the restaurant and place orders. The display device 3 is connected to the information processing device 2 via a communication line such as a mobile network. When the input device 1 is installed at each table, the input device 1 and the display device 3 may be realized by the same terminal device.

[0018] Next, the hardware configuration of the information processing device 2 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the hardware configuration of the information processing device 2 according to this embodiment. As shown in Fig. 2, the information processing device 2 includes a CPU (Central Processing Unit) 21, a RAM (Random Access Memory) 22, a ROM (Read Only Memory) 23, an auxiliary storage device 24, and a communication I / F (interface) 25.

[0019] The CPU 21 is the main controller. The RAM 22 expands programs and various data. The ROM 23 stores various programs. The auxiliary storage device 24 stores various programs and data. The communication I / F 25 is an interface for data communication with the input device 1 and the display device 3.

[0020] The CPU 21, RAM 22, ROM 23, auxiliary storage device 24, and communication I / F 25 are connected to one another via a bus 26. The CPU 21, RAM 22, and ROM 23 constitute a control unit. That is, the control unit executes control processing of the information processing device 2, which will be described later, by the CPU 21 operating in accordance with a control program stored in the ROM 23 or auxiliary storage device 24 and loaded in the RAM 22.

[0021] The auxiliary storage device 24 is composed of a non-volatile memory such as an HDD (Hard Disc Drive) or flash memory that retains stored information even when the power is turned off. The auxiliary storage device 24 stores product information about products offered in the store, surrounding environment information acquired from the input device 1, customer information, text information acquired by the information processing device 2, input text generated by the information processing device 2, and promotional text. Details of the text information, input text, and promotional text will be described later.

[0022] It is preferable that the information processing device 2 is installed in a secure environment. A secure environment is a configuration in which the information processing device 2 is installed and used in a local environment such as inside a restaurant. The auxiliary storage device 24 contains confidential information such as customer information, audio data of customer conversations, and image data of customer faces, so installing and using the information processing device 2 in a local environment can contribute to the protection of personal information.

[0023] Fig. 3 is a block diagram showing an example of the functional configuration of the information processing device 2 according to this embodiment. As shown in Fig. 3, the information processing device 2 includes a receiving unit 211, a first acquiring unit 212, a second acquiring unit 213, a third acquiring unit 214, a providing unit 215, and a deleting unit 216. Note that the functional configuration of the information processing device 2 is not limited to this.

[0024] The receiving unit 211 receives surrounding environment information related to the surrounding environment within the store and customer information related to customers present within the store. Specifically, the receiving unit 211 receives surrounding environment information related to the surrounding environment within the store and customer information related to customers present within the store, which are output by the input device 1. The receiving unit 211 also stores the received surrounding environment information and customer information in the auxiliary storage device 24.

[0025] The first acquisition unit 212 acquires text information that has been obtained by converting the status of the store and the customer represented in the surrounding environment information and the customer information into text. Specifically, the first acquisition unit 212 acquires text information that has been obtained by converting the status of the store and the customer represented in the surrounding environment information and the customer information into text from the surrounding environment information and the customer information received by the receiving unit 211.

[0026] For example, the first acquisition unit 212 performs speech recognition processing, natural language processing (NLP), image recognition processing, etc. on the surrounding environment information and the customer information using a known method to convert the states represented in the surrounding environment information and the customer information into text and acquires the text information. The first acquisition unit 212 also stores the acquired text information in the auxiliary storage device 24.

[0027] The second acquisition unit 213 cooperates with the large-scale language model to acquire an input sentence that represents the state of the store and the customer that is expressed in the text information. Specifically, the second acquisition unit 213 inputs the text information and instruction information (also called a prompt) that instructs the generation of an input sentence from the text information into the large-scale language model (LLM) using a known method, thereby causing the large-scale language model to generate an input sentence that represents the state of the customer and the store.

[0028] Then, the second acquisition unit 213 acquires the input sentence generated by the large-scale language model. The input sentence includes, for example, at least the customer's state, the customer's surrounding environment, and store information related to the customer's store (restaurant). Here, the store information is a menu that can be provided to the customer at the store.

[0029] The second acquisition unit 213 generates a first prompt stating, for example, that in order to acquire the state of the customer from the text information, the menu item ordered by the customer should be extracted from the text-converted voice data, etc. Also, the second acquisition unit 213 generates a second prompt stating, for example, that in order to acquire the surrounding environment of the customer, the temperature included in the temperature data, the humidity included in the humidity data, the estimated age, sex, number of people occupying the seat, the state of the customer's face (for example, sweating, etc.), and the progress state such as the amount of the menu item being served should be extracted from the captured image.

[0030] Furthermore, the second acquisition unit 213 generates a third prompt stating, for example, that in order to grasp information related to the customer's restaurant, information on the restaurant's menu and customer preferences contained in the customer information and past transaction information should be extracted. The second acquisition unit 213 stores the acquired input sentence in the auxiliary storage device 24.

[0031] Then, when the states of the store and the customer are input, the second acquisition unit 213 acquires promotional text into which the states of the store and the customer expressed in the text information are input, from a large-scale language model that is functionally configured to generate promotional text for a product corresponding to the states. Specifically, the second acquisition unit 213 inputs the input text including the acquired states of the store and the customer into the large-scale language model, and acquires promotional text into which the states of the store and the customer expressed in the text information are input, from a large-scale language model that is functionally configured to generate promotional text for a product corresponding to the states.

[0032] The second acquisition unit 213 inputs the acquired input text and instruction information instructing the generation of product promotional text from the input text into the large-scale language model, and acquires the promotional text generated by the large-scale language model. The promotional text includes at least a product recommended to the customer and text related to the promotion of the product. Here, the product is a menu item that can be offered to customers in the store.

[0033] For example, the second acquisition unit 213 inputs an input sentence and instruction information for generating promotional text to be provided to customers that corresponds to the input sentence into a large-scale language model using a known method, thereby causing the large-scale language model to generate promotional text based on the input sentence, and acquires the promotional text generated by the large-scale language model.

[0034] For example, in order to generate a promotional text, the second acquisition unit 213 generates a fourth prompt stating, for example, "This is a restaurant. You are a waitress. Please sell the product to the customer. From the input text, please generate a message to ask the customer to order an additional highball, which is one of the menu items." The second acquisition unit 213 stores the acquired promotional text in the auxiliary storage device 24. Note that the first prompt, second prompt, third prompt, and fourth prompt may be prepared in advance in the auxiliary storage device 24, or may be dynamically generated by the second acquisition unit 213.

[0035] The third acquisition unit 214 acquires product information about the product indicated in the promotional text. Specifically, the third acquisition unit 214 acquires the product information about the product indicated in the promotional text acquired by the second acquisition unit 213 from the auxiliary storage device 24. The product information is information including, for example, a menu image of the product, the menu price of the product, and special notes about the product. Here, the special notes are information about a limited-time sale. The third acquisition unit 214 associates the acquired product information with the promotional text and stores it in the auxiliary storage device 24.

[0036] The provision unit 215 provides the promotional text to the customer. Specifically, the provision unit 215 provides the promotional text acquired by the second acquisition unit 213 to the customer via the display device 3. The provision unit 215 also provides the promotional text together with product information to the customer. Specifically, the provision unit 215 provides the promotional text acquired by the second acquisition unit 213 to the customer via the display device 3 together with the product information acquired by the third acquisition unit 214. Here, the promotional text and product information provided to the customer via the display device 3 will be described with reference to FIG. 4.

[0037] Fig. 4 is a schematic diagram showing an example of a promotional text according to this embodiment. Fig. 4 shows a message 31 included in the promotional text, and a menu image 32, menu price 33, and special notes 34 included in the product information, all output to the display device 3. Fig. 4 shows the menu image 32, menu price 33, and special notes 34 corresponding to a highball as the product included in the message 31.

[0038] This allows customers to understand recommended information for the restaurant by checking the promotional text output on the display device 3. In addition, the information processing device 2 acquires changes in the customer's situation and the customer's surrounding environment in real time, so it can provide customers with information that is in line with the changes in situation. Furthermore, in the restaurant, suggestions are automatically made to customers via the display device 3, which increases the chances of receiving more orders and ultimately leads to an increase in the average customer spending.

[0039] Returning to FIG. 3, the deletion unit 217 deletes the surrounding environment information, customer information, text information, input text, promotional text, and product information. Specifically, when a customer performs a payment process at a store, the deletion unit 217 deletes the surrounding environment information, customer information, text information, input text, promotional text, and product information stored in the auxiliary storage device 24. This is because the above-mentioned information differs for each customer, and therefore becomes unnecessary once the customer performs the payment process. This allows the information processing device 2 to reduce the risk of confidential information being leaked.

[0040] Next, the control process of the information processing device 2 will be described with reference to Fig. 5. Fig. 5 is a flowchart showing an example of the control process of the information processing device 2 according to this embodiment.

[0041] The receiving unit 211 receives surrounding environment information related to the surrounding environment within the store and customer information related to customers present in the store (step S51). Subsequently, the first acquiring unit 212 acquires text information from the surrounding environment information and customer information received by the receiving unit 211 (step S52).

[0042] Next, the second acquisition unit 213 cooperates with the large-scale language model to acquire an input sentence that represents the state of the store and the customer represented in the text information (step S53). Next, the second acquisition unit 213 inputs the input sentence into the large-scale language model, and acquires promotional text that includes the state of the store and the customer represented in the text information, from the large-scale language model that is functionally configured to generate promotional text for a product corresponding to the state (step S54).

[0043] Next, the third acquisition unit 214 acquires product information about the product indicated in the promotional text acquired by the second acquisition unit 213 from the auxiliary storage device 24 (step S55). The provision unit 215 provides the promotional text acquired by the second acquisition unit 213 to the customer via the display device 3 (step S56). The provision unit 215 also provides the promotional text together with the product information to the customer. When this process ends, the processing of the information processing device 2 ends. This allows the customer to check the promotional text output on the display device 3.

[0044] As described above, the information processing device 2 of this embodiment receives surrounding environment information about the store's surrounding environment and customer information about customers present in the store, acquires text information that converts the status of the store and customer represented in the surrounding environment information and customer information into text, and when the status of the store and customer is input, inputs the status of the store and customer represented in the text information into a large-scale language model that is functionally configured to generate promotional text for products corresponding to that status, acquires the promotional text, and provides the acquired promotional text to the customer.

[0045] As a result, the information processing device 2 can provide flexible sales promotion messages to customers by using the store's surrounding environment and customer information, which allows stores such as restaurants and supermarkets to flexibly carry out sales promotion activities for customers who use the store to promote product sales.

[0046] The above-described embodiment can be modified as needed by partially changing the configuration or functions of each of the above-described devices. Therefore, several modifications of the above-described embodiment will be described below as other embodiments. The following mainly focuses on differences from the above-described embodiment, and detailed descriptions of commonalities with the content already described will be omitted. The modifications described below may be implemented individually or in appropriate combination.

[0047] (First Modification) In the above-described embodiment, the display device 3 to which the information processing device 2 outputs is described as being used in a restaurant, but the present invention is not limited to this. For example, the display device 3 to which the information processing device 2 outputs may be a mobile terminal lent to customers by a store such as a supermarket. Furthermore, the input device 1 of the information processing system 10 in the first modification need not be provided with the voice input device 11.

[0048] The mobile terminal is a portable terminal device such as a smartphone, etc. The mobile terminal is installed with an application for registering products and performing accounting procedures in a store, and is used for shopping in the store.

[0049] The information processing device 2 in the first modified example acquires the surrounding environment information output by the surrounding environment input device 12 and the text information output from the customer information output by the IC reader 13.

[0050] (Second Modification) In the above-described embodiment, the information processing device 2 equipped with a large-scale language model is configured to be deployed and used in a local environment, but this is not limiting, and the information processing device 2 equipped with a large-scale language model may also be configured to be deployed and used in a highly secure cloud environment. A highly secure cloud environment is a cloud environment that is not disclosed on the Internet and is connected to an in-house server environment via a highly confidential communication line.

[0051] (Third Modification) For example, confidential information may be included in the surrounding environment information about the surrounding environment within the store and the customer information about the customers present within the store, both of which are received by the receiving unit 211 of the information processing device 2. Here, the confidential information includes, for example, the above-mentioned customer information, as well as elements indicating customer information such as the customer's name, telephone number, email address, and the name of the company to which the customer belongs.

[0052] Therefore, the first acquisition unit 212 of the information processing device 2 may acquire text information in which elements that meet predetermined conditions are removed as confidential information from text information that has been converted into text the status of the store and the customer represented in the surrounding environment information and the customer information. Elements that meet predetermined conditions are elements related to confidential information. The first acquisition unit 212 stores the text information in the auxiliary storage device 24, in which elements that meet predetermined conditions are removed as confidential information.

[0053] (Fourth Modification) For example, the display device 3 may be provided with a speaker that outputs sound. By providing the speaker, the display device 3 can output sound corresponding to the promotional text.

[0054] The program executed by the information processing device 2 of the embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the program executed by the information processing device 2 of the embodiment and the modified example may be provided or distributed via a network such as the Internet.

[0055] The programs executed by each device in the above-described embodiments are provided in a state where they are pre-installed in a ROM, an auxiliary storage device, etc. The programs executed by each device in the above-described embodiments may be provided by being recorded in an installable or executable file format on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (Digital Versatile Disk).

[0056] Furthermore, the programs executed by each device of the above-described embodiments may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network.Furthermore, the programs executed by each device of the above-described embodiments may be provided or distributed via a network such as the Internet.

[0057] Although the embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments and their modifications can be embodied in various other forms, and various omissions, substitutions, changes, and combinations can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the inventions and their equivalents as defined in the claims. [Explanation of symbols]

[0058] 1. Input Device 2. Information processing equipment 3 Display device 10 Information Processing Systems 11 Voice input device 12 Surrounding environment input device 13 IC reader 211 Receiving unit 212 First acquisition part 213 Second Acquisition Department 214 Third Acquisition Department 215 Provision Department 216 Deleted section [Prior art documents] [Patent documents]

[0059] [Patent Document 1] Patent Publication No. 2021-51553

Claims

1. a receiving unit that receives surrounding environment information relating to the surrounding environment of the store and customer information relating to customers present in the store; a first acquisition unit that acquires text information that converts the surrounding environment information and the state of the store and the customer represented in the customer information into text; a second acquisition unit that acquires promotional texts based on the store and customer conditions expressed in the text information from a large-scale language model that is configured to generate promotional texts for products corresponding to the store and customer conditions when the store and customer conditions are input; a providing unit that provides the promotional text acquired by the second acquiring unit to the customer; An information processing device comprising:

2. a third acquisition unit that acquires product information related to the product indicated in the promotional text; the providing unit provides the promotional text together with the product information to the customer; The information processing device according to claim 1 .

3. the surrounding environment information includes at least voice data of the conversation of the customer, captured image data of the face of the customer, temperature data inside the store, and humidity data inside the store; The customer information includes at least an identification number that identifies the customer and past transaction information at the store. The information processing device according to claim 1 .

4. The promotional text includes at least a product recommended to the customer and a text about the promotion of the product; The product is a menu item that can be offered to the customer at the store. The information processing device according to claim 1 .

5. a deletion unit that deletes the surrounding environment information, the customer information, the text information, the sales promotion text, and the product information when the customer has completed payment processing at the store; The information processing device according to claim 2 .

6. The computer of the information processing device, a receiving unit that receives surrounding environment information relating to the surrounding environment of the store and customer information relating to customers present in the store; a first acquisition unit that acquires text information that converts the surrounding environment information and the state of the store and the customer represented in the customer information into text; a second acquisition unit that inputs the status of the store and the customer expressed in the text information into a large-scale language model that is configured to generate promotional text for a product corresponding to the status when the status of the store and the customer is input, and acquires the promotional text; a providing unit that provides the promotional text acquired by the second acquiring unit to the customer; An information processing program that makes it function as such.

7. a receiving unit that receives surrounding environment information related to a surrounding environment of a user and user information related to the user; a first acquisition unit that acquires text information that has been converted into text the surrounding environment and the state of the user; a second acquisition unit that inputs the surrounding environment and the state of the user into a large-scale language model that is configured to generate a provided sentence corresponding to the surrounding environment and the state of the user when the surrounding environment and the state of the user are input, and acquires the provided sentence; a providing unit that provides the provided text acquired by the second acquiring unit to the user; An information processing device comprising:

Images