Sales promotion support device and program

Abstract

To provide a sales promotion support device and program that enables the efficient provision of sales promotion services to customers. [Solution] The sales promotion support device of the embodiment includes: acquisition means for acquiring captured images from an imaging device that images customers who visit a store; extraction means for extracting feature quantities that indicate the characteristics of the customer from the captured images; control means for inputting first instruction information to a generation AI that generates response information according to the input information, instructing it to derive products according to the feature quantities; output means for outputting the response information generated by the generation AI to the customer; and reception means for receiving a first operation to instruct the reception means to stop outputting the response information. When the reception means receives the first operation, the control means stops outputting the response information and inputs second instruction information to the generation AI instructing it to create information that notifies that the output of the response information has been stopped. The output means outputs the response information generated by the generation AI according to the second instruction information.

Description

Technical Field

[0001] Embodiments of the present invention relate to a sales promotion support device and a program.

Background Art

[0002] Conventionally, as part of sales promotion activities, stores provide a service of recommending products such as coordination to customers who visit the store. For example, store clerks make responses such as recommending products suitable for customers from the products sold in the store.

[0003] In recent years, generative AI (Artificial Intelligence) such as large language models has attracted attention. The accuracy of generative AI is improving day by day, and technologies for making product recommendations and the like using generative AI that generates text have also been proposed. For example, based on information indicating the characteristics of a customer obtained by imaging or the like, for example, by generating and outputting text related to products placed in the store, products can be recommended without an explicit operation by the customer.

[0004] By the way, in the above-described generative AI, although it is possible to automatically generate text, the generated text does not necessarily include content that is interesting to the customer. However, in the conventional technology, even when text containing content that is not interesting to the customer is generated, the customer cannot stop the output of the text midway, and there is a possibility that unnecessary text will continue to be output.

Summary of the Invention

Problems to be Solved by the Invention

[0005] The problem to be solved by the present invention is to provide a sales promotion support device and a program capable of efficiently providing a sales promotion service to customers.

Means for Solving the Problems

[0006] The sales promotion support device of the embodiment includes an acquisition means for acquiring captured images from an imaging device that images customers visiting a store, an extraction means for extracting feature quantities that indicate the characteristics of the customer from the captured images, a control means for inputting first instruction information to a generation AI that generates response information according to the input information, instructing it to derive products according to the feature quantities, an output means for outputting the response information generated by the generation AI to the customer, and a reception means for receiving a first operation to instruct the reception means to stop outputting the response information. When the reception means receives the first operation, the control means stops outputting the response information and inputs second instruction information to the generation AI instructing it to create information that notifies that the output of the response information has been stopped. The output means outputs the response information generated by the generation AI according to the second instruction information. [Brief explanation of the drawing]

[0007] [Figure 1] Figure 1 shows an example of the system configuration of the sales promotion support system according to the embodiment. [Figure 2] Figure 2 shows an example of the hardware configuration of the sales promotion support device according to the present invention. [Figure 3] Figure 3 shows an example of the hardware configuration of a server device according to this embodiment. [Figure 4] Figure 4 is a diagram showing an example of the functional configuration of the sales promotion support device and server device according to the embodiment of this embodiment. [Figure 5] Figure 5 is a flowchart showing an example of the processing performed by the sales promotion support device of the embodiment. [Modes for carrying out the invention]

[0008] The following description of the sales promotion support device and program according to the embodiment will be given with reference to the drawings. The following embodiment describes an example applied to a store that sells goods such as clothing, but is not limited to this embodiment.

[0009] Figure 1 shows an example of the system configuration of a sales promotion support system according to the embodiment. The sales promotion support system 1 includes a sales promotion support device 10 and a server device 30. The sales promotion support device 10 and the server device 30 are connected to each other via a network N so as to be able to communicate.

[0010] Network N can utilize the Internet, VPN (virtual private network), LAN (local area network), public communication network, mobile communication network, etc., individually or in appropriate combinations. In this embodiment, a LAN installed within a store is used as an example of network N. The number of sales promotion support devices 10 in the sales promotion support system 1 is not limited to the illustrated example.

[0011] The sales promotion support device 10 is an example of a sales promotion support device and is installed in one or more units within the store. The sales promotion support device 10 serves as the point of contact between customers who visit the store and the sales promotion support system 1. The sales promotion support device 10 can be implemented using, for example, an information display device such as digital signage.

[0012] The sales promotion support device 10 is equipped with various input / output devices such as a display unit 21, an operation unit 22, an imaging unit 23, an audio input unit 24, and an audio output unit 25. The sales promotion support device 10 acquires customer information via input devices such as the imaging unit 23 and transmits instruction information (hereinafter also referred to as a prompt) containing inquiry content based on that information to the server device 30. When the sales promotion support device 10 receives a response to the prompt from the server device 30, it outputs response information based on the received response via an output device. The prompt will be described later.

[0013] The server device 30 is, for example, a server device installed in the back room of a store. The server device 30 has a generative AI (Artificial Intelligence) function specialized for natural language processing. When a prompt is sent from the sales promotion support device 10, the server device 30 uses its generative AI function to generate a response text corresponding to the content of the prompt's inquiry, and sends the generated response text to the sales promotion support device 10.

[0014] Although Figure 1 shows the server device 30 as a single device, in practice, the server device 30 may be realized through the cooperation of multiple devices. Furthermore, the server device 30 may be a cloud server (or cloud system) realized by multiple network-connected devices.

[0015] Next, the configuration of the sales promotion support device 10 and the server device 30 described above will be explained.

[0016] Figure 2 shows an example of the hardware configuration of the sales promotion support device 10 according to the embodiment. The sales promotion support device 10 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a communication unit 14, and a storage unit 15.

[0017] The CPU 11 is an example of a processor that comprehensively controls the operation of the sales promotion support device 10. The ROM 12 stores various programs. The RAM 13 is a workspace for displaying programs and various data.

[0018] The CPU 11, ROM 12, and RAM 13 are connected via a bus or the like to form a control unit 100 of the computer configuration. In the control unit 100, the CPU 11 operates according to a program stored in the ROM 12 or memory unit 15 and loaded into the RAM 13, thereby executing various processes.

[0019] The communication unit 14 is a wired or wireless communication interface that can be connected to the network N. The communication unit 14 communicates with external devices such as the server device 30 via the network N.

[0020] The storage unit 15 has a storage medium such as an HDD (Hard Disk Drive) or a flash memory, and maintains the stored content even when the power is turned off. The storage unit 15 stores programs 151 that can be executed by the CPU 11 and various setting information. For example, the program 151 includes programs for realizing the functional configurations described later.

[0021] In addition, the storage unit stores a product master 152 that stores information about products handled in the store. The product master 152 stores information such as the product name, unit price, product image, display location, etc. of the product corresponding to the product code in association with the product code that can identify the type of the product.

[0022] The product code is information (identification information) that can uniquely identify a product, and is, for example, a JAN (Japanese Article Number) code. The product name is the name of the product. The unit price is the price of one product. The product image is image data showing the appearance of the product. The display location is information indicating the location within the store where the product is displayed.

[0023] In this embodiment, the sales promotion support device 10 has a configuration that holds the product master 152. However, the present invention is not limited to this, and an external device (for example, the server device 30) accessible by the sales promotion support device 10 may hold the product master 152.

[0024] The sales promotion support device 10 also includes the above-described display unit 21, operation unit 22, imaging unit 23, voice input unit 24, voice output unit 25, etc.

[0025] The display unit 21 is a display device such as a liquid crystal display. The display unit 21 displays various information under the control of the control unit 100.

[0026] The operation unit 22 is an input device for receiving customer operations and has various control elements (operation buttons). For example, the operation unit 22 has a cancel button 221 for instructing the cancellation (stopping) of output of response information and an additional explanation button 222 for instructing additional explanation. The cancel button 221 is an example of a receiving means for receiving a first operation. The additional explanation button 222 is an example of a receiving means for receiving a second operation.

[0027] The operation unit 22 may be a touch panel provided on the surface of the display unit 21. For example, the cancel button 221 and the additional explanation button 222 may be operators (software keys) displayed on the display unit 21.

[0028] The imaging unit 23 is an imaging device having an image sensor such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor). The imaging unit 23 captures images of customers approaching the sales promotion support device 10 and generates an image showing the customer's appearance. Specifically, the imaging unit 23 is positioned to capture customers located on the display surface side of the display unit 21 and captures images of customers approaching the sales promotion support device 10. The images generated by the imaging unit 23 may be still images or moving images. Hereafter, the images captured by the imaging unit 23 will also be referred to as "captured images".

[0029] The voice input unit 24 is an example of a receiving means. The voice input unit 24 is a sound collection device equipped with a voice input device such as a microphone. The voice input unit 24 accepts voice input. The voice output unit 25 is a voice output device equipped with a voice output device such as a speaker and a voice synthesis function. The voice output unit 25 outputs voice under the control of the control unit 100.

[0030] Figure 3 shows an example of the hardware configuration of a server device 30 according to this embodiment. The server device 30 includes a CPU 31, ROM 32, RAM 33, communication unit 34, and storage unit 35.

[0031] The CPU 31 is an example of a processor that comprehensively controls the operation of the server device 30. The ROM 32 stores various programs. The RAM 33 is a workspace for displaying programs and various data.

[0032] The CPU 31, ROM 32, and RAM 33 are connected via a bus or the like to form a control unit 300 of the computer configuration. In the control unit 300, the CPU 31 operates according to a program stored in the ROM 32 or memory unit 35 and loaded into the RAM 33, thereby executing various processes.

[0033] The communication unit 34 is a wired or wireless communication interface that can be connected to the network N. The communication unit 34 communicates with external devices such as the sales promotion support device 10 via the network N.

[0034] The storage unit 35 has a storage medium such as an HDD or flash memory, and retains its contents even when the power is cut off. The storage unit 35 stores programs 351 that the CPU 31 can execute, as well as various setting information. For example, the program 351 includes a program for realizing the functional configuration described later.

[0035] Furthermore, the memory unit 35 stores the generation AI 352. The generation AI 352 is an example of a generation AI that generates text data, and is implemented, for example, by a large language model (LLM). When a prompt containing the content of an inquiry is input to the generation AI 352, it generates and outputs text (answer text) according to the instructions of the prompt. For example, the prompt can include not only the content of the inquiry, but also conditions to narrow down the direction and range of the answer text to be generated by the generation AI 352, as well as the style and level of the answer text.

[0036] For example, when the generating AI352 receives a prompt that describes the customer's characteristics and instructs it to derive products to recommend to the customer (hereinafter also referred to as recommended products), it generates text about the products selected based on the customer's characteristics and outputs it as a response. In this case, the response generated by the generating AI352 includes, for example, basic information such as the product name of the selected product, as well as text that promotes the product's features, etc.

[0037] Furthermore, when the generating AI352 receives a prompt instructing it to stop generating a response, it generates text such as a message informing the user to stop generating the response or an apology for generating an unnecessary response, and outputs it as a response. For example, when the generating AI352 receives a prompt such as "Please stop the explanation," it generates a response such as "Excuse me, please enjoy your shopping."

[0038] Furthermore, when the generating AI352 receives a prompt that instructs it to output additional response text, it generates text that provides more detailed explanations of the previously generated response text and outputs it as the response text.

[0039] The generated AI352 shall be generated using known deep learning techniques, but the method of generation is not particularly limited. For example, the generated AI352 may be fine-tuned based on information about products handled in the store.

[0040] Figure 4 shows an example of the functional configuration of the sales promotion support device 10 and server device 30 according to the embodiment. For the sake of clarity, Figure 4 also includes some of the hardware configurations described above.

[0041] The control unit 100 of the sales promotion support device 10 functions as an image acquisition unit 101, a detection unit 102, a voice recognition unit 103, a sales promotion control unit 104, a display control unit 105, and a voice output control unit 106, with the CPU 11 operating according to a program 151 stored in the ROM 12 and the storage unit 15. Some or all of these functions may be implemented by hardware such as dedicated circuits.

[0042] Furthermore, the control unit 300 of the server device 30 functions as a reception unit 301 and a response provision unit 302, with the CPU 31 operating according to the program 351 stored in the ROM 32 and the storage unit 35. Some or all of these functions may be implemented by hardware such as dedicated circuits.

[0043] The image acquisition unit 101 of the sales promotion support device 10 is an example of an acquisition means. The image acquisition unit 101 sequentially acquires the captured images taken by the imaging unit 23. The image acquisition unit 101 also stores the captured images for a predetermined period of time in the RAM 13 or the like.

[0044] The detection unit 102 of the sales promotion support device 10 is an example of an extraction means. The detection unit 102 detects the area where a person, i.e., a customer, is located (hereinafter referred to as the "person area") from the captured image acquired by the image acquisition unit 101. The technology for detecting the person area is not particularly limited, and known technologies can be used. For example, the detection unit 102 may detect the person area from the captured image by using image recognition technology such as face recognition or skeletal detection.

[0045] Furthermore, the detection unit 102 extracts feature quantities that represent the customer's physical characteristics from the person area. For example, the detection unit 102 extracts feature quantities such as the face and hairstyle from the customer's face image displayed in the person area. Also, for example, the detection unit 102 extracts the customer's physique as a feature quantity from the person area. Also, for example, the detection unit 102 obtains the characteristics of the customer's clothing (patterns, colors, shapes, etc.) and coordination as feature quantities from the person area. Also, for example, the detection unit 102 extracts the customer's age group and gender as feature quantities from the person area. Note that there are no particular restrictions on the method of feature extraction, and known technologies such as image feature extraction and AI models for estimating age and gender can be used.

[0046] The speech recognition unit 103 of the sales promotion support device 10 recognizes the speech input via the speech input unit 24 and converts it into text. The speech recognition unit 103 also outputs the converted text to the sales promotion control unit 104. It should be noted that known technologies can be used for the speech recognition.

[0047] The sales promotion control unit 104 of the sales promotion support device 10 is an example of a control means. The sales promotion control unit 104 generates various prompts. For example, the sales promotion control unit 104 generates a prompt (hereinafter also called a sales promotion prompt) that instructs the deriving of recommended products according to the detection result of the detection unit 102. Specifically, when the sales promotion control unit 104 receives customer feature quantities from the detection unit 102, it generates a sales promotion prompt that describes the feature quantities and the content requesting the output of recommended products. The sales promotion prompt is an example of first instruction information.

[0048] Furthermore, when generating promotional prompts, the sales promotion control unit 104 may use technologies such as RAG (Retrieval-Augmented Generation) to limit the range of products generated by the generating AI 352 to products handled by the store. For example, the sales promotion control unit 104 may limit the output of recommended products to those registered in the product master 152.

[0049] Furthermore, the sales promotion control unit 104 controls the operation of the device according to the content of operations performed via the operation unit 22 or voice operations performed via the voice recognition unit 103, and also generates various prompts.

[0050] For example, when the sales promotion control unit 104 receives a first operation to stop the output of answer information via the stop button 221 or voice command while the answer information is being output, it controls the display control unit 105 and the voice output control unit 106 to stop the output of the answer information. Also, when the sales promotion control unit 104 receives the first operation while the answer information is being output, it generates a prompt (hereinafter also called a stop prompt) that describes content requesting the cessation of the generation of the answer text. The stop prompt is an example of second instruction information. When the sales promotion control unit 104 generates a stop prompt, it may also include instructions in the stop prompt to request the creation of a message apologizing for the output of unnecessary answer text or a message encouraging purchases.

[0051] Furthermore, for example, when the sales promotion control unit 104 receives a second operation to instruct additional explanation via the additional explanation button 222 or voice operation, it generates a prompt (hereinafter referred to as the additional explanation prompt) that describes the content requesting additional explanation of the answer information (answer text). The additional explanation prompt is an example of the third instruction information. Note that when the sales promotion control unit 104 generates the additional explanation prompt, it may also include content (for example, the product name) contained in the previously outputted answer information (answer text) in the additional explanation prompt.

[0052] Furthermore, when the sales promotion control unit 104 receives text containing inquiry content other than the first and second operations described above via the voice recognition unit 103, it generates a prompt containing the content of that text. For example, if the text contains an inquiry about a product other than a recommended product, the sales promotion control unit 104 generates a prompt describing the inquiry content for that specific product.

[0053] When the sales promotion control unit 104 generates various prompts, it transmits them to the server device 30 via the communication unit 14, causing the AI ​​352 to generate a response text corresponding to the content of the prompt.

[0054] Note that the generation of a cancellation prompt is not limited to cases where cancellation is explicitly instructed via the cancellation button 221 or voice control. For example, when the sales promotion control unit 104 works in cooperation with the detection unit 102 to detect that a customer has left the sales promotion support device 10, it stops outputting response information and generates a cancellation prompt after a predetermined period of time has elapsed. Specifically, when the sales promotion control unit 104 detects that the detection of a person's region or the extraction of feature quantities has ceased, it determines that a customer has left the sales promotion support device 10. Then, after a predetermined period of time has elapsed since the customer left (for example, 3 seconds later), the sales promotion control unit 104 stops outputting response information and generates a cancellation prompt.

[0055] Furthermore, there are no particular restrictions on the method of generating prompts. For example, template prompts may be prepared for each input device (imaging unit 23, cancel button 221, additional explanation button 222) and each functional unit that inputs information to the promotion control unit 104 (detection unit 102, voice recognition unit 103), and the promotion control unit 104 may use different templates depending on the source of the information input. Alternatively, template prompts may be prepared for each instruction content (request content), and the promotion control unit 104 may use different templates depending on the input instruction content. For example, template prompts may be prepared for canceling the generation of response text and for additional explanations, and these templates may be used accordingly.

[0056] The reception unit 301 of the server device 30 receives various prompts transmitted from the sales promotion support device 10 via the communication unit 34. When the reception unit 301 receives a prompt, it inputs the prompt to the generation AI 352. When the generation AI 352 receives a prompt, it generates text corresponding to that prompt and outputs it as a response.

[0057] The response provision unit 302 of the server device 30 acquires the response text generated by the generation AI 352. The response provision unit 302 transmits the acquired response text to the prompt sender (sales promotion support device 10) via the communication unit 34.

[0058] When the sales promotion control unit 104 of the sales promotion support device 10 receives the response text transmitted from the server device 30 via the communication unit 34, it controls the display control unit 105 and the voice output control unit 106 to output the response information based on the response text from the display unit 21 and the voice output unit 25.

[0059] The display control unit 105 of the sales promotion support device 10 is an example of an output means. The display control unit 105 displays a screen based on the response text on the display unit 21. For example, the display control unit 105 displays the text written in the response text on the display unit 21. For example, based on product-identifiable information such as the product name included in the response text, the display control unit 105 reads information about the identified product from the product master 152 and displays it on the display unit 21.

[0060] The voice output control unit 106 of the sales promotion support device 10 is an example of an output means. The voice output control unit 106 causes the voice output unit 25 to output voice based on the response text. For example, the voice output control unit 106 causes the voice output unit 25 to read aloud the content of the text written in the response text.

[0061] With the above-described configuration of the sales promotion support device 10 and server device 30, when a customer who has come to the store approaches the sales promotion support device 10, the customer's characteristic data is acquired by the sales promotion support device 10, and a sales promotion prompt containing the characteristic data and a request for output of recommended products is sent to the server device 30. When the sales promotion prompt is input to the generation AI 352 in the server device 30, information about recommended products selected according to the customer's characteristic data is generated as a response and sent back to the sales promotion support device 10. The sales promotion support device 10 then outputs a screen and audio based on the response text sent back from the server device 30. In this way, the sales promotion support device 10 provides sales promotion support for products by presenting recommended products to the customer according to the customer's characteristics without any explicit operation by the customer.

[0062] By the way, the generation AI 352 of the server device 30 can automatically generate response text in response to prompts, but the generated response text does not necessarily contain content that is of interest to the customer. For example, the products recommended in the response text are not necessarily products that the customer is interested in. If the recommended products are not of interest to the customer, the response information output from the sales promotion support device 10 becomes unnecessary for the customer.

[0063] Therefore, the sales promotion support device 10 allows customers to stop outputting products if, for example, the recommended product is not of interest to them, by pressing the stop button 221 or by voice command.

[0064] When the sales promotion support device 10 is instructed to stop outputting response information via the stop button 221 or voice command, it stops outputting the response information and sends a stop prompt to the server device 30. The server device 30 inputs the stop prompt to the generation AI 352 and generates a response message, such as one informing the user that the output of response information has been stopped or apologizing for outputting unnecessary response information (response text), and sends it back to the sales promotion support device 10. The sales promotion support device 10 then outputs a screen and audio based on the response message sent back from the server device 30.

[0065] This prevents the sales promotion support device 10 from continuously outputting information that is unnecessary for the customer. Furthermore, the sales promotion support device 10 can present the customer with a response in a natural conversation, informing them that the output of response information has stopped and apologizing for outputting unnecessary information. Therefore, the sales promotion support device 10 can smoothly provide sales promotion services to customers.

[0066] Furthermore, if the recommended product is not of interest to the customer, it is expected that the customer will leave the sales promotion support device 10 without performing any operations such as pressing the cancel button 221. In such cases, when the sales promotion support device 10 detects that the customer has left its vicinity, it stops outputting response information after a predetermined time has elapsed and sends a cancel prompt to the server device 30. This prevents the sales promotion support device 10 from continuing to output unnecessary response information (response text) after the customer has left, thereby improving processing efficiency.

[0067] Furthermore, if the recommended product is of interest to the customer, the customer can request further explanation by using the additional explanation button 222 or by voice command. Specifically, when the sales promotion support device 10 receives an instruction for additional explanation of the response via the additional explanation button 222 or voice command, it sends an additional explanation prompt to the server device 30. The server device 30 inputs the additional explanation prompt into the generation AI 352, generates text related to the content of the previously sent response, and sends it back to the sales promotion support device 10 as a new response. The sales promotion support device 10 then outputs a screen and audio based on the response returned from the server device 30, for example, to present the customer with further information about the recommended product.

[0068] As a result, the sales promotion support device 10 can continuously output further response information regarding the content that the customer has shown interest in, enabling it to promote products while interacting with the customer.

[0069] Furthermore, customers can request information regarding any subject by voice inputting inquiries about specific products or other matters of their choice. Specifically, when the sales promotion support device 10 receives an inquiry via voice input, it generates a prompt containing the inquiry and sends it to the server device 30. The server device 30 inputs the prompt into the generation AI 352 and sends a response message containing the answer to the inquiry back to the sales promotion support device 10. The sales promotion support device 10 then displays a screen and audio based on the response message returned from the server device 30, presenting the customer with the answer to their inquiry.

[0070] As a result, the sales promotion support device 10 can present answer information to customers regarding any subject that has been inquired about by the customer, enabling it to promote products while interacting with the customer.

[0071] The following describes an example of processing performed by the sales promotion support device 10 with reference to Figure 5. Here, Figure 5 is a flowchart showing an example of processing performed by the sales promotion support device 10 of the embodiment. It should be assumed that the image captured by the imaging unit 23 is acquired by the image acquisition unit 101.

[0072] First, the detection unit 102 waits until it detects a person (customer) from the image captured by the imaging unit 23 (Step S11; No). When the detection unit 102 detects a person region containing a person from the image (Step S11; Yes), it extracts feature quantities from the detected person region (Step S12).

[0073] Next, the promotion control unit 104 generates a promotional prompt that includes the features extracted in step S12 and a request for the output of recommended products, and sends it to the server device 30 (step S13). In other words, the promotion control unit 104 works in cooperation with the server device 30 to input the generated promotional prompt to the generation AI 352.

[0074] In this case, the generating AI 352 of the server device 30 generates a response text that promotes recommended products in response to the input promotional prompt. The server device 30 then sends the generated response text to the promotional support device 10 that sent the promotional prompt.

[0075] In the sales promotion support device 10, when the sales promotion control unit 104 receives the response text transmitted from the server device 30, it controls the display control unit 105 and the voice output control unit 106 to start outputting response information based on the response text (step S14).

[0076] Next, the promotion control unit 104 determines whether or not an instruction to stop outputting the response information has been received via the stop button 221 or the like (step S15). If an instruction to stop outputting has been received (step S15; Yes), the promotion control unit 104 controls the display control unit 105 and the audio output control unit 106 to stop outputting the response information (step S16).

[0077] Next, the sales promotion control unit 104 generates a cancellation prompt and sends the generated cancellation prompt to the server device 30 (step S17), then proceeds to step S14. In other words, the sales promotion control unit 104, in cooperation with the server device 30, inputs the generated central prompt to the generation AI 352.

[0078] In this case, the AI ​​352 of the server device 30 generates a response message in response to the input cancellation prompt, which includes a message informing the user that the output of recommended products has been stopped and an apology for outputting unnecessary information. The server device 30 then sends the generated response message to the sales promotion support device 10 that sent the cancellation prompt. As a result, in step S14, a screen or audio message informing the user that the output of recommended products has been stopped is output as response information.

[0079] Furthermore, if output cancellation is not instructed in step S15 (step S15; No), the promotion control unit 104 determines whether or not the person detected in step S11 is still present, based on the detection result of the detection unit 102 (step S18). Here, for example, if the detection of the person's region or the extraction of feature quantities ceases, the promotion control unit 104 determines that the person has left (step S18; No).

[0080] If it is determined that the person has left, the sales promotion control unit 104 starts timing the elapsed time and waits until a predetermined time has elapsed (step S18; No → step S19; No). Once the predetermined time has elapsed (step S19; Yes), the sales promotion control unit 104 moves to step S16, stops outputting response information, and sends a cancellation prompt (step S17). If the customer is detected again before the predetermined time has elapsed (step S18; Yes), that is, if the detection of the person area or the extraction of features is resumed, the sales promotion control unit 104 stops timing the elapsed time and moves to step S20.

[0081] On the other hand, if the detection of the person region and the extraction of features are continuing, the promotion control unit 104 determines that a person is present (Step S18; Yes). In this case, the promotion control unit 104 determines whether or not an additional explanation of the answer text has been instructed via the additional explanation button 222 or the like (Step S20).

[0082] If no additional explanation is requested (step S20; No), the sales promotion control unit 104 proceeds to step S22. If additional explanation is requested (step S20; Yes), the sales promotion control unit 104 sets a flag in RAM 13 or the like to indicate that additional explanation has been requested (step S21), and proceeds to step S22.

[0083] In step S22, the sales promotion control unit 104 determines whether the output of the response information has been completed (step S22). If the output of the response information is still ongoing (step S22; No), the sales promotion control unit 104 returns to step S15.

[0084] If the output of the response information is complete (step S22; Yes), the sales promotion control unit 104 determines whether the flag is set or not (step S23). If the flag is set (step S23; Yes), the sales promotion control unit 104 generates an additional explanation prompt and sends it to the server device 30 (step S24), then proceeds to step S14. In other words, the sales promotion control unit 104 works in cooperation with the server device 30 to input the generated additional explanation prompt into the generation AI 352.

[0085] In this case, the generation AI 352 of the server device 30 generates a response that includes more detailed information about the content of the previously generated response (for example, recommended products) in response to the input additional explanation prompt. The server device 30 then sends the generated response to the sales promotion support device 10 that sent the additional explanation prompt. As a result, in step S14, more detailed information about the recommended products is output as response information.

[0086] On the other hand, if it is determined in step S24 that the flag is not set (step S23; No), the sales promotion control unit 104 returns to step S11. If a customer exists when the process returns to step S11, the sales promotion control unit 104 may consider that additional explanation has been instructed and proceed to step S24.

[0087] As described above, the sales promotion support device 10 acquires captured images from the imaging unit 23 that captures images of customers visiting the store, extracts feature quantities that indicate the characteristics of the customer from the captured images, inputs a sales promotion prompt to the generation AI 352 that instructs the generation of products according to the feature quantities, and outputs the response information generated by the generation AI 352 to the customer via the display unit 21 and the audio output unit 25. Furthermore, when the sales promotion support device 10 receives an operation to stop the output of response information, it stops the output of response information and inputs a cancellation prompt to the server device 30 (generation AI 352). The sales promotion support device 10 then outputs the response information corresponding to the cancellation prompt generated by the generation AI 352 via the display unit 21 and the audio output unit 25.

[0088] As a result, even if the sales promotion support device 10 outputs response information that is of no interest to the customer, the customer can stop the output of the response information midway through operation, thus preventing unnecessary response information from being continuously output. Therefore, the sales promotion support device 10 can efficiently provide sales promotion services to customers. In addition, the sales promotion support device 10 can inform the customer that the output of the response information has been stopped (canceled) and apologize for outputting unnecessary information in a natural conversation. Therefore, the sales promotion support device 10 can smoothly provide sales promotion services to customers.

[0089] Furthermore, when the sales promotion support device 10 detects that a customer has left the imaging range of the imaging unit 23 based on the captured image, it stops outputting response information after a predetermined time has elapsed and inputs a cancellation prompt to the server device 30 (generating AI 352).

[0090] As a result, the sales promotion support device 10 can stop outputting response information midway through if a customer leaves the device, thus preventing unnecessary response information from being continuously output. Therefore, the sales promotion support device 10 can efficiently provide sales promotion services to customers.

[0091] Furthermore, when the sales promotion support device 10 receives an operation to instruct the user to provide additional explanations regarding the response information, it generates an additional explanation prompt instructing the user to provide additional explanations regarding the content of the outputted response information, and inputs it to the server device 30 (generation AI 352).

[0092] As a result, the sales promotion support device 10 can continuously output response information that includes additional explanations regarding the response information that the customer has shown interest in, thereby enabling product promotion while interacting with the customer.

[0093] The embodiments described above can also be modified and implemented as appropriate by changing some of the configurations or functions of each of the devices described above. Therefore, several modifications of the embodiments described above will be described below as other embodiments. In the following, we will mainly describe the differences from the embodiments described above, and will omit detailed explanations of points that are common with what has already been described. Furthermore, the modifications described below may be implemented individually or in combination as appropriate.

[0094] (Variation 1) In the above-described embodiment, customer operations are received via the operation unit 22 and the voice input unit 24, but the system is not limited to this configuration, and either the operation unit 22 or the voice input unit 24 may be used. Also, in the above-described embodiment, response information is output using the display unit 21 and the voice output unit 25, but the system is not limited to this configuration, and either the display unit 21 or the voice output unit 25 may be used for output.

[0095] (Modification 2) In the above embodiment, prompt generation is performed by the sales promotion support device 10, but it is not limited to this, and may also be performed by the server device 30. In this case, for example, the sales promotion control unit 104 of the sales promotion support device 10 transmits the information necessary for prompt generation to the server device 30, and the response provision unit 302 of the server device 30 generates a prompt based on the information transmitted from the sales promotion support device 10.

[0096] For example, when the sales promotion control unit 104 transmits customer characteristics to the server device 30, the response provision unit 302 of the server device 30 generates a sales promotion prompt and inputs the generated sales promotion prompt to the generation AI 352. Also, when the sales promotion control unit 104 transmits information to the server device 30 instructing it to stop generating the response text, the response provision unit 302 of the server device 30 generates a stop prompt and inputs the generated stop prompt to the generation AI 352. Furthermore, when the sales promotion control unit 104 transmits information to the server device 30 instructing it to provide additional explanations for the response text, the response provision unit 302 of the server device 30 generates an additional explanation prompt and inputs the generated additional explanation prompt to the generation AI 352.

[0097] This allows for the same effects as the embodiments described above, and also enables the prompt generation function to be installed in the server device 30, thus allowing for a flexible system configuration of the sales promotion support system 1.

[0098] (Variation 3) In the above-described embodiment, the sales promotion support device 10 is configured to include various input / output devices, but it is not limited to this configuration, and the sales promotion support device 10 may be configured to have detachable input / output devices. For example, by using a surveillance camera installed on the ceiling of the store as the imaging unit 23, the sales promotion support device 10 and the imaging unit 23 may be configured as separate units. Also, for example, the sales promotion support device 10 may output circulation information and receive customer operations via a touch panel connected to the device.

[0099] This allows for the same effects as the embodiments described above, and also enables the prompt generation function to be installed in the server device 30, thus allowing for a flexible system configuration of the sales promotion support system 1.

[0100] While embodiments (and modifications) of the present invention have been described above, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, combinations, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents.

[0101] Furthermore, the programs executed by each device in the above embodiments are provided pre-installed in the storage medium (ROM or storage unit) provided by the device, but are not limited to this. For example, the programs may be configured to be provided as installable or executable files recorded on a computer-readable recording medium such as a CD-ROM, flexible disk (FD), CD-R, or DVD (Digital Versatile Disk). Moreover, the storage medium is not limited to a medium independent of the computer or embedded system, but also includes storage media that have downloaded and stored or temporarily stored programs transmitted via a LAN, the Internet, etc.

[0102] Furthermore, the programs executed by each device of the above embodiment may be stored on a computer connected to a network such as the Internet and provided by allowing downloads via the network, or they may be configured to be provided or distributed via a network such as the Internet. [Explanation of Symbols]

[0103] 1. Sales promotion support system 10. Sales promotion support devices 21 Display section 22 Control section 23 Imaging Unit 24. Voice input section 25 Audio output section 30 Server Devices 100 Control Unit 101 Image acquisition unit 102 Detection unit 103 Voice Recognition Unit 104 Sales Promotion Control Unit 105 Display Control Unit 106 Audio Output Control Unit 300 Control Unit Room 301 Reception 302 Answer provision department [Prior art documents] [Patent Documents]

[0104] [License 1] Patent No. 7365465

Claims

1. An acquisition means for acquiring captured images from an imaging device that captures images of customers who visit a store, An extraction means for extracting feature quantities that represent the characteristics of the customer from the captured image, A control means inputs first instruction information to a generating AI that generates response information according to the input information, instructing it to derive products according to the feature quantities. Output means for outputting the response information generated by the AI ​​to the customer, A receiving means that receives a first operation to instruct the cessation of outputting the aforementioned response information, Equipped with, When the receiving means receives the first operation, the control means stops outputting the response information and inputs a second instruction to the generating AI instructing it to create information that notifies that the output of the response information has been stopped. The output means is a sales promotion support device that outputs response information generated by the generating AI in accordance with the second instruction information.

2. When the control means detects, based on the captured image, that the customer has left the imaging range of the imaging device, it stops outputting the response information after a predetermined time has elapsed and inputs the second instruction information to the generating AI. The sales promotion support device according to claim 1.

3. The receiving means receives a second operation that instructs the providing of additional explanations for the response information. When the receiving means receives the second operation, the control means inputs a third instruction information to the generating AI that instructs the output means to provide additional explanation regarding the content of the response information output. The sales promotion support device according to claim 1.

4. The aforementioned reception means receives customer operations via an operator or voice. The sales promotion support device according to claim 1.

5. The output means outputs the response information by displaying or speaking. The sales promotion support device according to claim 1.

6. The computer for the sales promotion support device, An acquisition means for acquiring captured images from an imaging device that captures images of customers who visit a store, An extraction means for extracting feature quantities that represent the characteristics of the customer from the captured image, A control means inputs first instruction information to a generating AI that generates response information according to the input information, instructing it to derive products according to the feature quantities. Output means for outputting the response information generated by the AI ​​to the customer, A receiving means that receives a first operation to instruct the cessation of outputting the aforementioned response information, and make it work When the receiving means receives the first operation, the control means stops outputting the response information and inputs a second instruction to the generating AI instructing it to create information that notifies that the output of the response information has been stopped. The output means is a program that outputs response information generated by the generating AI in accordance with the second instruction information.

Images