Information processing device and program

Abstract

To provide an information processing device capable of proposing personalized outfit coordinations to customers, and a program.SOLUTION: An information processing device of an embodiment comprises: identification means for identifying a customer who has visited a store; acquisition means for acquiring information related to the behavior of the customer identified by the identification means; first presentation means for presenting event information indicative of events related to the behavior of the customer to the customer on the basis of information related to the behavior of the customer acquired by the acquisition means; derivation means for deriving the product to be proposed the customer on the basis of the event information selected by the customer from among the event information presented by the first presentation means; and second presentation means for presenting the product derived by the derivation means to the customer.SELECTED DRAWING: Figure 12

Description

[Technical Field]

[0001] An embodiment of the present invention relates to an information processing device and a program. [Background technology]

[0002] Conventionally, in retail stores that sell clothing, such as apparel stores, sales staff serve customers. In such retail stores, sales staff propose combinations of clothing (hereinafter also referred to as coordination) that are suitable for customers in response to their requests, that is, personalized coordination (for example, Patent Document 1).

[0003] However, it is often difficult for store staff to ensure sufficient time to serve each customer. In such cases, stores are unable to propose personalized outfits to customers, resulting in lost sales opportunities. Summary of the Invention [Problem to be solved by the invention]

[0004] The problem to be solved by the present invention is to provide an information processing device and a program that can propose personalized coordination to a customer. [Means for solving the problem]

[0005] The information processing device of the embodiment includes an identification means for identifying a customer who visits a store, an acquisition means for acquiring information regarding the behavior of the customer identified by the identification means, a first presentation means for presenting to the customer event information indicating events related to the customer's behavior based on the information regarding the customer's behavior acquired by the acquisition means, a derivation means for deriving products to be suggested to the customer based on event information selected by the customer from the event information presented by the first presentation means, and a second presentation means for presenting to the customer the products derived by the derivation means. [Brief explanation of the drawings]

[0006] [Figure 1] FIG. 1 is a schematic diagram showing a schematic configuration of a coordinate suggestion system according to an embodiment. [Figure 2] FIG. 2 is a block diagram illustrating an example of a hardware configuration of the mirror signage according to the embodiment. [Figure 3] FIG. 3 is a block diagram illustrating an example of a hardware configuration of a store server according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a data configuration of a customer information DB according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of a data configuration of an event calendar according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a data configuration of the product master according to the embodiment. [Figure 7] FIG. 7 is a block diagram illustrating an example of a functional configuration of the mirror signage according to the embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of a screen displayed on the mirror signage according to the embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of a screen displayed on the mirror signage according to the embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of a screen displayed on the mirror signage according to the embodiment. [Figure 11] FIG. 11 is a block diagram illustrating an example of the functional configuration of the store server according to the embodiment. [Figure 12] FIG. 12 is a sequence diagram illustrating an example of a control process of the coordination suggestion system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0007] Hereinafter, an embodiment of the coordination suggestion system 1 will be described with reference to the drawings. In the embodiment shown below, an example in which the system is applied to an apparel store (hereinafter also referred to as a store) that sells clothing accessories will be described, but the present invention is not limited to this embodiment. Furthermore, the present invention is not limited to the following embodiment, and the components in the following embodiment include those that can be easily conceived by a person skilled in the art, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, various omissions, substitutions, modifications, and combinations of the components can be made without departing from the spirit of the following embodiment.

[0008] 1 is a schematic diagram showing a schematic configuration of a coordination suggestion system 1 according to an embodiment. The coordination suggestion system 1 includes a mirror signage 2, a store server 3, and a web service server 4.

[0009] The mirror signage 2 and the store server 3 are installed, for example, in a store. The mirror signage 2 is installed, for example, in a fitting room or an aisle of the store. The store server 3 is installed, for example, in a data center inside or outside the store.

[0010] The mirror signage 2 and the store server 3 are connected to each other so that they can communicate with each other via a network Na such as a LAN (Local Area Network). The store server 3 is also connected to a web service server 4 so that they can communicate with each other via a network Nb such as the Internet. Note that the number of devices connected to the networks Na and Nb is not limited to the illustrated example.

[0011] The mirror signage 2 is an example of a display device. For example, the mirror signage 2 has a half mirror positioned opposite the display surface of the display provided in the mirror signage 2, so that the mirror signage 2 reflects the image of the customer and displays the display content so that the customer can see it. Note that the mirror signage 2 can also be used simply as a mirror.

[0012] The mirror signage 2 displays various screens. Specifically, the mirror signage 2 displays a screen related to customer service and a screen including controls that the customer can select via the operation unit 209 of the mirror signage 2. For example, the mirror signage 2 displays a screen informing the customer that service has begun. The mirror signage 2 also displays a screen including information about special events (hereinafter also referred to as events) that the customer can select via the operation unit 209 of the mirror signage 2. The mirror signage 2 also displays a screen including coordination of products (including, for example, tops, pants, shoes, accessories, etc., hereinafter also referred to as clothing items) that are recommended for purchase by the customer.

[0013] Furthermore, the mirror signage 2 cooperates with the store server 3, which will be described later, to perform authentication processing (hereinafter simply referred to as authentication processing) for customers to receive services from the store via the mirror signage 2. Specifically, the mirror signage 2 performs authentication processing by identifying the customer based on an image (hereinafter also referred to as customer image) relating to customer identification captured by the imaging unit 210 (see FIG. 2) included in the mirror signage 2. The customer image is, for example, an image of the customer's face.

[0014] More specifically, the mirror signage 2 transmits a customer image captured by the imaging unit 210 to the store server 3. The store server 3 then extracts features from the received customer image and compares them with feature data related to identifying the customer stored in the store server 3. If the features extracted from the customer image match any of the customer feature data stored in the store server 3, the store server 3 transmits a notification (hereinafter, an authentication processing completion notification) to the mirror signage 2 informing the user that authentication processing including customer information, which will be described later, has been successfully completed. Upon receiving the authentication processing completion notification from the store server 3, the mirror signage 2 displays customer information and a message informing the user that customer service has begun on the display unit 208 of the mirror signage 2. Here, the method for extracting features from the customer image can be any known or commonly used method.

[0015] The authentication process can be performed using various methods. For example, the image capture unit 210 of the mirror signage 2 may read a code symbol such as a two-dimensional code on a store membership card, and perform authentication to identify the customer based on the membership ID included in the code symbol.

[0016] The store server 3 is an example of an information processing device. The store server 3 is, for example, a server device installed in a store. The store server 3 stores customer information, information associated with information about events, information such as prices of clothing items handled by the store, and programs related to generating coordination of clothing items to be proposed to customers. Details of the information associated with customer information and information about events will be described later. The store server 3 also performs authentication processing in cooperation with the mirror signage 2. The store server 3 may be composed of multiple computers. In other words, the functions of the store server 3 may be distributed among multiple computers. The store server 3 may also be a cloud server installed on a cloud.

[0017] The store server 3 also performs a series of processes (hereinafter also referred to as coordination proposal processing) related to generating and providing promotional text to be proposed to customers in a coordination proposal LLM 309 (described later) stored in the store server 3. Details of the promotional text and the coordination proposal processing will be described later.

[0018] The Web service server 4 is, for example, a server device installed on the cloud. The Web service server 4 stores information such as the customer's SNS (Social Networking Service) account, information linked to the account, and information associated with customer-specific events. In addition, in response to a request from the store server 3, the Web service server 4 provides the information stored in the Web service server 4 to the store server 3 via the network Nb.

[0019] Next, the configuration of the above-mentioned mirror signage 2 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the hardware configuration of the mirror signage 2 according to the embodiment. As shown in Fig. 2, the mirror signage 2 includes a CPU (Central Processing Unit) 201, which is an example of a processor, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, a memory unit 204, and the like.

[0020] The CPU 201 comprehensively controls each unit of the mirror signage 2. The ROM 202 stores various programs. The RAM 203 is a workspace for developing programs and various data. The memory unit 204 stores various programs.

[0021] The CPU 201, ROM 202, RAM 203, and memory unit 204 are connected to one another via a bus 211. The CPU 201, ROM 202, and RAM 203 constitute a computer-configured control unit 200. That is, the control unit 200 executes control processing of the mirror signage 2, which will be described later, by the CPU 201 operating in accordance with a control program unit 205 stored in the ROM 202 and memory unit 204 and expanded in the RAM 203.

[0022] The memory unit 204 is a non-volatile memory such as a hard disk drive (HDD) or flash memory that retains stored information even when the power is turned off. The memory unit 204 includes a control program unit 205.

[0023] The control unit 200 is connected to a communication unit 207, a display unit 208, an operation unit 209, and an imaging unit 210 via a controller 206 and a bus 211. Here, the communication unit 207 is a communication interface for connecting to the store server 3 via a network Na. In addition, the store server 3 is connected to the Web service server 4 via a network Nb.

[0024] The controller 206 is connected to a communication unit 207, a display unit 208, an operation unit 209, and an imaging unit 210. Based on instructions from the control unit 200, the controller 206 controls each of the connected units.

[0025] The display unit 208 is a display device such as an LCD (Liquid Crystal Display). The display unit 208 displays various types of information under the control of the CPU 201. The operation unit 209 is a touch panel provided on the display unit 208. The operation unit 209 outputs operation details input via an input device to the CPU 201. Note that the operation unit 209 may be an input device such as a keyboard or a pointing device. The imaging unit 210 is an imaging device having an imaging element such as a CCD or a CMOS.

[0026] Next, the configuration of the above-mentioned store server 3 will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the hardware configuration of the store server 3 according to the embodiment. As shown in Fig. 3, the store server 3 includes a CPU 301, which is an example of a processor, a ROM 302, a RAM 303, a memory unit 304, etc.

[0027] The CPU 301 comprehensively controls each unit of the store server 3. The ROM 302 stores various programs. The RAM 303 is a workspace for developing programs and various data. The memory unit 304 stores various programs.

[0028] The CPU 301, ROM 302, RAM 303, and memory unit 304 are connected to one another via a bus 313. The CPU 301, ROM 302, and RAM 303 constitute a control unit 300 having a computer configuration. That is, the control unit 300 executes control processing of the store server 3, which will be described later, by the CPU 301 operating in accordance with a control program unit 305 stored in the ROM 302 and memory unit 304 and loaded into the RAM 303.

[0029] The memory unit 304 is a non-volatile memory such as a HDD or flash memory that retains stored information even when the power is turned off. The memory unit 304 includes a control program unit 305, a customer information DB 306, an event calendar 307, a product master 308, and a coordination suggestion LLM 309.

[0030] The customer information DB 306 is a data table or database for the store to manage customer information. Fig. 4 is a diagram showing an example of the data configuration of the customer information DB 306. As shown in Fig. 4, the customer information DB 306 stores customer information such as the customer's name, age, sex, characteristic data, purchase history, personal information usage permission flag, SNS link, calendar link, etc.

[0031] The feature data stores feature amounts extracted from the customer image. Here, feature amounts are quantified features of the customer image calculated using publicly known and commonly used methods. If a membership card is used for authentication processing, the membership ID and other information stored on the membership card may be stored as feature data.

[0032] The purchase history is a record of the date and time when a customer purchased a product at a store that manages the customer information DB 306, as well as a record of the purchase of the product, etc. The SNS link is a link for accessing the customer's SNS account or information linked to the account. The calendar link is a link for accessing an external calendar service used by the customer. By accessing the calendar link, the customer can refer to or obtain the schedule registered in their calendar and the event information of the event registered as a schedule. The event information is, for example, information that associates the date when various events are held with the event content, such as the event name and images related to the event.

[0033] The personal information use flag is flag information that specifies whether or not to enable the use of a customer's personal information in the coordination suggestion process described below. The personal information use flag is binary flag information that is, for example, "1" when the flag is enabled (hereinafter also referred to as the on state) and "0" when the flag is disabled (hereinafter also referred to as the off state). Specifically, when the personal information use flag is enabled, the control unit 300 of the store server 3 accesses the server corresponding to the address stored in the SNS link and calendar link in the coordination suggestion process, i.e., the Web service server 4. Then, the control unit 300 of the store server 3 obtains the customer's personal information from the Web service server 4, i.e., the customer's SNS account, information linked to the account, and event information for events registered in the schedule managed by the customer.

[0034] Returning to Figure 3, the event calendar 307 is a data table or database that allows the store to manage events. Figure 5 is a diagram showing an example of the data configuration of the event calendar 307. As shown in Figure 5, the event calendar 307 stores event information.

[0035] Here, the dates stored in event calendar 307 are stored in the format of, for example, "YYYY / MM / DD" indicating the year, month, and day, or "MMMM D, YYYY" indicating the month, day, and year. The event details stored in event calendar 307 are, for example, names related to events held at facilities attached to the store or facilities near the store, and images related to the events.

[0036] Returning to Fig. 3, the product master 308 is a data table or database for managing the prices and other information of products sold in a store. Fig. 6 is a diagram showing an example of the data configuration of the product master 308. As shown in Fig. 6, the product master 308 associates the type of product sold in a store with an identifiable product code, and stores product information such as the product name, price, product image, product description, etc. of the product corresponding to the product code.

[0037] A product image is, for example, an image that represents a product. Furthermore, the product description stored in the product master 308 includes, for example, the brand name, size, color, etc. of the product, which is a clothing item, as well as information such as the storage location of the product in the store. Furthermore, the product description includes information indicating the season, environment, event, etc., that is suitable for wearing the product, and information that contributes to the determination of the product to be recommended to the customer.

[0038] Returning to Figure 3, the Coordination Proposal LLM309 is a generative AI that generates text and is a Large Language Model (LLM). Here, the Coordination Proposal LLM309 is an example of a generative AI that can generate new content such as images, text, audio, and structured data by learning data patterns and relationships.

[0039] The coordination suggestion LLM 309 is, for example, an LLM constructed using known deep learning technology that, in response to input of text specifying conditions, outputs text related to products based on the conditions. Here, for example, the conditions may be reference conditions that serve as reference conditions for deriving the output results or constraint conditions for narrowing down the output results.

[0040] The coordination suggestion LLM 309 derives coordinations for products sold in stores based on various input conditions and generates promotional text to promote the derived products. Here, the promotional text is text data that describes, for example, the product names of clothing items recommended for purchase by customers and product descriptions of the clothing items. Note that the promotional text may also be text data in list format that includes the names and descriptions of multiple clothing items.

[0041] Furthermore, in this embodiment, an LLM is used as the generation AI, but the generation AI is not limited to an LLM as long as it is capable of generating text. Furthermore, the coordination suggestion LLM 309 may be configured independent of the store server 3. In other words, the coordination suggestion LLM 309 may be installed outside the store or on the cloud and configured to be able to communicate in response to a request from the store server 3.

[0042] The coordination proposal LLM 309 of this embodiment generates promotional text for a customer in response to input of an input sentence including event information selected by the customer in the coordination proposal process described below and instruction information instructing the generation of promotional text.

[0043] Here, the input sentence is generated in the form of a character string written in a natural language, for example. Specifically, the instruction information includes a character string (hereinafter also referred to as a prompt) containing the content, format, and information of the sentence desired to be generated by the coordination suggestion LLM 309. More preferably, the sentence written in the prompt is a sentence that clearly indicates the event information of the event selected by the customer and includes an instruction to generate promotional text from the event information and the customer's tastes and preferences related to clothing items (hereinafter also referred to as taste and preference information).

[0044] Note that the method for generating the prompt is not particularly limited, but for example, the generation processing unit 3003 of the store server 3, which will be described later, may employ a method for generating a prompt based on a predetermined template. In this case, a plurality of templates may be prepared corresponding to the event information, gender, and age group of the customer, and the generation processing unit 3003 may be configured to switch the template to be used depending on the event information and customer information selected by the customer.

[0045] As an example of a prompt, for example, a prompt may be input to the LLM instructing the creation of a sentence containing content related to the age of a customer included in the customer information.Also, for example, a prompt may be input to the LLM instructing the creation of a sentence containing content related to products recorded in the purchase history included in the customer information.

[0046] The control unit 300 is connected to a first communication unit 311 and a second communication unit 312 via a controller 310 and a bus 313. Here, the first communication unit 311 is a communication interface for connecting to the mirror signage 2 via a network Na. Furthermore, the second communication unit 312 is a communication interface for connecting to the Web service server 4 via a network Nb.

[0047] The controller 310 is connected to the first communication unit 311 and the second communication unit 312. Based on instructions from the control unit 300, the controller 310 controls each of the connected units.

[0048] Next, the functional configuration of the control unit 200 of the mirror signage 2 will be described with reference to Fig. 7. Fig. 7 is a block diagram showing an example of the functional configuration of the mirror signage 2 according to the embodiment. As shown in Fig. 7, the control unit 200 includes, as functional components, an authentication unit 2001 and a display control unit 2002. Note that the functional configuration of the mirror signage 2 is not limited to this.

[0049] Specifically, the control unit 200 (CPU 201) of the mirror signage 2 realizes the above-mentioned functional configuration by executing the control program unit 205 stored in the memory unit 204. Note that in this embodiment, the above-mentioned functional configuration is a software configuration realized by cooperation between the processor and program of the mirror signage 2, but is not limited to this, and a hardware configuration in which part or all of the functional configuration is realized by a dedicated circuit or the like may also be used.

[0050] The authentication unit 2001 authenticates the customer using the imaging unit 210. Specifically, the authentication unit 2001 captures an image of the customer using the imaging unit 210. The authentication unit 2001 also transmits the captured image of the customer to the store server 3. Upon receiving a notification of the completion of authentication processing from the store server 3, the authentication unit 2001 cooperates with the display control unit 2002 (described later) to cause the display unit 208 to display a message informing the customer that customer service has begun. When notifying the customer that customer service has begun, the authentication unit 2001 may also display customer information.

[0051] The display control unit 2002 displays various information on the display unit 208. Specifically, upon receiving a notification of the completion of the authentication process from the store server 3, the display control unit 2002 displays a message informing the start of customer service on the display unit 208, as shown in FIG.

[0052] Fig. 8 is a diagram showing an example of a screen displayed on the mirror signage 2. The display control unit 2002 displays a customer service start screen Ga as shown in Fig. 8 on the display unit 208 to notify the customer that customer service has begun. The customer service start screen Ga includes an area Gaa in which customer information and a message accompanying the start of customer service are displayed, an area Gab in which a message thanking the customer for visiting the store is displayed, and an area Gac in which an avatar modeled after a store clerk is displayed. Note that the display control unit 2002 may be configured not to display customer information.

[0053] If the authentication process is not completed successfully, for example, if the customer who has undergone the authentication process is a new customer and is not registered in the customer information DB 306, the display control unit 2002 may not display the customer service start screen Ga on the mirror signage 2, and may simply use the mirror signage 2 as a mirror. Furthermore, instead of displaying the customer service start screen Ga on the mirror signage 2, the display control unit 2002 may display a screen that prompts the customer to register as a member.

[0054] When the authentication process is successfully completed, the store server 3 transmits the event information to the mirror signage 2. Returning to FIG. 7, when the display control unit 2002 receives the event information from the store server 3, it causes the display unit 208 to display the event information in a format selectable from the operation unit 209 as shown in FIG.

[0055] Fig. 9 is a diagram showing an example of a screen displayed on the mirror signage 2. The display control unit 2002 displays an event selection screen Gb as shown in Fig. 9 on the display unit 208 based on the event information to allow the customer to select event information indicating an event in which the customer is interested. The event selection screen Gb includes areas Gba, Gbb, Gbc, Gbd, Gbe, and Gbf.

[0056] The customer's name is displayed in area Gba. The event information acquired from the linked calendar links of the event calendar 307 and the customer information DB 306 in the coordination suggestion process described below is displayed in area Gbb. Specifically, area Gbb has area Gbc, in which an event image included in the event information is displayed, and area Gbd, in which the event name included in the event information is displayed. Area Gbb is displayed for each acquired event information. Figure 9 shows an example in which two pieces of event information, with the event names "Mountain climbing" and "Live festival," have been acquired. Area Gbd also functions as an operator (operation button), and by operating within area Gbb, it is possible to select the event information in the operated area Gbb.

[0057] An avatar resembling a store clerk is displayed in the area Gbe, and a message prompting the customer to select event information is displayed in the area Gbf.

[0058] The number of pieces of event information to be displayed on one screen is not limited to the illustrated example. If the number of pieces of event information cannot fit on one screen, the event information that was not displayed may be displayed sequentially in response to a left-right scroll operation. Furthermore, the event selection screen Gb does not need to be displayed so as to occupy the entire display unit 208, and may be displayed on only a portion of the display unit 208, with the portion not displaying the event selection screen Gb being usable as a mirror.

[0059] When the display control unit 2002 receives a customer's selection of an event from the event information displayed on the display unit 208 (event selection screen Gb) via the operation unit 209, it transmits the selected event information to the store server 3. Furthermore, when the display control unit 2002 receives a coordination set from the store server 3, it causes the display unit 208 to display a screen for prompting the customer to select a coordination set, as shown in FIG. 10 . Here, the coordination set is information including product information of multiple products derived based on the promotional text generated by the coordination suggestion LLM 309. Specifically, the coordination set associates the product name and product image of each of the multiple products derived based on the promotional text generated by the coordination suggestion LLM 309.

[0060] Fig. 10 is a diagram showing an example of a screen displayed on the mirror signage 2. When the display control unit 2002 receives a coordinate set from the store server 3, it causes the display unit 208 to display a coordinate selection screen Gc as shown in Fig. 10 to allow the customer to select a coordinate set. The coordinate selection screen Gc includes areas Gca, Gcb, Gcc, Gcd, Gce, Gcf, and Gcg.

[0061] The customer's name is displayed in area Gca. The event name of the event selected by the customer on the event selection screen Gb is displayed in area Gcb. Figure 10 shows an example in which "Live Festival" has been selected on the event selection screen Gb. Area Gcc displays information related to the coordination set. Specifically, area Gcc has area Gcd in which product images of the products included in the coordination set are displayed, and area Gce in which the name of the coordination set corresponding to the event information is displayed. Area Gcc is displayed for each coordination set. Figure 10 shows an example of two coordination sets, "Indoor Coordination Set" and "Outdoor Coordination Set," corresponding to the selected event information, "Live Festival." Area Gce also functions as an operator (operation button), and by operating within area Gcc, it is possible to select the coordination set in the operated area Gcc.

[0062] An avatar resembling a store clerk is displayed in the area Gcf, and a message prompting the customer to select a coordinate set is displayed in the area Gcg.

[0063] The number of coordination sets displayed on one screen is not limited to the illustrated example. If the number of coordination sets does not fit on one screen, coordination sets that were not displayed may be displayed sequentially in response to a left-right scroll operation. Furthermore, the coordination selection screen Gc does not need to be displayed so as to occupy the entire display unit 208, but may be displayed on only a portion of the display unit 208, and the portion where the coordination selection screen Gc is not displayed may be usable as a mirror.

[0064] Next, the functional configuration of the control unit 300 of the store server 3 will be described with reference to Fig. 11. Fig. 11 is a block diagram showing an example of the functional configuration of the store server 3 according to the embodiment. As shown in Fig. 11, the control unit 300 includes, as functional components, an authentication processing unit 3001, a user-related information processing unit 3002, and a generation processing unit 3003. Note that the functional configuration of the store server 3 is not limited to this.

[0065] Specifically, the control unit 300 (CPU 301) of the store server 3 realizes the above-mentioned functional configuration by executing the control program unit 305 stored in the memory unit 304. In this embodiment, the above-mentioned functional configuration is a software configuration realized by cooperation between the processor and program of the store server 3, but is not limited to this, and a hardware configuration in which part or all of the functional configuration is realized by a dedicated circuit or the like may also be used.

[0066] The authentication processing unit 3001 is an example of an identification unit. The authentication processing unit 3001 identifies a customer who has visited the store. Specifically, the authentication processing unit 3001 extracts features from the customer image received from the authentication unit 2001 and compares the features with feature data stored in the customer information DB 306. If the features extracted from the customer image match any of the feature data of a customer stored in the customer information DB 306, the authentication processing unit 3001 identifies that the customer corresponding to the matching feature data has visited the store. Then, the authentication processing unit 3001 transmits an authentication processing completion notification to the mirror signage 2.

[0067] If the authentication process is not completed successfully, that is, if the features extracted from the customer image do not match any of the customer feature data stored in the customer information DB 306, the authentication processing unit 3001 sends a message to the mirror signage 2 informing that the authentication process was not completed successfully.

[0068] The user-related information processing unit 3002 is an example of an acquisition unit, a first presentation unit, and an extraction unit. The user-related information processing unit 3002 acquires information about the behavior of the customer identified by the authentication processing unit 3001. Here, the information about the behavior includes the purchase history of the customer's products, the content posted on the SNS by the customer and SNS users related to the customer, and event information about events registered in the customer's schedule.

[0069] Specifically, the user-related information processing unit 3002 accesses the SNS link of the customer stored in the customer information DB 306, and acquires, as information related to the customer's behavior, the content posted to the SNS by the customer and SNS users related to the customer from the accessed Web service server 4. The user-related information processing unit 3002 also accesses the calendar link of the customer stored in the customer information DB 306, and acquires, as information related to the customer's behavior, the event information of events registered in the customer's schedule from the accessed Web service server 4.

[0070] Note that user-related information processing unit 3002 accesses Web service server 4 when the personal information usage flag for the customer stored in customer information DB 306 is in an ON state, and restricts access to Web service server 4 when the personal information usage flag is in an OFF state. Hereinafter, the information acquired from Web service server 4 described above will also be collectively referred to as user-related information.

[0071] Furthermore, the user-related information processing unit 3002 extracts the customer's hobby and preference information based on the user-related information acquired from the Web service server 4. Specifically, the user-related information processing unit 3002 extracts the customer's hobby and preference information related to clothing items based on the content posted on the SNS by the customer and an SNS user related to the customer acquired from the Web service server 4.

[0072] Furthermore, the user-related information processing unit 3002 presents the customer with event information of events related to the customer's behavior based on the information on the customer's behavior acquired from the Web service server 4. Specifically, the user-related information processing unit 3002 determines the event information of events related to the customer's behavior as the event information stored in the event calendar 307 and the event information of events registered in the customer's schedule acquired from the Web service server 4. Then, the user-related information processing unit 3002 transmits the event information of events related to the customer's behavior to the mirror signage 2 and presents it to the customer via the display unit 208.

[0073] The event information of an event related to a customer's behavior that the user-related information processing unit 3002 transmits to the mirror signage 2 may be limited to a period, such as event information for the next month from the present.

[0074] The generation processing unit 3003 is an example of a derivation means and a second presentation means. The generation processing unit 3003 derives products to be proposed to the customer from event information selected by the customer from the event information presented by the user-related information processing unit 3002 via the display unit 208, the customer's hobby and preference information extracted by the user-related information processing unit 3002, and instruction information instructing the customer to propose products. The generation processing unit 3003 also outputs the products derived by the generation processing unit 3003 in a format selectable by the customer.

[0075] Specifically, when the generation processing unit 3003 receives event information selected by a customer via the mirror signage 2, it generates an input text that includes the event information, the customer's hobby and preference information extracted by the user-related information processing unit 3002, and instruction information that instructs the generation of promotional text.

[0076] The generation processing unit 3003 also inputs the generated input text into the coordination proposal LLM 309, causing the coordination proposal LLM 309 to generate promotional text presenting products recommended for purchase by the customer. After the coordination proposal LLM 309 generates the promotional text, the generation processing unit 3003 acquires the promotional text. Next, the generation processing unit 3003 calculates the similarity between the clothing items described in the promotional text and the products stored in the product master 308, and extracts multiple products from the product master 308 that have a similarity higher than a preset level. The clothing items extracted as described above reflect the customer's personal event schedule and hobbies and preferences.

[0077] Here, a publicly known technique may be used to calculate the similarity between the clothing item described in the promotional text and the product stored in the product master 308. For example, the similarity may be calculated based on the match rate between the words and phrases described in the clothing item described in the promotional text and the product description stored in the product master 308. Alternatively, for example, the product description stored in the product master 308 may be vectorized using a common natural language processing method and stored, and the similarity may be calculated based on the cosine similarity between the vectorized text and the text described in the promotional text.

[0078] The generation processing unit 3003 extracts multiple products from the product master 308 and generates a coordinate set that combines the multiple products. The generation processing unit 3003 then transmits the created coordinate set to the mirror signage 2.

[0079] The method of generating a coordinate set may use publicly known techniques. For example, for each type and color combination of clothing items, factors such as the season and environment suitable for wearing the product stored in the product description of the product master 308 may be used as factors for determining the combination, and a coordinate set may be generated according to predefined rules for the combination method.

[0080] Next, the control processing of the coordinate suggestion system 1 will be described with reference to Fig. 12. Fig. 12 is a sequence diagram showing an example of the control processing of the coordinate suggestion system 1 according to the embodiment. The sequence diagram shown in Fig. 12 shows an example of processing when a coordinate suggestion process is performed after a customer authentication process is performed.

[0081] First, the authentication unit 2001 of the mirror signage 2 acquires a customer image of a customer who visits the store via the imaging unit 210 (step S101). After acquiring the customer image, the authentication unit 2001 transmits the acquired customer image to the store server 3 (step S102).

[0082] The authentication processing unit 3001 of the store server 3 extracts features from the customer image received from the authentication unit 2001 and compares them with feature data stored in the customer information DB 306 (step S103). If the features extracted from the customer image match any of the customer feature data stored in the customer information DB 306, the authentication processing unit 3001 transmits an authentication processing completion notification to the mirror signage 2 (step S104).

[0083] When the display control unit 2002 of the mirror signage 2 receives the notification of completion of the authentication process from the authentication processing unit 3001, the display control unit 2002 of the mirror signage 2 causes the display unit 208 of the mirror signage 2 to display a message informing the customer that service has begun (step S105).

[0084] Meanwhile, the user-related information processing unit 3002 of the store server 3 determines the value of the personal information use flag of the customer identified by the authentication processing unit 3001 from the customer information DB 306 (step S106). If the flag is on, the user-related information processing unit 3002 accesses the customer's SNS link stored in the customer information DB 306 and acquires the content posted to the SNS by the customer and the SNS user associated with the customer from the accessed Web service server 4. Then, based on the acquired content posted to the SNS by the customer and the SNS user associated with the customer, the customer's hobby and preference information is extracted. If the flag is on, the user-related information processing unit 3002 accesses the customer's calendar link stored in the customer information DB 306 and acquires event information of events registered in the customer's schedule from the accessed Web service server 4 (step S107).

[0085] Next, the user-related information processing unit 3002 transmits the event information stored in the event calendar 307 and the event information of the events registered in the customer's schedule obtained from the Web service server 4 to the mirror signage 2 (step S108).

[0086] When the display control unit 2002 of the mirror signage 2 receives the event information from the user-related information processing unit 3002, it displays the event information on the display unit 208 in a selectable format (step S109). Next, when the display control unit 2002 accepts an operation to select event information via the operation unit 209, it transmits the selected event information to the store server 3 (step S110).

[0087] When the generation processing unit 3003 of the store server 3 receives the event information from the mirror signage 2, it generates an input sentence including the received event information, the customer's interest and preference information extracted by the user-related information processing unit 3002, and instruction information for instructing the generation of promotional text (step S111). Next, the generation processing unit 3003 inputs the generated input sentence to the coordination proposal LLM 309 (step S112), and causes the coordination proposal LLM 309 to generate promotional text presenting products recommended for purchase by the customer (step S113).

[0088] When the coordination suggestion LLM 309 generates promotional text, the generation processing unit 3003 of the store server 3 acquires the promotional text (step S114). Next, the generation processing unit 3003 calculates the similarity between the clothing items described in the promotional text and the products stored in the product master 308, and extracts multiple products from the product master 308 that have a predetermined similarity or higher (step S115). Next, the generation processing unit 3003 generates a coordination set that combines the multiple products extracted from the product master 308 (step S116). Then, the generation processing unit 3003 transmits the generated coordination set to the mirror signage 2 (step S117).

[0089] When the display control unit 2002 of the mirror signage 2 receives the coordinate set from the generation processing unit 3003, it causes the display unit 208 to display a screen representing the coordinate set (step S118). Then, when the display control unit 2002 receives a selection operation of a coordinate set via the operation unit 209, it causes the display unit 208 to display the storage location of the coordinate set selected by the customer (step S119).

[0090] In step S104, if the features extracted from the customer image do not match any of the feature data of customers stored in the customer information DB 306, the authentication processing unit 3001 may send a message notifying that the authentication process has not been completed successfully to the mirror signage 2. Then, upon receiving the message notifying that the authentication process has not been completed successfully, the display control unit 2002 may display the message on the display unit 208 and return the process to step S101.

[0091] Also, in step S106, if the personal information usage flag of the customer identified by the authentication processing unit 3001 from the customer information DB 306 is in the OFF state, the user-related information processing unit 3002 may obtain product information of products recommended by the store to the customer during a sale, etc., from the product master 308 instead of obtaining user-related information from the Web service server 4.

[0092] Furthermore, the user-related information processing unit 3002 may transmit a message to the mirror signage 2 prompting the customer to consent to the use of their personal information. In this case, upon receiving the message from the user-related information processing unit 3002, the display control unit 2002 causes the display unit 208 to display a message prompting the customer to consent to the use of their personal information in a format selectable from the operation unit 209. Then, when consent to the use of personal information is obtained from the customer via the operation unit 209, the display control unit 2002 transmits a message to the store server 3 indicating that consent to the use of personal information has been obtained from the customer. Then, upon receiving the notification, the user-related information processing unit 3002 changes the personal information use permission flag to an ON state and proceeds to step S107.

[0093] Also, in step S106, if the personal information usage flag of the customer identified by the authentication processing unit 3001 from the customer information DB 306 is in the off state, in step S108, only the event information stored in the event calendar 307 may be sent to the mirror signage 2.

[0094] As described above, in the coordination suggestion system 1 of this embodiment, the mirror signage 2 works in cooperation with the store server 3 to identify customers who visit the store. The store server 3 acquires user-related information about the identified customers from the Web service server 4. The store server 3 also works in cooperation with the mirror signage 2 to present event information to the customers based on the acquired user-related information. The store server 3 derives products to suggest to the customer based on the event information selected by the customer, the user-related information, and instruction information that instructs product suggestions. The mirror signage 2 then displays the derived products to the customer.

[0095] As a result, the coordination suggestion system 1 of this embodiment can perform processing that reflects the customer's characteristics by presenting event information and generating promotional text based on information about the customer's behavior. Also, it can generate a personalized coordination for the customer from the promotional text that reflects the customer's characteristics. Therefore, the coordination suggestion system 1 of this embodiment can suggest a personalized coordination to the customer without the intervention of a store clerk.

[0096] The above-described embodiment can be modified as needed by partially changing the configuration or functions of each of the above-described devices. Therefore, several modifications of the above-described embodiment will be described below as other embodiments. The following mainly focuses on differences from the above-described embodiment, and detailed descriptions of commonalities with the content already described will be omitted. The modifications described below may be implemented individually or in appropriate combination.

[0097] (Variation 1) In the above embodiment, the area Gbb of the event selection screen Gb displays the event information acquired from the linked calendar links of the event calendar 307 and the customer information DB 306 during the coordination suggestion process, but the area Gbb may display either the event information acquired from the event calendar 307 or the event information acquired from the linked calendar links of the customer information DB 306. For example, only the event information acquired from the event calendar 307 may be displayed in the area Gbb.

[0098] (Variation 2) In the above-described embodiment, when generating a coordination set, factors such as the season and environment suitable for wearing the product stored in the product description of the product master 308 are used as factors for determining the combination, but this is not limited to this, and customer taste and preference information may also be used as a factor for determining the combination.

[0099] The programs executed by the coordinate suggestion system 1 of the embodiment and the modified example may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the programs executed by the coordinate suggestion system 1 of the embodiment and the modified example may be provided or distributed via a network such as the Internet.

[0100] The programs executed by each device in the above-described embodiments are provided in a state where they are pre-installed in a ROM, a storage unit, etc. The programs executed by each device in the above-described embodiments may be provided by being recorded in an installable or executable file format on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a digital versatile disk (DVD).

[0101] Furthermore, the programs executed by each device in the above-described embodiments may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the programs executed by each device in the above-described embodiments may be provided or distributed via a network such as the Internet.

[0102] Although the embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments and their modifications can be embodied in various other forms, and various omissions, substitutions, changes, and combinations can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the inventions and their equivalents as defined in the claims. [Explanation of symbols]

[0103] 1. Coordination suggestion system 2. Mirror signage 3. Store server 4. Web Service Server 306 Customer information DB 307 Event Calendar 308 Product Master 309 Coordination Proposal LLM 2001 Certification Department 2002 Display control unit 3001 Authentication processing unit 3002 User-related information processing section 3003 Generation processing unit [Prior art documents] [Patent documents]

[0104] [Patent Document 1] Japanese Patent Publication No. 2021-182367

Claims

1. A means for identifying customers who visit the store; an acquisition means for acquiring information about the customer behavior identified by the identification means; a first presentation means for presenting to the customer event information indicating an event related to the customer's behavior based on the information on the customer's behavior acquired by the acquisition means; a deriving means for deriving a product to be proposed to the customer based on event information selected by the customer from the event information presented by the first presenting means; a second presentation means for presenting the product derived by the derivation means to the customer; An information processing device comprising:

2. The system further includes an extraction unit that extracts preference information related to the customer's preferences based on the information related to the customer's behavior acquired by the acquisition unit, The information processing apparatus according to claim 1 , wherein the deriving means derives a product to be proposed to the customer based on the event information and the preference information.

3. The information processing device according to claim 1 , wherein the first presentation means and the second presentation means present the information via a display device operable by the customer in the store.

4. The information processing device according to claim 1 , wherein the deriving means derives a product to be recommended to the customer from among products sold in the store.

5. The information processing device according to claim 3, wherein the acquisition means includes, as information regarding the customer's behavior, at least one of the customer's purchase history for products, content posted by the customer on a social networking site, and content of events registered in the customer's schedule.

6. The computer of the information processing device, A means for identifying customers who visit the store; an acquisition means for acquiring information about the customer behavior identified by the identification means; a first presentation means for presenting to the customer event information indicating an event related to the customer's behavior based on the information on the customer's behavior acquired by the acquisition means; a deriving means for deriving a product to be proposed to the customer based on event information selected by the customer from the event information presented by the first presenting means; a second presentation means for presenting the product derived by the derivation means to the customer; A program to function as a

Images