Information providing device, information providing method, and recording medium

Abstract

An information providing device according to the present invention is provided with: an acquisition means for acquiring video in which first customers are captured at a store; an identification means for identifying an action history of one of the first customers from the video by using identification information that is included in the video and that enables the identification of the first customer; a registration means for registering member information in association with an action history when a second customer who provides the member information is a customer for whom there is a first customer who is the same as the second customer on the basis of identification information of the second customer and the identification information, included in the video, of each of the first customers; a generation means for generating sales promotion information for the customer on the basis of the member information and the action history; an output means for outputting the sales promotion information to the customer; and a deletion means for deleting the identification information of the customer at a prescribed timing after it becomes possible to generate the sales promotion information.

Description

Information providing device, information providing method, and recording medium

[0001] The present disclosure relates to an information providing device, an information providing method, and a recording medium.

[0002] There is a technology that analyzes customer behavior using video footage taken in a store. For example, the customer behavior history can be used for store marketing or to provide information for sales promotion to customers.

[0003] Patent Literature 1 discloses a processing device that compares an image taken in a store with facial information included in customer information, identifies the customer's in-store behavior detected from the image, and registers the identified behavior in the customer information. In Patent Literature 1, when a person whose facial information is not registered is detected in the image, the processing device generates facial information from the facial image and registers the facial information in the customer information.

[0004] International Publication No. 2023 / 032000

[0005] Incidentally, since information that can identify an individual, such as a facial image, is personal information, both customers and stores have a need to avoid retaining information that can identify an individual, such as a facial image, from the perspective of protecting personal information.

[0006] An example of an objective of the present disclosure is to provide a technology that facilitates management of personal information in a technology for identifying behavioral history using video.

[0007] An information providing device in one aspect of the present disclosure includes an acquisition means for acquiring video of a first customer taken in a store; an identification means for identifying the first customer from the video using identification information contained in the video that can identify the first customer; a registration means for linking the behavioral history to membership information and registering it if the second customer is a customer for whom there is a first customer who is the same as the second customer, based on the identification information of a second customer who provides the membership information and the identification information of the first customer contained in the video; a generation means for generating promotional information for the customer based on the membership information and the behavioral history; an output means for outputting the promotional information to the customer; and a deletion means for deleting the customer's identification information at a predetermined time after the promotional information can be generated.

[0008] An information provision method in one aspect of the present disclosure obtains video of a first customer in a store, identifies the first customer's behavioral history from the video using identification information contained in the video that can identify the first customer, and, if the second customer is a customer for whom a first customer who is the same as the second customer exists, links the behavioral history to the membership information and registers it based on the identification information of a second customer who provides membership information and the identification information of the first customer contained in the video, generates promotional information for the customer based on the membership information and the behavioral history, outputs the promotional information to the customer, and deletes the customer's identification information at a predetermined time after the promotional information can be generated.

[0009] A program in one aspect of the present disclosure acquires video footage of a first customer in a store, identifies the first customer's behavioral history from the video using identification information contained in the video that can identify the first customer, and, if the second customer is a customer for whom a first customer who is the same as the second customer exists, links the behavioral history to the membership information and registers it based on the identification information of a second customer who provides membership information and the identification information of the first customer contained in the video, generates promotional information for the customer based on the membership information and the behavioral history, outputs the promotional information to the customer, and causes a computer to execute a process to delete the customer's identification information at a predetermined time after the promotional information can be generated.

[0010] Each program may be stored in a non-transitory computer-readable recording medium.

[0011] One example of the effect of the present disclosure is that it makes it easier to manage personal information in a technology for identifying behavioral history using video.

[0012] 1 is a diagram illustrating a configuration of a system including an information providing device; FIG. 2 is a block diagram illustrating a functional configuration of the information providing device; FIG. 3 is a diagram illustrating an example screen; FIG. 4 is a flowchart illustrating the operation of the information providing device; FIG. 4 is a block diagram illustrating another example of the functional configuration of the information providing device; FIG. 5 is a diagram illustrating an example screen; FIG. 6 is a flowchart illustrating the operation of the information providing device; and FIG. 7 is a diagram illustrating a hardware configuration for realizing the information providing device in the present disclosure by a computer and its peripheral devices.

[0013] Embodiments of the present disclosure will be described in detail with reference to the drawings.

[0014] First Embodiment FIG. 1 is a diagram illustrating an example of a system including an information providing device 100 according to the present disclosure.

[0015] In FIG. 1, an information providing device 100 is a device that provides sales promotion information based on the customer's behavior history in a store and the customer's membership information.

[0016] Here, sales promotion information is information for promoting sales of products and services at a store, such as, but not limited to, advertisements for promoting campaigns for products, services, stores, etc., discounts on products, services, or purchases, coupons for rewards such as points, etc.

[0017] The information providing device 100 is communicably connected to a member information database, a camera installed so as to be able to photograph customers, and a store terminal.

[0018] The member information database is a database that stores member information. The member information database may be included in the information providing device 100.

[0019] Member information is information about a customer who has registered as a member of a store or the like. Member information includes member identification information that identifies the customer as a member. Member information may also include information about other customers. Information about other customers included in the member information may be, for example, the customer's purchase history, customer attributes, customer preferences, etc.

[0020] The camera installed so as to be able to photograph customers is a camera installed in a store. The camera installed in a store is, for example, a camera installed on the ceiling or shelf of the store. There are no particular limitations on the camera that photographs customers, as long as it is capable of photographing the behavior of customers.

[0021] A store terminal is a terminal device used to provide services related to product sales at a store. The store terminal can acquire customer membership information. That is, the customer provides their membership information to the store terminal. For example, the store terminal acquires the membership information by reading a point card presented by the customer or a code displayed in an application on the terminal device.

[0022] Examples of the store terminal include a POS (Point of Sales) terminal that handles the payment of products purchased by a customer, a coupon issuing device that issues coupons in response to the customer providing membership information at the store, and a customer service support terminal that is used by a store clerk when the customer is served by the store clerk, etc. In Fig. 1, a POS terminal is shown as an example of the store terminal connected to the information providing device 100, but the information providing device 100 may be connected so as to be able to communicate with at least one of a POS terminal, a coupon issuing device, and a customer service support terminal.

[0023] An example of providing promotional information in FIG. 1 will be described.

[0024] A customer enters a store and wanders around the store. At this time, a camera captures the customer. At the store, the customer provides member information to a store terminal. At this time, the store terminal acquires the customer's member information. The information providing device 100 links a behavioral history based on the image acquired from the camera with the member information provided at the store terminal using the customer's identification information and registers it in a member information database. Then, the information providing device 100 outputs promotional information for the customer to the store terminal or the like based on the behavioral history and member information.

[0025] Note that this example only explains part of the processing of the information providing device 100, and the details of the processing of the information providing device 100 will be explained below.

[0026] Next, the configuration of the information providing device 100 according to the embodiment will be described.

[0027] Fig. 2 is a block diagram showing the configuration of the information providing device 100. Referring to Fig. 2, the information providing device 100 includes an acquiring unit 101, an identifying unit 102, a registering unit 103, a generating unit 104, an output unit 105, and a deleting unit 106.

[0028] Next, the configuration of the information providing device 100 in the first embodiment will be described in detail.

[0029] The acquisition unit 101 is an example of an acquisition unit that acquires video of the first customer in the store. The video is video captured by a camera installed in the store.

[0030] The acquisition unit 101 acquires video from a camera. As described above, the camera is a camera installed in a store. The camera installed in a store is, for example, a camera installed on the ceiling or a shelf of the store. The number or installation location of the cameras installed in the store is not particularly limited as long as they are capable of capturing images of customer behavior. Note that the video may be captured by multiple cameras installed in the store.

[0031] Here, the first customer refers to the customer who appears in the video.

[0032] The acquisition unit 101 also acquires the membership information of the second customer provided at the store terminal and the identification information of the second customer based on the image of the second customer.

[0033] The second customer is a customer who provides membership information. The first customer and the second customer may or may not be the same.

[0034] The identification unit 102 is an example of an identification means that identifies the behavior history of the first customer from the video using identification information that can identify the first customer included in the video.

[0035] Here, the identification information is information that can identify a customer. The identification information is, for example, biometric information of the customer identified from the video. The biometric information is, for example, a face image or an iris image. The biometric information may also be facial features identified from the face image or iris features identified from the iris image. The identification information may be at least one of clothing and belongings worn by the customer identified from the video. The identification information may also be the gait of the customer identified from the video.

[0036] The identification unit 102 may identify the behavior of a customer by identifying the customer using a combination of multiple types of identification information as the identification information.

[0037] For example, the identification unit 102 identifies identification information that can identify a customer from the video. Then, the identification unit 102 uses the identified identification information to track the customer in the video and identify the customer's behavior history. The identification unit 102 may identify the identification information and behavior history from the video using a known method.

[0038] The customer's behavior history is information used to provide promotional information to the customer. For example, the identification unit 102 identifies behavior that may indicate a relationship between the customer and a product. For example, the behavior that may indicate a relationship between the customer and a product is identified as behavior that indicates that the customer has an interest in the product. The behavior that indicates that the customer has an interest in the product is used to provide more effective promotional information to the customer.

[0039] Here, when the identification unit 102 identifies a behavior indicating that a customer has an interest in a product, the product may not be a single product but may be a group of products. The group of products may be, for example, a group of products classified by characteristics such as the use of the products or a group of products classified by the shelf on which the products are placed.

[0040] The identification unit 102 may use a known method to identify behavior indicating that a customer is interested in a product. For example, the identification unit 102 may identify, based on video, behaviors indicating that a customer is interested in a product, such as the customer's gaze turning toward the product, the customer lingering in front of the product for a predetermined period of time or longer, or the customer picking up the product. The identification unit 102 may then identify the product of interest based on the position, facial direction, and line of sight of the customer who performed the above-mentioned behavior. Note that the product of interest to the customer may be identified not only based on actual products or product shelves, but also based on advertisements displayed on signage, posters, etc.

[0041] The customer behavior history used for providing sales promotion information is not limited to this example. For example, the identification unit 102 may identify the customer's movement path in the store as the customer behavior history.

[0042] Furthermore, the identification unit 102 may identify, as the customer's behavior, the customer entering a store, the customer leaving a store, or the customer providing membership information. When identifying these behaviors, the identification unit 102 may use a known method.

[0043] The behavioral history identified by the identification unit 102 does not include information that can identify an individual. In other words, the behavioral history identified by the identification unit 102 is information that does not need to be protected as personal information.

[0044] The registration unit 103 is an example of a registration means that, when a second customer is a customer who exists as a first customer and who is the same as the second customer, links the behavioral history to the membership information and registers it based on the identification information of the second customer who provides the membership information and the identification information of the first customer included in the video. The second customer is a customer who provides membership information in order to receive store services at a store. For example, the second customer provides the membership information via a store terminal or a user terminal owned by the user.

[0045] The second customer's identification information may be identification information contained in an image taken by a camera installed in the store terminal to which the customer provides membership information, or identification information contained in video used to identify the customer's behavioral history.

[0046] The registration unit 103 uses known recognition technology or the like to identify the identification information of the first customer that can be determined to match the identification information of the second customer. Then, when the identification information of the first customer has been identified, the registration unit 103 links the behavioral history of the identified first customer to the membership information of the second customer. The linked behavioral history is registered in the membership information database.

[0047] The generation unit 104 is an example of a generation means that generates promotional information for a customer based on the member information and the behavioral history of the customer. The generation unit 104 generates promotional information based on the customer's member information and the customer's behavioral history in the store, so that promotional information that is more suited to the customer can be generated than when promotional information is generated using only one of the information.

[0048] The generating unit 104 generates sales promotion information about products that the customer is interested in but has not purchased, for example, based on products purchased by the customer based on the member information and actions indicating that the customer is interested in the products.

[0049] The promotional information generated by the generating unit 104 is not limited to this example, and the generating unit 104 may generate various types of promotional information. The generating unit 104 may also generate the promotional information using a known method.

[0050] The output unit 105 is an example of an output means for outputting sales promotion information to customers. The output unit 105 outputs the sales promotion information to a store terminal or a customer terminal used by a customer.

[0051] For example, the output unit 105 outputs promotional information to a customer terminal based on the customer's membership information. For example, the output unit 105 outputs the promotional information to a website or application to which the customer has logged in using the membership information on the customer terminal. Furthermore, for example, the output unit 105 may output the promotional information to a contact address registered as the customer's membership information.

[0052] For example, the output unit 105 outputs the sales promotion information to the store terminal to which the customer has provided their membership information. For example, the output unit 105 outputs the sales promotion information so that a printing device connected to the store terminal can print a receipt or other paper containing the sales promotion information. For example, the output unit 105 may output the sales promotion information so that it is displayed on the screen of the store terminal.

[0053] FIG. 3 shows an example of an output screen of an application that displays promotional information on a customer terminal after a purchase of a product at a store is completed. In FIG. 3, the output screen includes a message of thanks for the purchase, information about the purchased product, points awarded for the purchase, and promotional information. In FIG. 3, the output screen includes information about the purchased product, such as the name of the purchased product and the purchase quantity of the purchased product. Also, in FIG. 3, the output screen includes a button for checking purchase history details and a button for checking the customer's point details. Also, in FIG. 3, the promotional information is information indicating recommended products. Also, in FIG. 3, the output screen includes a button for recording the product output as a recommended product (a favorites button).

[0054] It should be noted that the example of the output screen in FIG. 3 is merely an example, and the manner in which the sales promotion information is output is not limited to this example.

[0055] Furthermore, for example, the output unit 105 may output information such as a message indicating that the promotional information is being provided using the behavioral history identified from the video, together with the promotional information.

[0056] The deletion unit 106 is an example of a deletion means that deletes the customer's identification information at a predetermined timing after the promotional information can be generated. That is, the deletion unit 106 deletes the customer's identification information that was registered by linking the behavioral history with the member information.

[0057] The predetermined timing for the deletion unit 106 to delete the identification information will be described. The identification information is retained so that the registration unit 103 can link the behavioral history with the membership information and the generation unit 104 can generate sales promotion information. However, because continuing to retain the identification information is undesirable from the perspective of protecting personal information, there is a need to promptly delete the identification information when it is no longer needed. Therefore, the predetermined timing for the deletion unit 106 to delete the identification information is the timing to delete the identification information in accordance with such needs. The predetermined timing is, for example, the timing when a customer provides membership information. For example, the predetermined timing is the timing when registration is performed by the customer providing membership information for payment at a POS terminal where the customer pays for the products they purchase. When a customer provides membership information for payment, it is expected that the customer will leave the store after payment, i.e., the customer is unlikely to browse products in the store. Therefore, by the deletion unit 106 deleting the identification information at the timing when registration is performed by the customer providing membership information for payment, the identification information can be deleted without delay.

[0058] Furthermore, for example, the predetermined timing is a timing based on the generation of promotional information. The timing based on the generation of promotional information is, for example, the timing when the promotional information is generated based on the behavioral history and member information. The timing based on the generation of promotional information may be the timing from when the promotional information is generated based on the behavioral history and member information until when the promotional information is output, or the timing when the promotional information is generated based on the behavioral history and member information and then output. This is because, after the promotional information is generated using the behavioral history, it may not be necessary to identify the behavioral history for generating the promotional information, and in this case, the identification information used to identify the behavioral history is not required.

[0059] Furthermore, for example, the predetermined timing is the timing when a customer leaves the store. In this case, the timing when the generation unit 104 generates the promotional information and the timing when the output unit 105 subsequently outputs the promotional information may be before or after the customer leaves the store. This is because there is no need to identify the behavioral history of a customer who has left the store, and therefore no identification information is required.

[0060] The timing of a customer leaving the store is, for example, the timing when it is determined from the video that the customer has left the store after promotional information becomes available for generation. In this case, if the first customer and the second customer are the same customer, the registration unit 103 links the behavioral history to the membership information and registers it based on the identification information of the second customer who provides membership information via the store terminal and the identification information of the first customer included in the video. Then, the identification unit 102 determines that the customer has left the store based on the video. The deletion unit 106 may delete the identification information when it is determined that the customer has left the store.

[0061] Furthermore, for example, the timing at which a customer leaves the store may be when a predetermined time has elapsed since the customer was photographed. The predetermined time is the amount of time the customer is expected to stay in the store. The predetermined time may be set in advance. The predetermined time may be set, for example, based on statistics of the amount of time customers stay in the store. The predetermined time may also be set for each store, each customer attribute, each customer, etc., or may be set to a fixed amount of time.

[0062] Next, an example in which a customer provides membership information at each store terminal will be described.

[0063] For example, if a customer provides membership information at a POS terminal, it is assumed that the customer provides the membership information to pay for the purchased items after shopping around the store. In this case, the timing when the customer provides the membership information at the POS terminal to pay for the purchased items corresponds to the timing when the customer provides the membership information via a store terminal among the above-mentioned predetermined timings. Therefore, the deletion unit 106 may delete the identification information at the timing when the customer provides the membership information at the POS terminal.

[0064] In this case, the customer has already made purchases in the store, so their behavioral history is identified and the generation unit 104 can generate promotional information. Therefore, in this case, the timing when the customer provides their membership information for the transaction at the POS terminal corresponds to the timing based on the generation of promotional information among the above-mentioned predetermined timings. Therefore, the deletion unit 106 may delete the identification information at the timing when the customer provides their membership information at the POS terminal.

[0065] Furthermore, for example, if a customer provides membership information at a POS terminal and then leaves the store, the deletion unit 106 may delete the identification information at the timing when the customer leaves the store, among the predetermined timings described above.

[0066] When a customer provides membership information for a transaction at a POS terminal, the deletion unit 106 may delete the identification information at one of the three timings described above. In this case, which of the three timings to delete the identification information may be set in advance. Furthermore, which of the three timings to delete the identification information may be set in advance for each characteristic of the customer's behavioral history. For example, the deletion unit 106 may delete the identification information of a customer who may continue to shop around the store after completing a transaction at the POS terminal when the customer leaves the store, and delete the identification information of other customers when the customer provides their membership information at the POS terminal. The fact that a customer may continue to shop around the store after completing a transaction at the POS terminal may be identified, for example, based on the customer's behavioral history that has already been registered.

[0067] Next, a case where a customer provides membership information to the coupon issuing device or customer service support terminal will be described. The coupon issuing device issues a preset coupon. The coupon issuing device may also issue a coupon generated by the generation unit 104 as promotional information.

[0068] For example, consider a case where a customer provides membership information to a coupon issuing device or a customer service support terminal. In this case, the customer may be either before shopping around the store, during shopping around, or after shopping around the store. That is, both a case where the identification unit 102 can identify a customer behavior history sufficient for generating promotional information and a case where the identification unit 102 cannot identify a customer behavior history sufficient for generating promotional information are possible.

[0069] For example, in a coupon issuing device or customer service support terminal, there may be a case where a customer provides membership information when the identification unit 102 has not been able to identify sufficient customer behavior history for generating promotional information. In this case, even if the membership information is provided to the coupon issuing device or customer service support terminal, the deletion unit 106 does not delete the identification information.

[0070] In addition, for example, in a coupon issuing device or customer service support terminal, there may be a case where a customer provides membership information when the identification unit 102 has identified a sufficient behavioral history of the customer for generating promotional information. In this case, the deletion unit 106 may delete the identification information at the time the membership information is provided to the coupon issuing device or customer service support terminal.

[0071] Whether or not the identification unit 102 has identified a sufficient customer behavior history for generating sales promotion information may be determined by the deletion unit 106 or by a determination unit (not shown).

[0072] For example, whether the identification unit 102 has identified a sufficient customer behavior history for generating promotional information may be determined based on the time from when the customer enters the store until when the customer provides their membership information on the coupon issuing device or customer service support terminal. For example, if the time from when the customer enters the store until when the customer provides their membership information on the coupon issuing device or customer service support terminal is equal to or greater than a threshold, it may be determined that the identification unit 102 has identified a sufficient customer behavior history for generating promotional information. The threshold may be set in advance to a time at which a sufficient customer behavior history for generating promotional information can be identified.

[0073] Furthermore, for example, whether the identification unit 102 has identified a customer behavior history sufficient for generating promotional information may be determined based on whether behavior indicating that the customer has become interested in a product has been identified. For example, if behavior indicating that the customer has become interested in a product has been identified, it may be determined that the identification unit 102 has identified a customer behavior history sufficient for generating promotional information.

[0074] Furthermore, for example, when a customer provides membership information via a coupon issuing device or a customer service support terminal, whether or not the identification unit 102 has identified a sufficient customer behavior history for generating promotional information may be set in advance based on the location of the store terminal in the store. Depending on the location of the store terminal in the store, it is possible to predict the timing at which the customer will provide their membership information via the store terminal.

[0075] For example, if the area where customer service is provided using a customer service support terminal or the area where a coupon issuing device is installed is close to the store entrance, it is expected that the customer will provide their membership information to the store terminal before shopping around the store. In this case, it is expected that the identification unit 102 will not be able to identify a customer's behavioral history sufficient for generating promotional information for the customer who provided their membership information to the coupon issuing device or customer service support terminal. Therefore, in this case, if the customer provided their membership information to the coupon issuing device or customer service support terminal, the deletion unit 106 may delete the identification information when the customer leaves the store, rather than when the customer provided their membership information.

[0076] Furthermore, for example, if the area where customer service is provided using the customer service support terminal or the area where the coupon issuing device is installed is far from the store entrance, it is expected that the customer will provide their membership information to the store terminal after making purchases in the store or while making their way around. In this case, it is expected that the identification unit 102 has identified a customer's behavioral history sufficient for generating promotional information for the customer who provided their membership information to the coupon issuing device or customer service support terminal. Therefore, in this case, if the customer provides their membership information to the coupon issuing device or customer service support terminal, the deletion unit 106 may delete the identification information at the time the customer provides their membership information via the store terminal.

[0077] There are cases where a customer does not provide membership information at a store. In this case, the deletion unit 106 may delete the identification information when the customer leaves the store. In this case, the registration unit 103 cannot link and register the customer's membership information and behavioral history. In this case, the registration unit 103 may register the behavioral history in the database without linking it with membership information. Even if the behavioral history is not linked to membership information, it may be useful for marketing at the store, so it may be desirable to accumulate it. In addition, the deletion unit 106 may delete the behavioral history together with the identification information when the customer leaves the store.

[0078] The operation of the information providing device 100 configured as above will be described with reference to the flowchart in Fig. 4. In this example, it is assumed that the deletion unit 106 deletes the identification information when the customer leaves the store.

[0079] The acquisition unit 101 acquires a video of a first customer in a store (step S101).

[0080] Next, the identification unit 102 identifies the behavior history of the first customer from the video using the identification information of the first customer included in the video (step S102).

[0081] Next, the acquisition unit 101 acquires the membership information of the second customer provided by the second customer at the store terminal (step S103). If the membership information of the second customer is not acquired in step S103 (step S103: No), the process proceeds to step S107.

[0082] In step S103, if the membership information of the second customer is obtained (step S103: Yes), the registration unit 103 links the behavioral history to the membership information and registers it if the first customer and the second customer are the same customer based on the identification information of the second customer who provides the membership information to the store terminal and the identification information of the first customer included in the video (step S104).

[0083] Next, the generation unit 104 generates sales promotion information based on the customer's membership information and behavior history (step S105).

[0084] Next, the output unit 105 outputs the sales promotion information generated in step S105 to the customer (step S106).

[0085] After step S106, or if the customer's membership information is not provided to the store terminal in step S103 (step S103: No), the identification unit 102 identifies that the customer has left the store based on the video (step S107).

[0086] Next, the deletion unit 106 deletes the identification information of the customer who has left the store (step S108).

[0087] This completes the series of operations of the information providing device 100. Note that the flowchart of FIG. 4 is an example of the processing of the information providing device 100, and the processing of the information providing device 100 is not limited to this example. For example, the processing of generating and outputting the promotional information in steps S105 and S106 may be performed after step S103, and the timing is not limited. For example, the processing of steps S105 and S106 may be performed after step S108. Also, for example, the processing of outputting the promotional information in step S106 may be performed after step S105, and the timing is not limited. For example, the processing of step S106 may be performed after step S108. Also, the processing of deleting the identification information in step S108 may be performed at any of the predetermined times as described above.

[0088] The information providing device in the above-described embodiment includes an acquisition unit, an identification unit, a registration unit, a generation unit, an output unit, and a deletion unit. The acquisition unit acquires video of a first customer captured in a store. The identification unit identifies the behavioral history of the first customer from the video using identification information that can identify the first customer contained in the video. The registration unit links the behavioral history to the membership information and registers it if the second customer is a customer who is the same as a first customer, based on the identification information of a second customer who provides membership information and the identification information of the first customer contained in the video. The generation unit generates promotional information for the customer based on the membership information and the behavioral history. The output unit outputs the promotional information to the customer. The deletion unit then deletes the customer's identification information at a predetermined timing after the promotional information can be generated.

[0089] The information providing device of this embodiment deletes the customer's identification information at a predetermined timing after promotional information can be generated, eliminating the need to manage personal information that is no longer needed. As a result, the information providing device of this embodiment can facilitate the management of personal information in a technology that identifies behavioral history using video.

[0090] [Second embodiment] Next, a second embodiment of the present disclosure will be described in detail with reference to the drawings. Below, the description of the second embodiment will be omitted to the extent that it does not make the description of the present embodiment unclear.

[0091] Fig. 5 is a block diagram showing the configuration of the information providing device 200. In Fig. 5, the information providing device 200 includes a receiving unit 207 in addition to the configuration of the first embodiment.

[0092] The acquiring unit 101, identifying unit 102, registering unit 103, generating unit 104, outputting unit 105, and deleting unit 106 are the same as those in the first embodiment, and therefore description thereof will be omitted.

[0093] The reception unit 207 is an example of a reception unit that receives a request as to whether the behavior history is to be linked to member information and registered.

[0094] For example, when a customer provides membership information at a store terminal, the reception unit 207 receives, via a selection screen displayed on the store terminal, a request as to whether the behavioral history will be linked to the membership information and registered. In this case, for example, when a customer provides membership information at a store terminal, the reception unit 207 causes a selection screen to be displayed on the store terminal. Then, the reception unit 207 receives, via the selection screen, a request as to whether the behavioral history will be linked to the membership information and registered.

[0095] The registration unit 103 performs a process of registering the behavior history in accordance with the content received by the reception unit 207 .

[0096] For example, when the reception unit 207 receives a request to register the behavioral history linked to the member information, the registration unit 103 registers the behavioral history linked to the member information. Also, when the reception unit 207 receives a request not to register the behavioral history linked to the member information, the registration unit 103 may register the behavioral history without linking it to the member information.

[0097] Alternatively, if the receiving unit 207 receives a request not to register the behavior history in association with the member information, the deletion unit 106 may delete the behavior history.

[0098] The timing at which the accepting unit 207 accepts whether to link the behavior history to the member information and register it is not limited to the above example.

[0099] For example, when a customer enters a store, the reception unit 207 may display a selection screen on a store terminal installed near the store entrance, and accept whether to link the behavior history to the member information and register it. In this case, the store terminal may be, for example, a signage installed near the store entrance or a scan shopping terminal installed in a shopping cart. In this case, the registration unit 103 may perform the behavior history registration process as described above, depending on the content accepted by the reception unit 207.

[0100] Furthermore, for example, the reception unit 207 may accept whether to register the behavioral history linked to the membership information by displaying a selection screen on a website or application to which the customer logs in using the membership information. In this case, the registration unit 103 may perform the process of registering the behavioral history as described above, depending on the content accepted by the reception unit 207.

[0101] 6 is an example of a selection screen. In FIG. 6, the selection screen includes a message prompting the customer to select whether or not to register a behavioral history, a button for registering the behavioral history, a button for not registering the behavioral history, a message indicating the intended use of the behavioral history, and a message indicating that the identification information is to be deleted. The reception unit 207 receives a request to register the behavioral history in association with the member information, depending on whether the button for registering the behavioral history or the button for not registering the behavioral history is pressed.

[0102] 6, the button for registering a behavioral history includes a message indicating the benefits of registering a behavioral history. In FIG. 6, the button for registering a behavioral history indicates that the user can "register a behavioral history and receive advantageous information."

[0103] The selection screen is not limited to the example shown in FIG.

[0104] The operation of the information providing device 200 configured as above will be described with reference to the flowchart of FIG.

[0105] The acquisition unit 101 acquires a video of a first customer in a store (step S201).

[0106] Next, the identification unit 102 identifies the behavior history of the first customer from the video using the identification information of the first customer included in the video (step S202).

[0107] Next, the acquisition unit 101 acquires the membership information of the second customer provided by the second customer at the store terminal (step S203). If the membership information of the second customer is not acquired at step S203 (step S203: No), the process proceeds to step S208.

[0108] In step S203, if the member information of the second customer is acquired (step S203: Yes), the reception unit 207 receives, via a selection screen displayed on the store terminal, whether to register the behavior history linked to the member information (step S204). In step S204, if it is received that the behavior history will not be registered linked to the member information (step S204: No), the process proceeds to step S208.

[0109] In step S204, if it is accepted that the behavioral history be linked to the member information and registered (step S204: Yes), the registration unit 103 will link the behavioral history to the member information and register it if the first customer and the second customer are the same customer based on the identification information of the second customer who provides the member information to the store terminal and the identification information of the first customer included in the video (step S205).

[0110] Next, the generation unit 104 generates sales promotion information based on the customer's membership information and behavior history (step S206).

[0111] Next, the output unit 105 outputs the sales promotion information generated in step S206 to the customer (step S207).

[0112] After step S207, if the customer's membership information is not provided to the store terminal in step S203 (step S203: No), or if it is accepted in step S204 that the behavioral history will not be linked to the membership information and registered (step S204: No), the identification unit 102 identifies that the customer has left the store based on the video (step S208).

[0113] Next, the deletion unit 106 deletes the identification information of the customer who has left the store (step S209).

[0114] This completes the series of operations of the information providing device 200. Note that the flowchart in Fig. 7 is an example of the processing of the information providing device 200, and similarly to the first embodiment, the processing of the information providing device 200 is not limited to this example.

[0115] The information providing device in the above-described embodiment includes an acquisition unit, an identification unit, a registration unit, a generation unit, an output unit, a deletion unit, and a reception unit. The acquisition unit acquires video of a first customer captured in a store. The identification unit identifies the behavioral history of the first customer from the video using identification information included in the video that can identify the first customer. The reception unit accepts whether to register the behavioral history linked to membership information. When the reception unit accepts whether to register the behavioral history linked to the membership information, the registration unit registers the behavioral history linked to the membership information if the second customer is a customer who exists as a first customer based on the identification information of a second customer who provides the membership information and the identification information of the first customer included in the video. The generation unit generates promotional information for the customer based on the membership information and the behavioral history. The output unit outputs the promotional information to the customer. The deletion unit deletes the customer's identification information at a predetermined timing after the promotional information can be generated.

[0116] The information providing device of this embodiment deletes the customer's identification information at a predetermined timing after promotional information can be generated, eliminating the need to manage personal information that is no longer needed. As a result, the information providing device of this embodiment can facilitate the management of personal information in a technology that identifies behavioral history using video.

[0117] Furthermore, the information providing device of this embodiment accepts a customer's request as to whether or not to register the behavioral history linked to member information, and performs processing to determine whether or not to register the behavioral history linked to member information according to the accepted request, so that the behavioral history can be registered according to the customer's request. As a result, the information providing device of this embodiment can easily manage the behavioral history according to the customer's request.

[0118] [Hardware Configuration] Some or all of the components of each device or system in each embodiment of the present disclosure described above are realized by any combination of an information processing device 1000 and a program, for example, as shown in Fig. 8. The information processing device 1000 includes, as an example, the following configuration.

[0119] - CPU (Central Processing Unit) 1001 - ROM (Read Only Memory) 1002 - RAM (Random Access Memory) 1003 - Program 1004 loaded into RAM 1003 - Storage device 1005 for storing program 1004 - Drive device 1007 for reading and writing from and to recording medium 1006 - Communication I / F 1008 for connecting to communication network 1009 - Input / output I / F 1010 for inputting and outputting data - Bus 1011 for connecting each component. Note that I / F is an abbreviation for Interface.

[0120] Each component of each device or system in each embodiment is realized by the CPU 1001 acquiring and executing a program that realizes the function of that component. The program that realizes the function of each component of each device is stored in the storage device 1005 or RAM 1003 in advance, for example, and is read by the CPU 1001 as needed. The program 1004 may be supplied to the CPU 1001 via a communication network, or may be stored in the recording medium 1006 in advance, and the drive device 1007 may read the program and supply it to the CPU 1001.

[0121] There are various variations in the method of realizing each device. For example, each device or system may be realized by any combination of a separate information processing device 1000 and a program for each component. Furthermore, multiple components included in each device may be realized by any combination of a single information processing device 1000 and a program.

[0122] Furthermore, some or all of the components of each device or system may be realized by general-purpose or dedicated circuits (circuitry) including a processor or the like, or a combination of these. Examples of circuits include a CPU, a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), and an AI (Artificial Intelligence) processing LSI (Large Scale Integration). These may be configured by a single chip or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits and a program.

[0123] When some or all of the components of each device or system are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, in which they are connected via a communication network.

[0124] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure.

[0125] Furthermore, although the operations are described in a sequential order in the form of a flowchart, the order of the description does not limit the order in which the operations are performed. Therefore, when implementing each embodiment, the order of the operations may be changed as long as it does not affect the content.

[0126] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.

[0127] Note that some or all of the configurations described in Supplementary Notes 2 to 18, which are subordinate to Supplementary Note 1 (information providing device) described later, may also be subordinate to Supplementary Note 19 (information providing method) and Supplementary Note 20 (recording medium) in the same subordinate relationship as Supplementary Note 2 to 18. Furthermore, not limited to Supplementary Note 1, Supplementary Note 19, and Supplementary Note 20, some or all of the configurations described as Supplements may be subordinate to various hardware, software, various recording means for recording software, or systems, within the scope of each of the above-mentioned embodiments.

[0128] [Supplementary Note 1] An information providing device comprising: an acquisition means for acquiring video of a first customer taken in a store; an identification means for identifying the first customer from the video using identification information contained in the video that can identify the first customer; a registration means for linking the behavioral history to membership information and registering the behavioral history when the second customer is a customer for which a first customer identical to the second customer exists, based on identification information of a second customer who provides membership information and the identification information of the first customer contained in the video; a generation means for generating promotional information for the customer based on the membership information and the behavioral history; an output means for outputting the promotional information to the customer; and a deletion means for deleting the customer's identification information at a predetermined timing after the promotional information can be generated.

[0129] [Supplementary Note 2] The information providing device according to Supplementary Note 1, wherein the predetermined timing is a timing when the customer provides the member information.

[0130] [Supplementary Note 3] The information providing device described in Supplementary Note 2, wherein the predetermined timing is the timing when the registration is performed by the customer providing the member information for payment at a POS terminal where the customer pays for the products they purchase.

[0131] [Supplementary Note 4] The information providing device according to any one of Supplementary Notes 1 to 3, wherein the predetermined timing is based on the generation of the sales promotion information.

[0132] [Supplementary Note 5] The information providing device according to any one of Supplementary Notes 1 to 4, wherein the predetermined timing is a timing when the customer leaves the store.

[0133] [Supplementary Note 6] The information providing device according to Supplementary Note 5, wherein the timing at which the customer leaves the store is a timing at which it is identified from the video that the customer has left the store after the promotional information becomes available to be generated.

[0134] [Supplementary Note 7] The information providing device according to Supplementary Note 5 or 6, wherein the timing at which the customer leaves the store is a timing at which a predetermined time has elapsed since the customer was photographed.

[0135] [Supplementary Note 8] The information providing device according to Supplementary Note 7, wherein the predetermined time is a time during which the customer is expected to stay in the store.

[0136] [Supplementary Note 9] The information providing device according to any one of Supplementary Notes 1 to 8, further comprising: a reception unit that receives whether or not the behavior history is to be linked to the member information and registered.

[0137] [Supplementary Note 10] The information providing device described in Supplementary Note 9, wherein when the customer provides the member information at the store terminal, the reception means receives, via a selection screen displayed on the store terminal, whether or not to register the behavior history in association with the member information.

[0138] [Appendix 11] The information providing device described in Appendix 9 or 10, wherein the registration means, when the reception means receives an instruction to register the behavioral history linked to the member information, registers the behavioral history linked to the member information, and when the reception means receives an instruction not to register the behavioral history linked to the member information, registers the behavioral history without linking it to the member information.

[0139] [Appendix 12] An information provision device as described in any of Appendices 1 to 11, wherein the member information is provided via a store terminal which is at least one of a POS terminal that handles the checkout of the products purchased by the customer, a coupon issuing device that issues coupons when the customer provides the member information at the store, and a customer service support terminal used by a store staff member when the customer is served by the store staff.

[0140] [Supplementary Note 13] An information providing device as described in any of Supplementary Notes 1 to 12, wherein the identification means identifies behavior indicating that the customer is interested in a product, and the generation means generates promotional information recommending a product that the customer has not purchased based on the product purchased by the customer based on the membership information and the behavior indicating that the customer is interested in the product.

[0141] [Supplementary Note 14] The information providing device according to any one of Supplementary Notes 1 to 13, wherein the identification information is biometric information of the customer identified from the video.

[0142] [Supplementary Note 15] The information providing device according to Supplementary Note 14, wherein the biometric information is a face image or an iris image.

[0143] [Supplementary Note 16] The information providing device according to any one of Supplementary Notes 1 to 15, wherein the identification information is at least one of clothing and accessories worn by the customer and belongings identified from the video.

[0144] [Supplementary Note 17] The information providing device according to any one of Supplementary Notes 1 to 16, wherein the identification information is a gait of the customer identified from the video.

[0145] [Supplementary Note 18] The information providing device according to any one of Supplementary Notes 1 to 17, wherein the output means outputs the sales promotion information to an output unit of a store terminal or a customer terminal used by the customer.

[0146] [Supplementary Note 19] An information provision method comprising: acquiring video footage of a first customer in a store; identifying a behavioral history of the first customer from the video using identification information contained in the video that can identify the first customer; linking the behavioral history to the membership information and registering it if the second customer is a customer for whom there is a first customer who is identical to the second customer, based on the identification information of a second customer who provides membership information and the identification information of the first customer contained in the video; generating promotional information for the customer based on the membership information and the behavioral history; outputting the promotional information to the customer; and deleting the customer's identification information at a predetermined time after the promotional information can be generated.

[0147] [Supplementary Note 20] A recording medium for recording a program that causes a computer to execute the following processes: acquiring video of a first customer taken in a store; identifying a behavioral history of the first customer from the video using identification information that can identify the first customer and that is included in the video; linking the behavioral history to the membership information and registering it if the second customer is a customer for whom there is a first customer who is the same as the second customer, based on the identification information of a second customer who provides membership information and the identification information of the first customer included in the video; generating promotional information for the customer based on the membership information and the behavioral history; outputting the promotional information to the customer; and deleting the customer's identification information at a predetermined timing after the promotional information can be generated.

[0148] REFERENCE SIGNS LIST 100 Information providing device 101 Acquisition unit 102 Identification unit 103 Registration unit 104 Generation unit 105 Output unit 106 Deletion unit 200 Information providing device 207 Reception unit 1000 Information processing device 1001 CPU 1002 ROM 1003 RAM 1004 Program 1005 Storage device 1006 Recording medium 1007 Drive device 1008 Communication I / F 1009 Communication network 1010 Input / output I / F 1011 Bus

Claims

1. An information providing device comprising: an acquisition means for acquiring video of a first customer taken in a store; an identification means for identifying the first customer from the video using identification information contained in the video that can identify the first customer; a registration means for linking the behavioral history to membership information and registering the behavioral history if the second customer is a customer for which a first customer identical to the second customer exists, based on the identification information of a second customer who provides membership information and the identification information of the first customer contained in the video; a generation means for generating promotional information for the customer based on the membership information and the behavioral history; an output means for outputting the promotional information to the customer; and a deletion means for deleting the customer's identification information at a predetermined time after the promotional information can be generated.

2. The information providing device according to claim 1, wherein the predetermined timing is the timing when the customer provides the member information.

3. The information providing device according to claim 2, wherein the predetermined timing is the timing when the registration is performed by the customer providing the member information for payment at a POS (Point of Sales) terminal where the customer pays for the products they purchase.

4. An information providing device according to any one of claims 1 to 3, wherein the predetermined timing is based on the generation of the sales promotion information.

5. An information providing device according to any one of claims 1 to 4, wherein the predetermined timing is the timing when the customer leaves the store.

6. The information providing device according to claim 5, wherein the timing at which the customer leaves the store is the timing at which it is determined from the video that the customer has left the store after the promotional information can be generated.

7. The information providing device according to claim 5 or 6, wherein the timing at which the customer leaves the store is a timing when a predetermined time has elapsed since the customer was photographed.

8. The information providing device according to claim 7, wherein the predetermined time is the time during which the customer is expected to stay in the store.

9. An information providing device according to any one of claims 1 to 8, further comprising: a reception means for receiving whether or not to register the behavioral history in association with the member information.

10. The information providing device of claim 9, wherein the reception means, when the customer provides the member information at the store terminal, receives, via a selection screen displayed on the store terminal, whether to link the behavioral history to the member information and register it.

11. The information providing device of claim 9 or 10, wherein the registration means, when the reception means accepts that the behavioral history be registered in association with the member information, registers the behavioral history in association with the member information, and, when the reception means accepts that the behavioral history be not registered in association with the member information, registers the behavioral history without linking it to the member information.

12. An information provision device as described in any one of claims 1 to 11, wherein the member information is provided via a store terminal which is at least one of a POS terminal which handles the checkout of the products purchased by the customer, a coupon issuing device which issues coupons when the customer provides the member information at the store, and a customer service support terminal used by a store staff member when the customer is served by the store staff member.

13. An information providing device as described in any one of claims 1 to 12, wherein the identification means identifies behavior indicating that the customer has an interest in a product, and the generation means generates promotional information recommending products that the customer has not purchased based on products purchased by the customer based on the membership information and behavior indicating that the customer has an interest in the product.

14. An information providing device according to any one of claims 1 to 13, wherein the identification information is biometric information of the customer identified from the video.

15. The information providing device according to claim 14, wherein the biometric information is a face image or an iris image.

16. An information providing device according to any one of claims 1 to 15, wherein the identification information is at least one of clothing and personal belongings worn by the customer identified from the video.

17. An information providing device according to any one of claims 1 to 16, wherein the identification information is the gait of the customer identified from the video.

18. An information providing device according to any one of claims 1 to 17, wherein the output means outputs the sales promotion information to an output unit of a store terminal or a customer terminal used by the customer.

19. An information provision method comprising: acquiring video footage of a first customer in a store; using identification information contained in the video that can identify the first customer, identifying the first customer's behavioral history from the video; if the second customer is a customer for whom there is a first customer who is the same as the second customer, linking the behavioral history to the membership information and registering it based on the identification information of a second customer who provides membership information and the identification information of the first customer contained in the video; generating promotional information for the customer based on the membership information and the behavioral history; outputting the promotional information to the customer; and deleting the customer's identification information at a predetermined time after the promotional information can be generated.

20. A recording medium for recording a program that causes a computer to execute the following processes: acquiring video footage of a first customer in a store; using identification information contained in the video that can identify the first customer, identifying the behavioral history of the first customer from the video; based on the identification information of a second customer who provides membership information and the identification information of the first customer contained in the video, if the second customer is a customer for whom there is a first customer who is the same as the second customer, linking the behavioral history to the membership information and registering it; generating promotional information for the customer based on the membership information and the behavioral history; outputting the promotional information to the customer; and deleting the customer's identification information at a predetermined time after the promotional information can be generated.

Images