Information processing system

Abstract

To efficiently acquire the situation of use of a promotion activity using the fragrance of a commodity.SOLUTION: An information processing system has: injection means that injects fragrance corresponding to a predetermined commodity according to a customer's operation; first acquisition means that acquires first data obtained by recording the injection date on which the injection means injects the fragrance and identification information for identifying the commodity corresponding to the injected fragrance; detection means that detects the movement of a customer reaching for the commodity from a picked-up image of a display shelf on which the commodity is displayed; second acquisition means that acquires second data obtained by recording the detection date on which the detection means detects the movement of the customer, and identification information on the commodity reached for by the customer in the movement or position information for specifying the display position of the commodity; and data management means that stores the first data and the second data in a storage and stores pieces of data having a time-series relationship in association with each other.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] FIELD An embodiment of the present invention relates to an information processing system. [Background technology]

[0002] Conventionally, supermarkets, convenience stores, mass retailers, and other stores have been promoting products by using their "scents" to promote the products they display in their stores. For example, they have installed devices or media that emit the scent of the products near the display.

[0003] However, the conventional method had the problem of being unable to grasp the customer usage status of promotional activities using "fragrance." Therefore, there was room for improvement in the operation of promotional activities using "fragrance." Summary of the Invention [Problem to be solved by the invention]

[0004] The problem to be solved by the present invention is to efficiently acquire the usage status of promotional activities using the scent of a product. [Means for solving the problem]

[0005] The information processing system of the embodiment includes an injection means that sprays a fragrance corresponding to a specific product in response to a customer's operation; a first acquisition means that acquires first data that records the injection date and time when the injection means sprayed the fragrance and identification information that identifies the product corresponding to the injected fragrance; a detection means that detects the action of a customer reaching out for the product from an image of a display shelf on which the product is displayed; a second acquisition means that acquires second data that records the detection date and time when the detection means detected the customer's action and the identification information of the product picked up by the customer in that action or location information that specifies the display location of the product; and a data management means that stores the first data and the second data in a storage device and associates and stores data that are chronologically related to each other. [Brief explanation of the drawings]

[0006] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to the first embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of the external configuration of the sales promotion support device according to the first embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of the hardware configuration of the aroma spraying device according to the first embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a hardware configuration of the sensor device according to the first embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of a hardware configuration of the POS terminal according to the first embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a hardware configuration of a server device according to the first embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of the functional configuration of the aroma spraying device, the sensor device, the POS terminal, and the server device according to the first embodiment. [Figure 8] FIG. 8 is a diagram showing an example of the data configuration of the injection performance data generated by the injection control unit of the first embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of the data configuration of the action result data generated by the customer action detection unit according to the first embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of first analysis result data generated by the analysis processor according to the first embodiment. [Figure 11] FIG. 11 is a diagram illustrating an example of second analysis result data generated by the analysis processing unit according to the first embodiment. [Figure 12] FIG. 12 is a sequence diagram for explaining the overall operation of the information processing system according to the first embodiment. [Figure 13] FIG. 13 is a flowchart illustrating an example of analysis processing performed by the server device of the first embodiment. [Figure 14] FIG. 14 is a diagram illustrating an example of the configuration of an information processing system according to the second embodiment. [Figure 15] FIG. 15 is a diagram illustrating an example of the configuration of an ID management server according to the second embodiment. [Figure 16] FIG. 16 is a diagram illustrating an example of the functional configuration of the aroma spraying device, the sensor device, the POS terminal, the server device, and the ID management server according to the second embodiment. [Figure 17] FIG. 17 is a diagram illustrating an example of the data configuration of the read result data generated by the read detection unit according to the second embodiment. [Figure 18] FIG. 18 is a sequence diagram for explaining the overall operation of the information processing system according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0007] Hereinafter, an embodiment will be described in detail with reference to the drawings. The embodiment described below is one embodiment of a server device and an information processing system, and does not limit the configuration, specifications, etc. The embodiment described below is an example of application to a POS (Point Of Sales) system introduced in a store such as a supermarket.

[0008] (First embodiment) 1 is a diagram showing an example of the configuration of an information processing system 1 according to the first embodiment. As shown in FIG. 1, the information processing system 1 includes a sales promotion support device 10, a POS terminal 20, and a server device 30.

[0009] The sales promotion support device 10 and the POS terminal 20 are installed in, for example, a store SP and connected to a server device 30 via a network N. The network N may be the Internet, a VPN (Virtual Private Network), a LAN (Local Area Network), a public communication network, a mobile communication network, or the like, either alone or in combination as appropriate. Note that the number of POS terminals 20 and sales promotion support devices 10 installed in the store SP is not particularly limited.

[0010] The sales promotion support device 10 is a device for supporting the sales promotion of products, and is installed in a store SP. The sales promotion support device 10 of this embodiment supports the sales promotion of products (hereinafter also referred to as target products) that feature "fragrance," such as air fresheners, detergents, bath additives, perfumes, etc. The number of target products is not limited to one, and may be multiple.

[0011] The sales promotion support device 10 includes, for example, a scent spraying device 11 and a sensor device 12. The scent spraying device 11 is an example of a spraying means. The scent spraying device 11 is placed, for example, near a target product and sprays the scent of the target product in response to a customer's operation. When the scent spraying device 11 sprays the scent, it generates spraying record data including the date and time of spraying and information that can identify the target product corresponding to the scent (a product code, described below), and transmits the spraying record data to the server device 30.

[0012] The sensor device 12 is an example of a detection means. The sensor device 12 detects the customer's behavior from image data captured of a display shelf (a product shelf 15 described later) on which the target product is displayed. When the sensor device 12 detects the customer's behavior, it generates customer behavior data including information indicating the date and time of the detection and the content of the behavior, and transmits the data to the server device 30.

[0013] The sales promotion support device 10 is not limited to the above configuration. For example, the sales promotion support device 10 may include a display device for displaying advertisements. The display device may be implemented, for example, by a liquid crystal display or the like, and displays images (video) for advertisements or promotions of pre-prepared target products. Furthermore, for example, the sales promotion support device 10 may include an audio output device. The audio output device may be implemented, for example, by a speaker or the like, and outputs audio for advertisements or promotions of pre-prepared target products. The display device and the audio output device may be integrated.

[0014] Here, one embodiment of the sales promotion support device 10 will be described with reference to Fig. 2. Fig. 2 is a diagram for explaining an example of the external configuration of the sales promotion support device 10. As shown in Fig. 2, the sales promotion support device 10 can be realized using a product shelf 15, for example.

[0015] The product shelf 15 has a multi-tier configuration with a bottom plate 16 and a top plate 17 separated by a plurality of shelf boards 18. For example, FIG. 2 shows a product shelf 15 with four tiers separated by three shelf boards 18. Target product I is displayed on the product shelf 15. FIG. 2 shows an example in which six types of target products Ia to If are displayed on the product shelf 15.

[0016] Additionally, a scent sprayer 11 is provided on the product shelf 15. FIG. 2 shows an example in which the scent sprayer 11 is provided on the second product shelf 15 from the top. Here, the scent sprayer 11 has six spray buttons B corresponding to each of the six types of target products I displayed on the product shelf 15, and when operation of a spray button B is accepted, the scent of the target product I corresponding to the spray button B is sprayed from a spray nozzle C. It is preferable that each spray button B displays the product name, image, etc. of the corresponding target product I.

[0017] This allows a customer operating the scent spraying device 11 to easily check the scent of the target product I that interests them and, after smelling the scent, take out the corresponding target product.

[0018] 2, the sensor device 12 is installed at a position on the floor surface in front of the product shelf 15 where it can capture an image of a section of width H from the edge of the product shelf 15 (hereinafter also referred to as a monitored area A). The width H is preferably long enough for a single customer to stand there. This makes it possible to efficiently capture the behavior of customers facing the product shelf 15.

[0019] In Figure 2, the sensor device 12 is held by a holding member 19 provided on the top plate 17, but this is not limited to this, and the sensor device 12 may be provided on the ceiling part immediately above the product shelf 15, for example.

[0020] 2 shows an example in which a display device 13 for displaying advertisements is provided on the top shelf of the product shelf 15. The display device 13, for example, repeatedly displays an advertising video for the target product I displayed on the product shelf 15. This allows the target product displayed on the product shelf 15 to be advertised to customers, thereby increasing the opportunities for customers to stop in front of the product shelf 15, use the scent spraying device 11, and purchase the target product I.

[0021] Returning to FIG. 1 , the explanation will continue. The POS terminal 20 is an example of a checkout means. The POS terminal 20 is a sales data processing device that performs a registration process to register the sales of products purchased by customers of the store and a checkout process for the products registered in the registration process. Once the checkout process is complete, the POS terminal 20 generates sales data that includes at least the details of the products purchased by the customer and the date and time of the transaction, and sends the sales data to the server device 30.

[0022] The server device 30 receives various data transmitted from the sales promotion support device 10 (aroma spraying device 11, sensor device 12) and the POS terminal 20. Furthermore, the server device 30 associates and stores data that are chronologically related to each other among the various received data.

[0023] The server device 30 may be installed inside or outside the store SP. The server device 30 may also be a so-called cloud consisting of a plurality of server devices.

[0024] The configuration of each device included in the information processing system 1 will be described below.

[0025] Fig. 3 is a diagram showing an example of the hardware configuration of scent spraying device 11. As shown in Fig. 3, scent spraying device 11 includes a control unit 111, a memory unit 112, a communication unit 113, an operation unit 114, and a scent spraying unit 115. These units are interconnected via a bus 116 such as a data bus or an address bus.

[0026] The control unit 111 has a processor such as a CPU (Central Processing Unit), memories such as a ROM (Read Only Memory) and a RAM (Random Access Memory), and a timekeeping unit such as an RTC (Real Time Clock), and is configured similarly to a general computer. For example, the control unit 111 is configured to load various programs stored in a memory such as a ROM or in the storage unit 112 into the RAM of the memory, and to realize the various functions of the aroma spraying device 11 described below by the processor executing the various loaded programs.

[0027] The storage unit 112 is a storage device equipped with a non-volatile recording medium such as a hard disk drive (HDD), a solid state drive (SSD), flash memory, etc. The storage unit 112 stores various programs and various data related to the operation of the aroma spraying device 11.

[0028] As an example, the storage unit 112 stores a control program 1121. For example, the control program 1121 includes at least one program for realizing each functional unit of the aroma spraying device 11.

[0029] The storage unit 112 also stores setting information 1122 that sets the correspondence between the spray buttons and the product codes of the target products that correspond to the fragrances sprayed by operating the spray buttons. For example, the setting information 1122 stores button IDs that can identify each spray button and the product codes of the target products that correspond to the fragrances sprayed by operating the spray button with the button ID in association with each other.

[0030] The communication unit 113 is an interface for communicating with an external device such as the server device 30 connected to the network N. The communication unit 113 includes either a communication circuit for wired communication or a communication circuit for wireless communication, and is connected to the network N via the communication circuit.

[0031] The operation unit 114 is equipped with various controls for operating the scent sprayer 11. For example, the operation unit 114 is equipped with a spray button, which is an operator for instructing the spraying of a scent. A spray button is provided for each type of scent that the scent sprayer 11 can spray, i.e., for each item of target product. For example, if the scent sprayer 11 can spray six types of scent, six spray buttons are provided.

[0032] The ejection button may be a physical button or a virtual button (GUI) displayed on the screen. In the latter case, the operation unit 114 is realized by a touch panel provided on a display screen such as an LCD (Liquid Crystal Display), and an image representing the ejection button is displayed on the display screen.

[0033] The scent spraying unit 115 sprays the scent under the control of the control unit 111. The scent spraying unit 115 has, for example, a holder such as a tank or cylinder that holds the scent gas, and a spray nozzle that sprays the scent gas held in the holder. Under the control of the control unit 111, the scent spraying unit 115 controls the opening and closing of the spray nozzle, thereby spraying the scent gas from the holder instructed by the spray button to the outside of the scent sprayer 11. The sprayed scent gas, i.e., the "scent" of the target product, is released from a spray nozzle (see Figure 2) provided in the scent spraying device 11.

[0034] When spraying multiple scents, scent sprayer 115 includes multiple holders that hold aromatic gases corresponding to the respective scents. For example, when spraying six types of scents, scent sprayer 115 includes six holders. In this case, a spray nozzle may be provided for each holder, or multiple holders may share one spray nozzle.

[0035] Fig. 4 is a diagram showing an example of the hardware configuration of the sensor device 12. As shown in Fig. 4, the sensor device 12 includes a control unit 121, a storage unit 122, a communication unit 123, and an imaging unit 124. These units are connected to each other via a bus 125 such as a data bus or an address bus.

[0036] The control unit 121 has a processor such as a CPU, memories such as a ROM and a RAM, and a clock unit such as an RTC, and is configured similarly to a general computer. For example, the control unit 121 is configured to load various programs stored in a memory such as a ROM or in the storage unit 122 into the RAM of the memory, and to realize each function of the sensor device 12 described below by the processor executing the various loaded programs.

[0037] The storage unit 122 is a storage device that includes a nonvolatile recording medium such as an HDD, an SSD, a flash memory, etc. The storage unit 122 stores various programs and various data related to the operation of the sensor device 12.

[0038] As an example, the storage unit 122 stores a control program 1221. For example, the control program 1221 includes at least one program for implementing each functional unit of the sensor device 12.

[0039] The communication unit 123 is an interface for communicating with an external device such as the server device 30 connected to the network N. The communication unit 123 includes either a communication circuit for wired communication or a communication circuit for wireless communication, and is connected to the network N via the communication circuit.

[0040] The imaging unit 124 is an imaging device such as a TOF camera, a stereo camera, or a 2D camera. The imaging unit 124 captures an image of a customer approaching the sales promotion support device 10 and acquires image data of a moving image. The image data captured by the imaging unit 124 is stored, for example, in RAM or the storage unit 122, and is subjected to the motion detection process described below. The amount of data (number of hours) of image data stored in the RAM or the storage unit 122 is not particularly important, and the image data may be deleted sequentially, for example, starting with image data for which motion detection has been completed.

[0041] 5 is a diagram showing an example of the hardware configuration of the POS terminal 20. The POS terminal 20 includes a control unit 21, a storage unit 22, a communication unit 23, a display unit 24, an operation unit 25, a scanner unit 26, and a printing unit 27. These units are communicatively connected via a bus 28 such as a data bus or an address bus.

[0042] The control unit 21 has a processor such as a CPU, memories such as a ROM and a RAM, and a clock unit such as an RTC, and is configured similarly to a general computer. For example, the control unit 21 is configured to load various programs stored in a memory such as a ROM or in the storage unit 22 into the RAM of the memory, and to realize the various functions of the POS terminal 20 described below by the processor executing the various loaded programs.

[0043] The storage unit 22 is a storage device that includes a non-volatile recording medium such as an HDD, an SSD, a flash memory, etc. The storage unit 22 stores various programs and various data related to the operation of the POS terminal 20.

[0044] As an example, the storage unit 22 stores a control program 221. For example, the control program 221 includes at least one program for implementing each function unit of the POS terminal 20.

[0045] The storage unit 22 also stores a product master 222 that associates product codes of products sold at the store SP with product information about the products. Here, the product code is an example of identification information that can identify the type of product, such as a JAN (Japanese Article Number) code. The product information includes the product name, price, etc. of the product corresponding to the product code. Note that the product master 222 includes the product code of the target product. The product master 222 may also hold target products and products other than the target products in a distinguishable state, for example, by including information that can identify whether the product is a target product in the product information.

[0046] The communication unit 23 is an interface for communicating with an external device such as a server device 30 connected to the network N. The communication unit 23 includes either a communication circuit for wired communication or a communication circuit for wireless communication, and is connected to the network N via the communication circuit.

[0047] The display unit 24 is configured with a display device such as an LCD, etc. The display unit 24 displays various information under the control of the control unit 21.

[0048] The operation unit 25 has various keys for operating the POS terminal 20. For example, the operation unit 25 has a value key used to manually input the number of items and item codes, a closing key for ending product sales registration and instructing to proceed to accounting, an accounting key for instructing to execute accounting processing, etc. The operation unit 25 may be a touch panel provided on the display screen of the display unit 24.

[0049] The scanner unit 26 reads information indicated in a code symbol such as a barcode, a two-dimensional code, etc. For example, the scanner unit 26 reads the product code of the product from the code symbol attached to the product.

[0050] The printing unit 27 is a printer device such as a thermal printer, etc. Under the control of the control unit 21, the printing unit 27 prints receipts and the like showing the details of the transaction on paper.

[0051] Fig. 6 is a diagram showing an example of the hardware configuration of the server device 30. As shown in Fig. 6, the server device 30 has a control unit 31, a storage unit 32, and a communication unit 33. The control unit 31, the storage unit 32, and the communication unit 33 are communicatively connected via a bus 34 such as a data bus or an address bus.

[0052] The control unit 31 has a processor such as a CPU, memories such as a ROM and a RAM, and a clock unit such as an RTC, and is configured similarly to a general computer. For example, the control unit 31 is configured to load various programs stored in a memory such as a ROM or in the storage unit 32 into the RAM of the memory, and to realize each function of the server device 30 described below by the processor executing the various loaded programs.

[0053] The storage unit 32 is a storage device that includes a non-volatile recording medium such as an HDD, an SSD, a flash memory, etc. The storage unit 32 stores various programs and various data related to the operation of the server device 30.

[0054] As an example, the storage unit 32 stores a control program 321, target product information 322, target product placement information 323, a store performance data storage unit 324, and an analysis result storage unit 325. For example, the control program 321 includes at least one program for realizing each functional unit of the server device 30.

[0055] The target product information 322 stores the product code of the target product in association with the product information of the target product corresponding to the product code. The product information includes the product name, price, etc. of the target product.

[0056] The target product placement information 323 stores the product code of the target product in association with information indicating the display position of the target product. Here, the display position of the target product means the position where the target product is displayed on the product shelf 15. For example, the display position of the target product is defined by the row and height positions, coordinates, area, etc. on the product shelf 15.

[0057] The store performance data storage unit 324 is an area for storing various data transmitted from the store SP. For example, the store performance data storage unit 324 is realized by a database or the like, and stores sales data, spray performance data, operation performance data, and the like.

[0058] The analysis result storage unit 325 is an area for storing analysis result data generated by the analysis processing unit 313 (see FIG. 7) described later.

[0059] The communication unit 33 is a communication interface for communicating with external devices such as the sales promotion support device 10 (aroma spraying device 11, sensor device 12) and the POS terminal 20. The communication unit 33 includes either a communication circuit for wired communication or a communication circuit for wireless communication, and is connected to the network N via the communication circuit.

[0060] Next, we will explain the functional configurations of the scent spraying device 11, the sensor device 12, the POS terminal 20, and the server device 30. Figure 7 is a diagram showing an example of the functional configurations of the scent spraying device 11, the sensor device 12, the POS terminal 20, and the server device 30.

[0061] First, we will explain the functional configuration of the scent spraying device 11. The control unit 111 of the scent spraying device 11 realizes the functions of a spraying control unit 1111 and a spraying performance data transmission unit 1112 by the processor executing a control program 1121 loaded into memory, as shown in FIG.

[0062] The spray control unit 1111 controls the spraying of the scent in response to an operation via the operation unit 114. Specifically, when the spray control unit 1111 receives a press of a spray button, it controls the scent spraying unit 115 to spray the scent corresponding to the operated spray button. Furthermore, the spray control unit 1111 continues spraying the scent while the spray button is pressed, and stops spraying the scent when the pressing operation is released.

[0063] The spray control unit 1111 also records the operation history of the spray operation. Specifically, when the spray control unit 1111 receives a press of the spray button, it records the date and time when the press was performed as the spray start date and time, and identifies and stores the product code corresponding to the button ID of the operated spray button from the setting information 1122. Next, when the press of the spray button is released, the spray control unit 1111 records the date and time when the press was released as the spray end date and time. Then, each time a fragrance spray operation is performed, the spray control unit 1111 generates spray record data consisting of a set of the spray start date and time, the spray end date and time, and the product code.

[0064] Fig. 8 is a diagram showing an example of the data configuration of the ejection performance data generated by the ejection control unit 1111. As shown in Fig. 8, the ejection performance data includes items such as the ejection date and time (ejection start date and time, ejection end date and time), product code, etc. Note that Fig. 8 shows three sets of ejection performance data, that is, the operation history of three ejection operations.

[0065] The first spraying record data shows that the scent corresponding to the target product with product code "0001" was sprayed from the spray start date and time "2024 / 5 / 16 15:01:35.278" to the spray end date and time "2024 / 5 / 16 15:01:38.623." The next spraying record data shows that the scent corresponding to the target product with product code "0003" was sprayed from the spray start date and time "2024 / 5 / 16 15:01:50.341" to the spray end date and time "2024 / 5 / 16 15:01:53.243." The last spraying record data shows that the scent corresponding to the target product with product code "0004" was sprayed from the spray start date and time "2024 / 5 / 16 15:02:40.261" to the spray end date and time "2024 / 5 / 16 15:02:45.431."

[0066] In this way, the spray control unit 1111 generates spray record data that can identify the date and time when the fragrance was sprayed and the product for which the fragrance was sprayed.

[0067] The injection performance data transmission unit 1112 transmits the injection performance data generated by the injection control unit 1111 to the server device 30. For example, every time the injection control unit 1111 generates injection performance data, the injection performance data transmission unit 1112 transmits the injection performance data to the server device 30. Also, for example, the injection performance data transmission unit 1112 transmits the injection performance data generated by the injection control unit 1111 to the server device 30 at a predetermined timing (for example, every hour or every 24 hours).

[0068] The spraying record data transmission unit 1112 may transmit identification information that can identify its own aroma spraying device 11 to the server device 30 together with the spraying record data.

[0069] Next, we will explain the functional configuration of the sensor device 12. The control unit 121 of the sensor device 12 realizes the functions of a customer behavior detection unit 1211 and a customer behavior data transmission unit 1212 by the processor executing a control program 1221 loaded into the memory, as shown in FIG.

[0070] The customer movement detection unit 1211 detects the movement of a customer from the image data captured by the imaging unit 124. For example, the customer movement detection unit 1211 detects an image of a customer (hereinafter also referred to as a customer image) from the image data, and detects the movement of the customer from the movement of the customer image.

[0071] Specifically, when the customer action detection unit 1211 detects a customer image from chronologically consecutive image data, it issues a unique detection ID and generates action record data that associates the detection ID with the date and time the customer image was detected. The detection ID is identification information for identifying a series of actions and corresponds to specific information that identifies the customer who performed the action. Furthermore, the detection date and time are recorded as two dates and times: the date and time when detection of the customer image started (hereinafter also referred to as the detection start date and time) and the date and time when detection of the customer image stopped (hereinafter also referred to as the detection end date and time).

[0072] Furthermore, the customer action detection unit 1211 detects an action of a customer reaching out towards the product shelf 15 (hereinafter also referred to as a reaching action) by tracking the movement of the customer image included in the image data. When a reaching action is detected, the customer action detection unit 1211 three-dimensionally analyzes the position of the customer's hand shown in the image data, etc., to identify the position and area of ​​the product shelf 15 where the customer reached out. The customer action detection unit 1211 then generates action record data that associates the detection ID with information identifying the position and area on the product shelf 15 where the customer reached out. Note that the reaching action is an action that is detected after the customer image is detected, so the detection ID issued when the customer image was detected continues to be used.

[0073] Fig. 9 is a diagram showing an example of the data configuration of the action record data generated by the customer action detection unit 1211. As shown in Fig. 9, the action record data includes items such as a detection ID, a detection date and time, and a hand reaching position. Note that Fig. 9 shows the detection results for detection IDs 1 to 3, that is, the action records for three customers.

[0074] Here, the behavior history data for detection ID "1" indicates that the subject stayed in front of the product shelf 15 from the detection start date and time "2024 / 5 / 16 15:01:20.678" to the detection end date and time "2024 / 5 / 16 15:04:10.375", and that the subject reached out to three different positions (target products) during this stay. Also, the behavior history data for detection ID "2" indicates that the subject stayed in front of the product shelf 15 from the detection start date and time "2024 / 5 / 16 15:11:07.321" to the detection end date and time "2024 / 5 / 16 15:12:22.115", and that the subject did not perform any reaching motion during this stay. Furthermore, the behavioral history data for detection ID "3" indicates that the person stayed in front of product shelf 15 between the detection start date and time "2024 / 5 / 16 15:37:51.416" and the detection end date and time "2024 / 5 / 16 15:40:42.348", and that during this stay, the person reached out to two different locations (target products).

[0075] In this way, the customer action detection unit 1211 generates the spraying record data that can identify the length of time the customer stayed at the product shelf 15 and the reaching action performed by the customer toward the product shelf 15 (target product).

[0076] 9, the position or area of ​​the product shelf 15 where the customer reached out is recorded as the reaching position, but this is not limiting, and the product code of the target product displayed at the reaching position may be recorded. In this case, the sensor device 12 stores, for example, target product placement information 323 (described later) that associates the product code of the target product with information indicating the display position of the target product, and the customer action detection unit 1211 identifies the product code corresponding to the reaching position based on the target product placement information 323.

[0077] Furthermore, the method for detecting a customer's movement by the customer movement detection unit 1211 is not particularly limited, and it is possible to apply known techniques using, for example, image recognition, AI (deep learning), etc. For example, the customer movement detection unit 1211 may detect skeletal data of the customer by estimating the posture of the customer from the customer image included in the image data, and detect a reaching movement from the movement of the skeletal data.

[0078] The customer action data transmission unit 1212 transmits the action history data generated by the customer action detection unit 1211 to the server device 30. For example, every time the customer action detection unit 1211 generates action history data, the customer action data transmission unit 1212 transmits the action history data to the server device 30. Also, for example, the customer action data transmission unit 1212 transmits the action history data generated by the customer action detection unit 1211 to the server device 30 at a predetermined timing (for example, every hour or every 24 hours).

[0079] The customer operation data transmission unit 1212 may transmit identification information that can identify its own sensor device 12 to the server device 30 together with the operation record data.

[0080] Next, we will explain the functional configuration of the POS terminal 20. The control unit 21 of the POS terminal 20 realizes the functions of a registration processing unit 211, an accounting processing unit 212, and a sales data transmission unit 213 by the processor executing a control program 221 loaded into memory, as shown in FIG.

[0081] The registration processing unit 211 executes product sales registration (registration processing) based on the product code read by the scanner unit 26 or the product code input via the operation unit 25. Specifically, the registration processing unit 211 reads product information corresponding to the product code from the product master 222, and stores the read product information together with the product code and the number of items in RAM or the like. When the registration processing unit 211 acquires a product code for which sales registration has already been completed, it adds 1 to the number of items for the corresponding product code. Note that the default value for the number of items is 1.

[0082] The accounting processor 212 processes the accounting for the products purchased by the customer. Specifically, when the accounting processor 212 receives an instruction to end sales registration by operating the closing key, etc., it calculates the total price of the products purchased by the customer based on the price and number of items included in the product information of each registered product. Here, the total price can be calculated by multiplying the product price by the number of items for that product and adding up the total for all registered products.

[0083] The accounting processor 212 executes accounting processing to settle the calculated total amount using the payment method specified by the customer. The accounting processor 212 may also display a screen on the display unit 24 for selecting a payment method during accounting processing.

[0084] When the transaction processing unit 212 completes the transaction, it generates sales data indicating the details of the transaction. The sales data includes the product code and quantity of the registered product, the total amount, the amount paid in the transaction, and other information indicating the date and time the transaction took place (transaction date and time). The transaction processing unit 212 then works in cooperation with the printing unit 27 to print the sales data on paper, thereby issuing a receipt indicating the transaction details.

[0085] The sales data transmission unit 213 transmits the sales data generated by the accounting processing unit 212 to the server device 30. For example, every time the accounting processing unit 212 generates sales data, the sales data transmission unit 213 transmits the sales data to the server device 30. Also, for example, the sales data transmission unit 213 transmits the sales data generated by the accounting processing unit 212 to the server device 30 at a predetermined timing (for example, every hour or every 24 hours).

[0086] The sales data transmitting unit 213 may transmit identification information capable of identifying its own POS terminal 20 (or store SP) together with the sales data to the server device 30. The sales data transmitting unit 213 may also extract sales data including the product code of the target product and transmit the extracted sales data to the server device 30.

[0087] Next, a description will be given of the functional configuration of the server device 30. The control unit 31 of the server device 30 realizes functions as a data acquisition unit 311, a data management unit 312, and an analysis processing unit 313 by the processor executing a control program 321 loaded into the memory, as shown in FIG.

[0088] The data acquisition unit 311 is an example of a first data acquisition means, a second data acquisition means, and a third data acquisition means. The data acquisition unit 311 acquires various data transmitted from the sales promotion support device 10 (aroma spraying device 11, sensor device 12) and the POS terminal 20 via the communication unit 33. For example, the data acquisition unit 311 acquires spraying performance data from the aroma spraying device 11. The data acquisition unit 311 also acquires customer behavior data from the sensor device 12. The data acquisition unit 311 also acquires sales data from the POS terminal 20.

[0089] Data management unit 312 is an example of a data management means. Data management unit 312 stores various data (sales data, spray history data, and customer behavior data) acquired by data acquisition unit 311 in store performance data storage unit 324. Data management unit 312 also associates and stores data that are chronologically related to each other based on date and time information included in each of the sales data, spray history data, and customer behavior data.

[0090] Specifically, the data management unit 312 searches for actual injection data whose injection date and time falls within the detection period (hereinafter referred to as the detection period) included in the customer behavior data. When the data management unit 312 finds the corresponding actual injection data, it stores the actual injection data in association with the customer behavior data. The method for associating the customer behavior data with the actual injection data is not particularly limited; for example, the association may be achieved by adding a detection ID included in the customer behavior data to the actual injection data.

[0091] When associating customer behavior data with spraying history data, the data management unit 312 may extract customer behavior data with a detection period equal to or greater than a threshold (e.g., 3 seconds or more) to exclude customer behavior data of customers who passed in front of the product shelf 15. In this case, the data management unit 312 compares the detection period included in the extracted customer behavior data with the spraying date and time included in each piece of spraying history data.

[0092] Furthermore, the data management unit 312 identifies a product code corresponding to the position or area of ​​the target of the reaching hand for the customer behavior data in which the reaching motion is recorded. Specifically, when the customer behavior data includes information indicating the position or area of ​​the target of the reaching hand, the data management unit 312 identifies a product code corresponding to the position or area of ​​the target of the reaching hand based on the target product placement information 323. Next, the data management unit 312 sequentially references, in chronological order, sales data including transaction dates and times after the detection period (detection end date and time) of the customer behavior data in which the reaching motion is recorded, and determines whether sales data including the identified product code exists. If the data management unit 312 detects sales data including the identified product code, it stores the sales data in association with the customer behavior data in which the reaching motion is recorded. Here, the method for associating the customer behavior data with the sales data is not particularly limited; for example, the association may be performed by adding a detection ID included in the customer behavior data to the sales data.

[0093] When associating customer behavior data with sales data, the data management unit 312 may limit the range of sales data to be referenced to sales data whose transaction date and time is after the detection end date and time and falls within a predetermined time period (e.g., one hour) from the detection end date and time. In this case, it is preferable to adjust the predetermined time period to be referenced based on the shopping habits of customers at the store SP.

[0094] In this way, the data management unit 312 associates and stores data related chronologically based on the date and time information included in each of the sales data, spray history data, and customer behavior data. This allows the data management unit 312 to associate sales data, spray history data, and customer behavior data related to the same customer, making it possible to record customer trends regarding the target product for each customer.

[0095] The analysis processing unit 313 is an example of a generating means. The analysis processing unit 313 generates analysis result data that indicates customer trends regarding target products, based on various data stored in the store performance data storage unit 324. The analysis processing unit 313 then stores (outputs) the generated analysis result data in the analysis result storage unit 325.

[0096] For example, the analysis processing unit 313 generates first analysis result data indicating customer trends with respect to a target product based on customer behavior data obtained over a predetermined unit time (e.g., one day's business hours). Specifically, the analysis processing unit 313 derives the number of customers who stopped by the product shelf 15 and the number of passersby who passed by without stopping by the product shelf 15 from the customer behavior data. The analysis processing unit 313 counts the number of detection IDs for which the elapsed time from the detection start date and time to the detection end date and time is less than a threshold (e.g., 3 seconds), and regards the counted number as the number of passersby. Furthermore, for example, the analysis processing unit 313 counts the number of detection IDs for which the elapsed time from the detection start date and time to the detection end date and time is equal to or greater than a threshold (e.g., 3 seconds). The analysis processing unit 313 then regards the counted number of detection IDs as the number of stopers who stopped by the product shelf 15, or derives a stop rate as the proportion of stopers to the total number of people calculated by adding the passersby to the stopers.

[0097] In addition, the analysis processing unit 313 derives the number of detection IDs for which the elapsed time from the detection start date and time to the detection end date and time is greater than a threshold (e.g., 3 seconds) and the percentage of such numbers, among the detection IDs for which the elapsed time is greater than 10 seconds or greater than 20 seconds.

[0098] Furthermore, the analysis processing unit 313 derives the number of detection IDs in which a reaching motion has been detected as the number of times of reaching, among the number of detection IDs for which the elapsed time from the detection start date and time to the detection end date and time is equal to or greater than a threshold (for example, 3 seconds), and derives the proportion of the number of times of reaching as the reaching rate. Whether a reaching motion has been detected can be determined based on the presence or absence of information specifying the position or area of ​​the reaching destination.

[0099] In addition, the analysis processing unit 313 derives the percentage (purchase rate) of target products that customers picked up and actually purchased by dividing the number of sales data associated with the customer behavior data of the detection ID by the number of detection IDs in which the reaching behavior was detected.

[0100] 10 is a diagram showing an example of first analysis result data generated by the analysis processing unit 313. Here, an example is shown in which analysis result data is derived based on one day's worth of customer behavior data.

[0101] As shown in FIG. 10, the first analysis result data includes items such as the number of passersby, stopover rate, stopover rate (10 seconds or more), stopover rate (20 seconds or more), reach rate, and purchase rate. By looking at such first analysis result data, it is possible to easily confirm the rate at which customers stop by the product shelf 15 and the percentage of customers who actually picked up the target product. In addition, by looking at the first analysis result data, it is possible to easily confirm the percentage of customers who ended up purchasing the target product they picked up. Therefore, it is possible to confirm the effectiveness of the sales promotion activities carried out by the sales promotion support device 10.

[0102] Furthermore, the analysis processing unit 313 generates second analysis result data that indicates customer trends regarding the target product based on the spraying record data obtained within a predetermined unit time (e.g., one day's business hours). Specifically, the analysis processing unit 313 counts the number of product codes of the target product included in the spraying record data for each type of product code, thereby deriving the number of times the fragrance has been sprayed for each target product.

[0103] The analysis processing unit 313 also refers to the sales data associated with the spraying performance data via the customer behavior data, and counts the number of product codes of the target products included in the sales data, i.e., the number of target products purchased, for each type of product code. The analysis processing unit 313 then divides the number of target products purchased by the number of times the scent of the target product was sprayed, thereby deriving the purchase rate as the number of purchases of the target product relative to the number of times the scent was sprayed.

[0104] 11 is a diagram showing an example of second analysis result data generated by analysis processing unit 313. Here, an example is shown in which second analysis result data is derived based on one day's worth of injection performance data.

[0105] As shown in Fig. 11, the second analysis result data has a data structure in which the number of sprays and the purchase rate are associated for each target product. Fig. 11 shows an example of output in which the product code of the target product is converted into the product name based on the target product information 322.

[0106] By looking at the second analysis result data in Figure 11, it is possible to check the number of times customers sprayed the fragrance for each target product. Also, by looking at the second analysis result data, it is possible to easily check how many target products that have been sprayed with fragrance were actually purchased. For example, it is possible to easily identify target products that have a low purchase rate despite being sprayed more frequently than other target products.

[0107] The analysis result data generated by the analysis processing unit 313 is not limited to the above example. For example, the analysis processing unit 313 may generate analysis result data (third analysis result data) that derives the relationship between the number of sprays and the reaching rate (number of reachings) for each target product based on customer behavior data and actual spray data that have a chronological relationship. The analysis processing unit 313 may also generate analysis result data in which the purchase rate is replaced with the reaching rate.

[0108] Next, a description will be given of an example of the operation of the information processing system 1. First, the overall operation of the information processing system 1 will be described with reference to Fig. 12. Here, Fig. 12 is a sequence diagram for explaining the overall operation of the information processing system 1.

[0109] First, when the customer action detection unit 1211 of the sensor device 12 detects a customer (customer image) present in front of the product shelf 15 from the image data captured by the imaging unit 124 (step S11), it records the current date and time as the detection start date and time (step S12).

[0110] Furthermore, when the spraying control unit 1111 of the scent spraying device 11 receives an instruction from a customer located in front of the product shelf 15 via the operation unit 114 to instruct the spraying of the scent of a specific target product (step S21), the spraying control unit 1111 sprays the scent of the instructed target product (step S22). Next, the spraying control unit 1111 generates spraying record data including the date and time when the scent was sprayed and the product code of the target consumption corresponding to the sprayed scent (step S23). Then, the spraying record data transmission unit 1112 transmits the spraying record data generated by the spraying control unit 1111 to the server device 30 (step S24).

[0111] The data acquisition unit 311 of the server device 30 acquires the spraying record data transmitted from the aroma spraying device 11 (step S31). Next, the data management unit 312 stores the acquired spraying record data in the store record data storage unit 324 (step S32).

[0112] On the other hand, when the customer action detection unit 1211 of the sensor device 12 detects the customer's outstretched hand action from the image data captured by the imaging unit 124 (step S13), it identifies the position or area of ​​the outstretched hand (step S14). If the customer action detection unit 1211 does not detect the outstretched hand action, the process proceeds to step S15.

[0113] Next, when the customer movement detection unit 1211 of the sensor device 12 detects from the image data captured by the imaging unit 124 that the customer has moved away from the product shelf 15 (step S15), it records the current date and time as the detection end date and time (step S16). Then, the customer movement detection unit 1211 generates customer movement data that records a series of customer movements based on the processing results of steps S12, S13, and S16 (step S17). Then, the customer movement data transmission unit 1212 of the sensor device 12 transmits the customer movement data generated by the customer movement detection unit 1211 to the server device 30 (step S18).

[0114] The data acquisition unit 311 of the server device 30 acquires the customer behavior data transmitted from the sensor device 12 (step S33). Next, the data management unit 312 stores the customer behavior data in the store performance data storage unit 324 (step S34). In addition, the data management unit 312 stores, among the spraying performance data stored in the store performance data storage unit 324, spraying performance data that has a chronological relationship with the customer behavior data stored in step S34, in association with the customer behavior data (step S35).

[0115] Specifically, the data management unit 312 searches the store performance data storage unit 324 for spraying record data whose spraying date and time falls within the detection period of the customer behavior data. The data management unit 312 then stores the corresponding spraying record date and customer behavior data in association with each other.

[0116] Meanwhile, the registration processing unit 211 of the POS terminal 20 executes the registration process for the products purchased by the customer (step S41). When an instruction to end the registration process is given by operating a closing key or the like, the transaction processing unit 212 calculates the total price of the registered products and executes the transaction process (step S42). Next, when the transaction process is completed, the transaction processing unit 212 generates sales data indicating transaction details such as the product codes of the registered products and the transaction date and time (step S43) and issues a receipt based on the sales data. The sales data transmission unit 213 then transmits the sales data generated by the transaction processing unit 212 to the server device 30 (step S44).

[0117] The data acquisition unit 311 of the server device 30 acquires the sales data transmitted from the POS terminal 20 (step S36). Next, the data management unit 312 stores the sales data in the store performance data storage unit 324 (step S37). In addition, the data management unit 312 stores, among the customer behavior data stored in the store performance data storage unit 324, customer behavior data that has a chronological relationship with the sales data stored in step S37, in association with the sales data (step S38).

[0118] Specifically, the data management unit 312 extracts customer behavior data in which the detection end date and time is within a predetermined time (e.g., one hour) from the customer behavior data that records the reaching behavior and is stored in the store performance data storage unit 324. Next, the data management unit 312 identifies a product code that corresponds to the position or area of ​​the reaching destination included in the extracted customer behavior data based on the target product placement information 323. Then, if the identified product code is included in sales data, the data management unit 312 associates the sales data with the corresponding customer behavior data and stores them.

[0119] Next, an example of the analysis process performed by the analysis processing unit 313 of the server device 30 will be described with reference to Fig. 13. Fig. 13 is a flowchart showing an example of the analysis process performed by the server device 30.

[0120] First, the analysis processing unit 313 generates first analysis result data based on the customer behavior data for a predetermined period stored in the store performance data storage unit 324 and the sales data associated with the customer behavior data (step S51).

[0121] In addition, the analysis processing unit 313 generates second analysis result data based on the spray performance data for a predetermined period stored in the store performance data storage unit 324 and sales data associated with the spray performance data via customer behavior data (step S52).

[0122] Then, analysis processing unit 313 stores the generated first analysis result data and second analysis result data in analysis result storage unit 325 (step S53), and ends this process.

[0123] As described above, the information processing system 1 according to this embodiment includes the scent spraying device 11 that sprays a scent corresponding to a target product in response to a customer's operation, and the sensor device 12 that detects the customer's action of reaching out for a target product from an image of the product shelf 15 on which the target product is displayed. The server device 30 of the information processing system 1 acquires spraying history data that records the spraying date and time when the scent spraying device 11 sprayed the scent and the product code of the target product corresponding to the sprayed scent, and customer action data that records the detection date and time when the sensor device 12 detected the customer's action and the identification information of the product picked up by the customer or information specifying the display position of the product, and stores the acquired spraying history data and customer action data in the store history data storage unit 324, and also stores data that are chronologically related to each other in an associated manner.

[0124] This allows the information processing system 1 to store spraying history data and customer behavior data related to the same customer in association with each other, allowing the customer's behavior regarding the target product to be recorded for each individual customer. Specifically, the relationship between the behavior of the customer approaching the product shelf 15 and the operation details of the scent sprayer 11 can be tracked and recorded. Therefore, the information processing system 1 can efficiently obtain information on the customer's usage of promotional activities using the product's scent.

[0125] The information processing system 1 also has a POS terminal 20 that executes the transaction process for products purchased by customers, and the server device 30 acquires sales data that records the transaction date and time of the transaction process executed by the POS terminal 20 and the product code of the product purchased in the transaction process, stores the acquired sales data in the store performance data storage unit 324, and also stores customer behavior data that has a chronological relationship with the transaction date and time included in the sales data in association with it.

[0126] As a result, the information processing system 1 can store sales data and customer behavior data related to the same customer in association with each other, allowing the customer's behavior regarding the target product to be recorded for each individual customer. Specifically, the entire series of actions a customer takes from the time they pick up the target product until they purchase it can be tracked and recorded. Therefore, the information processing system 1 can efficiently obtain information on the customer's usage of promotional activities using the product's scent.

[0127] In addition, in the information processing system 1, the sensor device 12 detects a customer approaching the product shelf 15, and the server device 30 acquires customer behavior data in which the detection start date and time when the sensor device 12 started to detect the customer and the detection end date and time when the customer was no longer detected are recorded as detection dates and times.

[0128] As a result, the information processing system 1 can easily determine whether a customer who approached the product shelf 15 passed by or stopped at the product shelf 15, based on the inspection date and time included in the customer behavior data. Therefore, the information processing system 1 can efficiently obtain information on customer usage of promotional activities using product scents.

[0129] In addition, in the information processing system 1, the fragrance spraying device 11 is installed on the product shelf 15, and the server device 30 associates and stores data in which the spraying date and time included in the spraying performance data and the detection date and time included in the customer operation data are in an inclusive relationship.

[0130] This allows the information processing system 1 to efficiently manage data by easily associating chronologically related spraying record data with customer behavior data. Therefore, the information processing system 1 can efficiently obtain information on customer usage of promotional activities using product scents.

[0131] Furthermore, in the information processing system 1, the server device 30 generates analysis result data indicating customer trends regarding target products based on various data stored in the store performance data storage unit 324.

[0132] This allows the information processing system 1 to effectively utilize the various data stored in the store performance data storage unit 324, making it possible to efficiently obtain information on customer usage of promotional activities using product scents.

[0133] (Second embodiment) The information processing system of the second embodiment has a configuration and function that can identify the customer who operated the scent spraying device 11. The information processing system 2 of the second embodiment will be described below. Note that components similar to those of the first embodiment described above are given the same reference numerals, and descriptions will be omitted as appropriate. Furthermore, components given the same reference numerals do not necessarily have all the same functions and properties, and may have different functions and properties depending on the embodiment.

[0134] Fig. 14 is a diagram showing an example of the configuration of an information processing system 2 according to the second embodiment. As shown in Fig. 14, the information processing system 2 includes a sales promotion support device 10, a POS terminal 20, a server device 30, and an ID management server 50. In the information processing system 2, the sales promotion support device 10 and the POS terminal 20 are provided in each of a plurality of stores SP.

[0135] The server device 30 of this embodiment is connected to each store SP and centrally manages data acquired at each store SP. The server device 30 also stores, in the storage unit 32 or the like, installation location management information (not shown) that associates identification information (hereinafter also referred to as device ID) that can identify a device installed in each store SP with installation location information that indicates the installation location of the device.

[0136] Furthermore, the sales promotion support device 10 of this embodiment includes an ID reader 40 in addition to the scent sprayer 11 and sensor device 12 described above.

[0137] The ID reader 40 is an example of a reading means. The ID reader 40 is a device that reads identification information (hereinafter also referred to as a user ID) that can identify a customer from a medium carried by the customer. Here, the user ID has information (e.g., a number) that is unique to each customer, and is assigned to the customer after, for example, going through a procedure such as membership registration. The user ID is an example of specific information that can identify the customer.

[0138] The ID reader 40 has a configuration according to the characteristics of the medium to be read. For example, if the medium to be read is a card medium such as a magnetic card or an IC card, the ID reader 40 has a magnetic card reader or an IC card reader. For example, if the medium to be read is a code symbol such as a barcode or a two-dimensional code displayed on a mobile device such as a smartphone carried by a customer, the ID reader 40 has a code scanner or an imaging device that can read the code symbol.

[0139] In this embodiment, the ID reader 40 is installed near the scent sprayer 11, for example, on the product shelf 15 shown in Figure 2, and reads the user ID from the medium of the customer using the scent sprayer 11. The ID reader 40 may also be provided integrally with the scent sprayer 11.

[0140] The ID reading device 40 is also configured to be able to communicate with the ID management server 50 via the network N, and transmits the read user ID to the ID management server 50. Specifically, the ID reading device 40 transmits a read notification to the ID management server 50, which includes the read user ID and the device ID of its own ID reading device 40.

[0141] The ID management server 50 is connected via a network N to the sales promotion support devices 10 (aroma spraying devices 11, sensor devices 12, ID reading devices 40) and server devices 30 etc. installed in each store SP so as to be able to communicate with each other.

[0142] The ID management server 50 receives the read notification transmitted from the ID reading device 40. Furthermore, upon receiving the read notification, the ID management server 50 generates customer identification data including the user ID and device ID contained in the read notification and the date and time when the read notification was received, and transmits the generated customer identification data to the server device 30. Note that the ID management server 50 may transmit customer information corresponding to the user ID read from customer management information 523 (described later) by including it in the customer identification data.

[0143] Furthermore, each of the scent spraying device 11, sensor device 12, and POS terminal 20 of this embodiment transmits its own device ID together with or included in various data to the server device 30. The server device 30 then stores the sets of various data and device IDs transmitted from each of the scent spraying device 11, sensor device 12, POS terminal 20, and ID management server 50, associating them with chronologically related data for each store SP and shelf 15 to which the device ID belongs. In this way, the server device 30 of this embodiment comprehensively manages the data acquired at each store SP.

[0144] Next, a description will be given of the configuration of the above-mentioned ID management server 50. Fig. 15 is a diagram showing an example of the hardware configuration of the ID management server 50 according to this embodiment.

[0145] 15, the ID management server 50 includes a control unit 51, a storage unit 52, and a communication unit 53. The control unit 51, the storage unit 52, and the communication unit 53 are communicatively connected via a bus 54 such as a data bus or an address bus.

[0146] The control unit 51 has a processor such as a CPU, memories such as a ROM and a RAM, and a clock unit such as an RTC, and is configured similarly to a general computer. For example, the control unit 51 is configured to load various programs stored in a memory such as a ROM or the storage unit 42 into the RAM of the memory, and to realize each function of the ID management server 50 described below by having the processor execute the various loaded programs.

[0147] The storage unit 52 is a storage device that includes a nonvolatile recording medium such as an HDD, an SSD, a flash memory, etc. The storage unit 52 stores various programs and various data related to the operation of the ID management server 50.

[0148] As an example, the storage unit 52 stores a control program 521, installation location management information 522, and customer management information 523. For example, the control program 521 includes at least one program for realizing each function unit of the ID management server 50.

[0149] The installation location management information 522 is a data table or database that associates the device ID of each device installed in each store SP with the installation location information of the device.

[0150] Here, the installation location information is information that can identify the store SP and the product shelf 15 where the device is installed. For example, for devices such as the scent spraying device 11 and the ID reading device 40 that are installed on the product shelf 15, it is preferable that the installation location information be information that can identify the store SP and the product shelf 15. Note that devices (scent spraying devices 11 and ID reading devices 40) installed in the same store and on the same product shelf 15 can be associated with the same installation location information.

[0151] For the POS terminal 20, the installation location information can be information that can identify the store SP where the POS terminal 20 is installed. Note that the installation location management information stored in the server device 30 of this embodiment can use a data table or database similar to the installation location management information 522.

[0152] The customer management information 523 stores customer information of a customer corresponding to the user ID in association with the user ID of the customer. The customer information includes, for example, the name and age of the customer.

[0153] The communication unit 53 is a communication interface for communicating with external devices such as the sales promotion support device 10 (aroma spraying device 11, sensor device 12, ID reading device 40) and the server device 30. The communication unit 53 includes either a communication circuit for wired communication or a communication circuit for wireless communication, and is connected to the network N via the communication circuit.

[0154] Fig. 16 is a diagram showing an example of the functional configuration of the scent spraying device 11, sensor device 12, POS terminal 20, server device 30, and ID management server 50 according to this embodiment. For ease of explanation, Fig. 16 illustrates an ID reading device 40.

[0155] The control unit 51 of the ID management server 50 realizes the functions of a reading detection unit 511, a reading history data transmission unit 512, and a usage restriction unit 513, as shown in Figure 16, by the processor executing the control program 521 loaded into the memory.

[0156] The read detection unit 511 detects that a user ID has been read by the ID reading device 40. Specifically, in response to a read notification transmitted from the ID reading device 40, the read detection unit 511 detects that a customer with a user ID included in the read notification has read the user ID with the ID reading device 40 with the device ID included in the read notification.

[0157] Furthermore, when the reading detection unit 511 detects that a user ID has been read by the ID reading device 40, it generates reading history data that records the user ID read by the ID reading device 40, the ID reading device 40 that performed the reading, the date and time the reading was performed, etc. Specifically, the reading detection unit 511 generates reading history data that includes the user ID and device ID included in the reading notification, and the date and time the reading notification was received. Hereinafter, the date and time included in the reading history data will also be referred to as the "reading date and time."

[0158] Fig. 17 is a diagram showing an example of the data configuration of the reading history data generated by the reading detection unit 511 of this embodiment. As shown in Fig. 17, the reading history data includes a user ID, a reading date and time, and a device ID. Note that Fig. 17 shows three reading history data sets, that is, the reading operation records of three people.

[0159] The first reading history data indicates that at reading date and time "2024 / 5 / 16 14:55:10.278", a customer with user ID "0000000001" performed a reading operation using an ID reader 40 with device ID "A000000001". The next reading history data indicates that at reading date and time "2024 / 5 / 16 15:04:20.241", a customer with user ID "0000099888" performed a reading operation using an ID reader 40 with device ID "B000000009". The last reading history data indicates that at reading date and time "2024 / 5 / 16 15:10:10.325", a customer with user ID "0010044003" performed a reading operation using an ID reader 40 with device ID "A000000001".

[0160] In this way, the reading detection unit 511 generates reading history data that can identify the user ID that can identify the customer, the ID reading device that performed the reading operation for the user ID, and the reading date and time. Note that the reading detection unit 511 may read customer information corresponding to the user ID from the customer management information 523 and include the read customer information in the reading history data.

[0161] 16, the description will be continued. The reading history data transmission unit 512 transmits the reading history data generated by the reading detection unit 511 to the server device 30. For example, every time the reading detection unit 511 generates reading history data, the reading history data transmission unit 512 transmits the reading history data to the server device 30. Also, for example, the reading history data transmission unit 512 transmits the reading history data generated by the reading detection unit 511 to the server device 30 at a predetermined timing (for example, every hour or every 24 hours).

[0162] The usage restriction unit 513 is an example of a control means. The usage restriction unit 513 controls the operation of the scent spraying device 11 and the sensor device 12, and starts the operation of the scent spraying device 11 and the sensor device 12 on the condition that the user ID is read by the ID reading device 40.

[0163] Specifically, when the usage restriction unit 513 receives a read notification from the ID reading device 40, it identifies the store and product shelf 15 where the user ID was read, based on the installation location management information 552 and the device ID included in the read notification. Then, the usage restriction unit 513 transmits instruction information permitting use (hereinafter also referred to as usage permission information) to the aroma spraying device 11 and sensor device 12 installed in the identified store and product shelf 15. In this way, the usage restriction unit 513 executes processing to restrict customers who use the sales promotion support device 10.

[0164] In the fragrance spraying device 11 of this embodiment, the spray control unit 1111 controls the device so that it can spray fragrance according to the usage permission information. For example, the spray control unit 1111 disables the spray button until it receives the usage permission information, and enables the spray button once it receives the usage permission information, making it operable. Furthermore, after enabling the spray button, the spray control unit 1111 disables the spray button if it is not operated for a predetermined period of time (e.g., 10 seconds). In this way, the fragrance spraying device 11 of this embodiment limits use of the fragrance spraying device 11 to customers who have read their user ID.

[0165] Furthermore, in the sensor device 12 of this embodiment, the customer movement detection unit 1211 starts detecting customer movements in accordance with the usage permission information. After starting to detect customer movements, if no movements are detected for a predetermined time (e.g., 10 seconds), the customer movement detection unit 1211 stops detecting customer movements. As a result, the sensor device 12 of this embodiment limits the movement detection targets to customers whose user IDs have been read.

[0166] Furthermore, in the server device 30 of this embodiment, the data acquisition unit 311 functions as an example of a first data acquisition means, a second data acquisition means, a third data acquisition means, and a fourth data acquisition means. The data acquisition unit 311 acquires, via the communication unit 33, various data transmitted from the sales promotion support device 10 (aroma spraying device 11, sensor device 12) and the POS terminal 20, and reading record data transmitted from the ID management server 50.

[0167] Furthermore, the data management unit 312 stores various data (sales data, spray performance data, customer behavior data, and reading performance data) acquired by the data acquisition unit 311 in the store performance data storage unit 324. In this embodiment, the target product information 322 corresponds to a plurality of stores SP and product shelves 15, and therefore stores the product code of the target product and information indicating the display position in association with each other for each store SP and product shelf 15.

[0168] Then, the data management unit 312 associates and stores data that are chronologically related based on the date and time information included in each of the sales data, the ejection record data, the customer action data, and the read record data.

[0169] Specifically, the data management unit 312 identifies the store SP or product shelf 15 where the device ID is installed, based on the installation location management information and the device ID included in (or associated with) each data. Then, the data management unit 312 associates and stores data that are chronologically related with each other, based on the date and time information included in each of the sales data, spray performance data, customer behavior data, and reading performance data, which are categorized for the same store SP and the same product shelf 15.

[0170] As an example, the data management unit 312 searches for customer behavior data whose detection start date and time is within a predetermined time (e.g., two minutes) based on the reading date and time included in the reading history data. For example, the data management unit 312 searches for customer behavior data whose detection start date and time is within a predetermined time before or after the reading date and time. Then, when the data management unit 312 finds the relevant customer behavior data, it stores the customer behavior data in association with the reading history data.

[0171] As another example, the data management unit 312 searches for ejection history data that includes an ejection start date and time within a predetermined period (e.g., 3 minutes) from the read date and time based on the read date and time included in the read history data. Then, when the data management unit 312 searches for the corresponding ejection history data, it stores the read history data in association with the ejection history data or the ejection history data associated with the customer operation data.

[0172] Here, the method of associating with the read history data is not particularly limited, and for example, the detection ID included in the customer behavior data may be added to the read history data to associate with a series of customer behavior data. Note that the method of associating sales data, spray history data, and customer behavior data is the same as in the above-described embodiment.

[0173] In this way, the data management unit 312 of this embodiment associates and stores chronologically related data for the same store SP (and product shelf 15) based on the date and time information included in each of the sales data, spraying history data, customer behavior data, and reading history data. In this way, the data management unit 312 associates and manages the sales data, spraying history data, and customer behavior data related to the same customer who used the same store SP (and product shelf 15). Therefore, the data management unit 312 can record the trends of each customer with respect to target products at each store SP in a state where the customer is identified.

[0174] Furthermore, the analysis processing unit 313 generates analysis result data indicating customer trends for target products for each store SP or each product shelf 15, based on the various data stored in the store performance data storage unit 324. Then, the analysis processing unit 313 stores (outputs) the generated analysis result data in the analysis result storage unit 325.

[0175] The processing performed by the analysis processing unit 313 is the same as that in the first embodiment described above, but analysis may be performed based on a newly added user ID. For example, the analysis processing unit 313 may generate analysis result data indicating customer trends regarding target products for each customer (individual) corresponding to the user ID. By using such analysis result data, it is possible to efficiently carry out sales promotions (distributing coupons and encouraging customers to visit the store) for the customers corresponding to the user ID, for example.

[0176] Next, the overall operation of the information processing system 2 will be described with reference to Fig. 18. Here, Fig. 18 is a sequence diagram for explaining the overall operation of the information processing system 2 according to this embodiment. In Fig. 18, the same processes as those in Fig. 12 are given the same step numbers, and the description thereof will be omitted as appropriate. Also, for the sake of convenience, Fig. 18 omits the processes related to the POS terminal 20 shown in Fig. 12 (steps S41 to S44, steps S36 to S38), but it is assumed that the same processes as those in Fig. 12 are performed.

[0177] First, when the user ID is read by the ID reader 40 (step S51), the ID reader 40 transmits a read notification including the user ID and device ID to the ID management server 50 (step S52).

[0178] Upon receiving the read notification from the ID reader 40, the read detection unit 511 of the ID management server 50 generates read record data based on the read notification (step S53).

[0179] Next, the usage restriction unit 513 of the ID management server 50 identifies the store and shelf 15 where the user ID was read, i.e., the installation location of the ID reading device 40, based on the installation location management information 552 and the device ID included in the read notification (step S54).The usage restriction unit 513 transmits usage permission information to the aroma spraying device 11 and the sensor device 12 installed at the identified installation location (step S55).

[0180] Meanwhile, the aroma spraying device 11 and the sensor device 12 start their operations upon receiving the usage permission information, and execute the processes of steps S11 to S18 and steps S21 to S24.

[0181] Furthermore, the read history data transmission unit 512 of the ID management server 50 transmits the read history data to the server device 30 at a predetermined timing (step S56).

[0182] When the data acquisition unit 311 of the server device 30 acquires the read history data transmitted from the ID management server 50 (step S61), the data acquisition unit 311 stores the acquired read history data in the store history data storage unit 324 (step S62). Note that, although Fig. 18 shows an example in which the read history data is acquired after step S35, the timing is not limited to this.

[0183] In addition, the data management unit 312 of the server device 30 associates and stores data of the same store SP and the same product shelf 15 that are chronologically related among the spraying performance data, customer behavior data, and reading performance data stored in the store performance data storage unit 324 (step S63).

[0184] By executing the above process, the information processing system 2 can record and manage each customer's actions toward the target products and fragrance spraying devices 11 on the product shelves 15 of each store SP in a manner that identifies each individual.

[0185] As described above, the information processing system 2 according to this embodiment can identify customers who have shown an interest in the scent spraying device 11 and store the spraying performance data and customer behavior data related to the customer in association with each other, thereby recording the customer's behavior regarding the target product on an individual basis. Specifically, the relationship between the behavior of customers approaching the product shelf 15 and the operation details of the scent spraying device 11 can be tracked and recorded on an individual basis. Therefore, the information processing system 1 can efficiently obtain information on the customer's usage of promotional activities using the scent of the product.

[0186] The above-described embodiment can be modified as needed by changing some of the configurations or functions of the above-described devices. Therefore, the following describes modifications of the above-described embodiment as other embodiments. The following mainly describes differences from the above-described embodiment, and omits detailed descriptions of commonalities with the content already described. The modifications described below may be implemented individually or in appropriate combination.

[0187] (Variation 1) In each of the above-described embodiments, the scent sprayer 11 is installed on the product shelf 15 where the target products are displayed. However, the scent sprayer 11 may be installed at a location away from the product shelf 15. In this case, the chronological inclusion relationship between the spraying history data and the customer behavior data relating to the same customer is lost, but picking up the target product after checking the scent of the target product is a common behavior. Therefore, for example, the data management unit 312 of the server device 30 may be configured to determine that there is a chronological relationship when customer behavior data indicating a reaching-out behavior relating to the same target product exists within a predetermined time (e.g., 5 minutes) from the spraying date and time included in the spraying history data, and associate the data with each other.

[0188] As a result, even if the aroma spraying device 11 and the target product are laid out apart, for example, the same effects as those of the above embodiment can be achieved.

[0189] (Variation 2) In each of the above-described embodiments, the sensor device 12 detects the behavior of the customer in front of the product shelf 15, but the present invention is not limited to this, and the server device 30 may detect the behavior of the customer.

[0190] In this case, the sensor device 12 transmits image data captured by the imaging unit 124 to the server device 30, and the server device 30 detects the customer's behavior from the image data. Specifically, the server device 30 has a functional unit similar to the above-mentioned customer behavior detection unit 1211, and the function of the functional unit is to detect the customer's behavior from the image data.

[0191] It is assumed that the image data captured by the image capturing unit 124 has the image capturing date and time recorded in the form of a time code or the like.

[0192] This reduces the processing load on the sensor device 12, and allows the information processing system 1 to be realized in a variety of configurations.

[0193] (Variation 3) In the second embodiment described above, the ID management server 50 transmits the reading history data of the user ID performed by each ID reading device 40 to the server device 30, but this is not limited to this, and each ID reading device 40 may transmit the reading history data to the server device 30.

[0194] In this case, for example, by installing a program in the ID reading device 40 that causes the computer of the ID reading device 40 to function in the same manner as the reading detection unit 511 and the reading record data transmission unit 512 described above, it is possible to realize a configuration in which the reading record data is transmitted from the ID reading device 40 to the server device 30. Specifically, the ID reading device 40 generates reading record data including the read user ID, its own device ID, and the date and time when the user ID was read (reading date and time). The ID reading device 40 then transmits the generated reading record data to the server device 30 at a predetermined timing.

[0195] As a result, the server device 30 can perform processing similar to that of the second embodiment using the read actual data transmitted from each of the ID reading devices 40, thereby achieving the same effects as those of the second embodiment.

[0196] (Variation 4) In the second embodiment described above, the ID management server 50 is configured to work in cooperation with the fragrance injection device 11 and the sensor device 12 to restrict the customers who can use the sales promotion support device 10, but this is not limited to this, and the configuration may also be such that no restrictions are placed on customers.

[0197] In this case, for example, the ID management server 50 can disable the function of the usage restriction unit 513 or can be configured to not even include the usage restriction unit 513, thereby allowing customers whose user IDs have not been read to use the sales promotion support device 10. The function of the usage restriction unit 513 may be configured to be switchable between enabled and disabled.

[0198] (Variation 5) In the second embodiment described above, the ID reading device 40 is installed near the scent spraying device 11 to identify customers who mainly use the sales promotion support device 10 (scent spraying device 11). However, the location where the ID reading device 40 is installed is not limited to this.

[0199] For example, an ID reader 40 may be installed near the POS terminal 20 or integrated with the POS terminal 20 to identify the customer using the POS terminal 20. In this case, it is preferable that the ID reader 40 reads the user ID when a transaction is made at the POS terminal 20. In this modified example, the customer restriction function of the ID management server 50 is not required.

[0200] In addition, in this modified example, the installation location management information of the server device 30 and the ID management server 50 stores information that can identify the pair of the POS terminal 20 and the ID reading device 40, for example, by associating and storing the device ID of the POS terminal 20 with the device ID of the ID reading device 40 installed on the POS terminal 20.

[0201] In addition, in this modified example, the data management unit 312 of the server device 30 classifies various data for each store SP (product shelf 15), and then associates and stores the sales data and reading history data that are chronologically related based on the date and time information contained in each of the sales data and reading history data.

[0202] Specifically, the data management unit 312 further divides the sales data and reading history data for each pair of POS terminal 20 and ID reading device 40 based on the installation location management information, and stores the sales data and reading history data that are related chronologically in association with each other.

[0203] For example, the data management unit 312 associates and stores data based on the transaction date and time included in the sales data and the reading date and time included in the reading record data, if the time difference between the two dates and times is within a predetermined period (for example, one minute).

[0204] As a result, in this modification, similar to the second embodiment described above, the customer's behavior regarding the target product can be recorded for each individual customer.

[0205] The programs executed by each device in the above-described embodiments are provided in a state where they are pre-installed in a ROM, a storage unit, etc. The programs executed by each device in the above-described embodiments may be provided by being recorded in an installable or executable file format on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (Digital Versatile Disk).

[0206] Furthermore, the programs executed by each device in the above-described embodiments may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the programs executed by each device in the above-described embodiments may be provided or distributed via a network such as the Internet.

[0207] Although the embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments and their modifications can be embodied in various other forms, and various omissions, substitutions, changes, and combinations can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the inventions and their equivalents as defined in the claims. [Explanation of symbols]

[0208] 1, 2 Information Processing System 10 Sales promotion support device 11 Scent sprayer 12 Sensor device 20 POS terminals 30 Server device 40 ID reader 50 ID management servers 1111 Injection control unit 1112 Injection performance data transmission unit 1211 Customer behavior detection unit 1212 Customer operation data transmission unit 211 Registration processing unit 212 Accounting Department 213 Sales Data Transmission Department 311 Data Acquisition Department 312 Data Management Department 313 Analysis Processing Unit 511 Reading detection unit 512 Reading performance data transmission unit 513 Usage Restrictions Department [Prior art documents] [Patent documents]

[0209] [Patent Document 1] JP 2014-142700 A

Claims

1. a spraying means for spraying a scent corresponding to a predetermined product in response to an operation by a customer; a first acquisition means for acquiring first data that records the date and time when the fragrance was sprayed by the spray means and identification information that identifies the product corresponding to the sprayed fragrance; a detection means for detecting the action of a customer reaching out for the product from a captured image of the display shelf on which the product is displayed; a second acquiring means for acquiring second data that records the date and time when the detecting means detected the customer's action, and identification information of the product picked up by the customer during the action or location information that identifies the display location of the product; a data management means for storing the first data and the second data in a storage device and for storing data having a chronological relationship in association with each other; An information processing system having the above.

2. an accounting instrument for performing accounting for the goods purchased by the customer; a third acquisition means for acquiring third data that records the transaction date and time when the transaction process was executed and identification information of the product purchased in the transaction process; and 2. The information processing system according to claim 1, wherein the data management means stores the third data in the storage device and associates and stores the first data, which has a chronological relationship with the transaction date and time included in the third data.

3. the detection means detects a customer approaching the display shelf; The second acquisition means acquires the second data in which a detection start date and time when the detection means detected the customer and a detection end date and time when the customer became undetected are recorded as the detection date and time. The information processing system according to claim 1 .

4. The spraying means is installed on the display shelf, the data management means stores data in association with each other, where the injection date and time included in the first data and the detection date and time included in the second data have an inclusive relationship. The information processing system according to claim 3 .

5. reading means for reading specific information that can identify the customer; The device further includes a fourth data acquisition means for acquiring fourth data that records the specific information read by the reading means and the reading date and time when the specific information was read, the data management means stores the fourth data in the storage device, and also stores other data that has a chronological relationship with the read date and time included in the fourth data in association with the fourth data; The information processing system according to claim 1 .

6. the reading means is installed on the display shelf, the data management means stores the first data or the second data in which the ejection date and time or the detection date and time is recorded within a predetermined time based on the reading date and time included in the fourth data, in association with the fourth data; The information processing system according to claim 5 .

7. The device further includes a control unit that controls the operations of the ejection unit and the detection unit, and starts the operations of the ejection unit and the detection unit on the condition that the specific information is read by the reading unit. The information processing system according to claim 6.

8. The method further comprises generating means for generating analysis result data indicating customer trends regarding the product based on the data stored in the storage device. The information processing system according to any one of claims 1 to 7.

Images