Information providing device, information providing method, and recording medium

The information providing device addresses the challenge of evaluating store clerks' diverse tasks by identifying operation rates and outputting relevant information to improve store operations efficiency.

WO2025196921A1PCT designated stage Publication Date: 2025-09-25NEC CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/010635
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-03-19
Publication Date
2025-09-25

AI Technical Summary

Technical Problem

Existing technologies fail to effectively visualize and evaluate the work status of store clerks beyond customer service tasks, such as stocking and shelving, to improve store operations efficiency.

Method used

An information providing device that acquires store video, identifies staff actions, calculates operation rates, and outputs information on employees with deviating rates to improve efficiency.

Benefits of technology

Enables visualization of store clerks' work status, identifying high or low operation rates, and prompting measures to enhance store operations efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024010635_25092025_PF_FP_ABST
    Figure JP2024010635_25092025_PF_FP_ABST
Patent Text Reader

Abstract

This information providing device comprises: an acquisition means for acquiring a video of a store; an action identification means for identifying an action of an employee in the store on the basis of the video of the store; a utilization rate identification means for identifying, on the basis of the identified action, the utilization rate which is a ratio of a time during which each employee works in each time zone; an employee identification means for identifying an employee whose utilization rate has deviated from a standard utilization rate in each time zone; and an output means for outputting information pertaining to the identified employee.
Need to check novelty before this filing date? Find Prior Art

Description

Information providing device, information providing method, and recording medium

[0001] The present disclosure relates to an information providing device, an information providing method, and a recording medium.

[0002] There is technology that can help evaluate the work of store clerks.

[0003] Patent Document 1 describes an information processing device that classifies people included in an image as either customers or store clerks, and calculates and displays statistical data for either the customers or store clerks. For example, the information processing device in Patent Document 1 extracts and displays, as store clerk statistical data, the customer service time, which is the time each store clerk spent interacting with customers.

[0004] Japanese Patent Application Laid-Open No. 2018-156597

[0005] In addition to customer service, store clerks perform a wide range of tasks, including stocking shelves, placing orders, and organizing shelves. Even in tasks other than customer service, there is a need to visualize and evaluate the work status of store clerks, so that the results can be used to improve the efficiency of store operations.

[0006] An example of an objective of the present disclosure is to provide a technology for providing information to improve the efficiency of work by store clerks in a store.

[0007] An information providing device in one aspect of the present disclosure includes an acquisition means for acquiring video of the store, an action identification means for identifying the actions of store staff in the store based on the video of the store, an operation rate identification means for identifying the operation rate, which is the percentage of time each store staff member is performing their duties for each time period, based on the identified actions, an employee identification means for identifying employees whose operation rate deviates from the standard operation rate for each time period, and an output means for outputting information about the identified employees.

[0008] An information provision method in one aspect of the present disclosure acquires video of a store, identifies the behavior of store employees based on the video of the store, identifies an operating rate, which is the percentage of time each employee spends performing their duties in each time period, based on the identified behavior, identifies employees whose operating rates deviate from the standard operating rate for each time period, and outputs information about the identified employees.

[0009] A program in one aspect of the present disclosure causes a computer to perform the following processes: acquire video of a store; identify the behavior of store employees based on the video of the store; identify an operating rate, which is the percentage of time each employee spends performing their duties in each time period, based on the identified behavior; identify employees whose operating rates deviate from the standard operating rate for each time period; and output information about the identified employees.

[0010] Each program may be stored in a non-transitory computer-readable recording medium.

[0011] One example of the effect of the present disclosure is that it is possible to provide information to improve the efficiency of store staff's work in a store.

[0012] 1 is a diagram showing a configuration of a system including an information providing device; 2 is a block diagram showing a functional configuration of the information providing device; 3 is a diagram showing an example of an output screen; 4 is a diagram showing an example of an output screen; 5 is a diagram showing an example of an output screen; 6 is a flowchart showing the operation of the information providing device; 7 is a diagram showing a hardware configuration for realizing the information providing device in the present disclosure by a computer and its peripheral devices;

[0013] Embodiments of the present disclosure will be described in detail with reference to the drawings.

[0014] [Embodiment] FIG. 1 is a diagram illustrating an example of a system including an information providing device 100 according to the present disclosure.

[0015] In FIG. 1, an information providing device 100 is a device that outputs information about store clerks whose availability rates deviate from the standard availability rate.

[0016] Here, the availability rate is the percentage of time that each employee performs their work during their working hours. The working hours may be divided into appropriate time periods such as one hour. Details will be described later.

[0017] The tasks are those related to the store's business that are performed by store staff. The tasks include a variety of tasks, such as cashiering, stocking, inventory taking, collecting expired products, ordering, and cleaning.

[0018] The information providing device 100 is communicably connected to a camera that captures images of the store and a terminal device that is an output destination. The information providing device 100 may also be connected to a database that manages information about the store.

[0019] The cameras are installed in the store so as to be able to capture images that allow the actions of store staff to be identified. The number of cameras that can be connected to the information providing device 100 is not limited.

[0020] The terminal device is an example of an output destination of information about a store clerk whose availability rate deviates from the standard availability rate, output by the information providing device 100. The terminal device outputs information about the store clerk so that it can be viewed by the store clerk or the store manager. The terminal device is, for example, a store computer, a smartphone, a tablet, or the like.

[0021] Next, the configuration of the information providing device 100 according to the embodiment will be described.

[0022] 2 is a block diagram showing the configuration of information providing device 100. Referring to FIG. 2, information providing device 100 includes an acquisition unit 101, a behavior identification unit 102, an utilization rate identification unit 103, a store clerk identification unit 104, and an output unit 105.

[0023] Next, the configuration of the information providing device 100 according to the embodiment will be described in detail.

[0024] The acquisition unit 101 is an example of an acquisition means for acquiring video of a store. The acquisition unit 101 acquires video of the store from a camera installed in the store. The video of the store is video from which the actions of a store employee can be identified. The video of the store may be video of an area where the store employee is active, and may include not only video of the sales floor of the store but also video of the back of the store.

[0025] In addition to the video, the acquisition unit 101 may acquire information from various sensors in the store. For example, the sensor may be a sensor provided in a terminal device carried by a store clerk. The sensor provided in the terminal device carried by the store clerk may be an acceleration sensor that detects the movement of the terminal device or a sensor that detects the biometric information of the store clerk. Furthermore, for example, the camera installed in the store may be a camera with a depth sensor.

[0026] The behavior identification unit 102 is an example of a behavior identification means that identifies the behavior of a store clerk in a store based on video of the store. Specifically, the behavior identification unit 102 identifies the behavior of the store clerk in the store and the time during which the behavior was performed.

[0027] The behavior identification unit 102 may use a known behavior estimation technique to identify the behavior, as long as it can at least determine whether or not the store clerk is working by identifying the behavior. Examples of behavior identification will be described later. The behavior identification unit 102 may, for example, detect a store clerk from video and identify the behavior of the detected store clerk. A known technique such as image recognition technology may also be used as a method for detecting a store clerk from video.

[0028] For example, the behavior identifying unit 102 may identify whether or not the clerk is performing an action. In this case, the behavior identifying unit 102 may identify a clerk performing an action as performing a job, and may identify a clerk not performing an action as not performing a job. For example, the behavior identifying unit 102 may identify a clerk not performing an action if the clerk is not moving his / her hands or feet. Furthermore, for example, the behavior identifying unit 102 may identify whether or not the behavior is work-related. In this case, for example, the behavior identifying unit 102 may identify whether or not the clerk's actions are work-related based on whether or not the clerk's actions, posture, and position in the store correspond to the actions, posture, and position of each job performed by the clerk. Furthermore, for example, the behavior identifying unit 102 may identify the type of behavior the behavior is. In this case, the behavior identifying unit 102 may identify the type of job the clerk's actions are based on the type of behavior. In this case, for example, the behavior identification unit 102 identifies which task the clerk's behavior corresponds to based on whether the clerk's movements, posture, and position in the store correspond to the movements, posture, and position of which task the clerk performs.

[0029] The behavior identification unit 102 may determine whether a store clerk is taking an action based not only on the presence or absence of an action but also on whether the clerk is captured in the store video. For example, the behavior identification unit 102 may identify the clerk as not taking an action if the clerk is not captured in the store video for a predetermined period of time or longer. Here, the predetermined period of time may be set appropriately so that the clerk will not be identified as not taking an action if he or she is working in a place not captured in the store video.

[0030] Furthermore, the behavior identifying unit 102 may identify the behavior of the store clerk using information from various sensors in addition to the video of the store. For example, the behavior identifying unit 102 may identify the behavior of the store clerk using a combination of the video of the store and the information from various sensors. In this case, too, the behavior identifying unit 102 may identify the behavior of the store clerk using a known behavior estimation technique.

[0031] The availability specification unit 103 is an example of an availability specification means that specifies an availability, which is the proportion of time that each employee performs their work in each time period, based on the specified behavior. As described above, the availability is the proportion of time that each employee performs their work in each time period.

[0032] Furthermore, for example, when the behavior identification unit 102 identifies which tasks a store clerk is performing, the utilization rate identification unit 103 may identify the utilization rate of the store clerk for each task. Furthermore, the utilization rate identification unit 103 may further identify the proportion of time that the store clerk spends performing the tasks for which they are responsible for each time period.

[0033] The time periods may be divided into hourly or 30-minute intervals, morning and afternoon, or may be divided according to the store's busyness or the staff shifts, as long as they are appropriately divided.

[0034] An example of the process by which the utilization rate identifying unit 103 identifies utilization rates will be described. In this example, the behavior identifying unit 102 identifies whether a store clerk's behavior is work-related behavior. For example, the utilization rate identifying unit 103 first counts the time during which a work-related behavior was performed among the behaviors of the store clerk identified by the behavior identifying unit 102. Then, the utilization rate identifying unit 103 calculates the ratio of the time during which work was performed to the total time for each time period. Note that the process by which the utilization rate identifying unit 103 identifies utilization rates is not limited to this example.

[0035] The employee identification unit 104 is an example of an employee identification means for identifying an employee whose operating rate deviates from the standard operating rate for each time period. An operating rate that deviates from the standard operating rate means at least one of an operating rate lower than the standard operating rate and an operating rate higher than the standard operating rate. The employee identification unit 104 identifies at least one of an employee with a low operating rate, whose operating rate is lower than the standard operating rate, and an employee with a high operating rate, whose operating rate is higher than the standard operating rate. By identifying an employee with a high operating rate or an employee with a low operating rate, the store manager or the like can take measures to improve the store's business efficiency.

[0036] For example, there may be concerns that a store clerk with a high utilization rate will experience a deterioration in health or quit due to the heavy workload. There may also be concerns that a store clerk with a low utilization rate will affect the workload and motivation of other store clerks, or result in increased labor costs. The store clerk identification unit 104 identifies store clerks whose utilization rates deviate from the standard utilization rate as information used for store management in such cases.

[0037] The standard utilization rate is the utilization rate required of a store clerk performing a task or the utilization rate that a store clerk performing a task should achieve. The standard utilization rate serves as a criterion for identifying at least one of a store clerk with a low utilization rate and a store clerk with a high utilization rate. The standard utilization rate may be expressed as a numerical value or as a numerical range. The numerical range may be represented by at least one of an upper limit and a lower limit. The store clerk identification unit 104 may identify all store clerks whose utilization rate deviates from the standard utilization rate, or may identify store clerks whose utilization rate deviates from the standard utilization rate by more than a predetermined value.

[0038] An example of setting a standard operating rate for each time period will be described. As described above, the standard operating rate is the operating rate required of a store clerk performing a task or the operating rate that the clerk performing a task should achieve. However, this standard operating rate may vary depending on the store's situation. For example, when the number of customers is large, the clerk will be busy with customer service tasks such as cashiering, and therefore the operating rate is expected to be high. Also, when the number of deliveries that need to be stocked is large, the clerk will be busy with product management tasks such as stocking, and therefore the operating rate is expected to be high. Conversely, when the number of customers is small, there are many clerks, or the number of deliveries is small, there are fewer tasks to be performed, and therefore the operating rate may be unavoidably low. Such store situations may change depending on the time period. Therefore, by setting the standard operating rate for each time period according to the store's situation, the clerk identification unit 104 can more appropriately identify clerks with high and low operating rates.

[0039] For example, the standard operating rate is set based on the store's performance data for each time period. For example, the standard operating rate may be set higher based on the performance data as the store becomes busier. Conversely, the standard operating rate may be set lower based on the performance data as the store becomes less busy.

[0040] Here, the performance data may be at least one of the number of sales clerks, the number of deliveries, the number of customers, and product sales data. The performance data is not limited to these examples, and may include data related to the store's busy status. For example, information indicating the skill level of each sales clerk, along with the number of sales clerks, may be used as performance data to set the standard utilization rate. Furthermore, the standard utilization rate may be set for each task performed by a sales clerk, and may be set, for example, based on performance data related to each task.

[0041] The standard utilization rate may also be set based on statistical values ​​of employee utilization rates during other time periods with similar performance data. For example, the standard utilization rate may be set based on statistical values ​​of employee utilization rates during other time periods with similar store busyness based on performance data. Examples of statistical values ​​include the average value and the median value.

[0042] Furthermore, for example, the standard operating rate is set based on the operating rates of other store employees, which may be, for example, operating rates of store employees who perform similar tasks during the same time period, but are not limited to this example.

[0043] Furthermore, the standard utilization rate may be set based on the store's performance data for each time period and the utilization rates of other store employees. For example, the standard utilization rate may be set based on the statistical values ​​of the utilization rates of store employees who perform the same work as the store employee whose utilization rate is being specified and who have similar performance data during other time periods.

[0044] The output unit 105 is an example of an output means that outputs information about the identified store clerk. The information about the store clerk output by the output unit 105 is, for example, the availability rate of the store clerk.

[0045] The information output by the output unit 105 will be explained for each output destination.

[0046] First, output to a sales clerk with a low utilization rate will be described. The output unit 105 uses the identification information of the sales clerk identified as having a low utilization rate to output to a terminal device or the like that can be viewed by the sales clerk with a low utilization rate. For example, when outputting to a sales clerk with a low utilization rate, the output unit 105 outputs to a contact address associated with the identification information of the sales clerk with a low utilization rate. Furthermore, for example, the output unit 105 outputs to a website or application to which the sales clerk with a low utilization rate has logged in using the identification information of the sales clerk.

[0047] The output unit 105 outputs a message to the store clerk with a low utilization rate, for example, indicating that the utilization rate is lower than the standard utilization rate. In this case, the message may be a preset message. Alternatively, the message may be a message corresponding to the number of times the store clerk with a low utilization rate has been identified as having an utilization rate lower than the standard utilization rate. The number of times the utilization rate has been identified as being lower than the standard utilization rate may be recorded in a database that manages store information. For example, the message corresponding to the number of times may be a warning the first time, a severe warning that is more severe than a warning the second time, and an even more severe warning or notice of punishment the third time, but is not limited to this example.

[0048] The output unit 105 may also output a notification screen to the clerk with a low utilization rate, including a button to be pressed when the clerk confirms the above-mentioned message. This button is used, for example, to record that the clerk who received the notification has confirmed the notification. In other words, when this button is pressed, the fact that the clerk confirmed the notification may be recorded in association with information about the clerk recorded in a database or the like that manages store information. In this case, related information such as the date and time when the clerk confirmed the notification may also be recorded in the above-mentioned database.

[0049] Furthermore, for example, this button may be used by a store manager or the like to confirm that the store clerk who received the notification has confirmed the notification. That is, when this button is pressed, the output unit 105 may further output information indicating the status of confirmation of the message to the store manager. The information indicating the status of confirmation may include, for example, whether confirmation was made, the date and time of confirmation, etc.

[0050] Furthermore, the output unit 105 may output a notification screen to the clerk with a low utilization rate when the clerk confirms the above-mentioned message, the notification screen including an input field for inputting the reason for the low utilization rate and options for selecting the reason. When the reason for the low utilization rate is input or selected, the input or selection may be recorded in the database as described above, or the output unit 105 may output information indicating the confirmation status including the reason for the low utilization rate.

[0051] Furthermore, the output unit 105 may output, to a store clerk with a low utilization rate, video of the time when the clerk was not performing work. In this case, the output unit 105 outputs, from the video of the store, video of the clerk during the time period when the behavior identification unit 102 identified the clerk as not performing work. In this case, the output unit 105 may output only a portion of the video of the time when the clerk was not performing work so that the video is not too long and difficult to review, or may output video of the time when the clerk was not performing work and the time before and after the time so that the situation during the time when the clerk was not performing work can be easily remembered.

[0052] 3 is an example of an output screen for a store clerk with a low utilization rate. For example, the output screen of FIG. 3 may be displayed when the store clerk logs in to a store terminal device for attendance registration or the like after a period of low utilization rate, but the timing and destination of the output are not limited to this example.

[0053] In FIG. 3 , the output screen for the clerk with a low utilization rate includes a message indicating that the utilization rate is lower than the standard utilization rate, such as "Caution" or "There were times when the utilization rate was low. Please review your work attitude." Also, in FIG. 3 , the output screen for the clerk with a low utilization rate includes information indicating the time periods when the utilization rate was low and the utilization rate for those time periods. Furthermore, in FIG. 3 , the output screen for the clerk with a low utilization rate includes a button to be pressed when confirming the above message ("Confirmed" button) and a button for inputting a reason ("Enter Reason" button). For example, when the button for inputting a reason is pressed, the output screen may transition to a screen for inputting or selecting a reason.

[0054] The output screen for the clerk with a low availability rate is not limited to the example of FIG. 3, and may include, for example, as described above, an image of the time when the clerk with a low availability rate is not performing work.

[0055] Next, output to a store clerk with a high availability rate will be described. The output unit 105 uses the identification information of the store clerk identified as having a high availability rate to output to a terminal device or the like that can be viewed by the store clerk with a high availability rate. For example, when outputting to a store clerk with a high availability rate, the output unit 105 outputs to a contact address associated with the identification information of the store clerk with a high availability rate. Furthermore, for example, the output unit 105 outputs to a website or application to which the store clerk with a high availability rate has logged in using the identification information of the store clerk.

[0056] The output unit 105 outputs, for example, a message of thanks to the employee with a high utilization rate for their efforts in their work. Furthermore, for example, the output unit 105 may output a questionnaire regarding staffing in the store to the employee with a high utilization rate. This is because, if the utilization rate of a staff member is higher than the standard utilization rate, the workload or staffing may be inappropriate. The output unit 105 may output a pre-stored message or questionnaire.

[0057] 4 is an example of an output screen for a store clerk with a high utilization rate. For example, the output screen in FIG. 4 may be displayed when the store clerk logs in to a store terminal device for attendance registration or the like after a period of high utilization rate, but the timing and destination of the output are not limited to this example.

[0058] In FIG. 4 , the output screen for the highly available employee includes a message of thanks for the employee's efforts, such as "There was a period of time when the employee's utilization rate was high. Thank you for your hard work." As shown in FIG. 4 , the output screen for the highly available employee may also include other messages, such as "If the workload is high, please consult with the store manager." In FIG. 4 , the output screen for the highly available employee includes information indicating the period of time during which the employee's utilization rate was high and the utilization rate during that period. Furthermore, in FIG. 4 , the output screen for the highly available employee includes a button to be pressed upon confirming the message ("Confirmed" button) and a button for inputting the details of the work-related consultation ("Enter consultation details" button). For example, when the button for inputting the details of the consultation is pressed, the output screen may transition to a screen for inputting the details of the consultation. The details of the consultation entered here may be recorded so that they can be referenced by the store manager.

[0059] The output screen for the store clerk with a high operating rate is not limited to the example shown in FIG.

[0060] Next, output to the store manager will be described. When outputting to the store manager, similar to the output to the store clerk described above, the output unit 105 uses the identification information of the store manager associated with the clerk identified as having a low or high utilization rate or the store to which the clerk belongs to perform output to a terminal device or the like that can be viewed by the store manager. For example, the output unit 105 may output to a contact associated with the identification information of the store manager, or may perform output on a website or application logged in using the identification information of the store manager.

[0061] The output unit 105 outputs, for example, information indicating the identified employee and the availability rate of the employee to the store manager. The output unit 105 may also output at least one of the number of times each employee was identified as having a low availability rate and the number of times each employee was identified as having a high availability rate.

[0062] Furthermore, the output unit 105 may further output to the store manager information that affects the utilization rate for the time period for which the output utilization rate is specified. The information that affects the utilization rate is information that is used as a reference when the store manager or the like considers the reasons for a high or low utilization rate. The information related to the utilization rate is, for example, performance data related to the status of the store.

[0063] Furthermore, similar to the output for the clerk with a low utilization rate, the output unit 105 may output to the store manager a video of a time period when the clerk with a low utilization rate is not performing his / her duties.

[0064] Furthermore, the output unit 105 may output information to the store manager indicating that a message has been output to the clerk with a low utilization rate, indicating that the utilization rate is lower than the standard utilization rate. For example, the output unit 105 may output an output screen including a button for the store manager to select whether or not to output a message to the clerk with a low utilization rate, indicating that the utilization rate is lower than the standard utilization rate. When outputting a message to the clerk with a low utilization rate, indicating that the utilization rate is lower than the standard utilization rate, is selected on this output screen, the output unit 105 may output a message to the clerk with a low utilization rate, indicating that the utilization rate is lower than the standard utilization rate, as described above.

[0065] In addition, when the output unit 105 outputs a notification screen to the clerk with a low utilization rate, the notification screen includes a button to be pressed when the clerk confirms a message indicating that the utilization rate is lower than the standard utilization rate, the output unit 105 may further output information indicating the status of confirmation of the above-mentioned message to the store manager.

[0066] Furthermore, the output unit 105 may output to the store manager a proposal for improving the skills and working conditions of employees with high operating rates. In this case, the output unit 105 may output a proposal for improving the skills and working conditions of employees with high operating rates that has been set in advance.

[0067] 5 is an example of an output screen for a store manager. For example, the output screen of FIG. 5 may be displayed when a store clerk whose operating rate deviates from the standard operating rate is identified and the identified store clerk logs in to a store terminal device for time attendance registration or the like, but the timing and destination of the output are not limited to this example.

[0068] In FIG. 5 , the output screen for the store manager includes information indicating the store clerk whose utilization rate deviates from the standard utilization rate and the utilization rate of the store clerk. The information indicating the store clerk whose utilization rate deviates from the standard utilization rate is, for example, the name or identification information of the store clerk, but may also be a facial image of the store clerk detected from video of the store. Also, in FIG. 5 , the utilization rate of the store clerk is shown as a transition of the utilization rate by time period, but it may also be shown only for the time period when the utilization rate deviates from the standard utilization rate. Also, in FIG. 5 , the output screen for the store manager includes video of the time when the clerk with a low utilization rate is not performing his or her duties, and the transition of the number of customers visiting the store, which is information related to the utilization rate.

[0069] The output screen for the store manager is not limited to the example shown in FIG.

[0070] In addition, the output destinations and output contents may be combined as appropriate.

[0071] The operation of the information providing device 100 configured as above will be described with reference to the flowchart of FIG.

[0072] First, the acquisition unit 101 acquires a video of a store (step S101).

[0073] Next, the behavior identification unit 102 identifies the behavior of the store clerk in the store based on the video of the store acquired in step S101 (step S102).

[0074] Next, the availability specification unit 103 specifies an availability rate, which is the percentage of time each employee performs work for each time period, based on the actions of the employees specified in step S102 (step S103).

[0075] Next, the employee identification unit 104 identifies an employee whose operating rate identified in step S103 deviates from the standard operating rate for that time period (step S104).

[0076] Then, the output unit 105 outputs information about the store clerk identified in step S104 (step S105).

[0077] This completes the series of operations of the information providing device 100. The processes of steps S101 to S104 may be executed as needed. The process of step S105 may be executed as needed or at a predetermined timing such as the timing described above.

[0078] The information providing device in the above-described embodiment includes an acquisition unit, a behavior identification unit, an availability identification unit, a store clerk identification unit, and an output unit. The acquisition unit acquires video of the store. The behavior identification unit identifies the behavior of store clerks in the store based on the video of the store. The availability identification unit identifies the availability, which is the percentage of time each store clerk spends performing their duties for each time period, based on the identified behavior. The store clerk identification unit identifies store clerks whose availability deviates from the standard availability rate for each time period. The output unit then outputs information about the identified store clerks.

[0079] The information providing device of this embodiment can identify the operating rate when various tasks are being performed in a store, and can therefore visualize the work status of store staff performing various tasks.

[0080] Furthermore, the information providing device in this embodiment identifies store clerks whose utilization rates deviate from the standard utilization rate and outputs information about the identified store clerks. This allows store managers and other personnel to recognize store clerks who need to address their operational status. This also allows the clerks themselves to know that they need to address their operational status. The provided information can prompt store managers and clerks to take measures to improve operations or offer suggestions for improving operations. For example, a store clerk with a high utilization rate may be concerned about their health deteriorating or quitting due to the heavy workload. A store clerk with a low utilization rate may be concerned about affecting the workload and motivation of other employees, or about increasing labor costs. By identifying such clerks and outputting information about them, store managers and clerks may be able to take measures or respond to improve the efficiency of operations in the store.

[0081] As a result, the information providing device according to this embodiment can provide a technique for providing information to improve the efficiency of operations in a store.

[0082] [Hardware Configuration] Some or all of the components of each device or system in each embodiment of the present disclosure described above are realized by any combination of an information processing device 1000 and a program, for example, as shown in Fig. 7. The information processing device 1000 includes, as an example, the following configuration.

[0083] - CPU (Central Processing Unit) 1001 - ROM (Read Only Memory) 1002 - RAM (Random Access Memory) 1003 - Program 1004 loaded into RAM 1003 - Storage device 1005 for storing program 1004 - Drive device 1007 for reading and writing from and to recording medium 1006 - Communication I / F 1008 for connecting to communication network 1009 - Input / output I / F 1010 for inputting and outputting data - Bus 1011 for connecting each component. Note that I / F is an abbreviation for Interface.

[0084] Each component of each device or system in each embodiment is realized by the CPU 1001 acquiring and executing a program that realizes the function of that component. The program that realizes the function of each component of each device is stored in the storage device 1005 or RAM 1003 in advance, for example, and is read by the CPU 1001 as needed. The program 1004 may be supplied to the CPU 1001 via a communication network, or may be stored in the recording medium 1006 in advance, and the drive device 1007 may read the program and supply it to the CPU 1001.

[0085] There are various variations in the method of realizing each device. For example, each device or system may be realized by any combination of a separate information processing device 1000 and a program for each component. Furthermore, multiple components included in each device may be realized by any combination of a single information processing device 1000 and a program.

[0086] Furthermore, some or all of the components of each device or system may be realized by general-purpose or dedicated circuits (circuitry) including a processor or the like, or a combination of these. Examples of circuits include a CPU, a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), and an AI (Artificial Intelligence) processing LSI (Large Scale Integration). These may be configured by a single chip or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits and a program.

[0087] When some or all of the components of each device or system are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, in which they are connected via a communication network.

[0088] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure.

[0089] Furthermore, although the operations are described in a sequential order in the form of a flowchart, the order of the description does not limit the order in which the operations are performed. Therefore, when implementing each embodiment, the order of the operations may be changed as long as it does not affect the content.

[0090] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.

[0091] [Supplementary Note 1] An information providing device comprising: an acquisition means for acquiring video of a store; an action identification means for identifying the actions of store staff in the store based on the video of the store; an operation rate identification means for identifying an operation rate, which is the percentage of time that each store staff member is performing their duties for each time period, based on the identified actions; an employee identification means for identifying employees whose operation rate deviates from a standard operation rate for each time period; and an output means for outputting information about the identified employees.

[0092] [Supplementary Note 2] The information providing device according to Supplementary Note 1, wherein the store clerk identification means identifies a store clerk with a low utilization rate, the utilization rate of which is lower than the standard utilization rate.

[0093] [Supplementary Note 3] The information providing device according to Supplementary Note 2, wherein the output means outputs a message to the store clerk with the low utilization rate, indicating that the utilization rate is lower than the standard utilization rate.

[0094] [Supplementary Note 4] The information providing device according to Supplementary Note 3, wherein the output means outputs a notification screen to the store clerk with the low availability rate, the notification screen including a button to be pressed when the store clerk confirms the message.

[0095] [Supplementary Note 5] The information providing device according to Supplementary Note 3 or 4, wherein the output means outputs a notification screen to the store clerk with the low utilization rate when the store clerk confirms the message, the notification screen including an input field for inputting a reason why the utilization rate is lower than the standard utilization rate.

[0096] [Supplementary Note 6] The information providing device according to any one of Supplementary Notes 3 to 5, wherein the output means further outputs information indicating a status of confirmation of the message to a manager of the store.

[0097] [Supplementary Note 7] The information providing device according to any one of Supplementary Notes 3 to 6, wherein the message is a message corresponding to the number of times the store clerk with the low utilization rate has been identified as having an utilization rate lower than the standard utilization rate.

[0098] [Supplementary Note 8] The information providing device according to any one of Supplementary Notes 2 to 7, wherein the output means outputs a video of a time when the store clerk with a low availability rate is not performing a task.

[0099] [Supplementary Note 9] The information providing device according to any one of Supplementary Notes 1 to 8, wherein the store clerk identification means identifies a store clerk with a high availability rate, the availability rate of which is higher than the standard availability rate.

[0100] [Supplementary Note 10] The information providing device according to Supplementary Note 9, wherein the output means outputs a questionnaire regarding staffing in the store to the store clerk with the high utilization rate.

[0101] [Supplementary Note 11] The information providing device according to any one of Supplementary Notes 1 to 10, wherein the standard operating rate is set based on performance data of the store for each time period.

[0102] [Supplementary Note 12] The information providing device according to Supplementary Note 11, wherein the standard operating rate is set higher as the store becomes busier based on the performance data.

[0103] [Supplementary Note 13] The information providing device according to Supplementary Note 11 or 12, wherein the performance data is at least one of the number of store staff, the number of deliveries, the number of customers visiting the store, and product sales data.

[0104] [Supplementary Note 14] The information providing device according to any one of Supplementary Notes 11 to 13, wherein the standard operating rate is set based on a statistical value of the operating rate of the store staff in other time periods for which the performance data is similar.

[0105] [Supplementary Note 15] The information providing device according to any one of Supplementary Notes 11 to 14, wherein the standard utilization rate is set based on a statistical value of the utilization rate of a store clerk who performs the same work as the store clerk whose performance data is similar to that of the store clerk whose utilization rate is to be specified, during another time period.

[0106] [Supplementary Note 16] The information providing device according to any one of Supplementary Notes 1 to 15, wherein the information relating to the store clerk is the availability rate of the store clerk.

[0107] [Supplementary Note 17] The information providing device according to Supplementary Note 16, wherein the output means further outputs information that affects the availability rate in a time period in which the availability rate to be output is specified.

[0108] [Supplementary Note 18] The information providing device according to Supplementary Note 17, wherein the information that affects the operating rate is store performance data.

[0109] [Supplementary Note 19] An information providing method comprising: acquiring video of a store; identifying the behavior of store staff in the store based on the video of the store; identifying an operating rate, which is the percentage of time each store staff member is performing their duties in each time period, based on the identified behavior; identifying store staff whose operating rate deviates from the standard operating rate for each time period; and outputting information about the identified store staff member.

[0110] [Supplementary Note 20] A recording medium for recording a program that causes a computer to execute the following processes: acquiring video of a store; identifying the behavior of store staff in the store based on the video of the store; identifying an operating rate, which is the percentage of time that each store staff member is performing their duties in each time period, based on the identified behavior; identifying store staff whose operating rate deviates from the standard operating rate for each time period; and outputting information about the identified store staff.

[0111] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 18 that are subordinate to Supplementary Note 1 (information providing device) may also be subordinate to Supplementary Note 19 (information providing method) and Supplementary Note 20 (recording medium) in the same subordinate relationship as Supplementary Note 2 to 18. Furthermore, not limited to Supplementary Note 1, Supplementary Note 19, and Supplementary Note 20, some or all of the configurations described as Supplements may be subordinate to various hardware, software, various recording means for recording software, or systems, within the scope of each of the above-mentioned embodiments.

[0112] REFERENCE SIGNS LIST 100 Information providing device 101 Acquisition unit 102 Behavior identification unit 103 Availability identification unit 104 Store clerk identification unit 105 Output unit 1000 Information processing device 1001 CPU 1002 ROM 1003 RAM 1004 Program 1005 Storage device 1006 Recording medium 1007 Drive device 1008 Communication I / F 1009 Communication network 1010 Input / output I / F 1011 Bus

Claims

1. An information providing device comprising: an acquisition means for acquiring video of a store; an action identification means for identifying the actions of store staff in the store based on the video of the store; an operation rate identification means for identifying the operation rate, which is the percentage of time that each store staff member is performing their duties in each time period, based on the identified actions; an employee identification means for identifying employees whose operation rate deviates from the standard operation rate for each time period; and an output means for outputting information about the identified employees.

2. The information providing device according to claim 1, wherein the store clerk identification means identifies a store clerk whose operation rate is lower than the standard operation rate.

3. The information providing device according to claim 2, wherein said output means outputs a message to said store clerk with a low utilization rate, indicating that said utilization rate is lower than said standard utilization rate.

4. The information providing device according to claim 3, wherein the output means outputs a notification screen to the store clerk with the low utilization rate, the notification screen including a button to be pressed when the store clerk confirms the message.

5. The information providing device according to claim 3 or 4, wherein the output means outputs a notification screen to the store clerk with the low utilization rate when the store clerk confirms the message, the notification screen including an input field for inputting the reason why the utilization rate is lower than the standard utilization rate.

6. An information providing device according to any one of claims 3 to 5, wherein the output means further outputs information indicating the status of confirmation of the message to a manager of the store.

7. The information providing device according to any one of claims 3 to 6, wherein the message is a message corresponding to the number of times the store clerk with the low utilization rate has been identified as having an utilization rate lower than the standard utilization rate.

8. An information providing device according to any one of claims 2 to 7, wherein the output means outputs video of a time when the store clerk with a low availability rate is not performing work.

9. An information providing device according to any one of claims 1 to 8, wherein the store clerk identification means identifies a store clerk with a high availability rate, the availability rate being higher than the standard availability rate.

10. The information providing device according to claim 9, wherein the output means outputs a questionnaire regarding staffing in the store to the store clerk with the high utilization rate.

11. The information providing device according to any one of claims 1 to 10, wherein the standard operating rate is set based on store performance data for each time period.

12. The information providing device according to claim 11, wherein the standard operating rate is set higher as the store becomes busier based on the performance data.

13. The information providing device according to claim 11 or 12, wherein the performance data is at least one of the number of store staff, the number of deliveries, the number of customers visiting the store, and product sales data.

14. An information providing device according to any one of claims 11 to 13, wherein the standard operating rate is set based on a statistical value of the operating rate of store staff during other time periods for which the performance data is similar.

15. An information provision device according to any one of claims 11 to 14, wherein the standard utilization rate is set based on the statistical values ​​of the utilization rates of store clerks who perform the same tasks as the store clerk whose performance data is similar during other time periods and whose utilization rate is to be specified.

16. An information providing device according to any one of claims 1 to 15, wherein the information relating to the store clerk is the availability rate of the store clerk.

17. The information providing device according to claim 16, wherein said output means further outputs information that affects the operating rate during a time period for which the operating rate to be output is specified.

18. The information providing device according to claim 17, wherein the information that affects the operating rate is store performance data.

19. An information provision method comprising: acquiring video of a store; identifying the behavior of store staff in the store based on the video of the store; identifying an operating rate, which is the percentage of time each store staff member is performing their duties in each time period, based on the identified behavior; identifying store staff whose operating rate deviates from the standard operating rate for each time period; and outputting information about the identified store staff.

20. A recording medium for recording a program that causes a computer to execute the following processes: acquiring video of a store; identifying the behavior of store staff in the store based on the video of the store; identifying an operating rate, which is the percentage of time that each store staff member is performing their duties in each time period, based on the identified behavior; identifying store staff whose operating rate deviates from the standard operating rate for each time period; and outputting information about the identified store staff.

Citation Information

Patent Citations

  • Activity state analysis system, activity state analysis device, activity state analysis method, activity state analysis program, and storage medium for storing program

    JP2016076092A

  • Reservation management system, reservation management method and reservation management program

    JP2020149371A

  • Actual facility condition evaluation device

    JP2020190909A

  • Evaluation system

    JP2021012622A

  • Employee management system

    JP2021077184A