Housekeeping evaluation system and housekeeping evaluation method

Abstract

To provide a housekeeping evaluation system and a housekeeping evaluation method which can clearly and fairly perform evaluation, by quantifying quality of housekeeping in an accommodation facility etc., and can further utilize the evaluation about the quality of the housekeeping, for a worker's education etc.SOLUTION: A housekeeping evaluation system comprises: a first capturing unit 1a which photographs an image of a state after performing housekeeping work; and an evaluation information deriving unit (an evaluation model stored in a server storage unit 3a and a third control unit 3b) which derives a score related to quality of the housekeeping work, on the basis of the image photographed by the first capturing unit 1a.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a housekeeping evaluation system and a housekeeping evaluation method for evaluating the performance of housekeeping in accommodation facilities such as hotels and inns. [Background technology]

[0002] Currently, the number of accommodation facilities across Japan is as follows: 8,000 business hotels with 820,000 rooms, 13,000 inns with 240,000 rooms, 11,000 city hotels with 200,000 rooms, and 2,000 resort hotels with 120,000 rooms. The number of hotels has doubled especially over the past 30 years.

[0003] In lodging facilities, guests are increasingly taking self-service amenities, taking only what they need, but housekeeping to keep rooms comfortable is still essential. On the other hand, labor productivity in the hotel industry is low compared to the overall industry labor productivity of 6.44 million yen per person, and inexperienced part-time workers are often employed, requiring constant training and guidance. Furthermore, when inexperienced staff are tasked with tasks that require experience and skill to be completed properly, such as bedmaking, the workmanship must be checked by an experienced person, which is also a factor in increasing the burden on staff.

[0004] Regarding technology related to the evaluation of housekeeping at accommodation facilities, for example, a system for managing and operating cleaning work is known, which comprises an orderer terminal of a cleaning work orderer and a contractor terminal that receives orders for cleaning work, the orderer terminal comprises a facility management section that manages the facility for which the cleaning work is to be performed, a cleaning work ordering section that orders the cleaning work, and a report receiving section that receives reports from the cleaning work contractor, the contractor terminal comprises a cleaning work receiving section that receives orders for cleaning work, a cleaning case management section that manages the cleaning work cases that have been ordered, and a report sending section that reports after cleaning is completed, and the report sending section includes at least the sending of photos or videos of the facility where the cleaning work has been performed (Patent Document 1).

[0005] According to Patent Document 1, this enables efficient communication and operation between the person ordering the cleaning work and the person receiving the cleaning work, and in addition, the state of the room after the cleaning worker has cleaned it is reported in images or videos which the person ordering the cleaning work can review, and by providing feedback on the evaluation, it is possible to ensure and improve the quality of the cleaning. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Patent Publication No. 2021-92983 DISCLOSURE OF THEINVENTION [Problem to be solved by the invention]

[0007] In the technology disclosed in Patent Document 1, cleaning workers use a smartphone or tablet device to take photos after cleaning is completed and videos during cleaning work, and send a report including files of the photos to the cleaning contractor. The files are then checked by the cleaning contractor and finally sent to the cleaning work orderer. However, in the technology of Patent Document 1, although the report including the files is checked by the cleaning contractor, it is merely used as evidence that the cleaning has been completed. The degree of completion (workmanship) of housekeeping work is an important factor that determines customer satisfaction, and is thought to affect the so-called retention of repeat customers and word-of-mouth on SNS, etc., but Patent Document 1 does not suggest any configuration for quantifying the workmanship of housekeeping work and using the scores for training workers, etc.

[0008] The present invention has been devised to solve such problems in the prior art, and its purpose is to provide a housekeeping evaluation system and a housekeeping evaluation method that enable a clear and fair evaluation to be made by quantifying the quality of housekeeping in accommodation facilities and the like, and further enables the evaluation of the quality of housekeeping to be used for educating workers, etc. [Means for solving the problem]

[0009] The present invention, which has been made to solve the above problems, provides a housekeeping evaluation system including a first imaging unit that captures an image of a state after housekeeping work has been performed, and an evaluation information derivation unit that derives a score for the performance of the housekeeping work based on the image captured by the first imaging unit. This makes it possible to easily evaluate the performance of the housekeeping work based on the image.

[0010] In addition, in the present invention, the evaluation information derivation unit derives a score for the performance of the housekeeping work based on an image including the item that is the subject of the housekeeping work and captured by the first imaging unit, thereby making it possible to easily evaluate the performance of the housekeeping work based on the image of the item.

[0011] In addition, in the present invention, the evaluation information derivation unit derives the score by an evaluation model trained using images of the housekeeping work performed appropriately and improperly, which have been acquired in advance, making it possible to easily derive a score by inputting a new image into the evaluation model.

[0012] In addition, in the present invention, the evaluation information derivation unit derives the rating score by an evaluation model trained using images that include an item that was the subject of the housekeeping work in a state where the housekeeping work was performed appropriately and in a state where the housekeeping work was performed improperly, which have been acquired in advance. This makes it possible to easily derive a rating score by inputting a new image of the item into the evaluation model.

[0013] In addition, in the present invention, the first imaging unit is included in an information terminal carried by a worker who performs the housekeeping work, and the image of the state after the housekeeping work is performed is captured by the worker. This allows the worker who performed the housekeeping work to immediately receive an evaluation of the quality of the housekeeping work.

[0014] The present invention further includes a second imaging unit that captures an image of a state after the housekeeping work is performed in a specific location, and the evaluation information derivation unit derives the rating score based on the image output by the second imaging unit. This makes it possible to easily derive a rating score by inputting an image captured by a Web camera or the like to the evaluation model.

[0015] The present invention also provides a surface condition measuring unit that measures the surface condition of an item that has been the subject of housekeeping work after the housekeeping work has been performed, and derives a score for the quality of the housekeeping work based on the surface condition of the item measured by the surface condition measuring unit, thereby making it possible to easily evaluate the quality of the housekeeping work for the item that has been the subject of the housekeeping work.

[0016] In addition, in the present invention, the object of the housekeeping work is bedding, and the evaluation information deriving unit derives a score based on the wrinkle state of the surface of the bedding measured by the surface condition measuring unit, thereby making it possible to evaluate the performance of the housekeeping work based on objective numerical values.

[0017] In addition, in the present invention, the surface condition measuring unit is included in an information terminal carried by a worker who performs the housekeeping work, which makes it possible to immediately evaluate the quality of the housekeeping work after the housekeeping work is performed.

[0018] The present invention also provides a housekeeping evaluation method for taking an image of a state after a housekeeping task has been performed, and deriving a score for the performance of the housekeeping task based on the image taken after the housekeeping task has been performed, thereby making it possible to easily evaluate the performance of the housekeeping task based on the image.

[0019] Furthermore, the present invention is adapted to derive a score for the quality of the housekeeping work based on an image including the item that is the subject of the housekeeping work, thereby making it possible to easily evaluate the quality of the housekeeping work based on an image of the item.

[0020] In addition, the present invention is adapted to measure the surface condition of an item that has been the subject of housekeeping work after the housekeeping work has been performed, and derive a score for the quality of the housekeeping work based on the measured surface condition of the item that has been the subject of the housekeeping work, thereby making it possible to easily evaluate the quality of the housekeeping work for the item that has been the subject of the housekeeping work.

[0021] In addition, the present invention is such that the object of the housekeeping work is bedding, and a score for the performance of the housekeeping work is derived based on the state of wrinkles on the surface of the bedding, thereby making it possible to evaluate the performance of the housekeeping work based on objective numerical values. Effect of the Invention

[0022] Thus, according to the present invention, by quantifying the quality of housekeeping in accommodation facilities and the like, it becomes possible to make a clear and fair evaluation, and furthermore, it becomes possible to utilize the evaluation of the quality of housekeeping for educating workers, etc. [Brief description of the drawings]

[0023] [Figure 1] FIG. 1 is an explanatory diagram showing an overview of a housekeeping evaluation system S1 according to a first embodiment of the present invention. [Diagram 2] Flowchart explaining the operation of the housekeeping evaluation system S1 [Diagram 3] FIG. 1A is an explanatory diagram showing a state in which items are appropriately arranged on a bar counter in a guest room, and FIG. 1B is an explanatory diagram showing the content of a notification on an information terminal 1 when items are not appropriately arranged. [Figure 4] FIG. 1A is an explanatory diagram showing a state in which the bed has been properly made in the bedding 25, and FIG. 1B is an explanatory diagram showing the content of a notification sent by the information terminal 1 when the bed has not been properly made. [Diagram 5] FIG. 1A is an explanatory diagram showing a state in which maintenance has been properly performed in a washbasin 29, and FIG. 1B is an explanatory diagram showing the content of a notification provided by an information terminal 1 when maintenance has not been properly performed. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] (First embodiment) A first embodiment of the present invention will be described below with reference to the drawings. Fig. 1 is an explanatory diagram showing an overview of a housekeeping evaluation system S1 according to the first embodiment of the present invention. The housekeeping evaluation system S1 is composed of an information terminal 1, a Web camera 2, a server 3, and a management terminal 4. These are connected to each other via a network 10, and information is transmitted and received between each of the components.

[0025] The information terminal 1 is, for example, a mobile information terminal such as a smartphone or a tablet terminal, a PC (Personal Computer), etc., and is carried by a worker (hereinafter, sometimes referred to as a "worker") such as a housekeeping staff member or a cleaning worker who performs housekeeping work in an accommodation facility, etc. The information terminal 1 includes a first imaging unit 1a, a first control unit 1b, a distance measuring unit 1c, a display unit 1d, and an input unit 1e.

[0026] The first imaging unit 1a is composed of a solid-state imaging element such as a COMS (Complementary Metal Oxide Semiconductor) image sensor. After performing housekeeping work, the worker operates the information terminal 1 and uses the first imaging unit 1a to capture an image of the space (guest room) including the items that are the subject of the housekeeping work. The first imaging unit 1a may be composed of a stereo camera. In this case, the stereo camera may be separate from the information terminal 1 and connected to the information terminal 1.

[0027] The first control unit 1b is composed of a CPU (Central Processing Unit) and the like, and operates according to a control program stored in a storage unit such as a ROM (Read Only Memory) or a RAM (Random access memory) (not shown). In the information terminal 1, the first control unit 1b and other components are connected via a bus (not shown) and the like, and the first control unit 1b controls the other components.

[0028] The distance measuring unit 1c measures the distance to the object (or the surface condition of the object) that is the target of the housekeeping work by using ToF (Time of Flight), which measures the time it takes for light to travel from the time it is emitted until the reflected light returns, LiDAR (Light Detection and Ranging), which performs optical scanning over a wide area using a pulsed laser, etc. The distance measuring unit 1c can be configured with the stereo camera described above.

[0029] The display unit 1d is composed of an LCD (Liquid Crystal Display) or an OLED (Organic Light Emitting Diode), and the input unit 1e is composed of a touch panel or the like. The worker operates the input unit 1e according to the guidance displayed on the display unit 1d. Based on the operation, the first control unit 1b controls the first imaging unit 1a to capture an image including the space or item that is the subject of the housekeeping work. In addition, the distance measuring unit 1c measures the surface condition of the item. The captured image and the measured surface condition of the item are transmitted to the server 3 via the network 10.

[0030] The Web camera 2 is composed of a second imaging unit 2a composed of a solid-state imaging element, and a second control unit 2b composed of a CPU and a storage unit (not shown) that controls the components of the Web camera 2. The Web camera 2 captures an image of a specific space that is the subject of housekeeping work. The image is, for example, once transmitted to the information terminal 1, and then transmitted to the server 3 via the network 10.

[0031] The server 3 is a known computer system. The server 3 is configured with a CPU (not shown) and includes a third control unit 3b that controls each component, and a server storage unit 3a. The server storage unit 3a includes a large-capacity storage device configured with RAID (Redundant Arrays of Independent Disks) in addition to ROM and RAM. A data set (to be described later) and image information transmitted from the information terminal 1 and the Web camera 2 are accumulated in the large-capacity storage. A worker evaluation database (to be described later) is built in the server storage unit 3a.

[0032] The management terminal 4 is a known computer system, and includes a fourth control unit 4b, a management terminal display unit, and a management terminal input unit (not shown). The management terminal 4 is typically configured as a PC or a tablet terminal, and is used by the manager of the housekeeping evaluation system S1, the person who manages and operates the accommodation facility, their contractor, etc. (hereinafter, sometimes referred to as the "manager, etc.").

[0033] Here, the Internet can be used, for example, as the network 10. Of course, the network 10 may be a so-called WAN (Wide Area Network) or LAN (Local Area Network) constructed in an accommodation facility or the like.

[0034] Hereinafter, the operation of the housekeeping evaluation system S1 will be described with reference to Fig. 1. A data set is stored in the server storage unit 3a of the server 3. This data set is used to learn an evaluation model that derives a score. The evaluation model is stored in the server storage unit 3a. The score refers to an index related to the performance of the housekeeping work.

[0035] In the first embodiment, the data set is composed of image data. The data set includes images of a portion of the guest room, and images of furniture, amenity goods, food containers 21, beverage bottles 22, glasses 23, etc. (see FIG. 3, etc.; hereinafter, these may be referred to as "items") arranged in the guest room (including images in which multiple items are photographed at the same time). Hereinafter, these images may be referred to as first images.

[0036] If a plurality of room types are set in the accommodation facility, the first image may be prepared for each room type. The first image may be captured by the first imaging unit 1a of the information terminal 1, or may be captured in advance by other imaging means. The first image is transmitted to the server 3 via the network 10 and stored in the server storage unit 3a.

[0037] Here, the first images are images taken in a predetermined direction from a plurality of predetermined positions. The first images include images of various areas in the guest room. Each of the first images includes images of objects in the guest room, such as a bed, a desk, and a shelf. The first images include not only images in which all objects that should be placed in each area are placed without omission (i.e., images in which housekeeping work has been properly performed), but also images in which some objects are missing and images in which objects are placed in a messy manner (i.e., images in which housekeeping work has been improperly performed). Furthermore, images of these objects taken at various angles and lighting conditions (imaging conditions) may also be included in the first images.

[0038] The first image also includes images of each item (or multiple items) arranged in the correct orientation, images upside down, left and right, front and back, or images rotated a specified angle from the correct orientation. Furthermore, for multiple items, images of items arranged with appropriate spacing between them and images of items arranged with inappropriate spacing between them (further or closer than a predetermined spacing) are also included. Note that it is preferable that these images also include images taken under multiple imaging conditions.

[0039] Furthermore, the data set includes images captured by the Web camera 2 (hereinafter, sometimes referred to as "second images"). Here, the Web camera 2 is placed in a relatively small space such as a washroom or toilet in a manner that respects the privacy of the guest (for example, directly above the wash basin 29 (see FIG. 5) so that the face and torso are not captured). The Web camera 2 is used to check in detail areas where it is difficult to accurately grasp the situation using the information terminal 1 carried by the worker.

[0040] The second image is an image taken in a predetermined direction from at least one predetermined position, and includes an image of a properly maintained state and an image of an improperly maintained state (inappropriate state) in a specific area. Here, the inappropriate state includes, as in the first image, a state in which an item is not placed in a position where it should be, and also a state in which an area that should not be dirty (or should be clean) is dirty.

[0041] The first and second images are acquired in advance when constructing the housekeeping evaluation system S1 (before learning the evaluation model described below), and as described above, include images of housekeeping work performed appropriately and improperly.

[0042] Next, labeling is performed on the data set (first image, second image). The data set stored in the server storage unit 3a is transmitted to the management terminal 4 via the network 10. Then, the manager or the like attaches a label to each image.

[0043] Specifically, if the first image is missing an item that should be included in the image, the administrator etc. will label the image with a score of, for example, -5 points x the number of missing items (n). Furthermore, the administrator etc. will add the "name of the item that should be included in the image" and the "name of the missing item" to the label. For example, if housekeeping work is performed properly, the image should include four items A, B, C, and D, but if the first image is missing two of these, items A and C, then n=2, and the administrator etc. will label the image with a score of -5 x 2 = -10 points.

[0044] Furthermore, items A, B, C, and D are added to the label as "item names that should be included in the image", and items A and C are added as "missing item names". Location information where the missing item should be located ("missing item location information") is also added to the label. The location information can be obtained, for example, by an administrator or the like specifying coordinates with a pointing device for an image displayed on a display or the like. Of course, the location information may be specified in the form of a so-called bounding box 50 (see FIG. 3, etc.). Note that if there is no missing item in the first image, NULL is added as the "missing item name" and the "missing item location information".

[0045] Furthermore, if the placement of the items in the first image is inappropriate, the administrator or the like may label the image with a score of, for example, -1 point x the number of inappropriately placed items (m). Here, cases where the placement of the items is inappropriate include cases where the items are upside down, front to back, or left to right inverted, where the items are not placed within a predetermined range, where multiple items are not placed in a predetermined order, where the orientation of the items is not within a predetermined angle range, etc. The spacing between multiple items may also be subject to evaluation.

[0046] The administrator or the like adds to the label "the name of the item that should be included in the image" and "the name of the item that is inappropriately positioned." For example, in the above example, if the first image includes items A, B, C, and D, but the orientation of item D is inappropriate (item D is a beverage bottle, and the printed label attached to the bottle cannot be directly seen by the guest, etc.), a score of -1 x 1 = -1 point is assigned to the label, with m = 1.

[0047] Furthermore, item A, item B, item C, and item D are added to the label as "names of items that should be included in the image", and item D is added as "name of item that is improperly placed". "Location information of improperly placed items" is also added to the label. If the first image does not contain any improperly placed items, NULL is added as the "names of improperly placed items" and "location information of improperly placed items". If a single first image contains multiple items, and an item that should be included in the image is missing and the placement of the item included in the image is improper, it is sufficient to add the "names of items that should be included in the image" once.

[0048] These scores, "names of items that should be included in the image", "names of missing items" and / or "names of items that are improperly placed", "location information of missing items" and / or "location information of items that are improperly placed" (hereinafter, sometimes referred to as "evaluation information") are transmitted from the management terminal 4 to the server 3, and the third control unit 3b associates the evaluation information with the first image and stores it in the server memory unit 3a. In this way, the evaluation information is assigned to each first image as a label. Note that the rules for assigning points as described above may be determined arbitrarily, and the administrator or the like assigns a label to the first image based on the rules.

[0049] The first image also includes an image of bedding 25 (e.g., a bed. See FIG. 4). The quality of the bedmaking of the bedding 25 is the subject of evaluation. The proportion of the bedding 25 in the guest room area is relatively large, and furthermore, the quality of the bedmaking is visually easy for guests to tell whether it is good or bad, so the quality of the bedmaking is given a large weight in the housekeeping work.

[0050] The evaluation of the quality of bed making is as follows: (a) Whether the sheet 28 (see FIG. 4) is spread out without wrinkles or slackness (b) Whether the position of the pillow 26 (see FIG. 4) is appropriate (if there are multiple pillows 26, whether the arrangement is balanced) (c) Whether the pillow 26 is fluffed and has a good shape (d) Whether the bed throw 27 (see Figure 4) is properly attached (e) Whether decorative pillows are properly placed (f) Whether the blanket is properly positioned Items such as:

[0051] Here, item (a) can be judged by the shadows that arise due to wrinkles in the sheet 28. If item (a) above is inappropriate for the first image, the administrator or the like assigns a score of, for example, -5 points to the label. Furthermore, if items (b) to (f) are inappropriate, a score of -1 point is added to each of the inappropriate items. For example, if, of items (a) to (f), (a) and (b) are inappropriate, a score of (-5) + (-1) = (-6) is assigned to the label. Of course, the method of assigning points may be determined arbitrarily.

[0052] Furthermore, at this time, bedding 25 is added to the label as the "name of the item to be included in the image". Then, (a) to (f) are added as the "name of the item to be included in the image", (a) and (b) are added as the "item of inappropriateness" for the performance, and further, "location information related to the inappropriate item" is added for (a) and (b). If the first image does not include an inappropriate item, NULL is added as the "inappropriate item" and the "location information related to the inappropriate item". That is, for the bedding 25, the evaluation information is composed of the score, "item name (bedding 25 in this case)", "item name included in the image ((a) to (f) in this case)", "inappropriate item ((a) and (b) in this case)", and "location information related to the inappropriate item". This evaluation information is also transmitted from the management terminal 4 to the server 3, and the third control unit 3b stores the evaluation information in association with the first image.

[0053] The second image is also labeled by the manager or the like in the same manner as bedding 25. The manager or the like evaluates whether or not an item (e.g., washbasin 29 in the bathroom) is properly maintained in the second image. Then, as evaluation information, a score, "name of item that should be included in the image" (washbasin 29 in this case), "name of item included in the image", "inappropriate item", and "location information related to the inappropriate item" are attached to the label.

[0054] After a first image and a second image of a predetermined scale are acquired as a data set and an administrator or the like has completed evaluation of the data set, the third control unit 3b uses the labeled data set to train an evaluation model by a machine learning technique. When the third control unit 3b inputs a new image into the trained evaluation model, evaluation information such as a score for the image is derived.

[0055] In this way, the third control unit 3b functions as an evaluation information derivation unit that derives a score related to the performance of the housekeeping work. The evaluation information derivation unit derives the score by an evaluation model trained using images of the housekeeping work performed appropriately and improperly, which have been acquired in advance. This makes it possible to easily derive a score by inputting a new image into the evaluation model.

[0056] Furthermore, the evaluation information derivation unit derives the score by an evaluation model trained using images including items that were the subject of the housekeeping work (the above-mentioned items A, B, C, and D, bedding 25, washbasin 29, etc.) in a state where the housekeeping work was performed appropriately and in a state where the housekeeping work was performed improperly, which have been acquired in advance. This makes it possible to easily derive a score by inputting new images of the items into the evaluation model.

[0057] In the first embodiment, the second imaging unit 2a may be provided for capturing an image of a state after a housekeeping task is performed in a specific location (e.g., a washroom), and the evaluation information derivation unit may derive an evaluation score based on an image output by the second imaging unit 2a. This makes it possible to easily derive an evaluation score by inputting an image captured by the Web camera 2 to the evaluation model.

[0058] Fig. 2 is a flowchart for explaining the operation of the housekeeping evaluation system S1. The explanation will be continued below with reference to Fig. 1 in addition to Fig. 2. Note that it is assumed that the training (learning) of the above-mentioned evaluation model has been completed prior to executing the processing of the flowchart.

[0059] First, a worker who has finished the housekeeping work takes a picture of the guest room with the information terminal 1 he or she carries to obtain image data (ST01). That is, the first imaging unit 1a is included in the information terminal 1 carried by the worker who performs the housekeeping work, and an image of the state after the housekeeping work is performed is taken by the worker. This allows the worker who performed the housekeeping work to immediately receive an evaluation of the quality of the housekeeping work.

[0060] When obtaining image data, it is preferable that the operator photographs the image in accordance with predetermined conditions. (i) Lighting conditions in the guest room (e.g., all curtains closed and all lights on in the guest room) (ii) The position of the worker when taking the photograph (multiple positions may be set) (iii) Subject and scope of photography Includes:

[0061] These conditions are preferably included in the conditions when the first image was acquired, and specific examples of (i) to (iii) are communicated in advance to the worker performing the housekeeping work using a manual or the like. Here, (iii) includes, for example, the bar counter and bedding 25 (bed) in the guest room. The worker also operates the information terminal 1 to acquire an image from the Web camera 2. The Web camera 2 can acquire an image, for example, of a washbasin 29 (see FIG. 5) in the bathroom taken from above.

[0062] The worker operates the input unit 1e of the information terminal 1 to transmit the image (image data) captured by the first imaging unit 1a to the server 3 (ST02). Here, the third control unit 3b counts the number of received images and obtains the number N of evaluated images (ST03). The third control unit 3b refers to the number N of evaluated images and determines whether or not there is any unevaluated image data (ST04). If there is no unevaluated image data (No in ST04), the process proceeds to ST11.

[0063] If there is unevaluated image data (Yes in ST04), the third control unit 3b inputs the image data (one of the multiple images; hereinafter, sometimes referred to as the "evaluation target image") received from the information terminal 1 into the evaluation model described above to obtain evaluation information (ST05). The third control unit 3b then associates the evaluation information with the worker's identifier (ID: IDentifier) ​​and stores it in the server storage unit 3a (ST06). At this time, information regarding the date and time when the housekeeping work was performed is also stored.

[0064] Thus, the housekeeping evaluation system S1 of the first embodiment includes a first imaging unit 1a that captures an image of the state after the housekeeping work has been performed, and an evaluation information derivation unit (third control unit 3b) that derives a score on the performance of the housekeeping work based on the image captured by the first imaging unit 1a. This makes it possible to easily evaluate the performance of the housekeeping work based on the image.

[0065] The evaluation information derivation unit derives a score for the performance of the housekeeping work based on images including the items that are the subject of the housekeeping work (the above-mentioned items A, B, C, and D, the bedding 25, the washbasin 29, etc.) captured by the first imaging unit 1a. This makes it possible to easily evaluate the performance of the housekeeping work based on the images of the items.

[0066] Next, the third control unit 3b judges whether the value of the rating included in the evaluation information is negative (ST07). If the value of the rating is non-negative (here, 0) (No in ST07), it is determined that the image to be evaluated does not include "missing item names", "inappropriately placed item names", etc., and the process moves to ST10. On the other hand, if the value of the rating is negative (Yes in ST07), the "missing item names", "inappropriately placed item names", "position information of missing items", and "position information of inappropriately placed items" are obtained from the evaluation information (ST08). Note that if the image to be evaluated is an image of bedding 25, "inappropriate items" and "position information related to inappropriate items" are obtained from the evaluation information.

[0067] Next, the third control unit 3b attaches a so-called bounding box 50 to the image to be evaluated based on the "position information of the missing item", or the "position information of the improperly placed item", or the "position information related to the improper item" (ST09). Hereinafter, the image to which the bounding box 50 is attached may be referred to as a "notification image". After that, the number N of evaluation images is decremented (ST10), and the process proceeds to ST04.

[0068] If there is no unrated image data (i.e., the evaluation has been completed for all images to be evaluated) (No in ST04), the third control unit 3b extracts from the server storage unit 3a the "name of missing item," "name of improperly placed item," "inappropriate item" (hereinafter, these may be referred to as "inappropriate items, etc."), and score (hereinafter, the score and "inappropriate items, etc." may be collectively referred to as "notification information") for each image to be evaluated. Then, the notification image and notification information are transmitted to the information terminal 1 and the management terminal 4 (ST11). Then, the process ends. Of course, at this time, it is also possible to transmit only the notification image and notification information for which the score is a negative value.

[0069] The third control unit 3b may transmit the "name of the missing item", "location information of the missing item", or the "name of the improperly placed item", "location information of the improperly placed item", or the "inappropriate item", or the "location information related to the inappropriate item" to the information terminal 1, and the information terminal 1 that receives them may generate a notification image. At this time, the evaluation target image may be transmitted to the information terminal 1. On the other hand, in ST02, if a predetermined identifier is attached to the image when the image data is transmitted from the information terminal 1 to the server 3, the evaluation target image can be identified by the information terminal 1, and therefore it is not necessary to transmit the evaluation target image again.

[0070] Fig. 3(A) is an explanatory diagram showing a state in which items are appropriately arranged on the bar counter in a guest room, and Fig. 3(B) is an explanatory diagram showing the content of a notification on information terminal 1 when items are not appropriately arranged. Here, Fig. 3(B) shows an example of a notification image and notification information displayed on display unit 1d of information terminal 1.

[0071] In Figure 3(B), the food container 21 shown in Figure 3(A) is not placed (corresponding to the "missing item" described above), the beverage bottle 22 is upside down, and the glass 23 is upside down (corresponding to the "improperly placed item" described above).

[0072] In this case, a bounding box 50 is displayed on the display unit 1d of the information terminal 1 at a position corresponding to the "missing item" or "improperly placed item," and the worker can learn the contents of the housekeeping work that has been judged to be inappropriate by the housekeeping evaluation system S1. Furthermore, a message is displayed on the display unit 1d. Based on the notification information, the message displays a score (here, -7 points), as well as the "name of the missing item" (here, food container 21) and the "name of the improperly placed item" (here, beverage bottle 22 and glass 23), indicating that the item is not placed or is placed improperly.

[0073] In this way, the "missing item" is not included in the image to be evaluated, but for the item not included in the image to be evaluated, the bounding box 50 is displayed at the position where it should be appropriately placed. That is, the above-mentioned third control unit 3b extracts the item that is missing from the situation where the housekeeping work is being performed appropriately based on the image captured by the first imaging unit 1a of the information terminal 1 and the evaluation information derived by the evaluation information derivation unit, and the position where the missing item should be placed is displayed on the information terminal 1.

[0074] Fig. 4(A) is an explanatory diagram showing a state in which the bed has been properly made in bedding 25, and Fig. 4(B) is an explanatory diagram showing the contents of a notification on information terminal 1 when the bed has not been properly made. Here, Fig. 4(B) shows an example of a notification image and notification information displayed on information terminal 1.

[0075] In Fig. 4(B), the pillow 26 and the bed throw 27 shown in Fig. 4(A) have shifted from their appropriate positions, and furthermore, the bedding 25 (sheets 28) has large wrinkles. All of these correspond to the "inappropriate items" mentioned above.

[0076] On the display unit 1d, a bounding box 50 is displayed at a position corresponding to the "inappropriate item" in the bed making described above. Furthermore, on the display unit 1d, a score based on the notification information (here, -7 points) is displayed as a message. Also, together with the names of the items corresponding to the "inappropriate item" (here, the pillow 26, the bed throw 27, and the bedding 25 (sheets 28)), a message is displayed indicating that the sheets 28 are wrinkled and that the items are not properly arranged.

[0077] Fig. 5(A) is an explanatory diagram showing a state in which maintenance has been properly performed in washbasin 29, and Fig. 5(B) is an explanatory diagram showing the contents of a notification on information terminal 1 when maintenance has not been properly performed. Here, Fig. 5(B) shows an example of a notification image and notification information displayed on information terminal 1.

[0078] In Fig. 5(B), the position of the stopper 30 shown in Fig. 5(A) is inappropriate, and dirt 31 is attached to the wash basin 29 (both of which correspond to the above-mentioned "inappropriate items"). A bounding box 50 is displayed on the display unit 1d at a position corresponding to the "inappropriate item". Furthermore, the display unit 1d displays a message indicating the content of the "inappropriate item" (here, the placement of the stopper 30 and the dirt 31) together with a score based on the notification information (here, -2 points).

[0079] In the above example, the worker is notified of the score for each image to be evaluated, but the scores for each image to be evaluated may be totaled and notified. Of course, both may be notified. In the first embodiment, the score is derived using a point deduction system, but it may be a point addition system, or a point deduction system may be used, a predetermined value may be added, and the offset value may be notified.

[0080] When there is an evaluation target image with a negative score, the third control unit 3b may notify the worker via the information terminal 1 that inappropriate items, etc. remain, and may further instruct the worker to correct the inappropriate items, etc. As described above, the notification information is also transmitted to the management terminal 4, and the manager, etc. may refer to the notification information and instruct the worker to correct the "inappropriate items, etc."

[0081] The worker may correct inappropriate work content in the housekeeping work based on the notification images and notification information exemplified in Figures 3 to 5. After correcting the inappropriate items, the worker can then photograph the guest room again (ST01), transmit the image data to the server 3 (ST02), and receive a reevaluation of the performance of the housekeeping work.

[0082] On the other hand, if there is no evaluation target image with a negative score, the third control unit 3b notifies the information terminal 1 (worker) and the management terminal 4 (manager, etc.) that the housekeeping work has been properly completed (completion report). The completion report is approved by the manager, etc., and an approval message is notified to the worker via the information terminal 1. This makes it possible to carry out the housekeeping work without confirmation from experienced staff, etc.

[0083] As described above, a worker evaluation database (hereinafter, sometimes referred to as "worker evaluation DB") is constructed in the server storage unit 3a. The worker evaluation DB stores the worker's identifier, the date and time (date and time information) when the worker performed the housekeeping work, notification information, notification images, the number of times the worker performed corrections in the housekeeping work (number of corrections), etc. The date and time information and the number of corrections can be acquired when the process of ST11 described above is executed.

[0084] The third control unit 3b accesses the worker evaluation DB based on an instruction issued from the management terminal 4 based on the operation of the manager, etc., and executes various analysis processes, etc. For example, for each worker, (1-1) Changes in housekeeping task scores over time (1-2) Time series of the number of corrective actions taken to complete housekeeping tasks (1-3) History of items, etc., extracted as "inappropriate items, etc." In addition, for all workers, (2-1) Ranking of items, etc., extracted as "inappropriate items, etc." (2-2) Average score (2-3) Average number of corrections etc. can be derived.

[0085] Based on these analysis results, the manager or the like can educate the workers in advance about the housekeeping tasks that are likely to be overlooked. The manager or the like can also use the information in (1-1) to (1-3) to quantitatively grasp the performance of the housekeeping tasks of each worker and reflect this in the worker's evaluation (salary), for example. In this way, the present invention makes the evaluation criteria clear and fair, which leads to the workers setting achievable goals, improving the quality of the housekeeping tasks and increasing their motivation. Second embodiment

[0086] In the above-mentioned evaluation of the quality of the bedmaking, the judgment of "whether the sheets 28 are spread out without wrinkles or slack" may be made using the distance measurement data acquired by the distance measurement unit 1c. Specifically, after the housekeeping work is completed, the worker moves the orientation of the information terminal 1 equipped with the distance measurement unit 1c left and right and up and down to change the point to be measured. At this time, it is desirable to display an image (output of the first imaging unit 1a) including the position (point) where the distance measurement is being performed by the distance measurement unit 1c on the display unit 1d of the information terminal 1, and notify the range where the distance measurement is actually completed, for example, by processing the color of the pixel corresponding to the point where the distance measurement is completed.

[0087] As a result, even if ToF is adopted as the distance measuring unit 1c, the distance measuring unit 1c essentially functions as a LiDAR and can three-dimensionally detect the arrangement and surface condition of the bedding 25 in the guest room. That is, the distance measuring unit 1c functions as a 3D-ToF. In this way, the first control unit 1b can generate a 3D-ToF image based on the output of the distance measuring unit 1c and detect the surface condition of the bedding 25 (sheets 28). Similarly, even if the first imaging unit 1a is configured with a stereo camera, it is possible to detect the surface condition of the bedding 25 based on the depth information. That is, the distance measuring unit 1c or the first imaging unit 1a functions as a surface condition measuring unit.

[0088] Then, the first control unit 1b measures the state of wrinkles on the surface of the bedding 25 based on the 3D-ToF image acquired by the distance measuring unit 1c or the stereo image acquired by the first imaging unit 1a (here, a stereo camera). For example, the first control unit 1b generates a height map (depth map) from the 3D-ToF image or the stereo image, and measures the depth on the surface of a predetermined area of ​​the sheet 28 (for example, the side of the mattress of the bedding 25 shown in FIG. 4(B)) to measure the position of the wrinkles (areas where the wrinkles exist) and the depth of the wrinkles in each area (the distance between the apex of the convex part and the bottom of the concave part), etc. Of course, the first control unit 1b may generate the height map using both the 3D-ToF image and the stereo image.

[0089] Then, the first control unit 1b derives a score for the quality of the bed making based on the number of areas with wrinkles and the depth of the wrinkles in each area. Thus, in the second embodiment, the first control unit 1b of the information terminal 1 functions as an evaluation information deriving unit. Note that the rules for assigning the score may be determined as appropriate, and for example, the weight of the depth of wrinkles that have a relatively large impact on the vision may be increased.

[0090] Thus, in the housekeeping evaluation system S1 of the second embodiment, the surface condition measuring unit (the distance measuring unit 1c or the first imaging unit 1a) is included in the information terminal 1 carried by the worker performing the housekeeping work, and the surface condition of the item (the sheets 28 of the bedding 25) can be measured by the worker. This enables the worker to immediately evaluate the performance of the housekeeping work after performing the housekeeping work.

[0091] The housekeeping evaluation system S1 also includes a surface condition measuring unit (distance measuring unit 1c or first imaging unit 1a) that measures the surface condition of the item (sheets 28 of bedding 25) that was the subject of housekeeping work after the housekeeping work (bed making) has been performed, and an evaluation information deriving unit (first control unit 1b) that derives a score regarding the performance of the housekeeping work based on the surface condition of the item measured by the surface condition measuring unit. This makes it possible to easily evaluate the performance of the housekeeping work for the item that was the subject of the housekeeping work.

[0092] The article targeted for the housekeeping work is bedding 25 (sheets 28), and the evaluation information deriving unit (first control unit 1b) derives a score based on the state of wrinkles on the surface of the bedding 25 measured by the surface condition measuring unit. This makes it possible to objectively evaluate the performance of the housekeeping work.

[0093] The housekeeping evaluation system S1 and the housekeeping evaluation method according to the present invention have been described in detail above based on specific embodiments, but these are merely examples, and the present invention is not limited to these embodiments. For example, the first embodiment and the second embodiment may be combined. That is, among the scores included in the notification information described in the first embodiment, a score based on the output of the surface condition measuring unit described in the second embodiment may be used for the bedding 25 (sheets 28). In addition, a part of the processing of the third control unit 3b may be executed by the management terminal 4, and the allocation of the processing may be determined arbitrarily. [Industrial Applicability]

[0094] The housekeeping evaluation system S1 of the present invention can quantify the quality of housekeeping, enabling a clear and fair evaluation to be made, and the evaluation can also be used for educating workers, etc., and therefore can be widely used in accommodation facilities such as hotels and inns, nursing homes where people in need of care live, hospitals, etc. [Explanation of symbols]

[0095] 1 Information terminal 1a First imaging unit 1b First control section 1c Ranging section 1d display section 2. Webcam 3 Server 3a Server memory section 3b Third control section 4. Management terminal 10 Network 25 Bedding 29 Wash Basin 50 Bounding Box S1 Housekeeping Rating System

Claims

1. a first imaging unit that captures an image of a state after a housekeeping task has been performed; an evaluation information deriving unit that derives a score regarding the performance of the housekeeping work based on the image captured by the first imaging unit; A housekeeping evaluation system comprising:

2. The evaluation information derivation unit is The housekeeping evaluation system according to claim 1, characterized in that a score regarding the performance of the housekeeping work is derived based on an image including the item that was the subject of the housekeeping work captured by the first imaging unit.

3. The evaluation information derivation unit is 3. The housekeeping evaluation system according to claim 1, wherein the score is derived from an evaluation model trained using images of the housekeeping tasks performed properly and improperly, the images having been acquired in advance.

4. The evaluation information derivation unit is The housekeeping evaluation system according to claim 1 or 2, characterized in that the score is derived from an evaluation model trained using images that include the item that was the subject of the housekeeping work, which have been acquired in advance, in a state where the housekeeping work has been performed appropriately and in a state where the housekeeping work has been performed improperly.

5. the first imaging unit is included in an information terminal carried by a worker performing the housekeeping work, 3. The housekeeping evaluation system according to claim 1, wherein the image of the state after the housekeeping task has been performed is taken by the worker.

6. a second imaging unit that captures an image of a state after the housekeeping work is performed in a specific location among the housekeeping works, 3. The housekeeping evaluation system according to claim 1, wherein the evaluation information derivation unit derives the score based on the image output by the second imaging unit.

7. a surface condition measuring unit that measures a surface condition of an item that has been the subject of housekeeping work in a state after the housekeeping work has been performed; an evaluation information deriving unit that derives a score for the performance of the housekeeping work based on the surface condition of the object measured by the surface condition measuring unit; A housekeeping evaluation system comprising:

8. The item targeted for the housekeeping work is bedding; 8. The housekeeping evaluation system according to claim 7, wherein the evaluation information deriving unit derives a score based on the state of wrinkles on the surface of the bedding measured by the surface condition measuring unit.

9. 9. The housekeeping evaluation system according to claim 7, wherein the surface condition measuring unit is included in an information terminal carried by a worker who performs the housekeeping work.

10. Take an image of the state after the housekeeping work is done, A housekeeping evaluation method, comprising deriving a score for the quality of the housekeeping work based on an image of the state after the housekeeping work has been performed.

11. The housekeeping evaluation method according to claim 10, further comprising deriving a score for the performance of the housekeeping work based on an image including an item that was the subject of the housekeeping work.

12. measuring the surface condition of the item that was the subject of the housekeeping work after the housekeeping work has been performed; A housekeeping evaluation method, comprising deriving a score for the performance of the housekeeping work based on the measured surface condition of the item that was the subject of the housekeeping work.

13. The item targeted for the housekeeping work is bedding; The housekeeping evaluation method according to claim 12, further comprising deriving a score for the performance of the housekeeping work based on the state of wrinkles on the surface of the bedding.

Images