Product dispenser status query system and method

By applying image recognition on mobile devices, a low-power and convenient way to obtain product dispenser status information is achieved, overcoming the difficulties in obtaining product dispenser status information for maintenance personnel in the prior art, and realizing efficient and low-power status acquisition.

CN121079705APending Publication Date: 2025-12-05KIMBERLY CLARK WORLDWIDE INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202480029930.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-04-06
Filing Date
2024-04-05
Publication Date
2025-12-05

AI Technical Summary

Technical Problem

In existing technologies, maintenance personnel have difficulty obtaining the status information of product dispensers in multiple restroom facilities efficiently and with low power consumption, resulting in waste and unnecessary power consumption.

Method used

Image recognition is used to identify the shape and location of the product dispenser on mobile devices, and the dispenser status is obtained by wirelessly accessing the cloud server, reducing the power demand of the dispenser itself and simplifying the information acquisition process.

Benefits of technology

It enables the acquisition of product distributor status information in a low-power and simple manner, reducing waste and power consumption, and improving maintenance efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121079705A_ABST
    Figure CN121079705A_ABST
Patent Text Reader

Abstract

A method and system for accessing information about a condition of a consumable product dispenser in a washroom facility is provided. Each product dispenser included in a washroom facility or a plurality of facilities may include a sensor for determining a product margin, a power level, or an operating condition. The server system stores a condition of each product dispenser. An image recognition application loaded onto the mobile device is configured to identify a particular product dispenser from the plurality of dispensers and access and communicate a condition of the product dispenser stored on the server system to a user. The methods and systems of the present disclosure not only simplify obtaining information about product dispensers, but do not deplete battery power of any product dispenser in doing so.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Cross-references to related applications

[0002] This application relates to and has priority with U.S. Provisional Patent Application No. 63 / 494,566, filed April 6, 2023, the entire contents of which are incorporated herein by reference for all purposes. Background Technology

[0003] For typical workplace restroom facilities, such as those in manufacturing plants, healthcare facilities, and office buildings, maintenance is usually assigned to a maintenance team that visits the facility on a schedule or periodically to replenish dispensers and ensure cleanliness. The same person or multiple individuals may be assigned to be responsible for multiple restroom facilities within a building or commercial premises.

[0004] In the past, maintenance personnel had little knowledge of the condition of a facility before actually entering it, especially whether the dispensers were full. In this respect, maintenance personnel had to be prepared for completely empty dispensers in the various facilities they were responsible for. Replenishment supplies were typically not stored in restroom facilities, and maintenance personnel had to carry sufficient supplies to deal with "worst-case scenarios," which could be an overburdensome task depending on the number of facilities and the type of dispensers.

[0005] It was also found that a significant amount of product waste can be attributed to certain maintenance practices. For example, a towel dispenser might be one-third full when inspected by maintenance personnel. However, the common practice during regular maintenance visits is to overfill the dispenser with a full refill. This overfilling often leads to dispenser blockages or excessive towel use by restroom patrons, such as when multiple towels are dispensed due to the overfill. If the dispenser has an anti-overfill device, the usual maintenance practice is to discard any remaining towels in the dispenser so that new, full refills can be loaded. Over time, this waste can become quite costly for building owners.

[0006] U.S. Patent Publication No. 2021 / 0279654 discloses a system and method in which a product dispenser and multiple restroom facilities are equipped with sensors that detect the remaining product level or quantity status of the product dispenser. These sensors communicate with a monitoring station assigned to each restroom facility. Based on the detected remaining product level or quantity status of the dispenser, a unique set of instructions is generated for each restroom facility. Using an identification system configured within each restroom facility, maintenance personnel entering the restroom facility can be identified, and the unique set of instructions can be provided to that maintenance personnel in a message via a mobile phone smart device or an audio or visual display device. Application '654 provides significant advancements in the art and is incorporated herein by reference.

[0007] However, there remains a need for further advancement and improvement in communicating information to maintenance personnel regarding the status or condition of one or more consumable product dispensers in a plurality of washroom facilities. For example, when information is stored on a computer system at a monitoring station, access to the information by maintenance personnel is typically accomplished digitally using, for example, Bluetooth technology. However, accessing the information can create an electrical power strain on the individual product dispensers, and complex software or action can also be required in order to achieve a digital connection to provide status data to a mobile device. Accordingly, there is a current need to access stored information regarding product dispensers while minimizing electrical power consumption and / or in a simpler manner than past systems and methods. SUMMARY

[0008] A method and associated washroom system incorporating aspects of the present disclosure are presented. The term "washroom" is used generically herein to encompass public, semi-public, or private facilities that patrons visit to use water basin or toilet facilities, bathing facilities, changing facilities, and the like. Such facilities are also referred to as lavatories, restrooms, public restrooms, men's restrooms, women's restrooms, and the like. A typical public or semi-private washroom has a plurality of toilet facilities or urinals and water basins.

[0009] While the present method and washroom system are particularly useful in "non- domestic" public or semi-private environments, the present system is not limited in the range of use. As used herein, the term "non-domestic" refers to places or locations outside of typical residences where people gather for various reasons or purposes. Examples of non-domestic locations include commercial sites such as office buildings, office suites, retail stores and warehouses, manufacturing facilities; schools; hospitals and other types of medical facilities; religious sites; hotels and motels; convention centers; sports arenas; playing fields; and the like. The method and system are particularly useful in buildings that provide a plurality of washroom facilities for use by tenants of the building, or industrial or manufacturing sites that provide a plurality of site facilities for a managed population. However, it should be understood that the present washroom system and method can also be used in residential or private environments, and such uses are within the scope and spirit of the present disclosure.

[0010] In accordance with aspects of the present disclosure, a system and associated method for maintaining a plurality of washroom facilities by maintenance personnel is provided. Such maintenance personnel can be members of a janitorial service agency responsible for the day-to-day repair, replenishment of consumables, and cleaning of the washroom facilities, or members of a building's facilities staff, and the like. Each of these washroom facilities has one or more consumable product dispensers, such as paper product dispensers, soap dispensers, toilet paper dispensers, and the like, that need to be replenished on a regular basis.

[0011] In one aspect, the present disclosure relates to a method of accessing information about the status of consumable product dispensers in a washroom facility. The method includes detecting a status of one product dispenser as part of a plurality of product dispensers in a plurality of washroom facilities. Each product dispenser is used to dispense a consumable product that requires periodic replenishment. The status can include at least one of: a product level, a power level, an operational status, or a combination thereof. The method further includes storing the detected status on a server system.

[0012] According to the present disclosure, the method further includes placing a mobile device in proximity to one of the product dispensers and accessing an image recognition application. The image recognition application is configured to identify the particular product dispenser from the plurality of dispensers and access the stored status of the product dispenser and communicate it to the user.

[0013] The image recognition application can operate in various ways according to the present disclosure. In one aspect, for example, the image recognition application can be configured to identify the shape of the product dispenser from optical data. For example, the product dispenser can include an external housing that is identified by the image recognition application. In one aspect, the image recognition application is configured to identify and recognize the product dispenser without identifying a barcode or QR code applied to the dispenser.

[0014] In one aspect, the image recognition application can be configured to identify the type of product dispenser (e.g., a particular model of a paper towel dispenser) and also configured to identify the location of the particular product dispenser. The location of the dispenser can be detected, for example, using a global positioning system associated with the mobile device. Alternatively, the location of the product dispenser can be determined by identifying a marker within the washroom in which the product dispenser is located.

[0015] In one aspect, the image recognition software accesses a camera on the mobile device or any suitable optical sensor capable of image analysis and identifies the product dispenser from optical data such as a photograph, picture, digital image, or video of the product dispenser taken within the washroom.

[0016] As described above, various different information about the particular product dispenser can be communicated to the user or maintenance personnel. For example, the communication can include a set of instructions including an expected replenishment requirement for the product dispenser based on the current status or requirements in the washroom facility file. In one aspect, the message can include a set of instructions including dispenser replenishment instructions based on expected usage of the washroom facility before the next scheduled visit of the maintenance personnel.

[0017] As described above, information about each product dispenser within a washroom facility can be stored on a server system. The image recognition application can access the server system without compromising in any way the power requirements of the product dispensers themselves. The server system may, for example, comprise a cloud-based system that the mobile device can access wirelessly, for example, over a wi-fi network or through cellular data. The status of each product dispenser contained within a plurality of washroom facilities may, for example, all be stored on the cloud-based system and accessed by the image recognition application using the mobile device.

[0018] The present disclosure also relates to a system for maintaining a plurality of washroom facilities by a maintenance personnel. The system comprises one or more product dispensers within each of the washroom facilities that require periodic replenishment of a consumable product. Each of the product dispensers can comprise at least one sensor that detects a status of the product dispenser. The status may, for example, be a product level, a power level, or an operational status. Each of the sensors can be in communication with a monitoring station assigned to the washroom facility. A server system can be configured to store the status of each product dispenser and, optionally, generate a set of instructions unique to each of the product dispensers. In accordance with the present disclosure, the system can also comprise an image recognition application loaded onto a mobile device that is configured to identify a particular product dispenser from a plurality of dispensers and access the product dispenser status stored on the server system.

[0019] As described above, the image recognition application can be configured to identify a particular product dispenser based on optical data, such as the overall shape of the particular product dispenser or specific features based on the overall shape. In one aspect, the image recognition application can be configured to identify the type of product dispenser based on the shape of the housing and can also be configured to determine the location of the particular product dispenser from all other product dispensers contained in each of the washroom facilities.

[0020] Other features and aspects of the present disclosure are discussed in more detail below. BRIEF DESCRIPTION OF DRAWINGS

[0021] In the remainder of the specification, including the reference to the accompanying drawings, the complete and operative disclosure of the present disclosure is set forth more particularly, in which:

[0022] Figure 1 is a diagrammatic view of a washroom facility incorporating a system and method in accordance with aspects of the present invention;

[0023] Figure 2 is a flowchart of one embodiment of a method in accordance with the present disclosure; and

[0024] Figure 3is a component diagram view of certain control features of the system and method according to the present invention.

[0025] The repeated use of reference characters in the present specification and drawings is intended to represent the same or similar features or elements of the invention. DETAILED DESCRIPTION

[0026] One of ordinary skill in the art will appreciate that the discussion is a description of exemplary implementations only and is not intended to limit the broader aspects of the disclosure.

[0027] As mentioned, in one aspect, the present disclosure relates to a method and system for maintaining a washroom facility, particularly where a maintenance personnel is required to periodically replenish a consumable product dispenser within the facility, such as a paper towel dispenser, soap dispenser, toilet paper dispenser, etc. The maintenance personnel can be a member of a janitorial service agency responsible for the day-to-day repair, replenishment of consumables, and cleaning of the washroom facility, or a member of a building’s facilities staff, etc.

[0028] More particularly, the present disclosure relates to a method and system for easily and conveniently providing a maintenance personnel with information regarding the status of a particular product dispenser, which can be one of many product dispensers being monitored simultaneously in many different washroom facilities and buildings. In the past, in order to access the status of a product dispenser, the product dispenser had to be manually inspected, or if the status was electronically monitored, a digital connection to the particular product dispenser was required, which can result in power consumption of the dispenser, and can also require complex software and / or firmware. However, according to the present disclosure, an image recognition application according to the present disclosure is loaded on a mobile device for scanning a particular product dispenser, which causes the mobile application to obtain the most recent status information for the device or washroom from a wireless connection to, for example, a cloud platform. The image recognition application is, for example, configured to not only recognize the particular type of product dispenser, but also the location of the dispenser, for communicating the status of the particular dispenser to the user without having to digitally connect with the dispenser itself. Although a barcode or QR code applied to the dispenser can be used to obtain the information, alternatively, the image recognition application can identify the product dispenser according to other indicia, including the shape of the dispenser housing or particular features on the dispenser housing. In one aspect, an augmented reality tool or artificial intelligence can be used to identify or determine the particular product dispenser for which information is requested.

[0029] REFERENCE Figure 1, an embodiment of a system and related method 10 for public or semi-private restroom facilities 12 within a building or commercial site location is illustrated. The building can have multiple similarly configured facilities 12 on one or more floors. In addition to having multiple facilities 12 in a single building or at a single site location, the system and method of the present disclosure is also applicable to monitoring multiple facilities in multiple buildings.

[0030] Figure 1 The design and features of the restroom facility 12 depicted are for illustrative purposes only. The restroom facility 12 is depicted as a men's restroom facility having one or more individual stalls 18 (with individual toilets 16) and one or more urinals 28. Multiple sinks 20 are also provided. Any combination of other conventional restroom components can also be provided in the restroom facility 12, such as toilet paper dispensers 22, soap dispensers 24, towel dispensers 26, etc. The individual stalls 18, urinals 28, and sinks 20 can be considered "function locations" 36 in which a patron can perform a desired restroom function within the facility 12. It should be understood that additional function locations 36 of any manner can also be included in the restroom facility 12, such as showers, changing rooms, baby care stations, etc.

[0031] Figure 1 A maintenance person 30 is depicted in the restroom facility 12. This person is responsible for ensuring that the various product dispensers 22, 24, 26 are operational and filled, and for the overall cleanliness of the facility 12.

[0032] Within each restroom facility 12, the product dispensers 22, 24, 26 are configured with at least one sensor 25 that detects at least one condition of the product dispensers 22, 24, and 26. For example, one or more sensors 25 can be used to detect a level or amount condition of product in the dispensers based on any number of operating principles, such as a running time of the dispenser or a direct measurement of the amount of product dispensed. In addition to product level, one or more sensors 25 can also monitor various other conditions. For example, when the product dispensers operate on battery power or have a backup battery pack, one or more sensors 25 can monitor the power level within each product dispenser. The condition monitored by the sensor can also be an operational condition. This operational condition can relate to, for example, whether there is a product clog or other malfunction. The operational condition can also relate to wear of components within the product dispenser, particularly movable components. For example, the condition can be whether various components within the dispenser have reached their operational life and need to be replaced.

[0033] The product dispensers 22, 24, 26 are in communication with the central monitoring system 14 via any manner of suitable wireless communication system, such as a Bluetooth® or ZigBee® system, for example. The central monitoring system 14 is configured to receive the condition data from the product dispensers 22, 24, 26 and to store this data in a database 32. The central monitoring system 14 can also be configured to receive data from other sources, such as a building management system 34, which can provide data relating to the overall operation of the building, such as the number of patrons in the building, the number of patrons in the restroom facility 12, etc. Figure 1The monitoring system 45 is a computer-implemented system that can be located remotely from the washroom facility 12 or configured within the facility 12. The monitoring system 45 can monitor multiple similarly configured washroom facilities 12 within one building or commercial site location or within multiple buildings or sites. The monitoring system 45 can be in direct communication with a system server 46. Information from the monitoring system 45 can be used by the server system to generate a unique set of instructions and messages for delivery to maintenance personnel 30 for each washroom facility 12 or product dispenser based on the detected product levels or other conditions of the dispensers 22, 24, 26 in the respective washroom facility 12.

[0034] In Figure 1 In embodiments, the instructions 32 are delivered to the maintenance personnel 30 via a mobile device 35 carried by the personnel 30, such as a smart phone, tablet, PDA, smart glasses, or other network-enabled device (all collectively referred to herein as "mobile device"). The instructions 32 can be delivered in the form of a text message, email, voice message, or any other format supported by the mobile device 35, including formats in which the device accesses and displays data from the central server system 46. The instructions 32 can be information related to the condition of a particular product dispenser. The communication 32 can be, for example, that no maintenance is required, that the dispenser requires product to be added, that there is a malfunction in the operation of the dispenser, the current status, condition, or product level of the dispenser, and / or a prediction of when the dispenser maintenance or product replenishment can be required.

[0035] The central server system 46 is in communication with all of the product dispensers and includes a memory or repository having a respective file or database associated with each of the product dispensers, where the system 46 retrieves, accesses, or opens the stored file or database associated with a product dispenser to generate appropriate instruction messages 32 or communications based on the updated status of the respective dispensers 22, 24, 26 in the identified washroom facility 12 forwarded by the monitoring system 45. The respective washroom facility file can also include any type of other relevant information, such as complaints, comments, or other conditions recorded or otherwise input into the server system 46 from any source. The file can contain information about events or activities in the building that can affect future washroom usage, where such information can be automatically or manually input into the server system 46 from any source, such as from an electronic schedule or calendar maintained by the building manager that is periodically automatically imported into the server system 46.

[0036] Each of the washroom facilities 12 is equipped with wireless communication capabilities for communicating with a mobile device 35 carried or worn by a user 30. In accordance with the present disclosure, for example, the mobile device 35 can include software and / or firmware that allows the device to receive communications from a server system 46. As will be described in greater detail below, the present disclosure relates to a more efficient way for a user 30 to communicate with the server system 46 for obtaining information about a particular product dispenser located within one of the washroom facilities.

[0037] As mentioned, certain embodiments will have a single building or multiple buildings with multiple washroom facilities 12 linked to one or more central server systems 46 and one or more monitoring systems 45, with each product dispenser within the multiple washroom facilities 12 in communication with the systems 45, 46. In this regard, the communication network is configured for these functions, with individual dispensers considered network-enabled devices that can be directly connected to the network through multiple direct network links (eliminating the need for a bus, router, or other networking equipment). It should also be understood that each network-enabled device (or group of such devices) in this configuration can represent a node, which in turn can be directly connected and / or multiplexed to the network via a direct network link. Further, the direct network links can represent secure communication channels that are physically hardened against tampering, and / or the communications can be encrypted to prevent unauthorized access to the information sent thereon.

[0038] The central server system 46 (which can be integrated with the monitoring system 45) can include a host computer, which can be an integrated server, or include peripheral servers or other hardware structures in any manner. The central processor system 46 can be a single networked computer, or a series of interconnected computers that are able to access a network via a gateway or other known networking system. Generally, the central server system 46 can include a central controller configured to manage, execute, and control individual terminal dispenser units, and to interact with network-enabled broadcast devices for retrieving / generating and playing the personalized messages described herein. The central server can include a memory for storing reward program processes and routines, a microprocessor (MP) for executing the stored programs, random access memory (RAM), and an input / output (I / O) bus. These devices can be multiplexed together via a common bus, or can be directly connected each via a dedicated communication line, depending on the needs of the system 10.

[0039] The central server system can be connected directly or indirectly through an I / O bus to any manner of peripheral devices, such as storage devices, wireless adapters, printers, etc. In addition, a database (DB) can be communicably connected to the central server and provide a data repository for the storage and correlation of information collected from various dispenser units, receivers, display devices, or nodes of such devices.

[0040] It should be appreciated that network-enabled devices (e.g., various dispenser units and / or display devices) can include similar features, or can be configured with functionality that allows for the exchange of information required to function as described herein. Network-enabled devices can include a number of internal components, such as a controller, microcontroller or microprocessor (MP) with program memory, random access memory (RAM), and an input / output (I / O) bus, all of which can be interconnected via address or data buses. The server system can include multiple, even redundant, program memory and random access memory to improve scalability, capacity, and / or processing speed.

[0041] Program memory and random access memory can be implemented as solid state memory, integrated circuits, magnetic readable memory, and / or optical readable memory. In addition, program memory can be read-only memory (ROM), or can be read / write memory such as a hard drive. In the case of using a hard drive as program memory, the data bus can include multiple address / data buses, which can be of different types, and there can be separate I / O circuitry between these data buses.

[0042] Network-enabled devices can be distributed in a single commercial establishment and connected with a LAN, or distributed in multiple sites and connected with a WAN. In addition, the LAN and / or WAN connecting each of these devices can include one or more separate and secure buses, routers, web servers, gateways, and other networking equipment to provide continuous and / or redundant connections to the network.

[0043] In the past, to communicate with a user 30 regarding the status of one of the product dispensers 22, 24, or 26, relatively complex connections and multiple hardware devices were used, including display screens, identification badges, and / or audio accessories. In one aspect, the product dispensers can also include digital screens for communicating with users, such as maintenance personnel. These past methods were not only complex, but can have resulted in power consumption, especially for product dispensers that operate on battery power.

[0044] According to the present disclosure, the mobile device 35 can include a system for shape / object recognition using static / scanning / dynamic image optical digital media processing. For example, in one aspect, the mobile device 35 can include an image recognition application 60 that is in secure and possibly encrypted connection with the server system 46 for receiving information about any particular product dispenser. For example, the mobile device 35 can include an image capture device 62 that is accessed by the image recognition application 60 for communicating an image of a product dispenser to the server system 46. The server system 46 in turn is configured to recognize the image and determine the particular product dispenser as the object in the image and communicate with the user 30 about one or more conditions of the product dispenser.

[0045] The image recognition application 60 included or loaded onto the mobile device 35 can be any suitable image recognition processor capable of analyzing optical images to identify two- or three-dimensional structures. Examples of shape or object recognition systems are disclosed, for example, in U.S. Patent Publication No. 2017 / 0249491, U.S. Patent Publication No. 2018 / 0075681, U.S. Patent No. 9,129,277, and U.S. Patent No. 10,095,030, all of which are incorporated by reference herein.

[0046] In Figure 1 particular implementations of the system and method of the present disclosure can include a mobile device 35 including an image recognition application 60 in communication with a cloud / server 46. The image recognition application 60 can be installed on the mobile device 35 alone, on the server system 46 alone, or can include software installed on both the mobile device 35 and the server system 46.

[0047] As described above, the mobile device 35 can include a personal computer, a mobile phone, a tablet, a video camera, smart glasses, or any other device capable of capturing digital images, such as videos and pictures, or controlling a peripheral device to capture videos and pictures. Figure 1 Only a single mobile device 35 is shown in communication with one cloud / server system 46. However, it should be understood that the present disclosure is not limited to Figure 1 particular implementations. For example, in other implementations, there can be any number of user devices in communication with a cloud and server system.

[0048] The mobile device 35 includes some type of method or component for receiving information and communicating the information to a user. The mobile device 35 can include, for example, a keyboard, mouse, game controller, touch screen input, thermal and / or electrical sensors, microphone, or any other component for accepting user input. The mobile device can include a display, which includes a liquid crystal display built into the device. In other embodiments, the mobile device can include a display that projects an image onto a surface, such as a lens on glasses or other visual surface.

[0049] In one embodiment, the mobile device 35 can include one or more processors and memory. The processors can be configured to access the memory to store received input or to execute commands, processes, or programs stored in the memory, such as the image recognition application 60. The processors can correspond to a processing device, such as a microprocessor or similar hardware processing device, or multiple hardware devices. The memory is capable of storing commands, processes, and programs for execution by the processors. The memory can be set up as ROM, RAM, flash memory, or any sufficient memory capable of storing a set of commands.

[0050] The server system 46 can also include one or more processors and memory that can be similar to those of the mobile device 35. The server system 46 can be configured to store received input as well as execute commands, processes, or programs stored in the memory, such as the recognition software application. Further, the memory is capable of storing commands, processes, and programs for execution by the processors. The memory is also configured to store images or other information received from the mobile device 35.

[0051] As described above, the mobile device 35 includes the image recognition application 60 and the image capture device 62. The image capture device 62 is used to capture optical data using, for example, any suitable optical sensor. The optical data can include still images, video, data streams, a series of still images, panoramas, or any other type of optical data that can be captured and communicated to the server 46. The image capture device 62 can be, for example, a camera, video camera, or any other suitable device for capturing optical data. In one aspect, the image capture device 62 is built into the mobile device 35. However, it should be understood that the image capture device 62 can be a component separate from the mobile device 35.

[0052] According to the present disclosure, the image capture device 62 is used to capture optical information corresponding to one of the product dispensers 22, 24, or 26 contained within the washroom facility 12. As described above, the optical data can be a picture or photograph, a video, or the like. The optical data captured by the image capture device 62 is communicated to or accessed by the image recognition application 60 and to the server 46. The server system 46 includes a memory containing reference data, particularly reference optical data. The server system 46, for example, can be configured to compare the optical data received from the image recognition application 60 to the reference data for determining the type of product dispenser for which the user 30 is requesting information. In one implementation, the server system 46 can use the reference data to not only determine the type of product dispenser, but also to identify the particular product dispenser and / or the location of the product dispenser within the washroom facility being monitored. Once the particular product dispenser is identified, for example, by software contained in the server system 46, the current condition of the product dispenser can be communicated back to the mobile device 35 and accessed by the user 30.

[0053] For example, in one aspect, the image capture device 62 is operated by the user or maintenance personnel to obtain optical data about one of the product dispensers. The optical data is then sent to the server system 46, which can be a cloud-based system. The server system 46 can then use recognition software to determine the particular product dispenser for which the user wishes to obtain information. In one aspect, the optical data is not processed or manipulated or altered in any way on the mobile device 35 and is transmitted to the server system 46 as raw data. Alternatively, the image recognition application 60 on the mobile device 35 can use filtering or recognition software prior to transmitting the optical data to the server system 46. In this implementation, the optical data can be altered or manipulated or can be transmitted to the server system 46 along with other information.

[0054] In one implementation, the optical data captured by the image capture device 62 and communicated to the server system 46 can be communicated to the server system along with other information. The other information, for example, can be the time at which the optical data was captured and any information about the location of the product dispenser. The optical data can also include the identity of the user or maintenance personnel 30. This information can be combined with the optical data by the image recognition application 60. This information can be used to determine the location of the product dispenser and to identify the maintenance personnel. A timestamp on the optical data can also be processed by the server system 46 such that information is communicated to the maintenance personnel 30 at a proximate time of a request for any information about the condition of the product dispenser.

[0055] In one embodiment, the optical data communicated by the image recognition application 60 to the server system 46 can include a picture or video of the shape of the product dispenser. For example, the optical data can include the shape of the outer housing of the product dispenser, or can include a portion of the shape of the outer housing of the product dispenser. The optical data can also include other indicia, including the background installation scene or any other information that can reveal the location of the product dispenser. In one aspect, a bar code or QR code on a particular product dispenser can be identified using the image capture device 62 for identifying the dispenser and its location. However, in alternative implementations, a QR code or bar code is not used in identifying a particular product dispenser, thereby eliminating the need to label each product dispenser in a plurality of facilities with a bar code and QR code. Instead, the image recognition software can include augmented reality tools that can identify a product dispenser by the shape of the product dispenser, by a portion of the shape of the product dispenser, or by other features of the dispenser.

[0056] The optical data created by the image capture device 62 is processed by the image recognition application 60. As described above, the image recognition application 60 can be contained solely on the mobile device, or can be partially on the mobile device 35 and partially on the server system 46. In one implementation, the optical data is fed to a comparison module to compare the optical data to reference data. The comparison module matches the optical data to the reference data to identify a particular product dispenser. For example, the product dispenser can be a toilet paper dispenser 22, a soap dispenser 24, or a towel dispenser 26. To identify and recognize a particular product dispenser, the dispenser type should be identified in conjunction with the location of the dispenser and, optionally, the model number or model year of the dispenser. It can be necessary to determine the location of a particular product dispenser when monitoring a large facility or a plurality of buildings that contain a plurality of identical product dispensers.

[0057] Any suitable method or technique can be used to determine the location of the product dispenser. For example, in one embodiment, the optical data transmitted to the comparison module can also include some indicia regarding the location of the product dispenser. Alternatively, the mobile device 35 can be in communication with a global positioning system (GPS). In this implementation, the optical data can be sent to the image recognition application containing the comparison module in conjunction with the location coordinates determined by the GPS.

[0058] On the other hand, the location of the product dispenser can be determined by monitoring the location of maintenance personnel 30. For example, maintenance personnel 30 may carry an electronic ID badge that can be integrated into a mobile device 35. A receiver may be installed in each restroom facility that senses the ID badge and sends that information to a server system 46 to determine the location of maintenance personnel 30. The location of the product dispenser can then be determined based on the location of maintenance personnel 30. However, in an alternative embodiment, the system and method of this disclosure can operate without monitoring the location of maintenance personnel or requiring maintenance personnel to wear or carry any type of electronic identification badge.

[0059] Once a specific product dispenser has been identified by the image recognition application 60, information stored in the memory on the server system 46 can be communicated to the user or maintenance personnel 30 via the mobile device 35. The information can be communicated to the user or maintenance personnel 30 visually, audio-visually, or both. In one implementation, for example, the condition of the product dispenser and any other information can be communicated to the maintenance personnel 30 as written communication appearing on the display screen of the mobile device 35. Information can be communicated to the maintenance personnel 30 within the image recognition application 60 for information security purposes. As described above, the information communicated to the maintenance personnel 30 may include any of the following: the amount of product contained in the product dispenser, the power level of the product dispenser, and / or any operating conditions that should be communicated to the maintenance personnel 30. In one aspect, the message or information communicated to the maintenance personnel 30 may be that the product dispenser contains product and is fully operable and requires no maintenance. In another aspect, the message or information communicated to the maintenance personnel 30 may indicate the current status, product balance, or condition of the product dispenser.

[0060] refer to Figure 2 This disclosure illustrates one embodiment or specific implementation of a method for providing users with information about the status of a product dispenser. For example... Figure 2 As illustrated, the flowchart includes the step of first capturing optical data 210 associated with the product dispenser. In one aspect, for example, a user can access a camera on a mobile device 35 and take pictures or videos of the product dispensers 22, 24, or 26 for which information is needed. This optical data can then be fed to an image recognition application 220. The image recognition application 220 may operate on the mobile device 35 in conjunction with a server system 46. In one embodiment, the image recognition application 60 includes a comparison module that compares the optical data with reference data 240, such as... Figure 2The reference data can be located, for example, in a memory or library 52 of the server system 46. From the optical data, the image recognition application can identify the product dispenser and optionally determine the location 250 of the product dispenser. In one embodiment, the optical data provides sufficient information to identify the particular product dispenser and its location. Alternatively, the optical data is provided to identify the particular type of product dispenser, and other information is used to determine the location. For example, the mobile device 35 can be in communication with a global positioning system for determining the location of the product dispenser. In this way, the method can identify the particular type of product dispenser as well as the exact location of the product dispenser within the facility being monitored by the system.

[0061] Once the particular product dispenser is identified, as shown at 260, information related to the condition of the product dispenser is sent to the user or maintenance personnel 30. This information can include, for example, the level of product remaining in the product dispenser, and can optionally include instructions as to when more product should be added to the product dispenser. Figure 2

[0062] Figure 3 is a schematic diagram of certain control aspects of a system 10 in accordance with the present application. In this particular system 10, the server system 46 comprises a computer-implemented server 47 in any manner. The system 46 includes a library 52 in which are stored washroom facility files 54. Each file 54 is associated with a particular washroom facility. As described above, each file 54 can include reference data for identifying a particular product dispenser.

[0063] As shown at 62, the mobile device 35 is configured to communicate with the server system 46, typically over a wireless network. The mobile device can include an image capture device 62 for sending optical data to the server system 46. The overall system 10 can also include an image recognition application for identifying a particular product dispenser once optical data related to the dispenser is received. Once the product dispenser is identified, the server system 46 can communicate to the mobile device 35 information 32 that can be related to the condition of the product dispenser, such as the current product inventory within the dispenser. Figure 3

[0064] In one aspect, the server system 46 can also be configured to receive information 58 about the maintenance personnel. The information 58 can be related to the identity of the particular maintenance personnel, their shift times, etc. As described above, in one embodiment, the maintenance personnel 30 can carry an ID badge that communicates a signal to the server system 46 indicative of the location of the maintenance personnel.

[0065] ​​These and other modifications and variations to the inventive concepts herein disclosed can be practiced in various locations within the scope of the claims and may be practiced in alternative embodiments, as will be apparent to those skilled in the art. No limitation is intended to the details of construction or design herein shown, other than as described in the claims and any equivalents thereto. Further, it is intended that each aspect disclosed in this document is by itself, fully applicable for use individually or in any combination. Additionally, any aspect disclosed in this document may be specifically combined with any and every other aspect or aspects. Furthermore, it is intended that all aspects disclosed herein can be combined in any manner, including with every other aspect or aspects.

Claims

1. A method of accessing information about the status of a consumable product dispenser in a washroom facility, the method comprising: detecting the status of a plurality of product dispensers in a plurality of washroom facilities, each product dispenser configured to dispense a consumable product that requires periodic replenishment, the status comprising at least one of: product level, power level, operational status, or a combination thereof; storing one or more washroom facility files on a server system, the one or more washroom facility files comprising information about the status of the product dispensers; and placing a mobile device in proximity to one of the product dispensers and accessing an image recognition application configured to identify a particular product dispenser from the plurality of dispensers and access and communicate the stored status of the product dispenser to a user.

2. The method of claim 1, wherein the image recognition application identifies the product dispenser by the shape of the product dispenser.

3. The method of claim 1, wherein the image recognition application is configured to identify the particular product dispenser by determining the location of the product dispenser.

4. The method of claim 1, wherein the image recognition application is configured to identify the particular product dispenser by determining the location of the product dispenser and the type of the product dispenser.

5. The method of claim 3 or 4, wherein the location of the product dispenser is determined by a global positioning system in communication with the mobile device.

6. The method of claim 3 or 4, wherein the location of the product dispenser is determined by identifying a marker within the washroom in which the product dispenser is located.

7. The method of claim 1, wherein the product dispenser comprises an external housing, and wherein the image recognition application identifies the particular product dispenser by the shape of the external housing.

8. The method of any of the preceding claims, wherein the image recognition application accesses a camera on the mobile device and identifies the particular product dispenser from optical data related to the product dispenser.

9. The method of any of the preceding claims, wherein the stored status communicated to the user comprises an expected replenishment requirement for the particular product dispenser.

10. The method of claim 1, wherein the stored status communicated to the user comprises product dispenser replenishment instructions based on expected usage of the washroom.

11. The method of claim 1, wherein the stored status communicated to the user comprises product dispenser instructions indicating the product level remaining in the product dispenser.

12. The method of claim 1, wherein the stored status of the product dispenser is communicated to the user via the mobile device, the mobile device displaying the stored status based on data from a server accessed by the mobile device.

13. The method of any of the preceding claims, wherein the image recognition application communicates with the server system for receiving the stored condition of the product dispenser.

14. The method of claim 11, wherein the server system comprises a cloud-based system.

15. The method of claim 12, wherein the stored condition communicated to the user is stored on the cloud-based system.

16. The method of any of the preceding claims, wherein the image recognition application identifies the particular product dispenser without using a barcode or QR code.

17. A system for accessing information about a condition of a consumable product dispenser in a washroom facility, the system comprising: a plurality of product dispensers located within a plurality of washroom facilities, wherein each washroom facility includes at least one product dispenser, each product dispenser requiring periodic replenishment of a consumable product; at least one sensor configured within each of the product dispensers, the at least one sensor detecting a condition of the product dispenser, the condition comprising at least one of: a product level, a power level, an operational condition, or a combination thereof; a server system configured to receive information about the condition of each product dispenser and configured to store the information; and an image recognition application loaded onto a mobile device, the image recognition application configured to identify a particular product dispenser from the plurality of product dispensers based on receiving optical data related to the particular product dispenser from the mobile device, the image recognition application communicating with the server system and configured to communicate a stored condition of the particular product dispenser to a user.

18. The system of claim 15, wherein the image recognition application is configured to identify a product dispenser based on a shape of the product dispenser.

19. The system of claim 15, wherein the image recognition application is configured to identify a type of the particular product dispenser and a location of the product dispenser.

20. The system of claim 17, wherein the image recognition application is configured to determine the location of the particular product dispenser by accessing a global positioning system in communication with the mobile device.

21. The system of claim 17, wherein the image recognition application is configured to determine the location of the product dispenser by identifying a sign within a washroom in which the product dispenser is located or by determining a location of the user.

22. The system of claim 15, wherein the product dispenser comprises an external housing, and wherein the image recognition application is configured to identify a product dispenser by the shape of the external housing.

Citation Information

Patent Citations

  • Shape recognition device, shape recognition program, and shape recognition method

    US10095030B2

  • Methods and arrangements for identifying objects

    US20170249491A1

  • Doorbell package detection systems and methods

    US20180075681A1

  • System and Method for Instructing Personnel on Washroom Maintenance Requirements

    US20210279654A1

  • Methods and arrangements for identifying objects

    US9129277B2