Intelligent door lock cleaning service system and method based on multi-modal sensing and dynamic scheduling

Abstract

The invention provides an intelligent door lock cleaning service system and method based on multi-mode perception and dynamic scheduling, and belongs to the technical field of intelligent identity recognition. According to the system, a multi-mode interaction and infrared sensing unit is integrated through an intelligent door lock, and a cleaning instruction of a user is received and verified. And the housekeeper service system generates cleaning tasks by adopting a dynamic priority scheduling algorithm fused with user behavior prediction, and performs optimal allocation in combination with the real-time state of the intelligent door lock. A temporary authorization mechanism based on a one-time dynamic password or a two-dimensional code is provided for cleaning personnel, the mechanism is bound with the door lock state, and the safety is high. And the system monitors the task execution track and state in real time, and feeds back the progress to the user side through the encryption link. According to the invention, the problems that the traditional cleaning service is low in efficiency, opaque and disjointed with an access control system are solved, the intelligent and credible closed-loop management of the whole process from demand triggering to completion is realized, and the user experience and the service management efficiency are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of identity recognition technology, and particularly relates to an intelligent door lock cleaning service system and method based on multi-modal perception and dynamic scheduling. BACKGROUND

[0002] In the field of smart home and accommodation services today, cleaning services, as an important part of daily operations, directly affect user experience in terms of efficiency and quality. Traditional cleaning service modes mostly rely on manual reservations, telephone communication or fixed time arrangements, and have many drawbacks.

[0003] In the prior art, some solutions attempt to combine door locks with service systems to optimize processes, such as the patent with publication number CN113592992A, which mentions triggering services through door locks. However, the task scheduling mechanism of this solution is too simple, as it only assigns tasks based on time sequence, and cannot handle real-time changing service demand scenarios. In actual operations, different users have different levels of demand urgency, membership levels, and historical service situations, and this single scheduling method can easily cause uneven resource allocation, resulting in a failure to respond to high-priority user needs in a timely manner and reducing service satisfaction.

[0004] In terms of authorized security, existing technologies mostly use static passwords or remote door opening to provide access for cleaning personnel. Static passwords are prone to leakage and difficult to manage, and once the password is obtained by unauthorized personnel, it may cause security risks; remote door opening relies on stable network connections, and if the network is interrupted or delayed, it will affect the efficiency of opening the door, and also cannot effectively limit the opening time and number of times, posing a risk of abuse of authority.

[0005] In addition, in terms of data evidence in the service process, the prior art has obvious shortcomings. For example, the system described in the published document CN114612754A lacks a reliable means of storing evidence of key operation process data, and when a service dispute occurs, it is difficult to identify responsibility and is not conducive to tracing and improving service quality due to the inability to provide tamper-proof operation records.

[0006] At the same time, the linkage between traditional cleaning services and access control systems is poor, and real-time information such as the state of the room and the state of the door lock cannot be obtained, resulting in blindness in task generation and execution. For example, when a user initiates a cleaning instruction, if there is someone in the room who has not been detected, the cleaning personnel may cause the user to be disturbed when they arrive; or when the door lock is in an abnormal state, the task is still assigned, resulting in a failure to properly carry out cleaning work and reducing service efficiency.

[0007] Therefore, an intelligent door lock cleaning service system and method capable of realizing multi-modal instruction receiving, dynamic task scheduling, safe temporary authorization and trusted data notarization are urgently needed to solve the problems of low efficiency, opacity, poor security and disconnection with the access control system in the prior art. SUMMARY

[0008] The present application aims to solve the problems of low efficiency, opacity, poor security and disconnection with the access control system in the prior art, and provides an intelligent door lock cleaning service system and method based on multi-modal perception and dynamic scheduling.

[0009] The present application provides an intelligent door lock cleaning service method based on multi-modal perception and dynamic scheduling, comprising the following steps: Multi-modal instruction receiving and verification: The cleaning instruction issued by the user is received through the physical button, voice interaction module or associated mobile application APP of the intelligent door lock; The intelligent door lock is integrated with an infrared sensor for assisting in determining whether there is anyone in the room; Before the instruction transmission, the user identity is verified through the identity verification module of the door lock or the safe interaction with the housekeeping service system; Safe instruction transmission and task generation: After verification, the intelligent door lock transmits the encrypted cleaning instruction to the housekeeping service system through the communication module; The cleaning instruction at least contains the desensitized user identification, room identification and instruction timestamp; The housekeeping service system analyzes the instruction and generates a cleaning application task containing a dynamic priority in combination with the real-time sensing data of the infrared sensor; Dynamic task scheduling and distribution: The housekeeping service system runs a task scheduling engine and uses a dynamic priority scheduling algorithm to distribute the cleaning task; The algorithm at least generates a scheduling queue by comprehensively considering the user's historical service frequency, current membership level, instruction receiving time, room type and real-time door lock state; The task information is assigned to the mobile terminal of the optimal cleaning personnel; Safe temporary authorization and task execution: After the cleaning personnel accept the task, the housekeeping service system generates a one-time temporary authorization credential with time effectiveness bound to the task ID and the real-time state of the door lock and sends it to the mobile terminal of the cleaning personnel; The cleaning personnel obtains the door opening permission by verifying the credential; During the task execution process, the cleaning personnel feeds back the state through the mobile terminal, and the system collects the location and progress information in real time; Trusted progress monitoring and feedback: The housekeeping service system pushes the task execution state to the display screen of the intelligent door lock and the mobile application APP of the user in real time through an encrypted link; At the same time, the system generates a hash value for the key operation log of the task, including authorization, door opening, start cleaning and completion, and stores it to the blockchain notarization module to ensure that the process data cannot be tampered with; Task closed loop and authorization invalidation: After the task is marked as completed, the temporary authorization credential is invalidated immediately, and the system generates a service report and stores it.

[0010] Preferably, the priority weight of the dynamic priority scheduling algorithm is dynamically calculated by the following formula: Priority score = (Member level coefficient * A) + (Urgency coefficient * B) + (1 / (Current time - Instruction receiving timestamp) * C) - (Historical service frequency coefficient * D); Wherein A, B, C, D are configurable weight coefficients, and the urgency coefficient is determined by the sentiment analysis of the user voice instruction or the emergency option selected on the APP side.

[0011] Preferably, the one-time temporary authorization credential is a time-synchronized one-time dynamic password or an encrypted and signed two-dimensional code dynamically generated by the housekeeping service system. The verification of the credential is not only based on its own validity, but also needs to verify whether the current door lock is in the locked state and the task state is assigned. Only when all the above conditions are met, the door lock will execute the unlocking.

[0012] Preferably, the blockchain storage module adopts a lightweight consortium chain architecture, and the housekeeping service system acts as a bookkeeping node, periodically chains the Merkle tree root hash value of the operation log for storage.

[0013] Preferably, the infrared sensor data of the intelligent door lock is used to assist decision-making. If a person is detected in the room at the time of instruction receiving, the system sends a confirmation prompt to the user through the APP, and the task can be generated only after the user confirms again.

[0014] The application also provides an intelligent door lock cleaning service system based on multi-modal perception and dynamic scheduling, comprising: Intelligent door lock terminal: including a main control chip, a multi-modal interaction module, an identity verification module, a state perception module, an encrypted communication module, and a display unit; User mobile terminal: installed with an application APP for communication with the service system, used for initiating instructions, identity verification, and receiving progress feedback; Housekeeping service system: comprising: Secure communication gateway: responsible for establishing an encrypted link with all terminals; Task scheduling engine: built-in dynamic priority scheduling algorithm; Device state management module: real-time monitoring and management of the running state of all intelligent door locks; Temporary authorization center: generating and verifying TOTP dynamic password based on RFC6238 standard; Blockchain storage agent: used for formatting logs and submitting hash values to the blockchain network; Data storage unit: used for storing user, task, and device data, wherein sensitive information is encrypted and desensitized; The cleaning service personnel mobile terminal is provided with a cleaning service APP, and is used for receiving tasks, navigation, requesting and using temporary authorization, feeding back multiple task states, and uploading positioning information.

[0015] Preferably, the identity authentication module supports multiple biometric recognition algorithms, and all biometric templates are encrypted and stored in a local secure chip of the smart door lock or a trusted execution environment of a server side.

[0016] Preferably, the system further comprises an open API interface connected with a third-party hotel management system or property management system, which is used for synchronizing room status and user check-in information, and realizing data linkage between systems.

[0017] Preferably, the encryption communication module supports national encryption algorithm for data encryption and identity authentication, so as to meet the safety compliance requirements of specific industries.

[0018] Preferably, the APP of the cleaning service personnel mobile terminal is integrated with an indoor map navigation function, which can guide the cleaning personnel to the target room and record the motion trajectory for service quality analysis.

[0019] Compared with the prior art, the present application has the following beneficial effects: The multi-modal interaction mode is adopted to receive user instructions, and the convenience of instruction initiation is improved; The dynamic priority scheduling algorithm is used to realize intelligent allocation of tasks and improve service response efficiency; The one-time temporary authorization mechanism is designed in combination with the task and the door lock state, and the authorization security is enhanced; The block chain storage technology is introduced to ensure the credibility and traceability of service process data; The room state is obtained through an infrared sensor and other sensing modules to realize accurate generation and execution of tasks; The present application realizes intelligent and credible closed-loop management of the whole process from demand triggering to task completion, and improves user experience and service management efficiency. BRIEF DESCRIPTION OF DRAWINGS

[0020] Fig. 1 The method of the embodiment of the present application shows the whole process from user-initiated cleaning instruction to task completion The flowchart of the method of the embodiment of the present application shows the whole process from user-initiated cleaning instruction to task completion Fig. 2 The architecture diagram of the whole composition of the system of the embodiment of the present application and the connection relationship between modules Fig. 3 The calculation model diagram of the dynamic priority scheduling algorithm of the method of the embodiment of the present application Fig. 4 The sequence diagram of temporary authorization and verification of the method of the embodiment of the present application DETAILED DESCRIPTION

[0021] In order to make the objects, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to specific embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and not intended to limit the present application.

[0022] Reference Figs. 1 to 4 The embodiment provides an intelligent door lock cleaning service system and method based on multi-modal perception and dynamic scheduling in a high-end hotel scene application.

[0023] In a high-end hotel scene, a gold card member user issues an urgent cleaning request to quickly clean the room during the stay period through the voice interaction module of the intelligent door lock in the room.

[0024] The voice interaction module of the intelligent door lock receives the voice instruction, transmits the voice data to the butler service system, the system performs emotion analysis on the voice instruction, detects the urgent emotion in the user's tone, determines the emergency coefficient as 0.8 (full score is 1.0). At the same time, the identity verification module of the intelligent door lock confirms the user's identity as a gold card member through face recognition, and the member level coefficient is 0.7. The infrared sensor detects that there is no one in the room, and there is no need for secondary confirmation.

[0025] The intelligent door lock transmits the encrypted cleaning instruction, including the desensitized user identifier, room identifier and instruction timestamp 10:00, to the butler service system through the encryption communication module supporting Wi-Fi6. The security communication gateway of the butler service system adopts TLS1.3 protocol to establish an encrypted link to ensure the safety of the instruction transmission.

[0026] After the butler service system parses the instruction, the task scheduling engine is run, and the dynamic priority scheduling algorithm is used to calculate the priority score. At this time, the current time is 10:00, A=0.3, B=0.3, C=0.2, D=0.2, and the historical service frequency coefficient is 0.2.

[0027] Priority score=(0.7*0.3)+(0.8*0.3)+(1 / (10:00-10:00)*0.2)-(0.2*0.2), Since the time difference is 0, 1 / (current time-instruction receiving timestamp) takes the preset maximum value 5, so the priority score=0.21+0.24+1.0-0.04=1.41.

[0028] The score is the highest in the current task queue, and the system inserts the task into the queue.

[0029] The device state management module of the housekeeping service system monitors in real time that the door lock state of the room is locked and the task state is set as assigned. The system assigns the task to the mobile terminal of the cleaner A who is closest and has no high priority task at present according to the current position, load condition and other information of the cleaner.

[0030] After the cleaner A accepts the task through the cleaning service APP, the temporary authorization center of the housekeeping service system generates a TOTP dynamic password bound to the task ID and the door lock state based on the RFC6238 standard, the password is valid for 15 minutes, and is sent to the mobile terminal of the cleaner A.

[0031] After the cleaner A arrives at the target room, the TOTP dynamic password is input on the input interface of the intelligent door lock. The door lock verifies the password validity, confirms that the door lock is in the locked state and the task state is assigned, and executes unlocking after verification.

[0032] During the cleaning process, the housekeeping service system pushes the task execution state to the display screen of the intelligent door lock and the mobile application APP of the user in real time through an encrypted link. When the cleaner A finishes cleaning and clicks complete, the system generates a hash value of the key operation log such as authorization, door opening, start cleaning and completion, submits it to the lightweight alliance chain through the block chain notarization agent, and the housekeeping service system as the accounting node periodically uploads the Merkle tree root hash value to the chain for notarization.

[0033] After the task is marked as completed, the temporary authorization voucher is invalidated immediately, the system generates a service report containing cleaning time, cleaner information and user reviewable area and stores it in the data storage unit, and the sensitive information is processed by encryption and desensitization.

[0034] The embodiment also provides an intelligent door lock cleaning service system and method based on multi-modal perception and dynamic scheduling for long-term apartment scene application In a certain long-term apartment scene, the user initiates a cleaning instruction through the associated mobile application APP. The infrared sensor of the intelligent door lock detects that there is someone in the room, and the housekeeping service system sends a confirmation prompt to the user through the APP: whether to confirm the initiation of the cleaning request? The user clicks to confirm and selects the normal emergency level option, and the emergency level coefficient is 0.3.

[0035] The intelligent door lock verifies the user's identity through fingerprint recognition, transmits the encrypted cleaning instruction containing the desensitized user identifier, room identifier and instruction timestamp 9:30 to the housekeeping service system through the Bluetooth 5.2 communication module. The security communication gateway of the system uses the national encryption algorithm SM2 / SM4 for data encryption and identity authentication.

[0036] The housekeeping service system is connected with the apartment management system through an open API interface, and is synchronized to a "today's check-out" list, which contains the room where the user is located. The task scheduling engine calculates the priority score, the user membership level coefficient is 0.5, A=0.2, B=0.2, C=0.3, D=0.3, the current time is 9:30, and the historical service frequency coefficient is 0.4.

[0037] The priority score=(0.5*0.2)+(0.3*0.2)+(1 / (9:30-9:30)*0.3)-(0.4*0.3), The time difference is 0, and the value is 5, so the priority score=0.1+0.06+1.5-0.12=1.54, combined with the today's check-out information, the task is prioritized.

[0038] The housekeeping service system assigns the task to the mobile terminal of the cleaning staff B, and the APP of B integrates an indoor map navigation function, and the system generates an optimal path according to the apartment floor plan to guide B to the target room. After B accepts the task, the system generates an encrypted signed two-dimensional code as a temporary authorization credential and sends it to the APP of B.

[0039] When B arrives at the door of the room, opens the APP and shows the two-dimensional code, the camera of the smart door lock scans the two-dimensional code for verification, and at the same time confirms that the door lock is in a locked state and the task state is assigned, and after verification, the door lock is unlocked.

[0040] B clicks start cleaning, and the APP starts recording the motion trajectory.

[0041] During the cleaning process, the user can view the progress in real time through the APP. After cleaning, B uploads the cleaned room picture to the APP and clicks finish. The system generates a hash value of the key operation log and stores it in the blockchain evidence module.

[0042] After the task is completed, the temporary authorization credential is invalid, the system generates a service report containing the motion trajectory analysis data of B, which is convenient for the apartment management party to evaluate the service quality. At the same time, the system synchronizes the room cleaning completion information to the apartment management system through an open API, and updates the room status to cleaned.

[0043] The intelligent door lock cleaning service system and method based on multi-modal perception and dynamic scheduling of the application realize intelligent management of the whole process of cleaning service from demand triggering to task completion by constructing a collaborative architecture of the intelligent door lock and the housekeeping service system, effectively solve the drawbacks of the traditional cleaning service mode, improve the intelligent level of accommodation service and user experience, and have strong practicality and popularization value.

[0044] It should be noted that the above-mentioned embodiments are only preferred embodiments of the present application, but are not intended to limit the present application, and any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

[0045] It should be noted that the relational terms herein such as first and second and the like are used solely to distinguish one entity or action from another, without necessarily requiring or implying any such actual relationship or order between such entities or actions. Moreover, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus.

[0046] Although the embodiments of the present application have been shown and described, it will be understood by those of ordinary skill in the art that various changes, modifications, alternatives, and variations can be made thereto without departing from the principles and spirit of the present application, and the scope of the present application is defined by the appended claims and their equivalents.

Claims

1. An intelligent door lock cleaning service method based on multi-modal perception and dynamic scheduling, characterized in that, The method comprises the following steps: Multi-modal instruction receiving and verification: receiving the cleaning instruction issued by the user through the physical button of the smart door lock, the voice interaction module or the associated mobile application APP; the smart door lock is integrated with an infrared sensor for assisting in determining whether there is a person in the room; Before the instruction transmission, the identity of the user is verified through the identity verification module of the door lock or the safe interaction with the housekeeping service system; Safe instruction transmission and task generation: after the verification, the smart door lock transmits the encrypted cleaning instruction to the housekeeping service system through the communication module; the cleaning instruction at least contains the desensitized user identification, room identification and instruction timestamp; the housekeeping service system analyzes the instruction and generates a cleaning application task containing a dynamic priority in combination with the real-time sensing data of the infrared sensor; Dynamic task scheduling and distribution: the housekeeping service system runs a task scheduling engine and adopts a dynamic priority scheduling algorithm to distribute the cleaning task; the algorithm at least generates a scheduling queue by comprehensively considering the historical service frequency of the user, the current membership level, the instruction receiving time, the room type and the real-time door lock state; the task information is assigned to the mobile terminal of the optimal cleaning personnel; Safe temporary authorization and task execution: after the cleaning personnel accept the task, the housekeeping service system generates a one-time temporary authorization credential with time effectiveness which is bound with the task ID and the real-time state of the door lock and sends it to the mobile terminal of the cleaning personnel; the cleaning personnel obtains the door opening permission by verifying the credential; during the task execution process, the cleaning personnel feeds back the state through the mobile terminal, and the system collects the location and progress information in real time; Trusted progress monitoring and feedback: the housekeeping service system pushes the task execution state to the display screen of the smart door lock and the mobile application APP of the user in real time through an encrypted link; at the same time, the system generates a hash value for the key operation log of the task, including authorization, door opening, starting cleaning and completion, and stores it to the block chain evidence storage module, so as to ensure that the process data cannot be tampered with; Task closed loop and authorization invalidation: after the task is marked as completed, the temporary authorization credential is invalidated immediately, and the system generates a service report and stores it.

2. The method of claim 1, wherein, The priority weight of the dynamic priority scheduling algorithm is dynamically calculated by the following formula: Priority score=(membership level coefficient*A)+(urgency coefficient*B)+(1 / (current time-instruction receiving timestamp)*C)-(historical service frequency coefficient*D); Wherein A, B, C and D are configurable weight coefficients, and the urgency coefficient is determined by the sentiment analysis of the user's voice instruction or the emergency option selected on the APP.

3. The method of claim 1, wherein, The one-time temporary authorization credential is a one-time dynamic password based on time synchronization or an encrypted signed two-dimensional code dynamically generated by the housekeeping service system; the verification of the credential is not only based on its own validity, but also needs to verify whether the current door lock is in the locked state and the task state is assigned, and the door lock will execute the unlocking after all the conditions are met.

4. The method of claim 1, wherein, The block chain evidence storage module adopts a lightweight consortium chain architecture, and the housekeeping service system acts as a bookkeeping node to periodically chain the Merkle tree root hash value of the operation log for evidence storage.

5. The method of claim 1, wherein, The infrared sensor data of the smart door lock is used for assisting decision-making. If a person is detected in the room when the instruction is received, the system sends a confirmation prompt to the user through the APP, and the task can be generated only after the user confirms it again.

6. A multi-modal perception and dynamic scheduling based intelligent door lock cleaning service system implementing the method of any one of claims 1-5. Comprise: The smart door lock terminal includes a main control chip, a multi-modal interaction module, an identity verification module, a state sensing module, an encrypted communication module, and a display unit. The user mobile terminal is installed with an application APP that communicates with the service system, which is used to initiate instructions, identity verification, and receive progress feedback. The housekeeping service system comprises: The secure communication gateway is responsible for establishing encrypted links with all terminals. The task scheduling engine has the dynamic priority scheduling algorithm built-in. The device state management module monitors and manages the running state of all smart door locks in real time. The temporary authorization center generates and verifies TOTP dynamic passwords based on the RFC6238 standard. The blockchain storage agent is used to format logs and submit hash values to the blockchain network. The data storage unit is used to store user, task, and device data, and sensitive information is encrypted and desensitized. The cleaning service personnel mobile terminal is installed with a cleaning service APP, which is used to receive tasks, navigate, request temporary authorization, and feedback multiple task states, and upload positioning information.

7. The system of claim 6, wherein, The identity verification module supports multiple biometric recognition algorithms, and all biometric templates are encrypted and stored in the local secure chip of the smart door lock or the trusted execution environment of the server.

8. The system of claim 6, wherein, The system also includes an open API interface that interfaces with third-party hotel management systems or property management systems, which is used to synchronize room status and user check-in information, and realize data linkage between systems.

9. The system of claim 6, wherein, The encrypted communication module supports national encryption algorithms for data encryption and identity authentication to meet the security compliance requirements of specific industries.

10. The system of claim 6, wherein, The APP of the cleaning service personnel mobile terminal integrates indoor map navigation function, which can guide the cleaning personnel to the target room and record their movement trajectory for service quality analysis.

Images