Intelligent home door-to-door service supervision method and system

Abstract

The invention discloses an intelligent home door-to-door service supervision method and system, and belongs to the field of intelligent service supervision, and the method comprises the steps of code scanning sign-in, NFC verification, positioning verification, image evidence collection, data aggregation verification and task filing feedback. The technical problems of diversified service authenticity verification means, high supervision credibility and strong data tampering prevention capability and cheating prevention and control capability are solved, service supervision on service personnel is realized, the credibility and traceability are improved, and cheating means such as remote control card punching, screenshot uploading and off-site false sign-in are effectively prevented; the continuity and rationality of the service chain are ensured; the user participation degree is effectively improved, and the fairness and traceability of the service process are enhanced; the system has good software and hardware compatibility, adapts to mainstream smart phones and existing smart home equipment, and is suitable for large-scale landing application.

Description

Technical Field

[0001] The present invention belongs to the field of intelligent service supervision, and particularly relates to an intelligent home visit service supervision method and system thereof. Background Art

[0002] With the increasing demand for home services such as home care for the elderly, maternal and child care, home repair, and housekeeping cleaning, the supervision of the service process and the authenticity of service quality have become pain points in the industry. On the one hand, traditional signing methods mostly rely on manual punching, single positioning, or photo uploading, which have problems such as data fraud, positioning drift, and unverifiable service processes. On the other hand, service platform managers lack efficient means to supervise the behavior during the service process in real time and conduct post-event audits, making it difficult to prove service disputes and control service quality.

[0003] In the prior art, the common signing verification method is QR code signing, but QR code signing is extremely easy to copy, prone to forging data or false signing, and the traditional QR code signing cannot fully restore the real scene and spatio-temporal background of the service process. Especially in the context of home service scenarios, the on-site environment is complex and changeable, and there is a lack of traceable service records between service personnel and customers, which has become an obstacle to the construction of the trust system. Summary of the Invention

[0004] The purpose of the present invention is to provide an intelligent home visit service supervision method and system thereof, which solve the technical problems of diverse service authenticity verification means, high supervision credibility, strong data tampering prevention ability, and cheating prevention ability.

[0005] To achieve the above purpose, the present invention adopts the following technical solutions:

[0006] An intelligent home visit service supervision method includes the following steps:

[0007] Step 1: The first mobile terminal periodically obtains the positioning data of the service personnel; the service personnel use the first mobile terminal to scan the on-site QR code at the service site, after verifying the signature of the on-site QR code, construct a scanned code data packet and upload it to the central server for caching;

[0008] Step 2: The service personnel use the first mobile terminal to scan the on-site NFC tag at the service site, the first mobile terminal reads the encrypted data block in the NFC tag, after decrypting, construct an NFC scan data packet and upload it to the central server for verification;

[0009] Step 3: The first mobile terminal filters out the positioning data whose time difference from the time of scanning the on-site QR code is less than a preset time threshold according to the time stamp of the scanned code data packet, constructs a positioning data packet and uploads it to the central server for distance calculation;

[0010] Step 4: After the person being served takes an image evidence of "the service staff is present" through the second mobile device or the home camera, construct a photo data packet and upload it to the central server;

[0011] After the second mobile device generates a photo forensics record, it periodically sends a shooting task to the home camera. The home camera takes a live video at regular intervals and fixed length according to the shooting task, and uploads it to the second mobile device. The second mobile device generates and stores video segments locally;

[0012] The second mobile device constructs a video data packet for each video segment and uploads it to the central server;

[0013] Step 5: The central server aggregates the data of the scan code data packet, NFC scan data packet, positioning data packet, photo data packet and video data packet, splices them into a check-in task data packet, and performs multi-dimensional consistency verification on the check-in task data packet: if the verification passes, mark the check-in task as successful; if the verification fails, mark the check-in task as abnormal and generate an exception message;

[0014] Step 6: Enter the check-in task into the task database, and output the feedback information of the check-in task to the management server and the first mobile terminal.

[0015] Preferably, the on-site QR code is pasted on the served family. When performing Step 1, it specifically includes the following steps:

[0016] Step 1-1: The service staff logs in through their own account on the first mobile terminal and opens the check-in interface provided by the first mobile terminal;

[0017] Step 1-2: The first mobile terminal automatically obtains GPS positioning monitoring at regular intervals, obtains positioning data at regular intervals and caches it;

[0018] Step 1-3: The first mobile terminal prompts the service staff to scan the on-site QR code, and the service staff uses the camera to scan the on-site QR code;

[0019] Step 1-4: The content of the on-site QR code includes the family unique identifier, the QR code generation timestamp, and the digest signed by the service platform with the private key;

[0020] Step 1-5: The first mobile terminal verifies the signature with the local public key: if it passes, construct a scan code data packet;

[0021] The scan code data packet contains the service staff ID and the family ID;

[0022] Step 1-6: The first mobile terminal uploads the scan code data packet to the central server through the TLS channel, and the central server temporarily stores the scan code data packet;

[0023] Preferably, the NFC tag is installed in the served household; when performing step 2, it specifically includes the following steps:

[0024] Step 2-1: After the first mobile terminal scans the on-site QR code, it prompts the service staff to scan the NFC tag again, and the service staff uses the first mobile terminal to scan the NFC tag;

[0025] Step 2-2: The first mobile terminal reads the preset encrypted data block in the NFC tag, and the content of the encrypted data block includes household ID, tag serial number, geographical coordinate hash, write timestamp, random anti-replay number, and check field;

[0026] Step 2-3: The first mobile terminal decrypts the encrypted data block through the AES-GCM algorithm and constructs an NFC scan data packet;

[0027] The NFC scan data packet contains the service staff ID and the household ID;

[0028] Step 2-4: The first mobile terminal uploads the NFC scan data packet to the central server, and the central server checks the geographical coordinate hash and the random anti-replay number again to ensure that the NFC tag is not forged.

[0029] Preferably, when performing step 3, it specifically includes the following steps:

[0030] Step 3-1: After completing steps 1-6, the first mobile terminal obtains the scanning time based on the timestamp of the scan data packet. Taking the scanning time as a reference, it retrieves all positioning data within the preset time threshold, selects the positioning data closest to the scanning time, and constructs a positioning data packet. The positioning data packet contains the service staff ID and the household ID;

[0031] Step 3-2: The first mobile terminal sends the positioning data packet to the central server, and the central server calculates the spherical distance between the positioning data in the positioning data packet and the geographical coordinate hash in the NFC scan data packet and keeps the calculation result.

[0032] Preferably, when performing step 4, it specifically includes the following steps:

[0033] Step 4-1: The members of the served household, that is, the served persons, obtain image evidence through the following two methods:

[0034] Method 1: Take a photo of the service staff through the second mobile terminal, and the second mobile terminal stores the captured image data A, that is, the image evidence;

[0035] Method 2: Send a shooting task to the home camera through the second mobile terminal. After receiving the shooting task, the home camera shoots the scene to obtain image data B, and sends the image data to the second mobile terminal through a third-party platform. The second mobile terminal uses the image data B as image evidence;

[0036] Step 4-2: The second mobile terminal constructs a photo data packet and sends it to the central server;

[0037] The photo data packet contains the service personnel ID and the home ID;

[0038] Step 4-3: The serviced person sends a video recording task to the home camera through the second mobile terminal at regular intervals. After receiving the video recording task, the home camera records the scene to obtain video data. The home camera sends the video data to the second mobile terminal through a third-party platform. The second mobile terminal segments the video data according to a fixed time, constructs video data packets for each segment, and uploads the video data packets to the central server;

[0039] The video data packet contains the service personnel ID and the home ID.

[0040] Preferably, when performing step 5, it specifically includes the following steps:

[0041] Step 5-1: The central server uses the service personnel ID and the home ID as key index data, splices and aggregates the barcode scanning data, NFC scanning data packet, positioning data packet, photo data packet and video data packet to generate a check-in task, and constructs a check-in task data packet;

[0042] Step 5-2: Perform multi-dimensional consistency verification on the check-in task data packet, specifically including:

[0043] Step 5-2-1: Perform identity registration verification on the service personnel ID; query the permissions of the service personnel ID, and judge whether there is a permission record to access the serviced home corresponding to the home ID; query whether the service personnel ID has a blacklist / disabled status mark;

[0044] If all verifications pass, mark the identity as normal; otherwise, mark the identity as abnormal;

[0045] Step 5-2-2: According to the calculation result of step 3-2, judge whether the distance difference between the current positioning coordinates of the service personnel and the coordinates of the NFC tag is less than a preset threshold: if yes, mark the geographical location as normal; if not, mark the geographical location as abnormal;

[0046] Step 5-2-3: Check the timestamps of the barcode scanning data, NFC scanning data, positioning data, photo data and video meta-information, and judge whether the following conditions are met:

[0047] Condition 1: The timestamps of all data are within the preset check-in time threshold;

[0048] Condition 2: The times of the scanned code data, NFC scan data, photo data, and video meta-information are increasing, and the time of the positioning data is after the time of the scanned code data;

[0049] Condition 3: When there are multiple video meta-informations, the start time and end time of the video formed by the video meta-informations do not overlap, and the time difference between the start time and the photo data is within the preset threshold;

[0050] Step 5-2-4: If all the conditions in Step 5-2-3 are met, mark the time offset as normal; otherwise, mark the time offset as abnormal;

[0051] Step 5-2-5: Perform Hash / CRC verification on the scanned code data, NFC scan data, positioning data, photo data, and video meta-information. If the verification passes, mark the data integrity as normal; if it fails, mark the data integrity as abnormal;

[0052] Step 5-2-6: Send the check-in task data packet and its verification result to the database server, mark the verification status of all verification items, and generate corresponding exception information according to the verification status.

[0053] Preferably, when performing Step 6, it specifically includes the following steps:

[0054] Step 6-1: The database server updates and saves the check-in task data packet and the status of the check-in task to the task database according to the verification result of the check-in task data packet. The saved content includes: the check-in task table, the verification log table, and the task status table;

[0055] Establish an index for the check-in task table using the task ID, family ID, and service personnel ID;

[0056] Establish an index for the verification log table using the task ID, log type, and creation time;

[0057] Establish an index for the task status table using the task ID;

[0058] Step 6-2: After the task status is updated, push a notification of the update completion to the central server. The central server retrieves the check-in task table, the verification log table, and the task status table corresponding to the check-in task according to the index in Step 6-1, generates feedback information, and returns the feedback information to the management server and the first mobile terminal.

[0059] An intelligent home-based door-to-door service supervision system includes a management server, a first mobile terminal, a second mobile terminal, a database server, a central server, a home camera, a QR code tag and an NFC tag, wherein the management server, the database server and the central server communicate with each other via the Internet;

[0060] The first mobile terminal and the second mobile terminal communicate with the central server via a mobile network;

[0061] The central server communicates with the third-party platform via the Internet, and the second mobile terminal communicates with the third-party platform via the Internet;

[0062] Both the QR code tag and the NFC tag are deployed in the served households; the first mobile terminal scans the QR code tag through the camera and scans the NFC tag through the built-in NFC chip.

[0063] Preferably, the first mobile terminal and the second mobile terminal are both mobile phones; the home camera is a network camera; the management server, database server and central server are all deployed within the service enterprise.

[0064] The intelligent home-based service supervision method and system described in the present invention solve the technical problems of diversified service authenticity verification methods, high supervision credibility, strong data tampering prevention and cheating prevention capabilities. The present invention collects data in different forms such as QR code, NFC, GPS positioning, photos, videos, etc., aggregates and verifies multi-dimensional consistency through a central server, thereby realizing service supervision of service personnel, improving credibility and traceability. Each key data packet contains identity ID, family ID, timestamp, signature verification information, and is transmitted and decrypted through encryption methods such as TLS, secure hash, AES-GCM, etc., combined with a random number anti-replay mechanism, effectively preventing "remote control clocking in" and " Through the time synchronization and distance threshold comparison of the multi-channels of “scan code - positioning - NFC - photo taking - video”, the system automatically checks whether the time of each link in the service process is reasonable and whether the spatial position is real, so as to ensure the continuity and rationality of the service chain; the service personnel can provide photos / videos of “service personnel presence” as evidence through the second mobile terminal or home camera, which effectively improves user participation and enhances the fairness and traceability of the service process; the overall system architecture supports the linkage communication of mobile terminals, home network cameras and back-end servers, has good software and hardware compatibility, is compatible with mainstream smartphones and existing smart home devices, and is suitable for large-scale implementation. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] Figure 1 It is the main flow chart of the present invention;

[0066] Figure 2 is the flowchart of step 1 of the present invention;

[0067] Figure 3 is the flowchart of step 2 of the present invention;

[0068] Figure 4 is the flowchart of step 3 of the present invention;

[0069] Figure 5 is the flowchart of step 4 of the present invention;

[0070] Figure 6 is the flowchart of step 5 of the present invention;

[0071] Figure 7 is the schematic diagram of the system architecture of the present invention. Detailed implementation manners

[0072] Example 1:

[0073] From Figures 1-7 An intelligent home on-site service supervision method shown, includes the following steps:

[0074] Step 1: The first mobile terminal regularly obtains the positioning data of the service personnel; the service personnel use the first mobile terminal at the service site to scan the on-site two-dimensional code, after performing signature verification on the on-site two-dimensional code, construct a scanned code data packet and upload it to the central server for caching;

[0075] The on-site two-dimensional code is pasted on the serviced family. In this embodiment, the two-dimensional code can be deployed in the serviced family by means of pasting a two-dimensional code label, or the two-dimensional code can be downloaded to the second mobile terminal for local deployment.

[0076] When performing step 1, it specifically includes the following steps:

[0077] Step 1-1: The service personnel log in through their own accounts on the first mobile terminal and open the sign-in interface provided by the first mobile terminal;

[0078] Step 1-2: The first mobile terminal automatically obtains GPS positioning monitoring regularly, obtains the positioning data regularly and caches it;

[0079] Step 1-3: The first mobile terminal prompts the service personnel to scan the on-site two-dimensional code, and the service personnel use the camera to scan the on-site two-dimensional code;

[0080] The content of the on-site two-dimensional code includes the family unique identifier, the two-dimensional code generation timestamp, and the digest signed by the private key of the service platform;

[0081] Step 1-5: The first mobile terminal verifies the signature with the local public key: if it passes,

[0082] Then construct a code scanning data packet;

[0083] The code scanning data packet contains the service staff ID and the family ID;

[0084] Specifically, the code scanning data packet is [header instruction] + [total data length] + [version number] + [device type] + [family ID] + [QR code generation time] + [service staff ID] + [mobile device code] + [code scanning timestamp] + [random number] + [check code] + [end symbol].

[0085] The descriptions of the fields in the code scanning data packet are shown in Table 1:

[0086]

[0087] Table 1

[0088] Steps 1 - 6: The first mobile terminal uploads the code scanning data packet to the central server through the TLS channel, and the central server temporarily stores the code scanning data packet.

[0089] Step 2: The service staff uses the first mobile terminal to scan the on-site NFC tag at the service site. The first mobile terminal reads the encrypted data block in the NFC tag, decrypts it, constructs an NFC scan data packet and uploads it to the central server for verification;

[0090] The NFC tag is set in the serviced family; when performing Step 2, it specifically includes the following steps:

[0091] Step 2 - 1: After the first mobile terminal scans the on-site QR code, it prompts the service staff to scan the NFC tag, and the service staff uses the first mobile terminal to scan the NFC tag;

[0092] Step 2 - 2: The first mobile terminal reads the preset encrypted data block in the NFC tag. The content of the encrypted data block includes the family ID, tag serial number, geographical coordinate hash, write timestamp, random anti-replay number, and check field;

[0093] In this embodiment, the specific content of the encrypted data block is as follows:

[0094] AES - GCM encryption block (128bit key)

[0095] {

[0096] Family ID,

[0097] Tag serial number,

[0098] Tag write timestamp,

[0099] Geographical location hash,

[0100] Anti-replay random number,

[0101] Label version number

[0102] }

[0103] If decryption fails or the content is illegal, prompt "Invalid label".

[0104] Step 2-3: The first mobile terminal decrypts the encrypted data block through the AES-GCM algorithm and constructs an NFC scan data packet;

[0105] The NFC scan data packet contains the service personnel ID and the family ID;

[0106] The specific NFC scan data packet is as follows:

[0107] [Header instruction] + [Total data length] + [Version number] + [Device type] + [Family ID] + [Label serial number] + [Label writing time] + [Geohash] + [Anti-replay random number] + [Service personnel ID] + [Device code] + [Scan timestamp] + [Checksum] + [End symbol].

[0108] The field descriptions in the NFC scan data packet are shown in Table 2 below:

[0109]

[0110] Table 2

[0111] Step 2-4: The first mobile terminal uploads the NFC scan data packet to the central server, and the central server checks the geocoordinate hash and the random anti-replay number again to ensure that the NFC tag is not forged.

[0112] In this embodiment, the policy for the central server to cache the NFC scan data packet is as follows: The NFC scan data packet is first locally saved for 5 minutes, and if the upload fails, it can be retried; using "Family ID + Service personnel ID" as the key, cache this record for subsequent task splicing; when aligning with the scan data packet, use the NFC scan timestamp + label writing time to jointly define the alignment method; through the principle of checking that the anti-replay random number + label timestamp is not earlier than the current system time by 2h, perform secure replay protection.

[0113] Step 3: The first mobile terminal filters out the positioning data whose time difference from the time of scanning the on-site two-dimensional code is less than the preset time threshold according to the timestamp of the scan data packet, constructs a positioning data packet and uploads it to the central server for distance calculation;

[0114] When performing Step 3, it specifically includes the following steps:

[0115] Step 3-1: After completing Step 1-6, the first mobile terminal obtains the scanning time based on the timestamp of the scanned code data packet. Taking the scanning time as a reference, all positioning data within the preset time threshold is retrieved, and the positioning data closest to the scanning time is selected to construct a positioning data packet, which includes the service personnel ID and the household ID.

[0116] In this embodiment, if the acquisition of positioning data fails, a prompt will be issued through the first mobile terminal, such as "Insufficient positioning accuracy. Please move to an outdoor or open area", and the default timing for automatically acquiring positioning data is 10 seconds.

[0117] Step 3-2: The first mobile terminal sends the positioning data packet to the central server, and the central server calculates the spherical distance between the positioning data in the positioning data packet and the geographical coordinate hash in the NFC scan data packet and retains the calculation result.

[0118] The positioning data packet specifically includes:

[0119] [Header instruction] + [Total data length] + [Version number] + [Device type] + [Service personnel ID] + [Household ID] + [Longitude] + [Latitude] + [Accuracy in meters] + [Altitude] + [Positioning method]

[0120] + [GPS timestamp] + [Device code] + [Check code] + [End symbol].

[0121] The descriptions of the fields in the positioning data packet are shown in Table 3 below:

[0122]

[0123] Table 3

[0124] In this embodiment, when the central service caches the positioning data packet, the caching strategy adopted includes: the positioning data packet is cached briefly for 10 minutes, and if the upload fails, it will be automatically retransmitted; it is organized by the household ID + service person ID key and stored in the "event cache table"; when aligning with the scanned code data packet, it is aligned in the way that takes the "service personnel ID + household ID" as the key and the GPS time must be within the range of ±5 minutes of the scanned code data packet time; the accuracy ≤ 15m and the point must fall within the circle with a radius of ±30m of the NFC hash coordinate to be considered valid; the "device code + timestamp + original coordinate + accuracy" can be recorded for future traceability analysis.

[0125] Step 4: After the service recipient takes an image evidence of "the service personnel are present" through the second mobile device or the household camera, a photo data packet is constructed and uploaded to the central server;

[0126] When performing Step 4, it specifically includes the following steps:

[0127] Step 4-1: The members of the served family, i.e., the served personnel, obtain image evidence in the following two ways:

[0128] Way 1: Take pictures of the service personnel through the second mobile terminal, and the second mobile terminal stores the captured image data A, that is, the image evidence.

[0129] Way 2: Send a shooting task to the home camera through the second mobile terminal. After receiving the shooting task, the home camera takes pictures of the scene to obtain image data B, and sends the image data to the second mobile terminal through a third-party platform. The second mobile terminal uses the image data B as the image evidence.

[0130] Step 4-2: The second mobile terminal constructs a photo data packet and sends it to the central server.

[0131] The photo data packet contains the service personnel ID and the family ID.

[0132] In this embodiment, the photo data packet includes two parts, one is the meta information packet, and the other is the photo file. The meta information packet specifically includes:

[0133] [Header instruction] + [Number of data bytes] + [Version number] + [Shooting device type] + [Family ID] + [Service personnel ID] + [Shooting timestamp] + [Photo taking method] + [Photo file hash] + [Photo format] + [Device code] + [Check code] + [End symbol].

[0134] The field description of the meta information packet is shown in Table 4 below:

[0135]

[0136] Table 4

[0137] The photo file is sent to the central server in the format of Base64 or the original binary picture. In this embodiment, the size of the photo is 2MB.

[0138] When the central server caches the photo data packet, the meta information is stored in the "media meta data table"; the picture body is stored in the object storage database; when performing data alignment, the family ID + service personnel ID is used as the key for alignment; when performing time window alignment, it is satisfied that the photo shooting time ∈ between the start and end times of the current "sign-in task"; if the mobile phone fails to take a successful picture, the home camera photo is allowed as an alternative fallback solution.

[0139] Step 4-3: The serviced person sends a video recording task to the home camera through the second mobile terminal at regular intervals. After receiving the video recording task, the home camera records the scene to obtain video data, and the home camera sends the video data to the second mobile terminal through a third-party platform. The second mobile terminal segments the video data according to a fixed time, constructs video data packets for each segment, and uploads the video data packets to the central server;

[0140] The video data packet contains the service personnel ID and the home ID.

[0141] The video data packet includes two parts: a media meta-information data packet and video ontology data.

[0142] In this embodiment, for each video segment, an independent "media meta-information data packet" is generated. The video length is 10 seconds, and the shooting task is initiated by the second mobile device and executed by the home camera;

[0143] The media meta-information data packet specifically includes:

[0144] [Header instruction] + [Number of data bytes] + [Version number] + [Media type] + [Home ID] + [Service personnel ID] + [Shooting timestamp] + [Media duration] + [Media format] + [Fragment sequence number] + [Device serial number] + [Video file hash] + [Checksum] + [End symbol].

[0145] The field description of the media meta-information data packet is shown in Table 5 below:

[0146]

[0147]

[0148] Table 5

[0149] The video ontology data is sent to the third-party platform in the form of binary blocks, then sent to the second mobile device by the third-party platform, and then uploaded to the central server by the second mobile device.

[0150] In this embodiment, the model of the home camera that can be used is the TA3R type home camera and its supporting third-party platform.

[0151] After generating the photo evidence record, the second mobile device sends a shooting task to the home camera at regular intervals. According to the shooting task, the home camera shoots the on-site video at regular intervals and fixed length, and uploads it to the second mobile device. The second mobile device generates video segments locally and stores them;

[0152] The second mobile device constructs a video data packet for each video segment and uploads it to the central server;

[0153] Step 5: The central server aggregates the barcode scanning data packet, NFC scanning data packet, positioning data packet, photo data packet, and video data packet, splices them into a check-in task data packet, and performs multi-dimensional consistency verification on the check-in task data packet: if the verification passes, mark the check-in task as successful; if the verification fails, mark the check-in task as abnormal and generate an exception message;

[0154] When performing Step 5, it specifically includes the following steps:

[0155] Step 5-1: The central server uses the service staff ID and family ID as key index data, splices and aggregates the barcode scanning data, NFC scanning data packet, positioning data packet, photo data packet, and video data packet to generate a check-in task and construct a check-in task data packet;

[0156] In this embodiment, the check-in task data packet is specifically as follows:

[0157] [Header instruction] + [Number of data bytes] + [Task ID] + [Service staff ID] + [Family ID]

[0158] + [Task start time] + [Task end time] + [QR code record pointer] + [NFC record pointer] + [Positioning record pointer] + [Photo list pointer] + [Video list pointer] + [Status code] + [Checksum] + [End symbol].

[0159] The field description of the check-in task data packet is shown in Table 6 below:

[0160]

[0161] Table 6

[0162] Step 5-2: Perform multi-dimensional consistency verification on the check-in task data packet, specifically including:

[0163] Step 5-2-1: Perform identity registration verification on the service staff ID; query the permissions of the service staff ID and determine whether there is a permission record to access the serviced family corresponding to the family ID; query whether the service staff ID has a blacklist / disabled status mark;

[0164] If all verifications pass, mark the identity as normal; otherwise, mark the identity as abnormal;

[0165] Step 5-2-2: According to the calculation result of Step 3-2, determine whether the distance difference between the current positioning coordinates of the service staff and the coordinates of the NFC tag is less than the preset threshold: if so, mark the geographical location as normal; if not, mark the geographical location as abnormal;

[0166] Step 5-2-3: Check the timestamps of the barcode scanning data, NFC scanning data, location data, photo data, and video meta information, and determine whether the following conditions are met:

[0167] Condition 1: The timestamps of all data are within the preset sign-in time threshold;

[0168] Condition 2: The times of the barcode scanning data, NFC scanning data, photo data, and video meta information are increasing, and the time of the location data is after the time of the barcode scanning data;

[0169] Condition 3: When there are multiple video meta information, the start time and end time of the video formed by the video meta information do not overlap, and the time difference between the start time and the photo data is within the preset threshold;

[0170] Step 5-2-4: If all the conditions in Step 5-2-3 are met, mark the time offset as normal; otherwise, mark the time offset as abnormal;

[0171] Step 5-2-5: Perform Hash / CRC verification on the barcode scanning data, NFC scanning data, location data, photo data, and video meta information. If the verification passes, mark the data integrity as normal; if not, mark the data integrity as abnormal;

[0172] Step 5-2-6: Send the sign-in task data packet and its verification result to the database server, mark the verification status of all verification items, and generate corresponding exception information according to the verification status.

[0173] In this embodiment, the obtained barcode scanning records, NFC, location, photos, and videos are spliced together to form a sign-in task, and then the sign-in task is subjected to abnormal verification. The verification results can include "success", "abnormal", and "failure".

[0174] "Success" means that all conditions are met.

[0175] "Abnormal" means that some conditions are not met.

[0176] "Failure" means that data is missing.

[0177] Each verification result has its own mark, which is convenient for the subsequent generation of exception information.

[0178] Step 6: Enter the sign-in task into the task database and output the feedback information of the sign-in task to the management server and the first mobile terminal.

[0179] When performing Step 6, it specifically includes the following steps:

[0180] Step 6-1: Based on the verification result of the sign-in task data packet, the database server updates and saves the sign-in task data packet and the status of the sign-in task to the task database. The saved content includes: the sign-in task table, the verification log table, and the task status table;

[0181] Establish an index for the sign-in task table using the task ID, family ID, and service staff ID;

[0182] Establish an index for the verification log table using the task ID, log type, and creation time;

[0183] Establish an index for the task status table using the task ID;

[0184] Step 6-2: After the task status is updated, push a notification indicating the update is complete to the central server. The central server retrieves the sign-in task table, verification log table, and task status table corresponding to the sign-in task based on the indexes in Step 6-1, generates feedback information, and returns the feedback information to the management server and the first mobile terminal.

[0185] In this embodiment, the central server can determine the status of the "sign-in task" based on the result of data verification: successful, abnormal, or failed. According to this result, the central server needs to update the status of the task in the database to maintain data integrity and consistency.

[0186] The data format in the database is as follows:

[0187] [Sign-in task ID] + [Service staff ID] + [Family ID] + [Sign-in task status] + [Verification log] + [Processing time].

[0188] Sign-in task ID: A unique identifier generated by "family identifier + service staff ID + first scan time".

[0189] Service staff ID: The unique identifier of the service staff, used to mark who completed this sign-in.

[0190] Family ID: The unique identifier of the family, used to distinguish different user families.

[0191] Sign-in task status: According to the verification result, the task may have the following statuses:

[0192] Successful: All verifications pass, and the sign-in task is completed normally.

[0193] Abnormal: There are problems with the task, but the system allows continued processing and requires manual review.

[0194] Failed: The task verification fails, and it is directly marked as failed and further processing is blocked.

[0195] Verification Log: Save the detailed logs for each verification step, record the failed steps and abnormal data for subsequent traceability and auditing.

[0196] Processing Time: The timestamp of task processing, recording the time when this operation is completed.

[0197] In the database, the sign-in task table, verification log table, and task status table are as follows:

[0198] Sign-in Task Table:

[0199] Fields: Task ID, Service Personnel ID, Family ID, Status, Verification Log, Processing Time;

[0200] Indexes: Task ID, Family ID, Service Personnel ID.

[0201] Verification Log Table:

[0202] Fields: Log ID, Task ID, Log Type, Log Content, Creation Time;

[0203] Indexes: Task ID, Log Type, Creation Time.

[0204] Task Status Table:

[0205] Fields: Task ID, Status, Update Time;

[0206] Indexes: Task ID.

[0207] The content of the feedback information returned by the central server to the management server and the first mobile terminal is as follows:

[0208] Content received by the first mobile terminal:

[0209] Return the sign-in task status (success, abnormal, failure).

[0210] If it is in an abnormal or failed state, provide relevant error explanations or warning messages to prompt the service personnel for the next operation (e.g., retry or contact the administrator).

[0211] If the task is successful, display "Sign-in completed, task submitted".

[0212] Content received by the management server:

[0213] Provide the detailed status information of all sign-in tasks, including status, abnormal logs, photo and video data, etc., for the administrator to view.

[0214] Provide the historical records and verification logs of the tasks for manual review and traceability.

[0215] Example 2:

[0216] An intelligent home visit service supervision system described in Embodiment 2 is a system architecture applied to an intelligent home visit service supervision method described in Embodiment 1, including a management server, a first mobile terminal, a second mobile terminal, a database server, a central server, a home camera, a QR code label, and an NFC label. The management server, the database server, and the central server communicate with each other through the Internet;

[0217] The first mobile terminal and the second mobile terminal communicate with the central server through a mobile network;

[0218] The central server communicates with a third-party platform through the Internet, and the second mobile terminal communicates with the third-party platform through the Internet;

[0219] Both the QR code label and the NFC label are deployed in the serviced household; the first mobile terminal scans the QR code label through a camera and scans the NFC label through a built-in NFC chip.

[0220] Preferably, the first mobile terminal and the second mobile terminal are both mobile phones; the home camera is an IP camera; the management server, the database server, and the central server are all deployed inside the service enterprise.

[0221] An intelligent home visit service supervision method and its system described in the present invention solve the technical problems of diverse means for verifying service authenticity, high supervision credibility, strong ability to prevent data tampering, and strong ability to prevent cheating. The present invention structurally collects data in different forms such as QR codes, NFCs, GPS positioning, photos, and videos, aggregates and conducts multi-dimensional consistency verification through a central server, thereby realizing the supervision of service personnel's services, improving credibility and traceability. Each key data packet contains an identity ID, a household ID, a timestamp, and signature verification information, and is transmitted and decrypted through encryption methods such as TLS, secure hash, and AES-GCM. Combined with a random number anti-replay mechanism, it effectively prevents cheating means such as "remote control clock-in", "screenshot upload of photos", and "off-site pseudo-sign-in"; through the time synchronization and distance threshold comparison of multiple channels of "scanning code - positioning - NFC - photographing - video", the system automatically checks whether the time of each link in the service process is reasonable and whether the spatial position is real, ensuring the continuity and reasonableness of the service chain; the serviced person can provide photos / videos of "the service personnel being present" through the second mobile terminal or the home camera as evidence materials, effectively improving user participation and enhancing the fairness and traceability of the service process; the overall system architecture supports the linked communication of mobile terminals, home network cameras, and backend servers, has good software and hardware compatibility, adapts to mainstream smartphones and existing smart home devices, and is suitable for large-scale implementation.

Claims

1. An intelligent home visit service supervision method, characterized in that: It includes the following steps: Step 1: The first mobile terminal periodically obtains the positioning data of the service staff; at the service site, the service staff uses the first mobile terminal to scan the on-site QR code. After performing signature verification on the on-site QR code, a scanned code data packet is constructed and uploaded to the central server for caching; Step 2: The service staff uses the first mobile terminal to scan the on-site NFC tag at the service site. The first mobile terminal reads the encrypted data block in the NFC tag. After decryption, an NFC scan data packet is constructed and uploaded to the central server for verification; Step 3: The first mobile terminal filters out the positioning data whose time difference from the time of scanning the on-site QR code is less than the preset time threshold according to the time stamp of the scanned code data packet, constructs a positioning data packet and uploads it to the central server for distance calculation; Step 4: After the person being served takes an image evidence of "the service staff is present" through the second mobile device or the home camera, a photo data packet is constructed and uploaded to the central server; After generating a photo forensics record, the second mobile device periodically sends a shooting task to the home camera. According to the shooting task, the home camera shoots the on-site video at regular intervals and lengths and uploads it to the second mobile device. The second mobile device generates and stores video segments locally; The second mobile device constructs a video data packet for each video segment and uploads it to the central server; Step 5: The central server aggregates the scanned code data packet, NFC scan data packet, positioning data packet, photo data packet and video data packet, stitches them into a sign-in task data packet, and performs multi-dimensional consistency verification on the sign-in task data packet: if the verification passes, the sign-in task is marked as successful; If the verification fails, the sign-in task is marked as abnormal and an abnormal message is generated; Step 6: The sign-in task is entered into the task database, and feedback information of the sign-in task is output to the management server and the first mobile terminal.

2. The intelligent home-based on-site service supervision method according to claim 1, wherein: The on-site QR code is pasted on the served family. When performing Step 1, it specifically includes the following steps: Step 1-1: The service staff logs in through their own account on the first mobile terminal and opens the sign-in interface provided by the first mobile terminal; Step 1-2: The first mobile terminal automatically obtains GPS positioning monitoring at regular intervals, obtains positioning data at regular intervals and caches it; Step 1-3: The first mobile terminal prompts the service staff to scan the on-site QR code, and the service staff uses the camera to scan the on-site QR code; The content of the on-site QR code includes the family unique identifier, QR code generation time stamp and the digest signed by the private key of the service platform; Step 1-5: The first mobile terminal verifies the signature with the local public key: if it passes, a scanned code data packet is constructed; The scanned code data packet contains the service staff ID and the family ID; Step 1-6: The first mobile terminal uploads the scanned code data packet to the central server through the TLS channel, and the central server temporarily stores the scanned code data packet.

3. The intelligent home visit service supervision method according to claim 2, wherein: The NFC tag is set in the served family. When performing Step 2, it specifically includes the following steps: Step 2-1: After scanning the on-site QR code, the first mobile terminal prompts the service staff to scan the NFC tag again, and the service staff uses the first mobile terminal to scan the NFC tag; Step 2-2: The first mobile terminal reads the preset encrypted data block in the NFC tag. The content of the encrypted data block includes the household ID, tag serial number, geographical coordinate hash, write timestamp, random anti-replay number, and check field; Step 2-3: The first mobile terminal decrypts the encrypted data block through the AES-GCM algorithm and constructs an NFC scan data packet; The NFC scan data packet contains the service staff ID and the household ID; Step 2-4: The first mobile terminal uploads the NFC scan data packet to the central server, and the central server checks the geographical coordinate hash and the random anti-replay number again to ensure that the NFC tag is not forged.

4. The intelligent home-based door-to-door service supervision method according to claim 3, characterized in that: When performing Step 3, it specifically includes the following steps: Step 3-1: After completing Step 1-6, the first mobile terminal obtains the scan time based on the timestamp of the scan data packet. Taking the scan time as a reference, it retrieves all positioning data within the preset time threshold, selects the positioning data closest to the scan time, and constructs a positioning data packet. The positioning data packet contains the service staff ID and the household ID; Step 3-2: The first mobile terminal sends the positioning data packet to the central server, and the central server calculates the spherical distance between the positioning data in the positioning data packet and the geographical coordinate hash in the NFC scan data packet and keeps the calculation result.

5. The intelligent home visit service supervision method according to claim 4, characterized in that: When performing Step 4, it specifically includes the following steps: Step 4-1: The members of the household being served, that is, the persons being served, obtain image evidence through the following two methods: Method 1: Take a photo of the service staff through the second mobile terminal and keep the captured image data A, that is, the image evidence; Method 2: Send a shooting task to the household camera through the second mobile terminal. After receiving the shooting task, the household camera takes a photo of the scene to obtain image data B, and sends the image data to the second mobile terminal through a third-party platform. The second mobile terminal uses the image data B as the image evidence; Step 4-2: The second mobile terminal constructs a photo data packet and sends it to the central server; The photo data packet contains the service staff ID and the household ID; Step 4-3: The person being served sends a video recording task to the household camera at regular intervals through the second mobile terminal. After receiving the video recording task, the household camera records the scene to obtain video data. The household camera sends the video data to the second mobile terminal through a third-party platform. The second mobile terminal segments the video data according to a fixed time, constructs a video data packet for each segment, and uploads the video data packet to the central server; The video data packet contains the service staff ID and the household ID.

6. The intelligent home visit service supervision method according to claim 5, characterized in that: When performing Step 5, it specifically includes the following steps: Step 5-1: The central server uses the service staff ID and the household ID as key index data, splices and aggregates the scan data, NFC scan data packet, positioning data packet, photo data packet, and video data packet to generate a check-in task and constructs a check-in task data packet; Step 5-2: Perform multi-dimensional consistency verification on the check-in task data packet, specifically including: Step 5-2-1: Perform identity registration verification on the service staff ID; query the permissions of the service staff ID to determine whether there is a permission record to access the serviced family corresponding to the family ID; query whether there is a blacklist / disabled status flag for the service staff ID; If all verifications pass, mark the identity as normal; otherwise, mark the identity as abnormal; Step 5-2-2: According to the calculation result of Step 3-2, determine whether the distance difference between the current positioning coordinates of the service staff and the coordinates of the NFC tag is less than the preset threshold: if yes, mark the geographical location as normal; if not, mark the geographical location as abnormal; Step 5-2-3: Check the timestamps of the barcode scanning data, NFC scanning data, positioning data, photo data, and video meta-information, and determine whether the following conditions are met: Condition 1: The timestamps of all data are within the preset sign-in time threshold; Condition 2: The times of the barcode scanning data, NFC scanning data, photo data, and video meta-information are increasing, and the time of the positioning data is after the time of the barcode scanning data; Condition 3: When there are multiple video meta-informations, the start time and end time of the video formed by the video meta-informations do not overlap, and the time difference between the start time and the photo data is within the preset threshold; Step 5-2-4: If all conditions in Step 5-2-3 are met, mark the time offset as normal; otherwise, mark the time offset as abnormal; Step 5-2-5: Verify the Hash / CRC in the barcode scanning data, NFC scanning data, positioning data, photo data, and video meta-information. If the verification passes, mark the data integrity as normal; if not, mark the data integrity as abnormal; Step 5-2-6: Send the sign-in task data packet and its verification result to the database server, mark the verification status of all verification items, and generate corresponding exception information according to the verification status.

7. The intelligent home visit service supervision method according to claim 6, wherein: When performing Step 6, it specifically includes the following steps: Step 6-1: The database server updates and saves the sign-in task data packet and the status of the sign-in task to the task database according to the verification result of the sign-in task data packet. The saved content includes: the sign-in task table, the verification log table, and the task status table; Establish an index for the sign-in task table using the task ID, family ID, and service staff ID; Establish an index for the verification log table using the task ID, log type, and creation time; Establish an index for the task status table using the task ID; Step 6-2: After the task status is updated, push a notification of the update completion to the central server. The central server retrieves the sign-in task table, verification log table, and task status table corresponding to the sign-in task according to the indexes in Step 6-1, generates feedback information, and returns the feedback information to the management server and the first mobile terminal.

8. An intelligent home visit service supervision system, which is applied to the intelligent home visit service supervision method described in any one of claims 1-7, and is characterized in that: It includes a management server, a first mobile terminal, a second mobile terminal, a database server, a central server, a home camera, a QR code tag, and an NFC tag. The management server, database server, and central server communicate with each other through the Internet; The first mobile terminal and the second mobile terminal communicate with the central server through the mobile network; The central server communicates with the third-party platform via the Internet, and the second mobile terminal communicates with the third-party platform via the Internet; The QR code label and the NFC label are both deployed in the household to be served; the first mobile terminal scans the QR code label through the camera and scans the NFC label through the built-in NFC chip.

9. The intelligent home-based door-to-door service supervision system according to claim 8, wherein: The first mobile terminal and the second mobile terminal are both mobile phones; the home camera is an IP camera; the management server, the database server, and the central server are all deployed within the service enterprise.

Images