Image processing system and method for nursing worker housekeeping law enforcement instrument

Abstract

A nursing worker housekeeping law enforcement instrument image processing system disclosed by the present invention comprises a law enforcement instrument terminal which comprises a central controller, a camera, a motor, an edge processor and a battery, the camera is connected with the central controller and is used for collecting an image of a hand position of a service worker, and the motor is used for driving the camera to move and adjusting an image collection angle; the edge processor is used for primarily processing images acquired by the camera, and the battery is connected with the central controller; and the cloud storage module is used for storing and processing the image which is acquired by the camera and is uploaded after primary processing. The invention further discloses an image processing method of the nursing worker housekeeping law enforcement instrument. Compared with the prior art, the technical problem that it is difficult to quickly screen image data collected by an existing law enforcement instrument to obtain effective information is solved.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent wearable devices, and in particular to an image processing system and method for a nursing worker and housekeeping law enforcement instrument. Background Art

[0002] As the demand for domestic workers and elderly care workers increases, a large number of workers with varying levels of professional skills provide services, which increases the complexity and risk of the industry. Caregivers and domestic workers are prone to disputes with their employers when providing services. In order to better protect the legitimate rights and interests of caregivers, domestic workers and employers, and provide true and objective service records, it is necessary to use equipment to collect data when the staff provides services, recording images, audio and other key data. Usually, data collection can be achieved through wearable law enforcement equipment or cameras installed in the employer's home.

[0003] The law enforcement instruments currently available on the market are mainly used in the law enforcement process of law enforcement personnel, such as police, security personnel, etc. This type of equipment usually has functions such as video recording, audio recording, GPS positioning, etc., and integrates batteries, cameras, control circuits and storage systems into a pendant that can be worn on the chest.

[0004] When cameras are installed in employers' homes to collect images, they are limited by the installation location and number of cameras, and data cannot be fully collected. Wearable body cameras can collect images, which can improve the quality of image collection, but like cameras, they can only view the collected images. The process of viewing the video usually involves obtaining the video from the memory card, and then manually searching for useful information from the long video, which makes it difficult to obtain effective information in a short time. Summary of the invention

[0005] The purpose of the present invention is to provide an image processing system and method for a nursing assistant and housekeeping law enforcement instrument to solve the technical problem that image data collected by existing law enforcement instruments are difficult to quickly screen to obtain effective information.

[0006] In order to achieve the above-mentioned object, on the one hand, the present invention provides an image processing system for a nursing worker and a housekeeping law enforcement instrument, comprising:

[0007] The body camera terminal includes a central controller, a camera, a motor, an edge processor and a battery. The camera is connected to the central controller. The camera is used to collect images of the service personnel's hand positions. The motor is used to drive the camera to move and adjust the image acquisition angle. The edge processor is used to perform preliminary processing on the images collected by the camera. The battery is connected to the central controller.

[0008] The cloud storage module is used to store and process images collected by the camera that have been uploaded after preliminary processing.

[0009] On the other hand, the present invention also provides a method for processing an image of a nursing worker and housekeeping law enforcement instrument based on the above-mentioned nursing worker and housekeeping law enforcement instrument image processing system, comprising the following steps:

[0010] S1, camera collects original images;

[0011] S2. The edge processor in the body camera terminal processes the original image once, removes the privacy information, and obtains a processed image.

[0012] S3, uploading the once processed image to the cloud storage module, backing it up and reprocessing it in the cloud storage module. When the once processed image is reprocessed, the computer vision algorithm and the large model are used to identify the products that the service personnel have touched, and generate service statistics;

[0013] S4. Based on the service statistical data, obtain the hand movements when a specific product is handled during the service process set by the employer and desired to be observed, and generate key movement statistics;

[0014] S5. Generate a service report and send it to the mobile terminal.

[0015] As a further description of the above technical solution:

[0016] In step S2, the central controller identifies the deviation between the service personnel's hands and the center of the video image in a processed image according to the algorithm, generates an angle adjustment instruction, and controls the camera to move and adjust the image acquisition angle so that the deviation between the service personnel's hands and the center of the video image is less than a set threshold. As a further description of the above technical solution:

[0017] In step S2, the privacy information removal process of the original image includes the edge processor blurring the collected facial image of the person and blurring the background of the scene outside the window in the collected image. As a further description of the above technical solution:

[0018] In step S2, one-time processing of the original image includes extracting basic service information, which includes service time, service location and service personnel code.

[0019] In summary, due to the adoption of the above technical solution, the beneficial effects of the present invention are:

[0020] 1. In the present invention, when the employer hires care workers, housekeepers and other service personnel to provide services, the service personnel wear care worker and housekeeper law enforcement instruments. An edge processor is set in the law enforcement instrument terminal, and the collected image data is preliminarily processed on the edge processor using an artificial intelligence algorithm to improve the image data processing efficiency, which is convenient for subsequent uploading to the cloud for further processing.

[0021] 2. In the present invention, in the law enforcement instrument terminal, based on the image captured by the camera, the central controller recognizes that the position of the service personnel's hands has not been effectively captured, and thus controls the movement of the camera through the motor and adjusts the camera image acquisition angle so that the service personnel's hands are captured in real time at the center of the image, thereby realizing automatic tracking of the service personnel's hand movements and increasing the proportion of effective information in the image data.

[0022] 3. In the present invention, the service report includes a processed image, service statistics, key action statistics and prohibited information statistics. The service report includes the original image data and the data statistics obtained after the image data is processed according to the employer's needs, which is convenient for the employer to quickly obtain effective information. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0024] Figure 1 This is a system architecture diagram of an image processing system for a nursing assistant and housekeeping law enforcement instrument.

[0025] Figure 2 The present invention is a flow chart of an image processing method for a nursing assistant and housekeeping law enforcement instrument.

[0026] Figure 3 The present invention is a flowchart of automatic hand tracking in an image processing method of a nursing assistant housekeeping law enforcement instrument. DETAILED DESCRIPTION

[0027] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings here can be arranged and designed in various different configurations.

[0028] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention claimed for protection, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0029] Example 1

[0030] See also Figure 1-3The present invention provides a technical solution: On the one hand, the present invention provides an image processing system for a nursing home law enforcement instrument, comprising:

[0031] The body camera terminal includes a central controller, a camera, a motor, an edge processor and a battery. The camera is connected to the central controller and is used to collect images of the service personnel's hand positions. The motor is used to drive the camera to move and adjust the image acquisition angle. The edge processor is used to perform preliminary processing on the images collected by the camera. The battery is connected to the central controller and is used to power the body camera terminal.

[0032] The cloud storage module is used to store and process images collected by the camera that have been uploaded after preliminary processing.

[0033] The cloud storage module includes an image recognition unit, a prohibited action setting unit and a key action setting unit. The image recognition unit identifies products that have been touched by the service personnel's hands. The prohibited action setting unit is used to set products that the service personnel are prohibited from touching during the service process. The key action setting unit is used to set the hand movements when specific products that the employer hopes to observe are handled during the service process.

[0034] The body law enforcement instrument terminal also includes a magnetic charging module, which is electrically connected to the battery to facilitate charging the battery.

[0035] On the other hand, the present invention also provides a method for processing an image of a nursing worker and housekeeping law enforcement instrument based on the above-mentioned nursing worker and housekeeping law enforcement instrument image processing system, comprising the following steps:

[0036] S1, camera collects original images;

[0037] S2. The edge processor in the body camera terminal processes the original image once, removes the privacy information, and obtains a processed image.

[0038] S3, uploading the once processed image to the cloud storage module, backing it up and reprocessing it in the cloud storage module, and using computer vision algorithms and large models to identify the products that the service personnel have touched with their hands during the secondary processing of the once processed image, and generating service statistics, in which the product names are associated with the corresponding video image segments;

[0039] S4. Based on the service statistical data, obtain the hand movements when a specific product is handled during the service process set by the employer and desired to be observed, and generate key movement statistics;

[0040] S5. Generate a service report and send it to the mobile terminal.

[0041] Working principle: When employers hire caregivers, domestic workers and other service personnel to provide services, the service personnel wear caregivers and domestic workers law enforcement devices. An edge processor is installed in the law enforcement device terminal. The collected image data is preliminarily processed on the edge processor using an artificial intelligence algorithm to improve the efficiency of image data processing, which is convenient for subsequent uploading to the cloud for further processing.

[0042] Example 2

[0043] Based on the above embodiments, this embodiment further makes the following improved technical solutions: in step S2, the central controller identifies the deviation between the service personnel's hands and the center of the video image in a processed image according to the algorithm, generates an angle adjustment instruction, and controls the camera to move and adjust the image acquisition angle so that the deviation value between the service personnel's hands and the center of the video image is less than the set threshold.

[0044] In the body law enforcement terminal, based on the image captured by the camera, the central controller recognizes that the position of the service personnel's hands has not been effectively captured, and thus controls the movement of the camera through the motor and adjusts the camera image acquisition angle so that the service personnel's hands are captured in real time in the center of the image, thereby realizing automatic tracking of the service personnel's hand movements and increasing the proportion of effective information in the image data.

[0045] Example 3

[0046] This embodiment further makes the following improved technical solution on the basis of the above embodiment: in step S2, the privacy information removal processing of the original image includes the edge processor blurring the collected facial image of the person and blurring the background of the scene outside the window in the collected image.

[0047] Before uploading the image to the cloud for further processing and storage, the nursing assistant and housekeeping law enforcement device will first remove the privacy information at the law enforcement device terminal to avoid collecting the faces of irrelevant people and leaking the external environment information of the house, avoid excessive data collection, and protect the privacy of the employer.

[0048] Example 4

[0049] Based on the above embodiments, the present embodiment further makes the following improved technical solutions: in step S2, one-time processing of the original image includes extracting basic service information, and the basic service information includes service time, service location and service personnel code, so as to facilitate classified storage in subsequent cloud storage, improve storage efficiency, and facilitate searching and further processing of image data.

[0050] Example 5

[0051] This embodiment further makes the following improved technical solutions on the basis of the above embodiments: in step S4, based on the service statistical data, it is judged whether the service personnel have come into contact with prohibited products, and the prohibited information statistics are obtained, and it is automatically judged and counted whether the service personnel have violated the regulations, so as to provide effective information to the employer.

[0052] The service report includes the once processed image, service statistics, key action statistics and prohibited information statistics. The service report includes the original image data and the data statistics obtained after the image data is processed according to the employer's needs, so that the employer can quickly obtain effective information.

[0053] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical scheme and inventive concept of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. A nursing worker housekeeping law enforcement instrument image processing system, characterized in that: include: The body camera terminal includes a central controller, a camera, a motor, an edge processor and a battery. The camera is connected to the central controller. The camera is used to collect images of the service personnel's hand positions. The motor is used to drive the camera to move and adjust the image collection angle. The edge processor is used to perform preliminary processing on the images collected by the camera. The battery is connected to the central controller. The cloud storage module is used to store and process images collected by the camera that have been uploaded after preliminary processing.

2. According to claim 1, the image processing system for the nursing assistant and housekeeping law enforcement instrument is characterized in that: The law enforcement instrument terminal also includes a magnetic charging module, and the magnetic charging module is electrically connected to the battery.

3. The image processing system for the nursing assistant and housekeeping law enforcement instrument according to claim 1 is characterized in that: The cloud storage module includes an image recognition unit, a prohibited action setting unit and a key action setting unit. The image recognition unit recognizes products that have been touched by the service personnel's hands. The prohibited action setting unit is used to set products that the service personnel are prohibited from touching during the service process. The key action setting unit is used to set the hand movements when specific products that the employer wants to observe are handled during the service process.

4. A method for processing an image of a nursing assistant and housekeeping law enforcement instrument based on the image processing system of the nursing assistant and housekeeping law enforcement instrument according to any one of claims 1 to 3, characterized in that: The following steps are involved: S1, camera collects original images; S2. The edge processor in the body camera terminal processes the original image once, removes the privacy information, and obtains a processed image. S3, uploading the once processed image to the cloud storage module, backing it up and reprocessing it in the cloud storage module. When the once processed image is reprocessed, the computer vision algorithm and the large model are used to identify the products that the service personnel have touched, and generate service statistics; S4. Based on the service statistical data, obtain the hand movements when a specific product is handled during the service process set by the employer and desired to be observed, and generate key movement statistics; S5. Generate a service report and send it to the mobile terminal.

5. The image processing method of the nursing assistant housekeeping law enforcement instrument according to claim 1 is characterized in that: In step S2, the central controller identifies the deviation between the service personnel's hands and the center of the video image in a processed image according to an algorithm, generates an angle adjustment instruction, and controls the camera to move and adjust the image acquisition angle so that the deviation value between the service personnel's hands and the center of the video image is less than a set threshold.

6. The image processing method of the nursing assistant housekeeping law enforcement instrument according to claim 1 is characterized in that: In step S2, the privacy information removal process of the original image includes the edge processor blurring the collected facial image of the person and blurring the background of the scene outside the window in the collected image.

7. The image processing method of the nursing assistant housekeeping law enforcement instrument according to claim 1 is characterized in that: In step S2, one-time processing of the original image includes extracting basic service information, which includes service time, service location and service personnel code.

8. The image processing method of the nursing assistant housekeeping law enforcement instrument according to claim 1 is characterized in that: In step S4, whether the service personnel have touched prohibited products is determined based on service statistical data, and prohibited information statistics are obtained.

9. The image processing method of the nursing assistant housekeeping law enforcement instrument according to claim 8 is characterized in that: The service report includes a processing image, service statistics, key action statistics and prohibited information statistics.

Images