Video recording system
The video recording system addresses the limitations of existing technologies by employing heart rate and blood pressure monitoring to detect incidents beyond physical impacts, ensuring reliable data protection and incident recording in driving and nursing care settings.
Patent Information
- Application Number
- JP2024215512
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-12-10
- Publication Date
- 2025-04-10
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing video recording systems for driving recorders and nursing care settings struggle to reliably detect and record incidents that do not involve physical impact, such as minor accidents, tailgating, or inappropriate behaviors between caregivers, due to reliance on acceleration sensors and video analysis.
A video recording system that uses a circular recording method and detects changes in heart rate or blood pressure to identify potential problems, allowing for automatic protection of video data before and after the incident, without the need for constant monitoring or advanced sensor technology.
The system effectively detects a wide range of incidents, including those without physical impact, and ensures that critical video data is protected and available for review, enhancing safety and reducing the risk of inappropriate behaviors in both driving and nursing care contexts.
Smart Images

Figure 2025060663000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a video recording system that employs a cyclic recording system, and more particularly to a video recording system that, when it detects the occurrence of a problem, can reliably store a predetermined amount of video footage before and after the problem occurs and later play back the video footage. [Background technology]
[0002] <Issues with video recording systems as driving recorders> Devices called driving recorders, drive recorders, dash cams, etc. (hereinafter simply referred to as "driving recorders" or "driving recorders, etc.") are in widespread use as in-vehicle video recording devices. These driving recorders are devices that constantly record the inside and outside of the vehicle using video cameras attached to the windshield, dashboard, etc., and their main purpose is to help investigate the cause of an accident, etc., by protecting and playing back the footage before and after the accident, etc., when an accident or other trouble occurs that causes an impact to the vehicle body.
[0003] As a prior art for a driving recorder, the technology described in Patent Document 1 has been proposed. This technology is comprised of "a camera that captures the situation in front of the vehicle while it is moving, a recording device that records the video signal from the camera as multiple still images, and an acceleration sensor for detecting the sudden stopping of the vehicle while it is moving," and its purpose is to "record the situation up to several seconds before the accident in still images, in the event of a car accident, to leave objective evidence for later accident investigation."
[0004] However, this technology has the problem that it cannot detect minor contact accidents that only cause a slight impact because it is configured to detect the occurrence of an accident or the like using an acceleration sensor. Furthermore, aggressive driving has recently become a social problem, and there is a great demand for the ability to record video footage if one is a victim of aggressive driving; however, acceleration sensors are unable to detect aggressive driving incidents.
[0005] Furthermore, even if a case occurs that does not result in an accident, such as a "near miss," but could have become an accident, there is a possibility that it may develop into trouble between drivers, and it is preferable to detect such a case as trouble as well.
[0006] As described above, even if an accident does not involve contact or impact, there is a high demand for recording video before and after an incident in which some kind of trouble occurs or an event that may lead to a trouble occurs. However, with conventional technology, in order to record this video, manual operations must be performed to protect the video data. If the operation is neglected or performed incorrectly, there is a risk that the video data will be lost.
[0007] <Issues with video recording systems in nursing care settings> In order to cope with the further aging of Japanese society in the future, it is essential to build a "community-based comprehensive care system" that comprehensively ensures medical care, nursing care, prevention, housing, and lifestyle support. To this end, it is essential to ensure a stable supply of nursing care personnel, who are one of the most important foundations, and to create a workplace and labor environment in which nursing care staff can work with peace of mind. In recent years, in the field of nursing care, the existence of inappropriate behavior such as verbal abuse and physical abuse between those receiving care (elderly people and people with disabilities who require and receive care or assistance) and caregivers (care workers, helpers, and other people engaged in nursing care work) has become apparent and is becoming a social problem.
[0008] These problems are not limited to those from caregivers to those in need of care, but also include inappropriate behavior from those in need of care or their families toward caregivers. For example, caregivers may be subjected to physical violence, mental violence, power harassment, or sexual harassment from those in need of care or their families, and various surveys have shown that these problems are on the rise. This is thought to be related to the fact that nursing care services involve a lot of direct interpersonal services, including visits to the users' homes and physical contact with the users, that the proportion of female staff is high, and that the services are directly related to quality of life and health and cannot be easily discontinued. Some caregivers find this difficult and leave their jobs, which is also one of the causes of the caregiver shortage.
[0009] In order to monitor inappropriate behavior occurring in nursing care facilities and to protect both caregivers and those receiving care, equipment such as surveillance cameras and monitoring cameras have been introduced. These equipment have the effect of preventing or suppressing the occurrence of inappropriate behavior by constantly monitoring the nursing care facility, and are also used to allow a third party to confirm and verify the situation if inappropriate behavior occurs.
[0010] Although the presence of the aforementioned surveillance cameras and monitoring cameras can deter or prevent inappropriate behavior, there is also the problem that the privacy of the person receiving care is violated by being constantly monitored. For caregivers, too, a work environment in which their caregiving is constantly filmed and can be freely viewed is not a pleasant one.
[0011] In order to solve such privacy issues caused by surveillance cameras and the like, the technology described in Patent Document 2 has been proposed. This technology is configured to "set emergency alert conditions that correspond to the level of care required by each individual person being observed (person receiving care), and by selecting the observation equipment to be connected to the observed person's terminal in accordance with the emergency alert conditions, it is possible to detect emergencies that are suited to the living situation of each individual person being observed," and has the effect of "resolving issues regarding the privacy and human rights of the observed person, as viewing of images of the observed person taken with a camera is limited to specific people such as family members or the person's doctor, and is limited to when an emergency occurs." That is, although the camera is constantly taking pictures, the pictures can only be viewed when an emergency occurs, so the privacy of the person being observed and cared for is not violated more than necessary.
[0012] However, the technology described in Patent Document 2 employs a configuration in which a human sensor, a Doppler sensor, and a thermal camera are used to detect and notify the care recipient of health problems as a means of detecting the occurrence of an emergency. The provision of this equipment is costly, and the installation work requires specialized knowledge and skills, making it difficult to install.
[0013] In addition, the only factor used to determine whether or not an emergency exists is the health problem of the person being cared for, meaning that it is not possible to detect problems such as verbal abuse, physical abuse, power harassment, and sexual harassment that may arise between caregivers and those being cared for. [Prior art documents] [Patent documents]
[0014] [Patent Document 1] JP 5-197858 [Patent Document 2] Patent Publication 2017-151755 Summary of the Invention [Problem to be solved by the invention]
[0015] Therefore, the first object of the present invention is to provide a video recording system that can reliably detect the occurrence of a problem that cannot be detected by video analysis or sensors and record the video, in a broad sense of the term. A second object of the present invention is to provide a video recording system that, when used as a driving recorder, can reliably detect the occurrence of accidents other than those involving impacts and record the footage. As a reference invention of the present invention, the third object is to provide a video recording system for use in nursing care sites that protects the privacy of those being cared for, reliably detects the occurrence of inappropriate behavior or other trouble, records video footage, and is simple in configuration, easy to install, and low-cost. [Means for solving the problem]
[0016] The above object of the present invention can be achieved by the following means. 1. A video recording system used as a driving recorder, In a video recording system for monitoring a subject, a cyclical recording system is adopted in which the captured video is constantly recorded and new video data is sequentially overwritten onto old video data. When a trouble is detected, video data of a predetermined time before and after the trouble is selected and protected from being deleted by overwriting, The means for detecting the occurrence of a problem is a change in the subject's heart rate, The subject is a driver of a vehicle; This video recording system is characterized in that the heart rate of a driver of a vehicle equipped with a driving recorder is constantly measured, and any change in the heart rate is detected as an occurrence of a problem. 2. The video recording system as described in claim 1, characterized in that the subject's heart rate is constantly measured by a wearable terminal with a heart rate measurement function worn by the subject, and this information is transmitted to the video recording system. 3. The subject's heart rate is detected when a sudden increase or decrease is measured; 3. The video recording system according to claim 1 or 2, characterized in that it is configured to detect when a preset rate of increase or decrease is exceeded based on the subject's normal heart rate. 4. A video recording system according to any one of claims 1 to 3, characterized in that the pulse of a subject is sensed when a state of tachycardia or bradycardia is measured. 5. A video recording system as described in any one of claims 1 to 4, characterized in that the subject's cardiac condition is constantly monitored by a wearable terminal with an electrocardiogram function, and any symptoms of atrial fibrillation are detected. 6. The means of detecting the occurrence of a problem is changes in the subject's heart rate and blood pressure. A sudden increase or decrease in the subject's blood pressure is detected, 6. The video recording system according to claim 1, wherein the system is configured to detect when a preset rate of increase or decrease is exceeded, based on the subject's normal blood pressure. 7. The video recording system according to any one of claims 1 to 6, characterized in that, when the occurrence of a trouble is detected, the driver is notified. 8. A video recording system according to any one of claims 1 to 7, characterized in that, when the occurrence of a trouble is detected, the vehicle driven by the subject person is caused to slow down or stop.
[0017] The following configuration can be mentioned as a reference invention R of the present invention. R1. In a video recording system for monitoring a subject, a cyclical recording system is adopted in which the captured video is constantly recorded and new video data is sequentially overwritten onto old video data. When a trouble is detected, video data of a predetermined time before and after the trouble is selected and protected from being deleted by overwriting, A video recording system, wherein the means for detecting the occurrence of a problem is a change in the subject's heart rate. R2. The video recording system described in R1, characterized in that the subject's heart rate is constantly measured by a wearable terminal with a heart rate measurement function worn by the subject, and this information is transmitted to the video recording system.
[0018] R3. The subject's heart rate is detected when a sudden increase or decrease in heart rate is measured. The video recording system described in R1 or 2 is characterized in that it is configured to detect when a preset increase or decrease rate is exceeded based on the subject's normal heart rate.
[0019] R4. The video recording system according to any one of R1 to R3, characterized in that the pulse of the subject is sensed when a state of tachycardia or bradycardia is measured.
[0020] R5. A video recording system as described in any one of R1 to R4, characterized in that the subject's cardiac condition is constantly monitored by a wearable terminal with an electrocardiogram function, and any symptoms of atrial fibrillation are detected.
[0021] R6. The means of detecting the occurrence of a problem is changes in the subject's heart rate and blood pressure. A sudden increase or decrease in the subject's blood pressure is detected, The video recording system described in any one of R1 to R5, characterized in that it is configured to detect when a preset rate of increase or decrease is exceeded, based on the subject's normal blood pressure.
[0022] R7. A video recording system used as a driving recorder, The video recording system described in any one of R1 to 6 is characterized in that the heart rate of the driver of a vehicle equipped with a driving recorder is constantly measured, and changes in the heart rate are detected as the occurrence of a problem.
[0023] R8. The video recording system according to R7, characterized in that the driver is notified when the occurrence of a trouble is detected.
[0024] R9. The video recording system according to R7 or 8, characterized in that it is configured to slow down or stop the vehicle driven by the subject when the occurrence of a problem is detected.
[0025] R10. A video recording system for use in a care facility, The occurrence of a problem is detected when a specific sound is detected. The video recording system according to any one of R1 to R6, wherein the specific voice is a prohibited word that is specified as one that should not be uttered in a nursing care setting.
[0026] R11. The video recording system described in R10, wherein the specific voice is a specific desire term defined in the care site as a term used by the care recipient to convey his or her own desires or wants.
[0027] R12. The person being watched over is a caregiver, The video recording system described in R10 or 11, characterized in that it is configured to protect caregivers by detecting and recording harassment acts by those being cared for.
[0028] R13. Video is captured by a glasses-type wearable device equipped with a camera function to capture video and a microphone function to receive and collect surrounding sounds. The video recording system described in any one of R10 to 12, characterized in that the glasses-type wearable device is connected via a network to a computer having either or both of a recording function for recording video and sound, and a judgment function for determining whether a sound recorded in a video is a specific sound.
[0029] R14. A glasses-type wearable device has an intercom function that enables voice calls over a network and a display function that displays images received over the network, The video recording system described in R13 is characterized in that it is configured to enable the transmission of information consisting of audio and images between a caregiver wearing the glasses-type wearable device and other people connected via a network. Effect of the Invention
[0030] The invention shown in 1 above is configured to constantly measure the heart rate of the person being watched, and if a change occurs in the heart rate of the person being watched, this is deemed to be the occurrence of a problem, and only the video of a predetermined time before and after the change is protected. Therefore, there is no need to make the situation of the person being watched and his / her surroundings viewable at all times, and the privacy of the person being watched can be protected, and when a problem occurs, the situation can be confirmed and verified later. The reason why the means for detecting the occurrence of trouble was a change in the subject's heart rate is as follows. Generally, when a person experiences some kind of trouble, such as an accident, the sympathetic nervous system becomes more active due to anxiety, tension, or stress, causing the heart rate to rise sharply. The heart rate may also drop sharply due to trouble such as a deterioration in one's physical condition. In some cases, the pulse interval may become irregular, causing symptoms of premature ventricular contractions. All of these symptoms are types of arrhythmia, and by detecting this arrhythmia state, it is possible to predict the high possibility that some kind of trouble has occurred. Therefore, in the present invention, a means is employed for detecting a change in the subject's heart rate, i.e., a symptom of arrhythmia in the subject, and determining that this is an occurrence of trouble. In the present invention, the term "occurrence of trouble" refers not only to the occurrence of an actual accident or other trouble, but also to the so-called near misses, such as when the subject feels the risk of a trouble occurring, or when tension arises due to a change in the surrounding situation, etc. Furthermore, the occurrence of health problems, such as the subject's physical condition deteriorating, is also considered to be included in the "occurrence of trouble." According to the invention shown in 1 above, it is possible to reliably detect the occurrence of a problem and reliably protect the images before and after the problem. In other words, conventional video recording systems are configured to detect the occurrence of a problem using various sensors such as acceleration sensors and real-time video analysis, and record video footage before and after the problem occurs. However, there are problems with this system, such as the inability to detect events in which the sensors do not react, or the inability to detect problems occurring in blind spots of the video. In contrast, the present invention is configured to constantly measure the subject's heart rate, and if an arrhythmia or the like that appears as a change in the heart rate occurs, it is configured to detect this as the occurrence of a problem, and is configured to reliably detect any type of problem that occurs. In other words, it is a novel and original configuration in that it does not rely on sensors or image analysis, but focuses on the heart rate, which is a numerical representation of abnormalities such as anxiety, tension, and stress felt by the subject, and detects the occurrence of a problem from this change. Furthermore, the invention shown in 1 above is an example of application in which the video recording system according to the present invention is used in a driving recorder, which can reliably detect any trouble that may occur while driving a vehicle (including automobiles, motorcycles, bicycles, etc.) (including while the vehicle is moving and while stopped), and can protect the video data before and after the trouble. In particular, this technology has a novel and significant effect in that it can detect situations in which the driver feels anxious, tense, or stressed, even when there is no contact or collision that the acceleration sensor does not react to, or when video analysis cannot detect the problem due to blind spots, etc. In addition, the "vehicle equipped with a driving recorder" in 1 above includes cases where the driving recorder is attached to the driver himself or to equipment worn by the driver, such as a helmet. According to the invention shown in 2 above, the subject's heart rate is constantly measured using a wearable device with a heart rate measurement function, such as a portable heart rate monitor or a smart watch with a biosensor. This makes it possible to measure the heart rate in a manner that places less burden on the subject and to reliably detect the occurrence of trouble. According to the inventions shown in 3 to 5 above, various symptoms indicative of arrhythmia, such as a sudden increase or decrease in heart rate, tachycardia, bradycardia, or atrial fibrillation, are detected to detect the occurrence of a trouble, and a more specific method can be proposed as a means for detecting the occurrence of a trouble. The invention shown in 6 above is configured to constantly measure the blood pressure of the person being monitored, and if a change occurs in the person's blood pressure, this is deemed to be a problem, and only the footage of a specified period of time before and after the change is protected. The reason why the means for detecting the occurrence of trouble was a change in the subject's blood pressure is as follows. It is generally known that when a person experiences some kind of trouble, such as an accident, the person feels anxiety, tension, or stress, which causes the excitement to be transmitted to the cardiovascular center in the medulla oblongata, increasing cardiac output and vascular resistance, resulting in a sudden rise in blood pressure. Blood pressure can also drop suddenly due to troubles such as a deterioration in one's physical condition. In this way, by detecting a sudden rise or fall in blood pressure, it is possible to predict the high possibility that some kind of trouble has occurred. Therefore, in the present invention, a means is employed for detecting a change in the subject's blood pressure and determining that this is an occurrence of a problem. According to the invention shown in 6 above, by detecting changes in blood pressure as well as changes in heart rate, the occurrence of a problem can be detected more reliably, and images before and after the problem can be reliably protected. According to the invention shown in 7 above, when the occurrence of a trouble is detected, the driver is notified of this, which is expected to encourage the driver to review the situation objectively. For example, the system could objectively notify the driver of his or her own poor physical condition, such as, "Your heart rate is dropping. Are you feeling unwell?" This is expected to help the driver take appropriate action, such as slowing down or stopping the vehicle. According to the invention shown in 8 above, when the occurrence of a problem is detected, the system can respond in conjunction with the vehicle, such as by slowing down or stopping the vehicle, which is expected to have the effect of preventing accidents, etc. For example, if an operating error occurs, such as confusing the brake and accelerator, the driver will panic and be unable to take appropriate action such as stopping the vehicle. In this case, however, the driver's heart rate is likely to rise sharply. If this condition could be detected and appropriate action such as automatically slowing down or stopping the vehicle could be taken, accidents could be prevented.
[0031] The effects of the inventions described in R1 to R14 listed above as reference inventions will be described below. The invention shown in R1 above is configured to constantly measure the heart rate of the person being watched, and if a change occurs in the heart rate of the person being watched, this is deemed to be the occurrence of a problem, and only the video of a specified time before and after the change is protected. Therefore, there is no need to make the situation of the person being watched and their surroundings available for viewing at all times, and the privacy of the person being watched can be protected, and when a problem occurs, the situation can be confirmed and verified later. The reason why the means for detecting the occurrence of trouble was a change in the subject's heart rate is as follows. Generally, when a person experiences some kind of trouble, such as an accident, the sympathetic nervous system becomes more active due to anxiety, tension, or stress, causing the heart rate to rise sharply. The heart rate may also drop sharply due to trouble such as a deterioration in one's physical condition. In some cases, the pulse interval may become irregular, causing symptoms of premature ventricular contractions. All of these symptoms are types of arrhythmia, and by detecting this arrhythmia state, it is possible to predict the high possibility that some kind of trouble has occurred. Therefore, in the present invention, a means is employed for detecting a change in the subject's heart rate, i.e., a symptom of arrhythmia in the subject, and determining that this is an occurrence of trouble.
[0032] In the present invention, the term "occurrence of trouble" refers not only to the occurrence of an actual accident or other trouble, but also to the so-called near misses, such as when the subject feels the risk of a trouble occurring, or when tension arises due to a change in the surrounding situation, etc. Furthermore, the occurrence of health problems, such as the subject's physical condition deteriorating, is also considered to be included in the "occurrence of trouble."
[0033] According to the invention shown in R1 above, it is possible to reliably detect the occurrence of a problem and reliably protect the images before and after the problem. In other words, conventional video recording systems are configured to detect the occurrence of a problem using various sensors such as acceleration sensors and real-time video analysis, and record video footage before and after the problem occurs. However, there are problems with this system, such as the inability to detect events in which the sensors do not react, or the inability to detect problems occurring in blind spots of the video.
[0034] In contrast, the present invention is configured to constantly measure the subject's heart rate, and if an arrhythmia or the like that appears as a change in the heart rate occurs, it is configured to detect this as the occurrence of a problem, and is configured to reliably detect any type of problem that occurs. In other words, it is a novel and original configuration in that it does not rely on sensors or image analysis, but focuses on the heart rate, which is a numerical representation of abnormalities such as anxiety, tension, and stress felt by the subject, and detects the occurrence of a problem from this change.
[0035] According to the invention shown in R2 above, the subject's heart rate is constantly measured using a wearable device with a heart rate measurement function, such as a portable heart rate monitor or a smart watch with a biosensor. This makes it possible to measure the heart rate in a manner that places less of a burden on the subject and to reliably detect the occurrence of trouble.
[0036] According to the inventions shown in R3 to R5 above, various symptoms indicative of arrhythmia, such as a sudden increase or decrease in heart rate, tachycardia, bradycardia, or atrial fibrillation, are detected to detect the occurrence of a trouble, and a more specific method can be proposed as a means for detecting the occurrence of a trouble.
[0037] The invention shown in R6 above is configured to constantly measure the blood pressure of the person being monitored, and if a change occurs in the person's blood pressure, this is deemed to be a problem, and only the video footage of a specified period of time before and after the change is protected. The reason why the means for detecting the occurrence of trouble was a change in the subject's blood pressure is as follows. It is generally known that when a person experiences some kind of trouble, such as an accident, the person feels anxiety, tension, or stress, which causes the excitement to be transmitted to the cardiovascular center in the medulla oblongata, increasing cardiac output and vascular resistance, resulting in a sudden rise in blood pressure. Blood pressure can also drop suddenly due to troubles such as a deterioration in one's physical condition. In this way, by detecting a sudden rise or fall in blood pressure, it is possible to predict the high possibility that some kind of trouble has occurred. Therefore, in the present invention, a means is employed for detecting a change in the subject's blood pressure and determining that this is an occurrence of a problem. According to the invention shown in R6 above, by detecting changes in blood pressure as well as changes in heart rate, the occurrence of a problem can be detected more reliably, and images before and after the problem can be reliably protected.
[0038] The invention shown in R7 above is an example of application of the video recording system of the present invention in a driving recorder, which can reliably detect any trouble that may occur while driving a vehicle (including automobiles, motorcycles, bicycles, etc.) (including while the vehicle is moving and while stopped), and can protect the video data before and after the trouble. In particular, this technology has a novel and significant effect in that it can detect situations in which the driver feels anxious, tense, or stressed, even when there is no contact or collision that the acceleration sensor does not react to, or when video analysis cannot detect the problem due to blind spots, etc. In addition, in R7 above, "vehicles equipped with a driving recorder" includes cases where the driving recorder is attached to the driver or to equipment worn by the driver, such as a helmet.
[0039] According to the invention shown in R8 above, when the occurrence of a trouble is detected, the driver is notified of this, which is expected to trigger the driver to review the situation objectively. For example, the system could objectively notify the driver of his or her own poor physical condition, such as, "Your heart rate is dropping. Are you feeling unwell?" This is expected to help the driver take appropriate action, such as slowing down or stopping the vehicle.
[0040] According to the invention shown in R9 above, when the occurrence of a problem is detected, the system can respond in conjunction with the vehicle, such as by slowing down or stopping the vehicle, which is expected to have the effect of preventing accidents and the like. For example, if an operating error occurs, such as confusing the brake and accelerator, the driver will panic and be unable to take appropriate action such as stopping the vehicle. In this case, however, the driver's heart rate is likely to rise sharply. If this condition could be detected and appropriate action such as automatically slowing down or stopping the vehicle could be taken, accidents could be prevented.
[0041] The invention shown in R10 above is configured to record images of the care site at all times, and when a problem occurs such as inappropriate behavior or a deterioration in health, only a specified period of video before and after the problem is recorded. Therefore, there is no need to make the condition of the care recipient available for viewing at all times, and the privacy of the care recipient can be protected, and when some kind of problem occurs, the condition can be confirmed and verified later.
[0042] Furthermore, the existence of this video recording system creates awareness that if any trouble occurs, the video footage before and after the incident can be checked later, which is expected to have the effect of preventing or suppressing trouble for both the care recipient and the caregiver.
[0043] Furthermore, by adopting a means for detecting the occurrence of a specific sound as a means for detecting the occurrence of a problem, it is possible to reliably detect the occurrence of a problem without using advanced technology such as video analysis. This allows the configuration to be simplified, making it possible to provide a low-cost video recording system. Furthermore, installation is easy as it does not require special knowledge or technology, and the time and cost required for installation can be reduced.
[0044] Furthermore, with methods of detecting the occurrence of trouble using video analysis, there is the problem that if a trouble occurs in a blind spot, it is difficult to detect. However, the configuration of the present invention, which detects the occurrence of a specific sound, can solve this problem and make it possible to more reliably detect the occurrence of trouble.
[0045] The invention shown in R10 above is configured to focus on prohibited words in nursing care sites as a means of detecting the occurrence of trouble. Prohibited terms in the nursing care field are specified by each nursing care facility and each nursing care-related organization, and can be adopted according to any standard. These prohibited terms are terms and expressions that must not be used in the nursing care field, and when these prohibited terms are used, it is highly likely that some kind of trouble will occur between the care recipient and the caregiver. Therefore, the occurrence of a problem can be determined and detected more reliably.
[0046] According to the invention shown in R10 above, each time a problem occurs in a nursing care site, images of the time before and after the problem are saved, and this image data can be accumulated. Using this image data, it is possible to understand the causes of problems and situations in which problems are likely to occur, to study tendencies in how to handle problems, and to study ways to solve problems and ways to avoid problems.
[0047] Currently, the solutions and avoidance measures for problems in the field of nursing care largely depend on the know-how of each nursing facility and caregiver, and this know-how is not shared among nursing care facilities nationwide. As a result, there are differences in the level of understanding and ability to solve and avoid problems between nursing facilities and caregivers. The video data accumulated by the video recording system of the present invention can be used to study solutions and avoidance measures for problems, and if this information is made available to care facilities across the country, it will be possible to reduce problems in care facilities nationwide.
[0048] As described above, the video recording system according to the present invention is expected to have a deterrent effect on trouble, and the accumulated video data from when trouble occurs is expected to lead to research into ways to prevent trouble, which is expected to further reduce the occurrence of trouble. This is expected to reduce the number of caregivers who quit their jobs due to troubles, and to help solve the problem of a shortage of caregivers.
[0049] Furthermore, it is believed that this will also contribute to the achievement of one of the SDGs (Sustainable Development Goals), "3. Ensure good health and well-being for all."
[0050] The invention shown in R11 above is configured to focus on specific desire terms, which are terms uttered by the care recipient to the caregiver and which have been defined in the care setting as terms that convey one's own needs or desires, as an element for determining and managing the occurrence of trouble.
[0051] These specific desire terms are words that are sometimes uttered by the care recipient toward the caregiver, and examples of this include abusive language. Abusive language uttered by the care recipient is often an expression of their own desires and wants, and they may not be able to express these well due to stress caused by mental and physical illness or the effects of dementia, resulting in abusive language uttered toward the caregiver. When these specific desire terms are uttered, particularly inexperienced caregivers, they may feel strong stress and cause trouble.
[0052] Therefore, by detecting the utterance of this specific desire term, it is possible to predict the occurrence of trouble. Also, if it is possible to predict and detect the occurrence of trouble in advance, it is possible to notify the caregiver that there is a risk of trouble occurring, and the caregiver who receives this notification can take care to prevent trouble from occurring. Furthermore, if the prediction of the occurrence of trouble is notified to the manager of the caregiver in charge, it is possible to encourage a change of the caregiver in charge or an improvement in the response, and therefore it is also possible to prevent trouble from occurring.
[0053] The invention shown in R12 above is intended to limit the purpose of the video recording system according to the present invention to protection of the caregiver. Conventional video recording systems (surveillance cameras, security cameras, etc.) used in care facilities are used for the purpose of protecting those receiving care, that is, by monitoring abusive language and violence from caregivers to those receiving care, and are configured with the functionality to do so. On the other hand, the invention shown in 12 above is a system that detects the occurrence of harassment (such as power harassment or sexual harassment) against caregivers by the care recipient or their family, records the footage, and protects them, which is an unprecedented idea in that it aims to protect caregivers.
[0054] The inventions shown in R13 to R14 above are configured to use a glasses-type wearable device as a device for capturing video. Glasses-type wearable devices have been proposed that are equipped with camera functions, microphone functions, intercom functions, display functions, etc., and by adopting these as the hardware to realize the video recording system of the present invention, it will be possible to monitor care sites in environments where cameras are not installed, such as home care, and the work and costs required for camera installation, etc. can be significantly reduced.
[0055] In addition, because the glasses-type wearable device is configured to be able to communicate with other computers, etc. via a network, the condition of the person being cared for and their surroundings can be observed by those operating other computers, etc., and any deficiencies in the caregiver's response can be pointed out, and the caregiver can also inquire about how to respond, making it possible to use it as a care support system, coaching system, etc. [Brief description of the drawings]
[0056] [Figure 1] FIG. 1 is a schematic diagram showing an embodiment of a video recording system according to the present invention; [Diagram 2] 1 is a flowchart showing the operation of a video recording system according to the present invention. [Diagram 3] FIG. 1 is a schematic diagram showing an embodiment in which a video recording system is used as a surveillance camera in a nursing care site. [Figure 4] FIG. 1 is a schematic diagram showing an embodiment of a photographing device (integrated type); [Diagram 5] FIG. 1 is a schematic diagram showing an embodiment of an imaging device (separate type); [Figure 6] FIG. 1 is a schematic perspective view showing an example of a glasses-type wearable device. [Figure 7] Schematic diagram illustrating the means for determining the risk of aspiration DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0057] The configuration of a video recording system according to the present invention will be described with reference to the drawings.
[0058] <Outline of the video recording system according to the present invention> FIG. 1 is a schematic explanatory diagram showing an example of an overview of a video recording system 1 according to the present invention (hereinafter, also simply referred to as "video recording system 1"). As shown in FIG. 1, the video recording system 1 is composed of a camera 2 that captures images of the person being watched over M and / or his / her surroundings, and a heart rate measuring device 3 worn by the person being watched over M, and the camera 2 and heart rate measuring device 3 are connected via a wireless network N.
[0059] The photographing device 2 has a camera function 21 for photographing images, a microphone function 22 for receiving and collecting surrounding sounds, a recording function 23 for recording and saving the photographed images (including "sound" received and collected by the microphone function; the same applies below), and a communication function 24 for connecting to the heart rate measuring device 3 via a network.
[0060] The recording function 23 may be configured to use a memory card (such as an SD card or USB memory) that can be removed from the photographing device 2, in addition to a storage device (such as a hard disk drive or solid state drive) built into the photographing device 2.
[0061] The communication function 24 is a function for connecting to the heart rate measuring device 3 via the network N, and is also a function for connecting to other computers, smartphones, smart glasses, and other portable information terminals. There is no limitation on the type of network, and any publicly known and publicly used network can be adopted without any special restrictions. However, considering the connection with the heart rate measuring device 3 worn by the subject M, a wireless network is preferable, and for example, a wireless LAN (local area network), a short-distance wireless communication such as Bluetooth (registered trademark), a mobile communication system used as a mobile phone line (3G, 4G, 5G (including local 5G and private 5G)), etc. can be used.
[0062] There is no limitation on the specific configuration of the imaging device 2 used in the present invention, and any publicly known and publicly used imaging device can be used without any particular restriction. For example, an imaging device commercially available as a driving recorder may be used.
[0063] The heart rate measuring device 3 is a device that measures the heart rate of the subject M. In addition to the function of constantly measuring the heart rate, the heart rate measuring device 3 has a notification function for connecting to the recording device 2 via the network N. There is no limitation on the specific configuration of the heart rate measuring device 3, and any publicly known and publicly used heart rate measuring device can be used without any particular restriction.
[0064] Examples of heart rate measuring devices 3 used in the present invention include a heart rate monitor worn by the subject M, and a sensing device using a camera that allows non-contact measurements without the subject M wearing any device.
[0065] A heart rate monitor is a device worn by the subject M to measure in contact with the body, and configurations in which it is worn on the finger, wrist, or chest are known. Recently, wearable devices that do not only simply measure heart rate but also have computer functions such as smartphones have become widely known, and a wearable device with a heart rate measurement function can be used as the heart rate measurement device 3 in the present invention. For example, if a smart watch with a biosensor in the form of a wristwatch is used, it can be obtained relatively easily and inexpensively, the physical burden on the subject M when wearing it is small, the heart rate can be measured at all times, and the information can be transmitted to another device (such as the imaging device 2) via the network N. Furthermore, when electrocardiogram measurement is required, a wearable device with a heart rate monitor and an electrocardiogram function, such as a portable electrocardiogram or a smart watch with an electrocardiogram function, can be used as the heart rate measuring device 3 of the present invention. This heart rate measuring device 3 may be a device called an activity meter or a biosensor.
[0066] For the heart rate measuring device 3 used in the present invention, a measuring technique using a near-infrared camera that can measure the heart rate from a distance without the subject M having to wear it can also be adopted. Specifically, a known configuration is to irradiate an infrared pattern onto the human body (subject M) and analyze the infrared image obtained by reflection to measure. This technology uses a near-infrared camera to capture the subject M irradiated with near-infrared light, detects pulse information from this image (information detected from changes in the hemoglobin in the blood on the skin surface), and calculates the heart rate from the detected pulse information. By using near-infrared light instead of visible light, it is possible to measure the heart rate regardless of day or night, or whether it is light or dark. If this heart rate measuring means is adopted as the heart rate measuring device 3, then by mounting it on the photographing device 2, the functions of the photographing device 2 and the heart rate measuring device 3 can be fulfilled by a single device.
[0067] In the present invention, the term "heart rate" includes the meaning of "pulse rate". As a medical term, heart rate means the number of times the heart beats per minute, while pulse rate means the number of times the blood vessels in each part of the body beat per minute, so strictly speaking, the meanings are different. In the present invention, the body parts where the heart rate is measured are often the blood vessels in each part, so strictly speaking, the "pulse rate" is being measured. However, as mentioned above, in the present invention, no distinction is made between the terms "heart rate" and "pulse rate", and the term "heart rate" is primarily used.
[0068] <Detailed configuration of the video recording system according to the present invention> Next, a flow of operations relating to the implementation of the video recording system 1 according to the present invention will be described. First, prepare a state in which the heart rate of the person M to be watched over can be constantly measured. One method is to have the person M wear a heart rate measuring device 3 (e.g., a wearable terminal with a heart rate measuring function). The embodiment in FIG. 1 is an example in which the person M wears a wearable terminal G with a heart rate measuring function as the heart rate measuring device 3. Another method is to prepare a state in which the heart rate of the person M can be sensed (a state in which near-infrared light can be irradiated and an image can be taken with a near-infrared camera).
[0069] Next, a range for detecting a change in heart rate is set. If a change in the set heart rate is detected, this is assumed to be a problem, and the video data is protected as described below. A first example of setting a change in heart rate is a state in which the heart rate of the subject M increases or decreases suddenly. The increase or decrease value and the increase or decrease rate are set based on the subject M's normal heart rate. The normal heart rate may be manually input by the subject M, or may be automatically measured when the heart rate measuring device 3 is worn.
[0070] For example, a setting may be made such that, based on the subject M's normal heart rate, if there is an increase or decrease of 20 bpm or more within a specified period of time, this is detected as a change in heart rate (i.e., the occurrence of a problem). Also, based on the subject M's normal heart rate, if there is an increase or decrease of 30% or more within a specified period of time, this is detected as a change in heart rate (i.e., the occurrence of a problem).
[0071] A second example of a change in heart rate is when the subject's pulse is measured to be in a tachycardia or bradycardia state, and this is detected as a change in the heart rate (i.e., the occurrence of a problem). Tachycardia refers to an increased heart rate, generally defined as a heart rate above 100 bpm, while bradycardia refers to a decreased heart rate, generally defined as a heart rate below 60 bpm.
[0072] For example, the heart rate measuring device 3 is set to have a tachycardia state where the heart rate exceeds 100 bpm and a bradycardia state where the heart rate falls below 60 bpm, and when setting the change in heart rate, the device is set to detect the state of tachycardia or bradycardia as a change in heart rate. In addition, normal heart rates vary from person to person, and some people, such as athletes with sports hearts, have extremely low normal heart rates. In this case, it is preferable to adopt a method of setting the increase or decrease value, increase rate, or decrease rate based on the normal heart rate of the subject M described above.
[0073] The second example of heart rate change mentioned above is detecting a state of tachycardia or bradycardia to infer that the subject is experiencing the symptom of "palpitations." Palpitations are generally defined as an uncomfortable feeling or discomfort felt when the heart beats faster, slower, or irregularly. This uncomfortable feeling or discomfort is subjective to the subject M and cannot be detected by a heart rate measuring device. Therefore, in order to grasp the state in which the heart beats faster or slower, the state of tachycardia or bradycardia is detected. If symptoms of arrhythmia such as tachycardia or bradycardia, the sudden increase or decrease in heart rate mentioned above, and premature contractions described below appear, it is highly likely that subject M feels discomfort or strangeness in the movement of his or her heart, and therefore will sense these conditions as a change in heart rate, i.e., the occurrence of a problem.
[0074] As a third example of a change in heart rate, a case can be cited in which the pulse of subject M is measured to be in a state of premature contraction, which is detected as a change in heart rate (i.e., the occurrence of a problem). Premature ventricular contractions are arrhythmias in which the heart contracts faster than normal due to abnormal stimulation, and are a state in which a normal, regular pulse is occasionally mixed with a fast pulse. In order to detect the state of premature ventricular contractions, a heart rate measuring device 3 can be used to measure the interval between pulses with high accuracy, or a heart rate measuring device 3 with an electrocardiogram function can be used.
[0075] A fourth example of a change in heart rate is when subject M's heart condition shows symptoms of atrial fibrillation, which is detected as a change in heart rate (i.e., the occurrence of a problem). Atrial fibrillation is a type of arrhythmia in which the atria flap and contract rapidly and partially without stimulation from the sinoatrial node. Regular sinoatrial node activity is not transmitted, and ventricular contractions occur at irregular intervals.
[0076] It is known that during a normal pulse (sinus rhythm), P waves, which indicate excitation of the atria, and QRS waves, which indicate excitation of the ventricles, appear as a set at regular intervals. On the other hand, in atrial fibrillation, the P waves disappear, finely pulsating fibrillation waves are generated, the regularity of the QRS waves is lost, and the pulse becomes irregular. That is, to detect the state of atrial fibrillation, an examination using an electrocardiogram that can observe P waves and QRS waves is necessary, and in the present invention, a means for detection using a heart rate measuring device 3 with an electrocardiogram function can be given. Wearable devices with an electrocardiogram function (for example, portable electrocardiographs and smart watches with biosensors) are commercially available, and these can be used.
[0077] The above-mentioned tachycardia, bradycardia, premature ventricular contraction, and atrial fibrillation are types of "arrhythmia" in which the electrical signals of the heart are disturbed, and by detecting the symptoms of this arrhythmia, it is possible to grasp the possibility of heart disease such as angina pectoris and myocardial infarction. Therefore, by grasping these symptoms, it is possible to sense that the subject M has developed some kind of health problem such as heart disease, that is, that a health trouble has occurred.
[0078] A normal heart rate measuring means needs to measure the number of beats per minute, so it takes at least one minute to detect a change in the heart rate. This method may not be sufficient to quickly detect the occurrence of a problem. Therefore, in the present invention, it is preferable to adopt a means for quickly detecting a change in the heart rate using the following method. As an example, a method can be considered in which the heart rate is calculated by constantly counting the number of heartbeats for one minute from the starting point, starting from one minute before the current time.
[0079] Another example is a method of predicting heart rate from pulse intervals. When the normal heart rate is 60 bpm, the pulse interval is one second. If the pulse interval becomes 0.5 seconds, the heart rate is 120 bpm, which is double the normal rate. With this method, changes in heart rate can be detected in as little as a few seconds. As another example, a method of prediction based on the pulse rate over a 10-second period can be considered. When the normal heart rate is 60 bpm, the number of beats per second is 1, and the number of beats per 10 seconds is 10. If this number of beats per 10 seconds is 15, this is equivalent to 90 beats per minute, and the heart rate is 30 bpm higher than normal. With this method, it is possible to detect a change in the heart rate over a 10-second period, for example.
[0080] So far, the present invention has been described in terms of the means for detecting the occurrence of a problem by using changes in heart rate. In addition to changes in heart rate, changes in blood pressure can also be used as a means for detecting the occurrence of a problem. It is known that the driver's blood pressure rises while driving a vehicle. For example, it has been reported that even when driving safely at a speed of about 30 to 40 km per hour, the systolic blood pressure rises by an average of 25 mmHg, and when driving slalom at a speed of 60 to 80 km per hour, the systolic blood pressure rises by an average of 43 mmHg. This is thought to be caused by stress caused by tension while driving. These blood pressure rises can be said to be average values for blood pressure rises while driving, but if a rise is observed beyond this, there may be other causes. Possible causes include worsening driving conditions due to bad weather, vehicle troubles such as breakdowns, reckless or suspicious driving by oneself or others, and damage from tailgating. The occurrence of these troubles causes the driver to feel more stress than during normal driving, and it is thought that blood pressure also rises more than during normal driving. Besides driving a vehicle, if subject M encounters a situation that makes him / her feel anger, fear, anxiety, surprise, etc., his / her blood pressure will rise. For example, in relation to the use of the video recording system 1 in a nursing care site described below, caregiver Z who is subjected to verbal and physical abuse from care recipient Y is likely to be highly stressed. In such cases, as described above, the heart rate will increase, and so will blood pressure. Therefore, if a change in blood pressure is used as a means for detecting the occurrence of trouble in addition to a change in heart rate, it is possible to more reliably detect the occurrence of trouble. Also, instead of a change in heart rate, a change in blood pressure can be used as a means for detecting the occurrence of trouble.
[0081] As described above, the present invention can employ a configuration in which, when the blood pressure of subject M suddenly rises or falls, it is detected as a problem occurring to subject M or his / her surroundings. The range of what is detected as a sudden increase or decrease in blood pressure can be set arbitrarily by the subject M, etc. For example, a setting can be made such that, based on the subject M's normal blood pressure, if the systolic blood pressure (systolic blood pressure) increases or decreases by 25 mmHg or more in a predetermined time, this is detected as a change in blood pressure (i.e., the occurrence of a problem). Another setting can be made such that, based on the subject M's normal blood pressure, if the systolic blood pressure (systolic blood pressure) increases or decreases by 20% or more in a predetermined time, this is detected as a change in blood pressure (i.e., the occurrence of a problem). In addition, if the above-mentioned predetermined time is long, such as one hour, it is not preferable because it takes time to detect and the change cannot be considered sudden. Therefore, it is preferable to set it to a short time, such as 30 seconds or one minute. In addition, although the above explanation has been given as an example of an increase or decrease in maximum blood pressure (systolic blood pressure), this may be set to minimum blood pressure (diastolic blood pressure). Recently, portable and wristwatch-type blood pressure monitors, known as wearable blood pressure monitors, have become commercially available. If the subject M wears this wearable blood pressure monitor separately, or wears the above-mentioned wearable terminal with heart rate measurement function to which a blood pressure measurement function has been added, the subject M's blood pressure can be constantly measured, and changes in blood pressure can be detected.
[0082] Next, the cyclic recording by the image capturing device 2 will be described. Circular recording is a method of storing images in which the captured image is constantly recorded, and new image data is written over old image data in sequence, and is widely used as an image storage method for surveillance cameras and driving recorders. This method is often adopted because image data is large in data volume and the memory capacity of recording devices is limited. The present invention employs a cyclical recording system, and is configured such that when a problem occurs, video data of a predetermined time before and after the occurrence of the problem is automatically selected and protected and saved so that it is not deleted by overwriting. In other words, video data is normally saved and deleted sequentially by overwriting, but the video data of a predetermined time before and after the occurrence of the problem is protected from being saved and overwritten. The present invention is configured to detect the occurrence of the problem by a change in the heart rate of the subject M.
[0083] The time period for which video data is protected can be preset. For example, any time period can be set, such as automatically protecting 60 seconds of video data before and after the occurrence of a problem. It is also possible to set the system to protect all video data during the period when changes in heart rate continue, in addition to the video data before and after the occurrence of a problem.
[0084] Furthermore, in addition to protecting the video data before and after the occurrence of a problem, it is preferable to also record and protect the heart rate data that detects the problem, because changes in heart rate can be useful in identifying the cause of the problem, for example, in the case of a sudden illness such as a myocardial infarction.
[0085] In the video recording system 1, the device that detects the change in heart rate may be either the photographing device 2 or the heart rate measuring device 3. The measurement result of the heart rate of the subject M may be constantly transferred from the heart rate measuring device 3 to the photographing device 2, and the photographing device 2 may determine whether or not the change corresponds to a change in heart rate based on the result, or the heart rate measuring device 3 may determine whether or not the change corresponds to a change in heart rate and then notify the photographing device 2 that the change corresponds to a change in heart rate (i.e., that the occurrence of a trouble has been detected).
[0086] 2 is a flow chart showing an example of the operation of the video recording system 1. The flow of the operation of the video recording system 1 will be described with reference to this diagram. First, the photographing device 2 starts photographing the subject M and / or his / her surroundings, and starts cyclic recording of the image data obtained by the photographing. At this time, the time period of the image data to be protected can be set for the image data before and after the occurrence of the trouble, which is protected from being deleted by overwriting.
[0087] When the cyclical recording starts, continuous measurement of the heart rate of the subject M is started. If monitoring by electrocardiogram is required, monitoring is started at the same time. When the subject M realizes that the heart rate cannot be measured because the subject M is not wearing the heart rate measuring device 3, for example, a configuration may be adopted in which an alert or the like is used to notify the subject M of this. At this time, the subject M can manually set, or the video recording system 1 can automatically set, the range within which a change in heart rate is detected. The start of the cyclic recording and the start of the heart rate measurement may be inverted.
[0088] Next, a determination is made constantly in real time as to whether the constantly measured heart rate of the subject M falls within a set range that can be sensed as a change in heart rate. If the change in heart rate falls within a preset range, it is detected as a problem.
[0089] In Fig. 2, "specific voice" is written as a determination factor, which is a determination factor used in the video recording system 1 in the nursing care site, and will be described in detail later. Although not shown in Fig. 2, a change in blood pressure can be added as a detection means in addition to a change in heart rate.
[0090] If a problem is detected, video data before and after the problem is automatically selected and protected. In addition, if necessary, the subject M is notified that the change in heart rate falls within the set range, i.e., that a problem has been detected. The notification destination may be not only the subject M, but also another person (person requiring notification) set in advance.
[0091] Furthermore, if necessary, a command is issued to execute a preset operation to an object (e.g., a vehicle, a security system, a monitoring system, etc.) associated with the video recording system 1. For example, if the object is a vehicle, it may be instructed to slow down or stop, and if it is a security system, it may be instructed to notify a security management company, police, or fire department.
[0092] The above-mentioned operation is repeated unless the subject M or the like stops the operation of the video recording system 1 (termination process).
[0093] <Use as a driving recorder> Next, an application example in which the video recording system 1 according to the present invention is used as a driving recorder will be described. A driving recorder is an in-vehicle video recording device that is installed primarily for the purpose of recording situations such as video footage of car accidents. A typical driving recorder uses an acceleration sensor or other device to detect impacts caused by a collision or other accident, and protects video data before and after the accident. However, this configuration for detecting impacts to protect video data has the problem that it cannot detect accidents that do not involve impacts such as contact or that involve only a weak impact, such as damage caused by aggressive driving or attempted accidents. In these cases, the driver must manually protect the video data.
[0094] The video recording system 1 of the present invention is configured to detect changes in the heart rate of a subject M (the driver in the case of a driving recorder) as the occurrence of a problem, and can reliably detect even problems that do not involve the above-mentioned impacts.
[0095] In the case of aggressive driving, accidents or attempted accidents caused by mistaking the accelerator for the brake when driving by elderly drivers, or other attempted accidents, the driver feels anxiety, tension, stress, etc., which in most cases causes an increase in heart rate. In addition, in the case of abnormal physical condition such as abnormal cardiac function, a decrease in heart rate and irregular pulse are often observed. These symptoms are collectively called arrhythmia, and if the occurrence of arrhythmia symptoms is detected as the occurrence of a problem (including situations that may develop into a problem), video data before and after the occurrence of the problem can be reliably and automatically protected, and can be used to record the situation of the problem and to identify its cause.
[0096] When the video recording system 1 is used as a driving recorder, the image capturing device 2 is installed in a part of the vehicle such as the dashboard or the windshield. If the vehicle is a motorcycle or bicycle, the image capturing device 2 may be attached near the handlebars or on an accessory such as a helmet worn by the driver.
[0097] The heart rate measuring device 3 may be a wearable G (e.g., a smart watch) with a heart rate measuring function worn by the driver. In addition, by utilizing the above-mentioned heart rate measuring means using the near-infrared camera, an environment in which the driver's heart rate can be measured at all times may be created by equipping the photographing device 2 or a car navigation system with near-infrared light irradiation and near-infrared camera functions. As described above, a change in blood pressure may be used as well as a change in heart rate as a means for detecting the occurrence of a problem. In this case, the heart rate measuring device 3 worn by the subject M is provided with a blood pressure measuring function.
[0098] The filming device 2 and the heart rate measuring device 3 are connected via a communication means such as Bluetooth (registered trademark), and when the heart rate measuring device 3 detects a change in the driver's heart rate (the occurrence of a problem), it transmits this to the filming device 2, and the filming device 2 protects the video data before and after the occurrence of the problem.
[0099] Furthermore, if the heart rate measuring device 3 detects a problem and notifies the driver with sound or light, etc., it is expected that the driver will be made aware of symptoms of poor physical condition without realizing it, which will prevent or suppress the development of an accident. For example, if the driver's own poor physical condition can be objectively notified, such as "Your heart rate is dropping. Are you feeling unwell?", the driver who receives this notification can take appropriate measures, such as slowing down or stopping the vehicle, thereby preventing an accident.
[0100] Furthermore, if the heart rate measuring device 3 is set to slow down or stop the vehicle when it detects the occurrence of a problem, it is expected that the effect of preventing the development of a serious accident can be expected even if the driver is unconscious or has lost consciousness due to a decline in cardiopulmonary function. Recently, there have been many accidents caused by elderly people mistaking the accelerator for the brake, and even in such cases, the driver becomes upset and his heart rate increases. If this situation can be detected as the occurrence of a problem as soon as possible, it is possible to prevent the development of a serious accident.
[0101] A driving recorder using the present invention is also useful for providing as an automobile insurance service. Some automobile insurance companies provide driving recorders to monitor their policyholders (drivers), which provide services such as automatic reporting in the event of an accident, recording of the circumstances of the accident, and support alerts for safe driving. However, the driving recorders currently in use have a problem in that these services do not function unless there is an impact that reacts to an acceleration sensor or the like. Therefore, a driving recorder using the present invention is suitable because it can detect troubles that do not involve impacts, and can also detect poor physical condition, drowsiness, and other such conditions of the driver by changes in heart rate, and can record and store specific video data for protection.
[0102] <Use as a video recording system in nursing care facilities> Next, an application example in which the video recording system 1 according to the present invention is used as a surveillance camera in a nursing care site will be described.
[0103] FIG. 3 is a schematic explanatory diagram showing an embodiment in which the video recording system 1 is used as a monitoring camera in a care site, and shows the state of a room R for a care recipient Y in a care facility.
[0104] 3, an image capturing device 2 is installed on the ceiling of a living room R, and the entire living room R is captured by this image capturing device 2. The state of the care recipient Y in the living room R is constantly captured, and even when a caregiver Z enters the room to provide care, the state of care including the caregiver Z is captured. In FIG. 3, one imaging device 2 is installed in one room, but two or more devices may be installed, and the installation location is not limited to the ceiling, but may also be on a wall, a desk, or a shelf.
[0105] The image capturing device 2 is equipped with a camera function 21 and a microphone function 22, and is configured to constantly record as image data not only images but also sounds (including voices and sounds) generated in the living room R. Unless otherwise specified, the term "image data" in this specification includes sounds as well as images.
[0106] In Figure 3, the photographing device 2 includes a microphone function 22 and is installed as an integrated piece of equipment, but since the microphone function 22 built into the photographing device 2 alone may not be able to pick up sounds from the entire room R, one or more devices with a microphone function may be installed in various places in the room R separately from the photographing device 2.
[0107] It is preferable to install a plurality of separate devices having microphone function 22 in various places used by care recipient Y, such as the room R of care recipient Y, the dining room, hallway, bathroom, toilet, etc. of the care facility. As described later, the video recording system 1 according to the present invention is configured to detect trouble, etc., by the generation of a specific sound, so it is necessary to prepare an environment in which all sounds generated in various places can be received and collected without omission.
[0108] If the photographing device 2 is equipped with a recording function 23, the photographed video is recorded as video data in this photographing device 2. If the photographing device 2 is not equipped with a recording function 23, the video data is transferred using an optional communication function 24 to another device with a video recording function, such as another computer (including a server) C, and the video data is recorded. The video data recorded here is configured so that new video data is written over old video data in sequence, that is, it is recorded in a circular manner.
[0109] The contents of this video data are monitored in real time by the sound determination function 25, the contents of the sound data included in the video data are constantly checked, and the occurrence of a specific sound is constantly monitored. Specifically, what is assumed to be a specific sound is compiled into a database, and sounds generated at the nursing care site are collated with the contents of the database to constantly determine whether or not a specific sound has occurred. Details of this specific sound will be described later.
[0110] When the generation of a specific sound is detected, this is deemed to be the occurrence of a trouble, and from among the recorded video data, a specified period of video data before and after the occurrence of the trouble is selected and protected so that it will not be deleted by overwriting. The specified period for which the video data is protected can be set arbitrarily.
[0111] As a means for protecting the video data for a predetermined period of time before and after the occurrence of a problem, a means for transmitting the video data to another device having a data recording function via a network may be adopted. For example, a method for protecting the video data by transmitting the video data to a computer or a mobile information terminal owned by a care facility or a family member of the person receiving care may be adopted.
[0112] Furthermore, when the generation of a specific sound (occurrence of trouble) is detected, a notification is sent to pre-designated persons (hereinafter also referred to as "notification recipients"), such as the care facility manager, each caregiver, and the family of the person being cared for. Specifically, the notification is sent to the pre-designated notification recipients' mobile phones, smartphones, personal computers, etc. via e-mail, SNS, dedicated application software, etc.
[0113] Furthermore, when the occurrence of a specific sound (occurrence of a trouble) is detected, the video data for a predetermined time before and after the occurrence of the specific sound that has been protected as described above can be played back, and the video can be confirmed. In other words, unless the occurrence of a trouble is detected, the viewing of the video data may be restricted. This is because if the video data is always viewable, there is a risk of violating the privacy of the person being cared for.
[0114] In this manner, an example in which the video recording system 1 according to the present invention is applied to a surveillance camera in a nursing care site is characterized in that the occurrence of a specific event such as a problem is judged and detected by sound.
[0115] So far, it has been explained that the means for detecting the occurrence of trouble is a specific sound generated at the nursing care site, but it can also be used for detecting a change in the heart rate of the subject M. The means for detecting trouble at the nursing care site may be either a change in the heart rate of the subject M or the generation of a specific sound, or both.
[0116] In an example in which the video recording system 1 according to the present invention is applied to a surveillance camera in a care site, unlike a conventional surveillance camera, the subject of surveillance is not the care recipient Y but the caregiver Z. Therefore, the subject of surveillance M becomes the caregiver Z here.
[0117] A caregiver Z, who is a person M to be watched over, wears a wearable device G (such as a smart watch) with a heart rate measurement function as a heart rate measurement device 3, and the heart rate is constantly measured. In the field of caregiving, troubles can occur due to verbal abuse or harassment from the care recipient Y or his / her family or other related parties, or due to the behavior of caregiver Z. Regardless of the cause, caregiver Z will feel agitation, anxiety, tension, or stress caused by anger, etc., and in many cases, his / her heart rate will increase. By detecting this increase in heart rate as a sign of trouble, it is possible to reliably detect the occurrence of trouble in the field of caregiving. Although the subject whose heart rate is to be measured can be the care recipient Y, many of the care recipients Y suffer from dementia, etc., and problems such as the care recipient Y removing the heart rate measuring device 3 without permission can easily occur. As described above, a change in blood pressure may be used as well as a change in heart rate to detect the occurrence of a problem. In this case, the heart rate measuring device 3 worn by the caregiver Z, who is the subject M, is assumed to have a blood pressure measuring function.
[0118] When the video recording system 1 according to the present invention is used as a surveillance camera in a care site, the occurrence of trouble can be detected more reliably by detecting changes in the heart rate of the person M as the occurrence of trouble and also detecting the occurrence of a specific sound as the occurrence of trouble. Since neither changes in heart rate nor the occurrence of a specific sound are detected by video, there is no need to monitor the video at all times, and the privacy of the person Y who is being cared for can be protected.
[0119] <Detailed explanation of the video recording system in the nursing care field> Next, a detailed configuration of the video recording system 1 according to the present invention used in a nursing care site will be described. The video recording system 1 is composed of a photographing device 2 and a heart rate measuring device 3.
[0120] The photographing device 2 has a camera function 21 and a microphone function 22, and may also have a recording function 23, a communication function 24, and a voice determination function 25 within the same device. In other words, some or all of the functions of the recording function 23, etc. may be integrated into one or more devices. Therefore, for example, the recording function 23 may use the functions of a separate recording device.
[0121] An embodiment of the photographing device 2 is shown in FIGS. 4 shows an example of a configuration in which the various functions are integrated, with the camera function 21, microphone function 22, recording function 23, communication function 24, and voice determination function 25 being configured as a single device (hereinafter referred to as an "integrated type"). If an integrated type configuration is adopted for the imaging device 2, the task of installing it in the room of the care recipient or the like is easy and simple.
[0122] 5 shows an example in which some functions are integrated, but other functions are configured separately (hereinafter referred to as "separate type"). Specifically, the camera function 21, microphone function 22, and communication function 24 are configured as one device (imaging device 2) and installed in room R, and the recording function 23, communication function 24, and voice determination function 25 are incorporated in computer C in another room connected to this via network N.
[0123] In the case of the separated type shown in FIG. 5, video data consisting of images and sounds photographed and collected by the camera function 21 and microphone function 22 is transferred to a computer C via a network N.
[0124] The video data transferred to computer C is cyclically recorded using the recording function 23. The transferred video data is also judged in real time using the audio judgment function 25 to see whether it contains a specific sound. If it is judged that the specific sound is included, this is determined to be the occurrence of a problem, and the video data for a predetermined period of time before and after the occurrence of the problem is protected from being erased. In addition, in the separate type, if the communication function 24 of the imaging device 2 detects a change in the heart rate of the subject M (caregiver Z), the information is transferred to computer C, and the video data before and after the occurrence of the trouble is protected from being erased in computer C.
[0125] The video recording system 1 used in a nursing care site has a voice determination function 25 . The voice determination function 25 is a function that determines whether or not the voice received and collected by the microphone function 22 matches a specific voice that has been set in advance. If the voice generated at the care site matches this specific voice, it is determined that a problem has occurred. Specifically, this specific voice is stored in a database in advance, and is compared with the voice generated at the care site to constantly determine whether or not the specific voice has been generated.
[0126] There is no limitation on the specific configuration of the voice determination function 25. For example, a program for performing the above-mentioned determination can be created and installed in a computer C such as a personal computer, tablet computer, or server. In addition, AI (artificial intelligence) may be used to determine whether or not a particular voice matches. By having a computer learn (deep learning) particular voices and dealing with all volumes, tones, dialects, intonations, etc., it is possible to accurately determine whether or not a voice that is being produced corresponds to a particular voice.
[0127] Regarding the network The network N is a communication means used when the photographing device 2 and the heart rate measuring device 3 send and receive information, and when the functions included in the photographing device 2 are separated into two or more devices (separate type) and information is sent and received between each device having these functions. Specifically, communication infrastructure such as wired or wireless LANs (Local Area Networks) and WANs (Wide Area Networks), as well as telephone lines and mobile phone lines, can be used.
[0128] It is assumed that in nursing care facilities, wired or wireless LAN will often be used as the network N used in the present invention. However, in order to introduce a new wired LAN to a care facility that does not have LAN facilities or does not have sufficient LAN facilities, it is necessary to lay cables throughout each location and room, which poses a problem of high introduction costs. There is also the problem that it is not suitable for use with mobile information terminals such as smartphones and tablet terminals. Wireless LAN is suitable for use with mobile information terminals, but in care facilities, concrete walls and fireproof doors are obstacles to radio wave propagation, so repeaters must be installed in various places, which also poses a problem of high introduction costs. In care facilities, cables for watching television are often laid in each room, and there is a way to use these cables as LAN cables, but converters and the like are required, so it is difficult to keep costs down.
[0129] In such a case, it is preferable to use a mobile phone line as the network N. Recently, the fifth generation mobile communication system (commonly known as "5G") has started to be introduced, and it is considered that the communication capacity of the mobile phone line is sufficient even when transmitting video data. If a mobile phone line is used as the network N, the video recording system according to the present invention can be used even in places where there is no network environment, such as at the site of a home care service.
[0130] As described above, examples of the network N used in the present invention include mobile phone lines such as 5G, and it is preferable to use local 5G technology. Local 5G is a 5G network that can be used individually by local companies and local governments that are not telecommunications carriers, depending on the needs of the region or industry. In contrast to the uniform 5G communication services that telecommunications carriers deploy nationwide, local 5G allows regions and companies to build, operate, and use their own 5G networks in specific areas, such as within their own buildings or premises. By using this technology, a local 5G network can be formed, for example, within a single nursing facility or a specific area that includes multiple nursing facilities, and when a problem occurs, information can be shared between teams that have established a cooperative system, whether within the same facility or between different facilities. This allows a team of multiple people to respond to problems that occur, especially at night when there is a shortage of manpower.
[0131] Regarding specific audio Next, a means for determining whether a specific voice has occurred according to the present invention will be described. In the present invention, the occurrence of trouble in a care setting refers to verbal abuse, physical abuse, power harassment, sexual harassment, and the like that occurs between a caregiver and a care recipient.
[0132] The video recording system 1 used in nursing care facilities uses the occurrence of a specific sound as a determining factor for the occurrence of a problem. The specific voice refers to a voice that is emitted by a human being and that may be emitted when a problem occurs in a care facility. Specifically, this includes verbal abuse, mental violence, power harassment, or sexual harassment uttered by the person receiving care, their family members or other related parties, or the caregiver.
[0133] 〇Prohibited words The present invention is characterized in that it focuses on "prohibited words" in nursing care sites as the above-mentioned specific sounds. These prohibited terms are terms that have been defined by each care facility or care organization as terms that must not be uttered in the care setting, and are terms that each facility or organization has defined independently. In other words, prohibited words are words that caregivers should not use when speaking to those they are caring for, in order to protect the human rights and dignity of those they are caring for. These prohibited words are originally rules for caregivers, but even if the care recipient or their family uses prohibited words against the caregiver, it may be considered power harassment or sexual harassment, and some kind of trouble may have occurred.
[0134] Examples of prohibited words include calling someone by their first name, nicknames, you, commanding language such as "Do this!", "Hurry up!", and "Stop it!", and negative words such as "gross," "dirty," and "in the way." In addition, words that express problems specific to the care recipient can also be set as prohibited words, such as the name of the disease the care recipient is suffering from (especially if the care recipient has not been informed of the name of their disease), and political or religious matters on which opinions are divided depending on the care recipient's ideology or beliefs.
[0135] Additionally, regardless of the content of the words, voices that are louder than necessary, shouting or threatening voices, voices that include sighs, etc. are also considered inappropriate in nursing care settings. Therefore, such tones of voices may also be set as specific sounds, regardless of whether they correspond to prohibited words or not.
[0136] In the video recording system 1 according to the present invention, the prohibited words defined by each care facility or each care organization are compiled into a database, and the voice determination function 25 compares and determines the prohibited words with voices uttered at the care site. It is preferable to train a computer to learn these prohibited words and use AI to make judgments. Specifically, the computer is trained to handle each prohibited word in a variety of volumes, tones, dialects, intonations, etc., so that it can accurately judge whether a voice uttered in a nursing care setting corresponds to any of the prohibited words.
[0137] The content of these prohibited words can be arbitrarily set according to the care facility or the like in which the video recording system 1 is installed. In addition, it is preferable that the prohibited words set here are classified into several levels in terms of content, and it is possible to arbitrarily set which level of prohibited words is detected and the video data is saved and a notification is sent to the administrator or the like.
[0138] Furthermore, by detecting sounds of beatings and falls in addition to the above-mentioned prohibited words and treating them as specific sounds, it is possible to more reliably detect the occurrence of trouble, etc. Specifically, by detecting sounds of beatings, it is possible to detect the high possibility that some kind of trouble (violence, etc.) has occurred between the care recipient and the caregiver, and by detecting sounds of falls, it is possible to detect the high possibility that the care recipient has experienced health trouble (falling or fainting).
[0139] 〇Specific desire term It is preferable to employ specific desire terms together with the above-mentioned prohibited terms as elements (specific sounds) for detecting the occurrence of trouble, etc. The specific desire terms will be described below.
[0140] Specific desire terms are words that the care recipient utters to the caregiver, etc., and are words that express their own desires and wants as abusive language. These specific desire terms can sometimes be uttered as abusive language, and the care recipient may not be able to express their own desires and wants well, which can lead to trouble in the field of care.
[0141] Specifically, the following applies: Many of the care recipients are elderly, and their memory and judgment abilities are impaired, and many of them suffer from dementia. The stress of being unable to control their mind and body can lead to a variety of symptoms, such as abusive language and violence, wandering around without permission, and delusions of theft, such as claiming that their wallet or other items have been stolen, which are not true. These symptoms are called BPSD (Behavioral and Psychological Symptoms of Dementia), and are said to be behavioral and psychological symptoms of dementia. This BPSD can manifest as abusive language, which, when directed at caregivers, often causes anger and stress in the caregiver. In particular, inexperienced caregivers may not understand that abusive language by care recipients, i.e., the use of specific desire terms, is a type of BPSD and is an unavoidable symptom, and this can lead to problems.
[0142] In the field of nursing care, the care recipient is considered to be a weak person, and abusive language by the care recipient is considered to be an expression of their own desires and wants. Therefore, the abusive language by the care recipient can be defined as a specific desire term, and when this specific desire term is uttered, there is a risk of trouble occurring, so it is preferable to detect it as a specific voice.
[0143] If the system is configured to record video data when specific need terms are generated, it can be used as verification material when some kind of trouble occurs, and can also be used as educational material for inexperienced caregivers. Furthermore, if the system is configured to immediately notify the caregiver when the generation of a specific need term is detected, the caregiver can be made aware that it is a symptom of BPSD, and anger and stress can be suppressed, which can prevent or suppress the development of trouble.
[0144] The following words can be cited as specific desire terms: Insulting words used against caregivers include calling them "stupid," "idiot," "slow," "useless," etc. Words that constitute power harassment using a superior position include "take responsibility," "don't disobey," "quit," and "you're useless," while words that constitute sexual harassment include "let me touch you" and "ugly."
[0145] The purpose of using the occurrence of this specific desire term as a specific sound to detect the occurrence of trouble, etc. is to protect caregivers from harassment by the care recipients and their families, etc. Conventional surveillance cameras and surveillance systems in nursing care facilities have been introduced with the idea of protecting or watching over the care recipients by monitoring for abusive language or violence from caregivers toward the care recipients.
[0146] On the other hand, in the current nursing care field, there are many cases of harassment (power harassment consisting of abusive language, sexual harassment consisting of sexual verbal behavior, etc.) from the care recipients and their families against caregivers, which causes mental stress for caregivers. This stress can lead to a loss of motivation, resulting in many caregivers leaving the company, and the strong stress can lead to aggressive feelings, which can manifest in the form of abusive language or violence against the care recipients.
[0147] Therefore, the idea of protecting and watching over caregivers is necessary. This will help to solve the problem of caregivers quitting their jobs, and it is also expected to have the effect of preventing and suppressing troubles such as verbal abuse and violence against those receiving care. This invention is novel and original in that it is inspired by the idea of protecting or watching over caregivers in any care setting, and aims to ensure the safety of caregivers working in care settings, help build a working environment where they can continue to work with peace of mind, and ultimately lead to the securing and retention of human resources. This feature and purpose is expressed in the fact that specific desire terms are sensed as factors that predict the occurrence of trouble.
[0148] As described above, the specific desire term is a word uttered by a caregiver. Therefore, in determining whether or not a voice is a specific desire term, if it is possible to determine whether or not the voice is uttered by a caregiver, the accuracy of the determination can be increased. Whether or not the voice being uttered is made by the care recipient can be determined by registering the voiceprint of the care recipient in advance in the determination device.
[0149] It is well known that a voiceprint is a sonagram that is the result of frequency analysis of a voice, and is known to differ from person to person. By registering the voiceprint of the care recipient in advance and equipping the system with a function to analyze the voice uttered at the care site and convert it into a voiceprint, it is possible to reliably determine the occurrence of specific desire terms. In addition to specific desire words, voiceprints can also be used to determine the above-mentioned prohibited words. That is, the voiceprints of the caregivers in charge are also registered in advance, and by comparing them with the voiceprints of the voices uttered at the care site, the reliability of the determination of prohibited words can be increased.
[0150] Speech lock In addition to the above-mentioned prohibited words and specific desire words, speech locks, which are words and actions that are considered inappropriate in the nursing care field, may also be used as a specific sound to detect the occurrence of trouble, etc. Speech lock refers to verbal restraint of physical or mental behavior, and is a term used by caregivers to restrain the care recipient. It is widely known that physical restraint of the care recipient is not desirable, but speech lock, which verbally restrains the care recipient's behavior, has also been recognized in recent years as a term that should not be used in the field of care.
[0151] Examples of speech locking words include words that inhibit or restrict the behavior of the care recipient, such as "Don't move," "Don't stand, just sit down," etc. Although such words are sometimes uttered by caregivers without any malicious intent to ensure the safety of the care recipient, they may make the care recipient feel uncomfortable. To avoid speech lock, it is preferable to replace "Don't move" with "Could you please wait a moment?" and "Don't stand up, stay sitting down" with "It's dangerous if you do this, so could you please stay sitting down?" etc.
[0152] Use of AI deep learning As described above, it is preferable to employ prohibited words, specific desire words, or speech lock as elements for detecting the occurrence of trouble or the like.
[0153] On the other hand, it is not easy to determine whether an uttered word corresponds to these terms. There are differences in the use of words and intonation depending on the speaker, and when dialects are also taken into consideration, there is a certain degree of variability in determining whether a word corresponds to a prohibited term. In order to accurately determine whether a word corresponds to a prohibited term while taking into account the existence of this variability, it is preferable to use AI deep learning technology.
[0154] After organizing and accumulating information from actual care sites, a computer can be trained to improve the accuracy of determining whether or not a prohibited word is used. The contents that the computer can be trained on can include, for example, words actually spoken in care sites and the results of the determination of whether or not the words are used as prohibited words, the circumstances in which the prohibited words were spoken, and dialects in each region. Furthermore, as described above, if the voiceprints of the care recipient and the caregiver are registered in the computer, it can be determined whether the speaker is either the care recipient or the caregiver, or a third party, which allows for even more accurate determination of whether or not a word is used.
[0155] The specific content and standards of prohibited words, specific desire words, or speech locks may be set arbitrarily by each nursing care facility, nursing care association, or other organization. It is preferable to operate the video recording system according to the present invention after reflecting any setting.
[0156] Use of glasses-type wearable devices Next, application examples of the video recording system 1 will be described. All or part of the functions of the video recording system 1 can be installed in a glasses-type wearable device G. As shown in Fig. 6, if a camera function G1 and a microphone function G2 are installed in a glasses-type wearable device G, it can be used as an image capturing device 2. By having a caregiver Z wear the glasses-type wearable device G, images and sounds of the line of sight and surroundings of the caregiver Z can be captured and received, which has the advantage that the video recording system 1 according to the present invention can be used even in care settings where fixed cameras are not installed, such as home care or nursing care settings.
[0157] This eyeglass-type wearable device G can be equipped with all or some of the functions such as a camera function G1, a microphone function G2, a recording function G3, a communication function G4, a determination function G5, a display function G6, and / or an intercom function G7. It is even more preferable if the function of a heart rate measuring device 3 can be equipped. The communication function G4 used here is a function for transmitting and receiving information using any wireless network (e.g., Bluetooth (registered trademark)) with a wearable terminal W with a heart rate measuring function that is separately worn by the caregiver Z, who is the subject M. If the heart rate of the subject M is constantly transmitted from the wearable terminal W with a heart rate measuring function worn by the subject M to a glasses-type wearable device G also worn by the subject M, when the judgment function G5 of the glasses-type wearable device G judges that there is a change in the heart rate set in advance, this will be detected as the occurrence of a problem, and the video data before and after the occurrence of the problem can be protected.
[0158] In addition, the communication function G4 is used for purposes such as transferring video data captured by the camera function G1 of the glasses-type wearable device G to other devices and notifying pre-registered persons who need to be notified when a problem is detected.
[0159] The judgment function G5 is a function that constantly monitors the heart rate transmitted from the wearable device W with a heart rate measuring function worn by the subject M, and judges whether or not the heart rate changes according to a preset value. It is also a function that judges whether or not a specific voice is present. In other words, the occurrence of a problem is detected by this judgment function G5. There is no limitation on the specific configuration of the glasses-type wearable device G used in the present invention. Any known and publicly used technology for glasses-type wearable devices can be used without any particular limitations.
[0160] Next, the display function G6 and the intercom function G7 will be described. These functions are used when caregiver Z, who is the person M being watched over, contacts and exchanges information with caregivers in other locations. The display function G6 and intercom function G7 are particularly useful for caregiver Z who is providing care alone. When providing home care or working night shifts, caregiver Z is often forced to provide one-on-one care with care recipient Y, and there are often no other caregivers nearby. In such an environment, for example, inexperienced caregivers, there are many cases where unexpected situations arise and they have difficulty responding. When such an incident occurs, if the display function G6 and intercom function G7 can be used to exchange information with caregivers in other locations, it is possible to receive appropriate support and advice.
[0161] As mentioned above, the glasses-type wearable device G has a communication function G4, and can communicate with other computers and smartphones with communication functions via a network. This allows not only voice calls but also the sending and receiving of images and documents, so that, for example, it is possible to send an image of the situation at a home care facility and receive advice or points out problems from caregivers in other locations.
[0162] With the display function G6, it is possible to view video data and materials sent by caregivers in other locations. For example, if a video lecture on how to care for a patient is sent and the caregiver can view this while providing care, the caregiver can respond appropriately even if the caregiver is unfamiliar with the task or manner. In addition, if a problem occurs with one of the caregivers working as a group team, such as at the same care facility or affiliated care facilities, and this is detected by a change in heart rate or a specific sound, a configuration may be adopted in which the image of the problem occurring is displayed on the display of the other caregivers in the same group team. This allows the other caregivers in the same group team to immediately grasp the situation of the problem, and if necessary, they can rush to help or use the communication function G4 to give advice, etc. It is preferable that group teams of the same care facility or affiliated care facilities be able to communicate at all times via the local 5G communications network described above.
[0163] An intercom is a type of on-premise telephone used in operations that require simultaneous command to moving staff, and is sometimes called a mutual communication on-premise telephone. The intercom function G7 used in the present invention has the same functions as this intercom, and is a communication function that is not limited to a communication range within the premises, but can be used over a wide area via a network such as a mobile phone line. In other words, it has a communication function and a speech function (having at least a microphone function and a speaker function). By using this intercom function G7, if a problem occurs with one of the caregivers working as a group team in the same nursing facility or affiliated nursing facilities, the other caregivers in the group team can all call and communicate at once. This allows the other caregivers in the group team to immediately understand the situation and, if necessary, can rush to help or use the communication function G4 to give advice.
[0164] This intercom function G7 is preferably provided in the temple portion of the glasses-type wearable device G, as shown in FIG. The temple portion is a rod-shaped portion for hanging the glasses-type wearable device G on the wearer's ear. It is preferable that the microphone portion be configured to be able to be brought closer to the wearer's mouth by moving a part of the temple portion downward. When the intercom function G7 is not in use, it can be stored in the temple section and does not interfere with the movement during caregiving, and when the intercom function is in use, the microphone section can be brought close to the mouth to make it easier to pick up what the wearer is saying. It is preferable that the speaker section be provided in a position on the temple section close to the wearer's ear.
[0165] Another function that may be provided in the glasses-type wearable device G is a function for maintaining an appropriate distance between the caregiver Z and the person being cared for Y. One of the causes of trouble between caregiver Z and care recipient Y is when the physical distance between them is too close or too far during caregiving. If the distance between the two is too close, care recipient Y (especially those with dementia) may suddenly become angry due to surprise or discomfort, and as a result may verbally abuse or become violent towards caregiver Z. If the distance between the two is too far, care recipient Y may feel uncomfortable that he or she is not being cared for carefully, which may also lead to verbal abuse or violence. To eliminate such problems, caregiver Z needs to maintain an appropriate distance from care recipient Y. Therefore, it is preferable that the glasses-type wearable device G is equipped with a function that measures the distance between the wearer, caregiver Z, and the person in need of care Y, and notifies the caregiver Z by means of an alarm or other means if the distance is outside a preset appropriate distance range. By equipping the device with this function, it is possible to notify the caregiver Z if he or she unconsciously gets too close to the person in need of care Y, helping both parties to maintain an appropriate distance.
[0166] * Use as a remote medical treatment tool As mentioned above, care recipient Y often suffers from dementia. On the other hand, many are suspected of having dementia but have not been diagnosed by a doctor. Only a doctor can diagnose whether or not someone has dementia, but going to a doctor just to receive a diagnosis is not easy due to issues such as a shortage of caregivers.
[0167] Therefore, by transmitting the video data stored by the video recording system 1 to a doctor and having the doctor review it, it is possible to diagnose whether the care recipient Y has dementia as part of remote medical treatment. In particular, video data stored upon detecting the occurrence of a problem or the like often contains behavior specific to dementia, making it ideal for diagnosing dementia. It is also important to note that the precautions to take in daily life and treatment methods vary depending on the type of dementia that is diagnosed. For example, a characteristic of Alzheimer's is "spatial agnosia," where the brain cannot recognize what the eyes can see. If caregivers are aware of this, they can provide higher quality care and may be able to reduce verbal and physical abuse by the dementia care recipient. By creating a database of protected footage during incidents and collaborating with dementia specialists and national-level dementia research institutions, it will be possible to effectively utilize this information in formulating more detailed dementia diagnostic criteria and developing dementia treatment drugs.
[0168] Furthermore, the video recording system 1 using the above-mentioned glasses-type wearable device G can capture the condition of the cared for person Y from a close distance, and by transmitting the vital signs of the cared for person Y along with this video data, more information can be sent to the doctor, making it ideal for remote medical treatment. Furthermore, the doctor can use the intercom function G7 or the like to instruct the caregiver Z on the areas that need to be photographed, making it a useful tool for remote medical treatment.
[0169] Use as a means to prevent aspiration As described above, if the video recording system 1 is installed in the eyeglass-type wearable device G, the condition of the care recipient Y can be captured from the viewpoint of the caregiver Z, which can be used for various purposes.
[0170] One example is the function of preventing aspiration when assisting with eating in a room or dining room. Care recipient Y often has difficulty swallowing food and drink that has been put in the mouth and sent to the stomach due to organic or functional factors such as aging, which is called a swallowing disorder. This swallowing disorder often leads to life-threatening situations such as choking due to food getting stuck in the throat, or aspiration pneumonia caused by aspiration. Caregiver Z must be extremely careful when assisting care recipient Y with meals to prevent aspiration, etc. According to the "Monthly Vital Statistics Annual Total (approximate figures)" published by the Ministry of Health, Labor and Welfare, the number of deaths caused by aspiration pneumonia was 38,462 in 2018. Of pneumonia patients aged 70 or older, more than 70% had aspiration pneumonia, indicating that it is a common disease, especially among the elderly. The number of deaths from aspiration pneumonia is expected to increase in the future, and is predicted to rise to approximately 70,000 men and 50,000 women, totaling approximately 120,000, by 2030. These statistical data and predictions also show the importance of measures to prevent aspiration in nursing care settings.
[0171] However, it is particularly difficult for inexperienced caregiver Z to properly assist with meals while taking into account the swallowing function, physical condition, etc. of the person being cared for Y. If the video recording system 1 can be used to assist with appropriate meal assistance, it would be significant in preventing problems such as aspiration.
[0172] In the present invention, as a means for preventing or suppressing the occurrence of aspiration, attention is paid to the posture of the care recipient Y when eating. That is, as shown in FIG. 7(a), if the care recipient Y eats with his / her back straight and his / her pelvis upright, it is known that the risk of aspiration is small. On the other hand, as shown in FIG. 7(b), if the care recipient Y eats with his / her back hunched and his / her pelvis not upright, it is known that the risk of aspiration is large. In the present invention, attention is paid to the posture when eating, and a means for preventing or suppressing aspiration is adopted.
[0173] If caregiver Z assists with eating while wearing glasses-type wearable device G with camera function G1, the care recipient Y's posture when eating can be recorded. This recorded video data is analyzed in real time, and if it is detected that the care recipient Y's back is not straight or the pelvis is not upright, it notifies caregiver Z of this. Caregiver Z who receives this notification can encourage care recipient Z to correct his / her posture, so that the care recipient Z can eat in the correct posture.
[0174] In the above-mentioned video data analysis, specifically, it is preferable to grasp the position of the head of the care recipient Y and judge whether the care recipient Y is eating in a correct posture. As shown in Fig. 7(a), if the head of the care recipient Y is located directly above the torso, it can be determined that the posture is correct, and as shown in Fig. 7(b), if the head of the care recipient Y is protruding in another direction, such as forward, from directly above the torso, it can be determined that the posture is not correct. In this way, if the risk of aspiration, etc. can be determined based on the position of the head of the care recipient Y, there is no need to use advanced image analysis, etc., and a video recording system 1 with aspiration prevention function can be provided at low cost.
[0175] * Linking with other sensors The video recording system 1 of the present invention can work in conjunction with other sensors installed at the care site to quickly detect changes in the physical condition or health problems of the person being cared for, and take more appropriate measures. For example, if information obtained from infrared sensors, mat sensors, microwave sensors, vital data measuring devices, nurse call systems, etc. that may be installed in the room R of the care recipient Y can be added to the information obtained from the video recording system 1, it will be possible to reliably detect any potential problems that may occur in the care setting.
[0176] By utilizing the above-mentioned application example of the glasses-type wearable device G, information obtained from other sensors in addition to the video recording system 1 can be notified via the network N, and the caregiver Z who is wearing the device can be promptly notified of the occurrence of a problem, etc. The caregiver Z can visually check the notified information displayed on the glasses-type wearable device G. In this way, information can be received and confirmed without using hands, which is particularly convenient when caring for other people.
[0177] -Collecting research materials The video recording system 1 according to the present invention is also useful as a means for collecting research materials related to nursing care. By using the video recording system 1, every time a problem occurs in the nursing care site, video footage before and after the problem occurs is saved, and this video data can be accumulated. Using this video data, it is possible to understand the causes of problems and situations in which problems are likely to occur, to study tendencies in how to handle problems, solutions to problems, and measures to avoid problems.
[0178] Currently, the solutions and avoidance measures for problems in the field of nursing care largely depend on the know-how of each nursing facility and caregiver, and this know-how is not shared among nursing care facilities nationwide. As a result, there are differences in the level of understanding and ability to solve and avoid problems between nursing facilities and caregivers. If the video data accumulated by the video recording system 1 of the present invention can be used to research solutions and avoidance measures for problems and if this information is made public to care facilities across the country, it will be possible to reduce problems in care facilities nationwide.
[0179] Use as a nursing record The video data stored by the video recording system 1 can be used as a care record. At the end of the day's shift, the video data can be reviewed and a care record can be created, ensuring accurate records. This reduces the amount of work required for handing over tasks. In addition, the video data itself can be saved as a care record, and the video can be reviewed and used to verify any trouble or illness that occurs later.
[0180] * Use as a training tool for new caregivers, etc. The video data stored by the video recording system 1 can be visualized and made visible as teaching material for training and instruction for caregivers, and the information can be shared and used. The saved video data is a video recording of problems that occur in the nursing care field, and can be used as teaching material, for example, to show these cases to new or inexperienced caregivers and instruct them on how to deal with them.
[0181] Regarding each function, use example, application example, etc. described in this specification, two or more functions, use examples, application examples may be combined and used without any particular restrictions. [Explanation of symbols]
[0182] 1. Video recording system 2. Imaging Device 21 Camera Function 22 Microphone Function 23 Recording function 24 Communication Functions 25 Voice detection function 3. Heart rate measuring device C Computer S Mobile information terminal G Glasses-type wearable device G1 Camera Features G2 Microphone Function G3 Recording Function G4 communication function G5 Judgment function (heart rate, voice) G6 Display Features G7 Intercom Function W Wearable device with heart rate measurement function N Network (wired and wireless) M. Person to be monitored Y Care recipient Z. Caregiver R living room
Claims
1. A video recording system used as a driving recorder, In a video recording system for monitoring a subject, a cyclical recording system is adopted in which the captured video is constantly recorded and new video data is sequentially overwritten onto old video data. When a trouble is detected, video data of a predetermined time before and after the trouble is selected and protected from being deleted by overwriting, The means for detecting the occurrence of a problem is a change in the subject's heart rate, The subject is a driver of a vehicle; This video recording system is characterized in that the heart rate of a driver of a vehicle equipped with a driving recorder is constantly measured, and any change in the heart rate is detected as an occurrence of a problem.
2. 2. The video recording system according to claim 1, wherein the subject's heart rate is constantly measured by a wearable terminal with a heart rate measuring function worn by the subject, and this information is transmitted to the video recording system.
3. The subject's heart rate is detected when a sudden increase or decrease in heart rate is measured, 3. The video recording system according to claim 1, wherein a heart rate exceeding a preset rate of increase or decrease is detected based on the subject's normal heart rate.
4. 4. The video recording system according to claim 1, wherein the pulse of the subject is sensed when a state of tachycardia or bradycardia is measured.
5. A video recording system as described in any one of claims 1 to 4, characterized in that the subject's cardiac condition is constantly monitored by a wearable terminal with an electrocardiogram function, and any symptoms of atrial fibrillation are detected.
6. The means for detecting the occurrence of a problem is a change in the subject's heart rate and blood pressure, A sudden increase or decrease in the subject's blood pressure is detected, 6. The video recording system according to claim 1, wherein the system is configured to detect when a preset rate of increase or decrease is exceeded based on the subject's normal blood pressure.
7. 7. The video recording system according to claim 1, further comprising a configuration in which, when an occurrence of a trouble is detected, a driver is notified.
8. 8. The video recording system according to claim 1, further comprising a configuration for slowing down or stopping a vehicle driven by the subject person when the occurrence of a trouble is detected.
Citation Information
Patent Citations
Decision device, decision method and decision program
JP2011028332A
Biological state monitoring apparatus
JP2012081194A
Drive recorder
JP2018041122A
Drive recorder
JP2020091589A
Driving recorder
JP1993197858A