Behavior determination device, method, and program

The device determines the order of initiation of contact acts by comparing body movement detection times, enhancing interaction analysis and reducing power consumption in interhuman communication systems.

JP7622841B2Active Publication Date: 2025-01-28NIPPON TELEGRAPH & TELEPHONE CORP
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023529239
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-06-21
Publication Date
2025-01-28
Estimated Expiration
2041-06-21

AI Technical Summary

Technical Problem

Existing interhuman communication technologies cannot accurately determine the order of initiation of contact acts between individuals, limiting the detailed understanding of the status of such interactions.

Method used

A device and method that detects and compares the body movements of individuals before and during contact, using interhuman communication to determine the order of initiation of the act by comparing detection times of body movements.

Benefits of technology

Enables detailed tracking of the initiation order of contact acts, facilitating better understanding of both normal and unexpected interactions, and reducing unnecessary power consumption by triggering communication only upon contact.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007622841000001
    Figure 0007622841000001
  • Figure 0007622841000002
    Figure 0007622841000002
  • Figure 0007622841000003
    Figure 0007622841000003
Patent Text Reader

Abstract

An action determination device according to an aspect of the present invention, when determining an action including a contact between a first subject and a second subject by utilizing person-to-person communication between the first subject and the second subject, detects a first bodily motion presaging the action and a second bodily motion at the time of occurrence of the action, and acquires the respective times of detection. Then, when a contact occurs due to the action between the first subject and the second subject, the action determination device uses the person-to-person communication between the first subject and the second subject to transmit the time of detection of the first bodily motion and the time of detection of the second bodily motion to each other. Then, the action determination device compares the time of detection of the first bodily motion and the time of detection of the second bodily motion that have been transmitted, and determines the starting order of the action between the first subject and the second subject on the basis of the result of comparison.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] One aspect of the present invention relates to an action determination device that determines the state of an action, for example, when a person performs an action including physical contact, and an action determination method and program executed by the device. [Background technology]

[0002] In recent years, human body communication technology has been attracting attention as one of the short-range wireless communication technologies. Human body communication technology is a communication technology that uses the human body as a transmission path, and when people carrying terminals come into contact with each other, information is transmitted between the terminals via each person's body (see, for example, Patent Document 1, Non-Patent Document 2 or 3).

[0003] Using this technology, for example, when someone shakes hands in a social setting such as an office or event venue, this action can be recorded in a behavioral history, or when an action involving contact occurs between a medical professional or caregiver and a patient or person being cared for in a medical or nursing care setting, this action can be recorded in a work log, etc. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent No. 4069061 [Non-patent literature]

[0005] [Non-Patent Document 1] Yuichi Kado, Mitsuru Shinagawa, "RedTacton: Near-Body Electric Field Communication Technology and Its Applications," NTT Journal, January 2010, Internet<URL; https: / / www.ntt.co.jp / journal / 1001 / files / jn201001016.pdf> [Non-Patent Document 2] Mitsuru Shinagawa, "Communication Technology Using the Human Body as a Transmission Path," Journal of the Institute of Image Information and Television Engineers, Vol. 63, No. 11, pp. 1525-1530, 2009 Summary of the Invention [Problem to be solved by the invention]

[0006] However, while body-to-body communication technology can detect who has come into contact with whom, it cannot detect who attempted to make contact first. For this reason, when an action involving contact is performed between people, it is difficult to obtain a detailed understanding of the circumstances of that action.

[0007] The present invention has been made in light of the above-mentioned circumstances, and aims to provide a technique that enables a more detailed understanding of the circumstances of actions involving contact between people. [Means for solving the problem]

[0008] In order to solve the above problems, a first aspect of the action determination device or method according to the present invention is configured to, when a device for determining an action including contact between a first subject and a second subject is executed, detect a first body movement of the first subject and the second subject that is a precursor of the action and a second body movement at the time of the action, respectively, and store the detection times. Then, when the contact due to the action occurs between the first subject and the second subject, transmit the detection times of the first body movement and the detection times of the second body movement between terminals respectively held by the first subject and the second subject, compare the transmitted detection times of the first body movement and the detection times of the second body movement, determine the start order of the action between the first subject and the second subject based on the comparison result, and generate and store action determination information including information representing the determined start order of the action.

[0009] In order to solve the above problems, a second aspect of the action determination device or method according to the present invention is configured to, when determining an action including contact between a first subject and a second subject by using human body communication between the first subject and the second subject, first detect a first body movement of the first subject and the second subject that is a precursor of the action and a second body movement at the time of the action, respectively, and store the detection times. Then, when the contact due to the action occurs between the first subject and the second subject, transmit the detection times of the first body movement and the detection times of the second body movement between the first subject and the second subject by using the human body communication, compare the transmitted detection times of the first body movement and the second body movement, determine the start order of the action between the first subject and the second subject based on the comparison result, and generate action determination information including the determination result. Effect of the Invention

[0010] According to the first and second aspects of the present invention, for example, when an action involving contact between people occurs, it is possible to determine not only whether or not contact occurred, but also the start order of the action, which makes it possible to later check the situation in more detail when an unexpected action such as a violent act occurs. Also, when a normal action such as a handshake or exchange of business cards is performed, the start order of the action at that time is recorded, making it possible to later look back on the situation in detail.

[0011] That is, according to each aspect of the present invention, it is possible to provide a technology that enables a more detailed understanding of the situation of an action including contact between people. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an action management system including an action determination device according to an embodiment of the present invention. [Diagram 2]FIG. 2 is a block diagram showing an example of a hardware configuration of an action determination device according to an embodiment of the present invention. [Diagram 3] FIG. 3 is a block diagram showing an example of a software configuration of the action determination device according to an embodiment of the present invention. [Figure 4] FIG. 4 is a flowchart showing the procedure and contents of the action determination process executed by the action determination device shown in FIGS. [Diagram 5] FIG. 5 is a diagram for explaining an example of the operation of the action determination device when an action including contact is performed between users. [Figure 6] FIG. 6 is a diagram showing an example of action determination information obtained by the action determination device shown in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0014] [One embodiment] In one embodiment of the present invention, an example is given of a case where an action including contact is performed between a caregiver and a person being cared for in a care setting, and this action is determined using a communication terminal of a human body communication system as an action determination device.

[0015] (Configuration example) (1) System FIG. 1 is a diagram showing an example of the overall configuration of an action management system including an action determination device according to an embodiment of the present invention.

[0016] The system of the embodiment utilizes a human body communication system HC. When a contact action occurs between a caregiver U1 and a care recipient U2, the human body communication system HC communicates with a communication terminal T u1 ,T u2 In this embodiment, communication signals are transmitted between the communication terminals T u1 ,T u2The communication terminal T has a function as the action determination device according to the present invention. u1 ,T u2 The terminal WT determines the state of contact behavior that occurred between the caregiver U1 and the care recipient U2, and transmits behavior determination information indicating the determination result to the management terminal WT.

[0017] The management terminal WT is, for example, a personal computer, and is managed by, for example, a care facility. The management terminal WT may be a mobile information terminal such as a smartphone or tablet terminal carried by the caregiver U1.

[0018] The management terminal WT is a communication terminal T of the human body communication system. u1 ,T u2 The management terminal WT receives the activity determination information transmitted from the care receiver 1 and records the received activity determination information in the activity history database. When an output request for the activity determination information is input, the management terminal WT reads out the activity determination information from the activity history database and displays it on a display of the management terminal WT, or transmits it to a terminal used by a family member of the care receiver, for example.

[0019] The system according to the embodiment includes a server device SV. The server device SV is, for example, a server computer provided on the cloud or the Web, and is connected to the management terminal WT or the communication terminal T of the human body communication system. u1 ,T u2 The management terminal WT is used to download application programs required for the action determination process to the management terminals WT, and to receive and centrally manage action determination information transferred from the management terminals WT.

[0020] In addition, the communication terminal T of the human body communication system u1 ,T u2 The action determination information transmitted from the administrator terminal WT may be transmitted directly to the server SV without passing through the administrator terminal WT.

[0021] The network NW is composed of a wide area network including the Internet, and an access network for accessing the wide area network. As the access network, a wired or wireless LAN (Local Area Network) or a wired or wireless public network is used, but other communication lines such as a CATV line may also be used.

[0022] (2) Communication terminal T u1 ,T u2 2 and 3 are diagrams showing a communication terminal T having a function as an action determination device according to an embodiment of the present invention. u1 ,T u2 1 is a block diagram showing an example of a hardware configuration and a software configuration of the

[0023] Communication terminal T u1 ,T u2 The device includes a control unit 1 that uses a hardware processor such as a central processing unit (CPU). A storage unit having a program storage unit 2 and a data storage unit 3, a sensor interface (hereinafter, the interface will be abbreviated as I / F) unit 4, and a communication I / F unit 5 are connected to the control unit 1 via a bus 6.

[0024] A motion sensor 7 and a clock 8 are connected to the sensor I / F unit 4. The motion sensor 7 is, for example, a vibration sensor or an acceleration sensor, and detects vibrations caused by sudden movements of the arms or legs of the caregiver U1 or the care recipient U2. The sensor I / F unit 4 converts the detection signal of the vibration detected by the motion sensor 7 into digital data and inputs it to the control unit 1. The clock 8 measures the current time and outputs the measured data, and is used by the control unit 1 to obtain the detection time of the vibration. The clock 8 can be substituted by a software timer of the control unit 1. A position sensor using a GPS (Global Positioning System) or the like may be connected to the sensor I / F unit 4. The parts to be detected when detecting the body movements of the caregiver U1 or the care recipient U2 are not limited to the arms and legs, but may be any part of the head or torso.

[0025] The communication I / F unit 5 has an interface for communication between human bodies and a communication interface that adopts a short-range wireless data communication standard such as Wi-Fi (registered trademark) or Bluetooth (registered trademark). u1 ,T u2 They transmit and receive signals between the human bodies and also transmit and receive information to and from the control terminal WT.

[0026] The program storage unit 2 is configured, for example, by combining a non-volatile memory such as an HDD (Hard Disk Drive) or SSD (Solid State Drive) as a storage medium that can be written to and read at any time, and a non-volatile memory such as a ROM (Read Only Memory), and stores application programs necessary for executing various control processes related to one embodiment of the present invention, in addition to middleware such as an OS (Operating System).

[0027] The data storage unit 3 is, for example, a combination of a non-volatile memory such as an HDD or SSD, which can be written to and read from at any time, as a storage medium, and a volatile memory such as a RAM (Random Access Memory), and is equipped with a vibration model storage unit 31, a specific vibration information storage unit 32, a user information storage unit 33, and an action judgment information storage unit 34 as main storage units in one embodiment of the present invention.

[0028] The vibration model storage unit 31 stores learned data of a vibration model that is generated in advance by, for example, CNN (Convolutional Neural Network) machine learning.

[0029] The specific vibration information storage unit 32 is used to store detection information of a specific vibration pattern detected by the control unit 1 and associated with a sudden movement of the arm or leg of the care recipient U2.

[0030] The user information storage unit 33 stores the identification information (user ID) of the caregiver U1 and the care recipient U2 or the communication terminal T u1 ,T u2 The identification information (terminal ID) of the device is stored.

[0031] The action determination information storage unit 34 is used to store the action determination information generated by the control unit 1.

[0032] The control unit 1 includes, as processing functions according to an embodiment of the present invention, a vibration data acquisition processing unit 11, a specific vibration detection processing unit 12, a user information mutual transmission processing unit 13, an action determination processing unit 14, and an action determination information output processing unit 15. All of these processing units 11 to 15 are realized by causing a hardware processor of the control unit 1 to execute a program stored in the program storage unit 2.

[0033] The vibration data acquisition processing unit 11 constantly receives a vibration detection signal output from the motion sensor 7 via the sensor I / F unit 4 , and passes the received vibration detection signal to the specific vibration detection processing unit 12 .

[0034] The specific vibration detection processing unit 12 analyzes the vibration pattern included in the vibration detection signal passed from the vibration data acquisition processing unit 11 based on the learned data of the vibration model stored in the vibration model storage unit 31. Then, it detects a specific vibration pattern associated with a sudden movement of the arm or leg, and generates specific vibration detection information representing the detection result. At the same time, the specific vibration detection processing unit 12 acquires detection time data of the specific vibration pattern from the clock 8, includes the acquired detection time data in the specific vibration detection information, and stores this specific vibration detection information in the specific vibration information storage unit 32.

[0035] The user information mutual transmission processing unit 13 is a communication terminal T u2 ,T u1 When inter-body communication becomes possible between the communication terminal T and the communication I / F unit 5, the user ID or the terminal ID is read from the user information storage unit 33, and the read ID is transmitted from the communication I / F unit 5 to the communication terminal T on the other side together with the detection time data of the specific vibration pattern stored in the specific vibration information storage unit 32. u2 ,T u1 The process of sending to is performed.

[0036] At the same time, the user information mutual transmission processing unit 13 u2 ,T u1 The device receives the other party's ID and the detection time data of the specific vibration pattern transmitted in the same manner from the communication I / F unit 5 via the communication I / F unit 5, and stores the received other party's ID and the detection time data of the specific vibration pattern in the user information storage unit 33.

[0037] The action determination processing unit 14 determines whether or not the specific vibration information of the communication terminal T u1 ,T u2 The time data of the detection of a specific vibration pattern in the communication terminal T u2 ,T u1The detection time data of the specific vibration pattern notified from the is compared with the ...

[0038] Furthermore, the action determination processing unit 14 performs a process of generating action determination information for each action, the information including an identification number of the action, information indicating the start order of the action, and information indicating the occurrence time of the action, and storing the generated action determination information in the action determination information storage unit 34. As the information indicating the start order of the action, for example, the ID of the performer who starts the action and the ID of the performe who receives the action are used.

[0039] When the act judgment information is stored in the act judgment information memory unit 34, the act judgment information output processing unit 15 reads out this act judgment information in real time or in batches for a certain period of time or a certain quantity, and transmits the read act judgment information from the communication I / F unit 5 to the management terminal WT.

[0040] (Example of operation) Next, the communication terminal T configured as above u1 ,T u2 An example of the operation will be described.

[0041] FIG. 4 shows the communication terminal T u1 ,T u2 FIG. 5 is a flowchart showing the procedure and contents of the action determination process executed by the control unit 1 of the communication terminal T. u1 ,T u2 1 is a diagram for explaining an example of the operation of the embodiment, and in this example, a case is shown in which a care recipient U2 suffering from dementia or the like commits an act of violence against a caregiver U1. Hereinafter, the communication terminal T used by the care recipient U2 who is the initiator of the above action will be referred to as u2 The operation of the above will be described as an example.

[0042] (1) Actions before the act (1-1) Acquisition of vibration detection signal Communication terminal T u2 In step S10, the control unit 1 constantly acquires a vibration detection signal output from the motion sensor 7 via the sensor I / F unit 4 under the control of the vibration data acquisition processing unit 11. Then, the control unit 1 passes the vibration detection signal to the specific vibration detection processing unit 12. Note that the acquisition process of the vibration detection signal may be performed intermittently as long as it does not affect the detection of the vibration pattern.

[0043] (1-2) Detection of specific vibrations Next, communication terminal T u2 In step S11, under the control of the specific vibration detection processing unit 12, the control unit 1 analyzes the vibration pattern of the vibration detection signal passed from the vibration data acquisition processing unit 11 based on the learned data of the vibration model stored in the vibration model memory unit 31, thereby detecting a specific vibration pattern associated with, for example, a sudden movement of the arm or leg of the care recipient U2.

[0044] This detection process detects a specific vibration pattern that occurs with the movement of the care recipient U2 when the care recipient U2 raises his / her hand, for example, as shown in Fig. 5. Note that the specific vibration pattern to be detected is not limited to the raising of the hand, and may be a pattern corresponding to other movements such as sticking out the hand or kicking the foot.

[0045] The specific vibration detection processing unit 12 determines whether the specific vibration pattern is detected in step S12. When the specific vibration pattern is detected, the specific vibration detection processing unit 12 subsequently acquires time data representing the detection time T of the specific vibration pattern from the clock 8 via the sensor I / F unit 4 in step S13. The specific vibration detection processing unit 12 stores the acquired time data representing the detection time T in the specific vibration information storage unit 32 as specific vibration detection information together with the detection result of the specific vibration pattern, i.e., information representing the type of the detected specific vibration pattern.

[0046] Communication terminal T u2The control unit 1 repeats the process of detecting the specific vibration pattern in steps S10 to S13 until contact between the caregiver U1 and the care recipient U2 is detected.

[0047] (2) Actions taken during and after the act (2-1) Mutual transmission of user information Communication terminal T u2 In step S14, the control unit 1 of the communication terminal T monitors contact between the care recipient U2 and the caregiver U1. u1 ,T u2 This is done by the presence or absence of a body-to-body communication signal flowing between them.

[0048] In this state, for example, as shown in FIG. 5, assume that the hand of the care recipient U2 touches the body of the caregiver U1 at time t. Then, the communication terminal T u2 The control unit 1 of the user information mutual transmission processing unit 13 is triggered by the body contact, and under the control of the user information mutual transmission processing unit 13, first, in step S15, the time data representing the detection time T of the specific vibration pattern stored in the specific vibration information storage unit 32 and the care recipient ID or the communication terminal T stored in the user information storage unit 33 are u2 The terminal ID of the caregiver U1 is transmitted as user information from the communication I / F unit 5 to the communication terminal T u1 The signal is transmitted via body-to-body communication.

[0049] At the same time, in step S16, the user information mutual transmission processing unit 13 transmits the communication terminal T u1 The other user information transmitted from the care recipient U2 by the human body communication is received via the communication I / F unit 5. The received user information of the other user is temporarily stored in the user information storage unit 33. The other user information includes the detection time t of a specific vibration pattern when the hand of the care recipient U2 touches the body of the caregiver U1, the ID of the caregiver U1 or the communication terminal T u1 The device ID is included.

[0050] In addition, with regard to the process of transmitting one's own user information in step S15 and the process of receiving the other party's user information in step S16, step S16 may be executed before step S15.

[0051] (2-2) Judgment of conduct The above communication terminal T u1 ,T u2 When the transmission of user information between the communication terminals is completed, u2 The control unit 1 then determines the status of the above-mentioned action in step S17 under the control of the action determination processing unit 14. The procedure and contents of this determination process will be described below.

[0052] That is, the action determination processing unit 14 retrieves the specific vibration information of the communication terminal T u2 The time data representing the detection time T of the specific vibration pattern detected before the contact is read in, and the time data representing the detection time T of the communication terminal T on the other side is read in from the user information storage unit 33. u1 The time data of the detection time t of the specific vibration pattern detected at the time of contact, transmitted from the , is read in. Then, the two times T and t are compared to determine which comes first.

[0053] As a result of this determination, in the situation shown in Fig. 5, the detection time T of the specific vibration pattern on the care recipient U2 side is earlier than the detection time t of the specific vibration pattern on the caregiver U1 side, so the care recipient U2 is determined to be the performer who initiated the action, and the caregiver U1 is determined to be the performed side who received the action. In other words, the start order of the actions between the caregiver U1 and the care recipient U2 is determined.

[0054] The action determination processing unit 14 associates the action identification number with the time of occurrence of the action, the action performer ID, and the action recipient ID, and generates action determination information. The generated action determination information is then temporarily stored in the action determination information storage unit 34.

[0055] In addition, when a position sensor is connected to the sensor I / F unit 4, the action determination processing unit 14 determines the position of the communication terminal T u2The position data may be acquired from the position sensor, and the acquired position data may be further included in the action determination information. In this case, latitude and longitude are used as the position data.

[0056] Furthermore, the type of action, for example, "hitting," "poking," "pushing," "kicking," "touching," etc., may be determined based on the analysis results of the specific vibration pattern, and the determined type of action may be included in the action determination information.

[0057] (2-3) Transmission of behavior determination information Communication terminal T u2 Next, in step S18, the control unit 1 reads out the act determination information from the act determination information storage unit 34 under the control of the act determination information output processing unit 15, and transmits the read out act determination information to the management terminal WT from the communication I / F unit 5. Note that in the process of transmitting the act determination information, the act determination information may be transmitted in real time each time it is obtained, or act determination information for a certain period of time or a certain amount of information may be transmitted collectively.

[0058] From now on, communication terminal T u2 The control unit 1 repeatedly executes the action determination process in steps S10 to S18.

[0059] (3) Management of action history information on the management terminal WT The management terminal WT is the communication terminal T u1 ,T u2 The system receives and stores each of the pieces of activity determination information transmitted from the respective devices. Then, for each activity, the system compares each of the received activity determination information to determine whether the contents match, and generates a single piece of integrated activity determination information by deleting the other and leaving only one of the overlapping information elements. Then, the system stores the integrated activity determination information in the activity history database as activity history information.

[0060] Furthermore, when generating the integrated activity determination information, the management terminal WT performs the following processes. For example, the performer ID and the performed person ID or terminal ID included in the activity determination information are converted into the name of the care recipient U2 and the name of the caregiver U1 based on information in the personal information database managed by the server device SV. Also, for example, when the activity determination information includes location data, the latitude and longitude indicating this location data are converted into a location name, such as a facility name, floor name, or room name. An example of the activity history information is shown in Figure 6.

[0061] Furthermore, the management terminal WT displays the action determination information of the actions stored in the action history database on the display of the management terminal WT in response to, for example, an operation by the caregiver U1 who is the owner of the management terminal WT. The management terminal WT also periodically transmits the action determination information stored in the action history database to the server device SV in a batch. The server device SV acquires the action determination information from all the management terminals WT and manages it in a batch.

[0062] In addition, there may be a case where both U1 and U2 are care recipients. In that case, the care recipient does not have a management terminal WT. Therefore, in this case, for example, an access point is installed at an arbitrary position in the facility, and a communication terminal T u1 ,T u2 The action determination information transmitted from the communication terminal T may be transmitted to the server device SV via the access point. u1 ,T u2 In the case where the user terminal 10 has a communication interface for directly transmitting data to the server device SV via the network NW, the action determination information may be transmitted directly to the server device SV.

[0063] (Action and effect) As described above, in one embodiment, the communication terminal T u1 ,T u2In the system, before an action including contact is performed between the caregiver U1 and the care recipient U2, a specific vibration pattern accompanying hand or foot movement that is a precursor to the action is detected based on the detection signal of the motion sensor 7, and the detection time T of the detected specific vibration pattern is obtained from the clock 8 and stored. Then, when contact between the caregiver U1 and the care recipient U2 is detected, the specific vibration pattern at this time is detected and the detection time t is obtained, and the detection time t of the specific vibration pattern detected at the time of this contact and the detection time T of the specific vibration pattern detected before the contact are stored in the communication terminal T. u1 ,T u2 The detection time T and the detection time t are then compared, and based on the comparison result, it is determined which of the caregiver U1 and the care recipient U2 started the action first, that is, the start order of the actions, and action determination information including the start order of the actions is generated.

[0064] Therefore, according to one embodiment, when an action including contact occurs between the caregiver U1 and the care recipient U2, not only the occurrence of contact but also the start order of the action can be determined, so that when an unexpected action such as a violent act occurs, the situation at that time can be checked in more detail later. Also, when a normal action such as a handshake or an exchange of business cards is performed, the start order of the action at that time can be recorded, so that the situation at that time can be reviewed in detail later.

[0065] In addition, by including in the action determination information, in addition to the start order of the action, information indicating the location where the action occurred, which is identified based on latitude and longitude data detected by the position sensor, and information indicating the type of action, which is identified from the detected specific vibration pattern, it is possible to grasp the situation of the action in more detail.

[0066] Furthermore, in one embodiment, the following effect is also achieved. That is, as a means for transmitting user information, for example, a general wireless communication means such as Wi-Fi may be used to periodically transmit user information. However, when such a wireless communication means is used, wireless transmission is performed periodically regardless of whether body movement is detected or not, which leads to an increase in power consumption due to communication and a large drain on the terminal battery. In response to this, in one embodiment, human body contact is used as a trigger to transmit user information including the detection results of body vibrations detected and stored up to that point to the communication terminal T. u1 ,T u2 In other words, the communication between the human body is used, and the user information is transmitted only when necessary. u1 ,T u2 This reduces unnecessary power consumption for communication via the mobile phone, thereby extending the life of the battery.

[0067] [Other embodiments] In the above embodiment, all the functions of the action determination device according to the present invention are implemented in a communication terminal T of the human body communication system HC. u1 ,T u2 However, the present invention is not limited to this, and some of the functions of the action determining device may be provided in the management terminal WT.

[0068] In this case, the communication terminal T of the human body communication system HC u1 ,T u2 In addition to the body-to-body communication function, the communication terminal T is provided with a motion sensor 7 and a clock 8. u1 ,T u2 The control terminal WT stores the vibration detection signal output from the motion sensor 7 together with the time of occurrence, and when a contact is detected, transmits the vibration detection signal and its time stamp to the control terminal WT together with the terminal ID transmitted between the communication terminals. u1 ,T u2Based on the vibration detection signal and its timestamp sent from the, a series of processes are carried out, from detecting specific vibrations to determining the start order of actions and generating and storing action determination information.

[0069] In this way, the management terminal can take on the processing of detecting a specific vibration pattern and the processing of determining an action, which have a large processing load. u1 ,T u2 This simplifies the configuration and significantly reduces the processing load.

[0070] In the embodiment, the communication terminal T u1 ,T u2 The communication terminals T u1 ,T u2 However, the present invention is not limited to this. u1 ,T u2 Alternatively, one of the communication terminals may transmit user information to the other, and the communication terminal that receives the user information may perform the behavior determination.

[0071] In the embodiment, the communication terminal T u1 ,T u2 The above description is based on an example in which user information is transmitted by the communication terminal T. u1 ,T u2 The user information may be transmitted between the communication terminals T by using a wireless interface that adopts a low-power wireless data transmission standard such as Bluetooth. In this case, the contact between the human bodies is determined by, for example, detecting the bodies of the users U1 and U2 approaching to a distance equivalent to the contact using a proximity sensor, or detecting vibrations indicating the contact using an acceleration sensor, and the communication terminal T is activated using the result of the contact determination as a trigger. u1 ,T u2 User information is transmitted between them.

[0072] In addition, the functional configuration of the action determination device, the type of action, the processing procedures and processing contents of each process from the specific vibration detection process to the action start order determination process and the action determination information generation process can be modified in various ways without departing from the gist of this invention.

[0073] Although the embodiment of the present invention has been described in detail above, the above description is merely an example of the present invention in every respect. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. In other words, in implementing the present invention, a specific configuration according to the embodiment may be appropriately adopted.

[0074] In short, this invention is not limited to the above-mentioned embodiment as it is, and in the implementation stage, the components can be modified and embodied without departing from the gist of the invention. In addition, various inventions can be formed by appropriately combining multiple components disclosed in the above-mentioned embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, components from different embodiments may be appropriately combined. [Explanation of symbols]

[0075] U1…Caregiver U2…Care recipient HC: Human body communication system T u1 ,T u2 …Communication terminal WT: Management terminal NW…Network SV: Server device 1...Control unit 2...Program memory section 3. Data storage section 4. Sensor I / F section 5...Communication I / F section 6…Bus 11...Vibration data acquisition processing unit 12...Specific vibration detection processing unit 13...User information mutual transmission processing unit 14...Action determination processing unit 15...Action determination information output processing unit 31...Vibration model storage section 32...Specific vibration information storage section 33...User information storage unit 34...Act judgment information storage unit

Claims

1. An action determination device for determining an action including contact between a first subject and a second subject, a motion detection processing unit that detects a first body motion of the first subject and a second body motion of the second subject at the time of occurrence of the action, and stores the detection times of the first body motion and the second body motion at the time of occurrence of the action; a transmission processing unit that transmits a detection time of the first body movement and a detection time of the second body movement between a terminal carried by the first subject and a terminal carried by the second subject when the contact due to the action occurs between the first subject and the second subject; a determination processing unit that compares the transmitted detection time of the first body movement with the detection time of the second body movement and determines the start order of the action between the first subject and the second subject based on the comparison result; an action determination information generation processing unit that generates and stores action determination information including information that indicates a start order of the determined actions; An action determination device comprising:

2. 1. An action determination device that determines an action including contact between a first subject and a second subject by using human body-to-human body communication between the first subject and the second subject, a motion detection processing unit that detects a first body motion of the first subject and a second body motion of the second subject at the time of occurrence of the action, and stores the detection times of the first body motion and the second body motion at the time of occurrence of the action; a transmission processing unit that transmits, when the contact due to the action occurs between the first subject and the second subject, a detection time of the first body movement and a detection time of the second body movement between the first subject and the second subject by using the human body communication; a determination processing unit that compares the transmitted detection time of the first body movement with the detection time of the second body movement and determines the start order of the action between the first subject and the second subject based on the comparison result; an action determination information generation processing unit that generates and stores action determination information including information that indicates a start order of the determined actions; An action determination device comprising:

3. The action determination device according to claim 1 or 2, wherein the action determination information generation processing unit generates and stores action determination information including identification information of the first subject or the second subject who will be the initiator of the action, and identification information of the first subject or the second subject who will be the recipient of the action, as information representing the start order of the action.

4. The action determination device according to any one of claims 1 to 3, wherein the action determination information generation processing unit generates and stores action determination information including information representing the start order of the action and the action occurrence time represented by the detection time of the second body movement.

5. The action determination device of claim 1 or 2, wherein the movement detection processing unit acquires in advance specific vibration patterns corresponding to the first body movement and the second body movement to be detected and stores them as a vibration model, detects vibrations generated in association with the first body movement and the second body movement, and detects the first body movement and the second body movement by comparing the detected vibrations with the specific vibration patterns stored in the vibration model.

6. 1. An activity determination method performed by a device for determining an activity including contact between a first subject and a second subject, comprising: detecting a first body movement of the first subject and a second body movement of the second subject at the time of occurrence of the action, respectively, and storing the detection times; When the contact due to the action occurs between the first subject and the second subject, transmitting a detection time of the first body movement and a detection time of the second body movement between terminals carried by the first subject and the second subject, respectively; a step of comparing the transmitted detection time of the first body movement with the detection time of the second body movement, and determining the start order of the action between the first subject and the second subject based on the comparison result; generating and storing action determination information including information indicating a start order of the determined action; An action determination method comprising:

7. 1. An activity determination method executed by a device that determines an activity including contact between a first subject and a second subject by using human body-to-human body communication between the first subject and the second subject, comprising: detecting a first body movement of the first subject and a second body movement of the second subject at the time of occurrence of the action, respectively, and storing the detection times; transmitting, when the contact due to the action occurs between the first subject and the second subject, a detection time of the first body movement and a detection time of the second body movement between the first subject and the second subject by using the body-to-body communication; a step of comparing the transmitted detection time of the first body movement with the detection time of the second body movement, and determining the start order of the action between the first subject and the second subject based on the comparison result; generating and storing action determination information including information indicating a start order of the determined action; An action determination method comprising:

8. A program for causing a processor included in the action determination device to execute processing by each of the processing units included in the action determination device according to claim 1 .

Citation Information

Patent Citations

  • Body mount electronic apparatus, control method for body-mounted electronic apparatus, control program for body-mounted electronic apparatus, external apparatus for body communication, and body communication

    JP2004088223A

  • Nursing management system

    JP4069061B2

  • Communication device, communication method and communication system

    WO2019008864A1

  • Communicating method, program, recording medium, and communication system

    WO2020162038A1