Wireless communication device, base station device, and wireless communication system

JP7631910B2Active Publication Date: 2025-02-19JVC KENWOOD CORP
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2021037067
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-03-09
Publication Date
2025-02-19
Estimated Expiration
2041-03-09

AI Technical Summary

Benefits of technology

【0009】 本発明によれば、緊急事態を適切に判断することができる。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007631910000001
    Figure 0007631910000001
  • Figure 0007631910000002
    Figure 0007631910000002
  • Figure 0007631910000003
    Figure 0007631910000003
Patent Text Reader

Abstract

To provide a wireless communication device, a base station device, and a wireless communication system capable of properly determining emergency situations.SOLUTION: A portable wireless communication device used by a user in a wireless communication system includes: an ambient sound information acquisition unit (sound signal acquisition unit) for acquiring ambient sound information relating to sound including ambient sound of the user; a biometric information acquisition unit for acquiring biometric information of the user; a determination unit for determining, based on at least one of the ambient sound information and the biometric information, whether or not the user is in an abnormal state; a sound generation unit that generates a notification sound according to the type of the abnormal state when the determination unit determines that the user is in the abnormal state; and a communication control unit that transmits the ambient sound information, the biometric information, the information on the type of the abnormal state, and the information on the notification sound to a base station device via a communication unit.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a wireless communication device, a base station device, and a wireless communication system. [Background technology]

[0002] 2. Description of the Related Art There is known a technique for making an emergency call reliably even when it is difficult for a user to make a call in the event of an emergency (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2000-307460 A Summary of the Invention [Problem to be solved by the invention]

[0004] Emergencies occur with varying degrees of severity depending on the situation. It is desirable to be able to properly assess various types of emergencies.

[0005] An object of the present invention is to provide a wireless communication device, a base station device, and a wireless communication system that are capable of appropriately determining an emergency situation. [Means for solving the problem]

[0006] The wireless communication device of the present invention comprises an ambient sound information acquisition unit that acquires ambient sound information related to audio including ambient sounds of a user; a biometric information acquisition unit that acquires biometric information of the user; a judgment unit that determines whether the user is in an abnormal state based on at least one of the ambient sound information and the biometric information; a voice generation unit that generates a notification voice according to the type of abnormal state when the judgment unit determines that the user is in an abnormal state; and a communication control unit that transmits the ambient sound information, the biometric information, information related to the type of abnormal state, and the notification voice to a base station device via a communication unit.

[0007] The base station device of the present invention comprises a user information acquisition unit that acquires ambient sound information regarding audio including ambient sound of a user, biometric information of the user, information regarding a type of abnormal condition of the user, and a notification audio corresponding to the type of abnormal condition from a wireless communication device via a first communication unit, an abnormality judgment information acquisition unit that acquires abnormality judgment information for determining whether or not the user's condition is abnormal from an external device via a second communication unit, a judgment unit that judges whether or not the user is in an abnormal condition using the abnormality judgment information based on at least one of the ambient sound information and the biometric information, and a response determination unit that switches processing depending on the judgment result of the judgment unit, and when the judgment result of the judgment unit does not match the information regarding the type of abnormal condition of the user received from the wireless communication device, the response determination unit generates a signal requesting reanalysis to the wireless communication device and transmits the signal requesting reanalysis to the wireless communication device via the first communication unit.

[0008] A wireless communication system according to the present invention includes a wireless communication device according to the present invention and a base station device according to the present invention. Effect of the Invention

[0009] According to the present invention, an emergency situation can be appropriately determined. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram for explaining an overview of a wireless communication system according to an embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating an example of the configuration of the wireless communication device according to the embodiment. [Diagram 3] FIG. 3 is a flowchart showing an example of a processing flow of the wireless communication device according to the embodiment. [Figure 4] FIG. 4 is a diagram for explaining a method of loop-storing an audio signal. [Diagram 5] FIG. 5 is a diagram for explaining the recording data. [Figure 6]FIG. 6 is a diagram for explaining the message generation table. [Figure 7] FIG. 7 is a diagram for explaining a method for acquiring position information at the time of transition to the analysis mode. [Figure 8] FIG. 8 is a block diagram illustrating an example of the configuration of a base station device according to the embodiment. [Figure 9] FIG. 9 is a flowchart showing an example of a process flow of the base station device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. However, the present invention is not limited to the embodiment described below.

[0012] [Embodiment] An overview of a wireless communication system according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram for explaining an overview of a wireless communication system according to an embodiment.

[0013] As shown in FIG. 1, the wireless communication system 1 includes a wireless communication device 10, a biosensor 12, and a base station device 14.

[0014] The wireless communication device 10 is a portable wireless communication device used by a user U. Examples of the wireless communication device 10 include, but are not limited to, portable wireless communication devices such as a business wireless communication device, a smartphone, and a tablet terminal. The wireless communication device 10 may be, for example, a game console.

[0015] The biosensor 12 is attached to the user U. The biosensor 12 is attached, for example, to the torso or arm of the user U, but may be attached to other body parts. The biosensor 12 detects bioinformation of the user U. The biosensor 12 is composed of, for example, a heart rate sensor, a blood pressure sensor, a body temperature sensor, etc., but may be composed of other sensors.

[0016] The base station device 14 transmits and receives various data signals including voice signals to and from the wireless communication device 10. The base station device 14 transmits and receives various data signals including voice signals to and from other external devices (not shown) via a wired or wireless network.

[0017] In this embodiment, the wireless communication device 10 detects ambient sound of the user U with a microphone and acquires biometric information of the user U from the biometric sensor 12. The wireless communication device 10 determines whether the state of the user U is abnormal or not based on the detected ambient sound and the acquired biometric information. The wireless communication device 10 transmits the detected ambient sound and the acquired biometric information to the base station device 14.

[0018] In this embodiment, the base station device 14 receives ambient sound detected by the wireless communication device 10, acquired biological information, and the like from the wireless communication device 10. The base station device 14 determines whether the ambient sound received from the wireless communication device 10 and the state of the user U are abnormal or not. The base station device 14 transmits information according to the determination result of the state of the user U to the wireless communication device 10.

[0019] [Wireless communication device] A configuration example of a wireless communication device according to an embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing a configuration example of a wireless communication device according to an embodiment.

[0020] As shown in FIG. 2, the wireless communication device 10 includes an input unit 20, a microphone 22, a display unit 24, an audio output unit 26, a memory unit 28, a communication unit 30, a GNSS (Global Navigation Satellite System) receiving unit 32, and a control unit 34.

[0021] The input unit 20 is an input device that accepts various input operations for the wireless communication device, and includes, for example, a button, a switch, a lever, a numeric keypad, a touch panel, and a PTT (Push to Talk) button.

[0022] The microphone 22 acquires various sounds including ambient sounds of the wireless communication device 10. The ambient sounds include sounds that are generated when the user is shot or involved in an accident or disaster, which is assumed to be an emergency situation. The microphone 22 generates an audio signal corresponding to the acquired sounds. The microphone 22 outputs the generated audio signal to the control unit 34.

[0023] The display unit 24 displays various images. The display unit 24 includes a display including, for example, a liquid crystal display (LCD) or an organic electro-luminescence (EL) display. The display unit 24 may include, for example, a light-emitting unit such as an LED (Light Emitting Diode). The input unit 20 and the display unit 24 may be integrated together using a touch panel or the like.

[0024] The audio output unit 26 outputs various sounds. For example, the audio output unit 26 outputs at least one of a voice and a notification sound to the user. The audio output unit 26 is realized by, for example, a speaker.

[0025] The storage unit 28 is a memory that stores various types of information. The storage unit 28 stores information such as the contents of calculations by the control unit 34 and programs. The storage unit 28 includes at least one of a RAM (Random Access Memory), a main storage device such as a ROM (Read Only Memory), and an external storage device such as a HDD (Hard Disk Drive). In this embodiment, the storage unit 28 stores an AI (Artificial Intelligence) model 28a for determining the state of the user U.

[0026] The AI ​​model 28a is a model for identifying the state of the user U from at least one of the ambient sound and the biometric information of the user U. The AI ​​model 28a is, for example, a trained AI model that has been trained using a plurality of data sets as teacher data, with voice and information indicating the state occurring when the voice is generated as one data set. The AI ​​model 28a may be, for example, a trained AI model that has been trained using a plurality of data sets as teacher data, with biometric information and information indicating the state of the user when the biometric information is detected as one data set. The AI ​​model 28a is, for example, a conventional neural network (CNN) model. The AI ​​model 28a may be any other model. The AI ​​model 28a may be updated, for example, when the software of the wireless communication device 10 is upgraded.

[0027] The communication unit 30 is a communication device that wirelessly transmits and receives various types of information between the wireless communication device 10 and an external device. The communication unit 30 transmits and receives information between the wireless communication device 10 and the base station device 14, for example.

[0028] The GNSS receiver 32 receives a GNSS signal including information for identifying location information from a GNSS satellite (not shown). The GNSS receiver 32 outputs the received GNSS signal to the control unit 34. The GNSS receiver 32 can be realized by, for example, a GNSS receiver circuit or a GNSS receiver device.

[0029] The control unit 34 controls the operation of each unit of the wireless communication device 10. The control unit 34 is realized, for example, by a central processing unit (CPU) or a micro processing unit (MPU) executing a program stored in the storage unit 28 or the like using a RAM or the like as a working area. The control unit 34 may be realized, for example, by an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). The control unit 34 may be realized by a combination of hardware and software.

[0030] The control unit 34 includes a voice signal acquisition unit 40 , a biometric information acquisition unit 42 , a position information acquisition unit 44 , a determination unit 46 , a voice generation unit 48 , a memory control unit 50 , and a communication control unit 52 .

[0031] The audio signal acquisition unit 40 acquires various audio signals. For example, the audio signal acquisition unit 40 acquires an audio signal related to an ambient sound from the microphone 22.

[0032] The biometric information acquiring unit 42 acquires biometric information of the user U. The biometric information acquiring unit 42 acquires the biometric information of the user U from the biometric sensor 12.

[0033] The position information acquisition unit 44 acquires position information of the wireless communication device 10. The position information acquisition unit 44 calculates the current position of the wireless communication device 10 by a known method, for example, based on the GNSS signal received by the GNSS receiver 32. The position information acquisition unit 44 calculates the current position of the wireless communication device 10 in earth coordinates, for example.

[0034] The determination unit 46 determines the state of the user U who has the wireless communication device 10. For example, the determination unit 46 determines whether or not the user U is in an abnormal state. An abnormal state means an emergency state in which the user U needs help. The determination unit 46 determines whether or not the user U is in an abnormal state by, for example, calculating the urgency of the state of the user U. Specific processing by the determination unit 46 will be described later.

[0035] The voice generating unit 48 generates various kinds of voice. For example, the voice generating unit 48 generates a voice according to the determination result of the determining unit 46. Specific processing of the voice generating unit 48 will be described later.

[0036] The storage control unit 50 stores various types of information in the storage unit 28. Specific processing by the storage control unit 50 will be described later.

[0037] The communication control unit 52 controls the communication unit 30 to control communication between the wireless communication device 10 and an external device. The communication control unit 52 controls communication between the wireless communication device 10 and the base station device 14, for example. Specific processing by the communication control unit 52 will be described later.

[0038] [Processing content] The processing content of the wireless communication device according to the embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing an example of the flow of processing of the wireless communication device according to the embodiment.

[0039] The control unit 34 acquires an audio signal (step S10). Specifically, when the process starts, the audio signal acquisition unit 40 constantly acquires an audio signal related to the ambient sound of the wireless communication device 10 detected by the microphone 22. Then, the process proceeds to step S12.

[0040] The control unit 34 acquires location information (step S12). Specifically, the location information acquisition unit 44 constantly acquires location information of the current location of the wireless communication device 10 at a predetermined interval based on the GNSS signal received by the GNSS receiving unit 32. The predetermined interval is, for example, one second, but is not limited to this. Then, the process proceeds to step S14.

[0041] The control unit 34 acquires the biometric information (step S14). Specifically, the biometric information acquisition unit 42 constantly acquires the biometric information of the user U detected by the biometric sensor 12. Then, the process proceeds to step S16.

[0042] The control unit 34 loop-records the audio signal and the position information (step S16). Specifically, the storage control unit 50 controls the audio signal acquired by the audio signal acquisition unit 40 and the position information acquired by the position information acquisition unit 44 to be associated with each other, converted into a file, and loop-stored in the storage unit 28. The biometric information acquired in step S14 may also be converted into a file together with the position information and the audio signal, and stored in the storage unit 28. Then, the process proceeds to step S18.

[0043] A method of loop-storing an audio signal will be described with reference to FIG. 4. FIG. 4 is a diagram for explaining a method of loop-storing an audio signal. As shown in FIG. 4, the storage control unit 50 controls the storage unit 28 to store, as recorded data, data files D1, D2, ..., and Dn (n is an arbitrary integer) in which audio signals and position information are associated with each other and filed. When the position information acquisition unit 44 acquires position information at one-second intervals, the data file becomes a data file containing one second of audio. The storage control unit 50 continues to store a data file in which an audio signal and position information are associated with each other for any n seconds, and after n seconds have elapsed, overwrites and stores a new data file in the data file D1. FIG. 5 is a diagram for explaining recorded data. As shown in FIG. 5, the data file is associated with "audio data" related to the audio signal acquired by the audio signal acquisition unit 40 and "position information" acquired by the position information acquisition unit 44. For example, in the data file D1, the audio data is "VD1" and the position information is "(N1, E1)". In Figure 5, the audio data is conceptually shown as "VD1" and the location information as "(N1, E1)", but in reality, the audio data may represent the actual recorded audio, and the location information may represent the latitude and longitude at the time the audio data was actually recorded.

[0044] Returning to FIG. 3, the control unit 34 determines whether or not there has been an input equal to or greater than the threshold (step S18). Specifically, the audio signal acquisition unit 40 determines whether or not there has been an audio signal with a volume equal to or greater than the threshold. An audio signal with a volume equal to or greater than the threshold means an audio signal that may indicate an emergency. Alternatively, the biometric information acquisition unit 42 may determine whether or not there has been an audio signal with a value equal to or greater than the threshold. An audio signal with a value equal to or greater than the threshold means an abnormal value of the biometric information that may indicate an emergency. If it is determined that there has been an input equal to or greater than the threshold (step S18; Yes), proceed to step S20. If it is not determined that there has been an input equal to or greater than the threshold (step S18; No), proceed to step S42.

[0045] If the result of the determination in step S18 is Yes, the control unit 34 transitions to an analysis mode (step S20). Specifically, the control unit 34 transitions to the analysis mode for determining whether or not an emergency has occurred to the user. When transitioning to the analysis mode, the control unit 34 stops loop storage after storing the audio signal up to a position where the data file storing the audio signal with an input equal to or greater than the threshold is not erased, and proceeds to step S22.

[0046] The control unit 34 judges whether an emergency has occurred to the user U (step S22). Specifically, the judgment unit 46 analyzes the voice signal stored in the storage unit 28 using the AI ​​model 28a to judge the surrounding situation of the user U. The judgment unit 46 judges the state of the user U based on the current biometric information of the user U acquired by the biometric information acquisition unit 42. The judgment unit 46 judges whether the user U is in an emergency based on the judgment result of the surrounding situation of the user U and the judgment result of the state of the user U. If it is judged that an emergency has occurred to the user U (step S22; Yes), the process proceeds to step S24. If it is not judged that an emergency has occurred to the user U (step S22; No), the process proceeds to step S42. In the following, a case where the user U is shot on the road as an example of an emergency that has occurred to the user U will be described.

[0047] If it is determined as Yes in step S22, the control unit 34 transitions to the emergency mode (step S24). Specifically, the control unit 34 transitions to the emergency mode for requesting rescue. Then, the process proceeds to step S26.

[0048] The control unit 34 generates a notification voice for requesting rescue (step S26). Specifically, the voice generation unit 48 acquires the notification voice according to the emergency determined in step S22. More specifically, the voice generation unit 48 generates the notification voice according to the biometric information of the user U, the location information associated with the voice data stored in the storage unit 28, and the message generation table stored in the storage unit 28.

[0049] The message generation table will be described with reference to Fig. 6. Fig. 6 is a diagram for explaining the message generation table. As shown in Fig. 6, the message generation table 28c includes items such as "location", "situation", and "action".

[0050] The "location" indicates the location where the user has an emergency, such as "road," "sea," "mountain," "river," ..., or "unknown."

[0051] The "status" indicates the type of emergency, such as "shooting," "traffic accident," "fall," "submersion," "fire," "explosion," ... or "unknown."

[0052] "Response" indicates the response that should be taken in the event of an emergency. Examples of "Response" include "Request for help," "Request for rescue," "Request for an ambulance," "Request for a fire engine," "Request for the police," and "No response required."

[0053] For example, when the determination unit 46 determines that the user U has been shot on a road, the voice generation unit 48 selects "road" from the "location" item, "gunshot" from the "situation" item, and "request help" and "request an ambulance" from the "response" item.

[0054] Next, a method of acquiring location information at the time of analysis will be described with reference to FIG. 7. FIG. 7 is a diagram for explaining a method of acquiring location information at the time of transition to the analysis mode. FIG. 7 shows recorded data in which voice data and location information stored in the storage unit 28 are associated with each other. In the example shown in FIG. 7, for example, it is assumed that the analysis mode is transitioned to at the timing of time t1. In this case, the voice generating unit 48 acquires location information associated with the data file D2.

[0055] When the voice generating unit 48 acquires information necessary for generating a voice, it acquires a notification voice based on the acquired information. The voice generating unit 48 generates a notification voice such as, for example, "Emergency situation has occurred. User U has been shot, the location is a road, the position coordinates are (N2, E2), user U's heart rate is X, the electrocardiogram is Y, there is a risk of death, and support and an ambulance are requested." Information regarding the risk of death is also called urgency.

[0056] Returning to Fig. 3, the control unit 34 transmits information to the base station device 14 (step S28). Specifically, the communication control unit 52 transmits the notification voice generated in step S26 and the loop-stored recorded data via the communication unit 30. That is, the information transmitted to the base station includes the type of the event that occurred, location information of the place where the event occurred, the type of place, a request for response, biometric information of the user U, information related to the urgency level, and recorded data at the time of the emergency occurrence.

[0057] The control unit 34 determines whether or not a request for additional information has been received (step S30). Specifically, the control unit 34 determines whether or not a request for additional information has been received for the information transmitted to the base station device 14 in step S28. The request for additional information can be said to be a request for reanalysis. If it is determined that a request for additional information has been received (step S30; Yes), the process proceeds to step S32. If it is determined that a request for additional information has not been received (step S30: No), the process proceeds to step S42.

[0058] If the answer is Yes in step S30, the control unit 34 executes reanalysis (step S32). Specifically, the control unit 34 executes the processes from step S22 to step S26 on not only the audio signal of the data file in which the input was equal to or greater than the threshold, but also all audio signals stored after the data file in which the audio signal in which the input was equal to or greater than the threshold was stored in step S20. Then, the process proceeds to step S34.

[0059] The control unit 34 determines whether the reanalysis determination result matches the previous determination result (step S34). Specifically, the determination unit 46 determines whether the results of the processes from step S22 to step S26 match the reanalysis result of step S32. If it is determined that the reanalysis determination result matches the previous determination result (step S34; Yes), the process proceeds to step S40. If it is determined that the reanalysis determination result does not match the previous determination result (step S34; No), the process proceeds to step S36.

[0060] If it is determined as No in step S34, the control unit 34 cancels the emergency mode (step S36). Specifically, the control unit 34 cancels the emergency mode set in step S24. Then, the process proceeds to step S38.

[0061] The control unit 34 transmits information to the base station device 14 that the previous determination result was an error (step S38). Specifically, the communication control unit 52 transmits information to the base station device 14 via the communication unit 30 that the previous determination result was an error. Then, the process proceeds to step S42.

[0062] If the answer is Yes in step S34, the control unit 34 transmits the reanalysis result and all of the loop-stored sound recording data to the base station device 14 (step S40). Specifically, the communication control unit 52 transmits the reanalysis result of step S32 and all of the loop-stored sound recording data to the base station device 14 via the communication unit 30. The reanalysis result and all of the loop-stored sound recording data are also called reanalysis information. This allows the base station device 14 to also perform reanalysis. Then, the process proceeds to step S42.

[0063] If it is determined as No in step S18, if it is determined as No in step S22, if it is determined as No in step S30, after step S38, or after step S40, the control unit 34 determines whether or not to end the process (step S42). Specifically, the control unit 34 determines to end the process in Fig. 3 when it has received an operation to end the process, when it has received an operation to turn off the power, or when it has received a completion notification from the base station device 14. If it is determined to end the process (step S42; Yes), it ends the process in Fig. 3. If it is not determined to end the process (step S42; No), it proceeds to step S10.

[0064] [Base station equipment] A configuration example of a base station device according to an embodiment will be described with reference to Fig. 8. Fig. 8 is a block diagram showing a configuration example of a base station device according to an embodiment.

[0065] As shown in FIG. 8, the base station device 14 includes a communication unit 60, a network communication unit 62, a storage unit 64, and a control unit 66.

[0066] The communication unit 60 is a communication device that wirelessly transmits and receives various information between the base station device 14 and an external device. The communication unit 60 transmits and receives information between, for example, the base station device 14 and the wireless communication device 10. The communication unit 60 acquires, for example, ambient sound information related to sounds including ambient sounds of the user U, biometric information of the user U, information related to the type of abnormal state of the user U, and notification sound from the wireless communication device 10.

[0067] The network communication unit 62 is a communication device that communicates with other external devices. The network communication unit 62 has a function of connecting to a network (not shown) by wire or wirelessly. The network is, for example, the Internet, but is not limited to this. The network communication unit 62 acquires, for example, abnormality determination information from other external devices for determining whether the user's condition is abnormal or not.

[0068] The storage unit 64 is a memory that stores various information. The storage unit 64 stores, for example, information such as the calculation contents of the control unit 66 and programs. The storage unit 64 includes, for example, at least one of a RAM, a main storage device such as a ROM, and an external storage device such as a HDD. The storage unit 64 stores, for example, ambient sound information regarding a sound including an ambient sound of the user U received by the communication unit 60, biometric information of the user U, information regarding a type of an abnormal state of the user U, a notification sound, and the like. In this embodiment, the storage unit 64 stores an AI model 64a for determining the state of the user U.

[0069] The AI ​​model 64a is a model for identifying the state of the user U from at least one of the ambient sound and the biological information of the user U. The AI ​​model 64a is a trained AI model that has been trained using a plurality of data sets as teacher data, with, for example, a voice and information indicating a situation occurring when the voice is generated as one data set. The AI ​​model 64a is an AI model that has been trained by taking into account abnormality determination information acquired from another external device as teacher data via the network communication unit 62, for example. The AI ​​model 64a is an AI model that has been trained using a larger number of data sets as teacher data, compared to the AI ​​model 28a stored in the wireless communication device 10. Therefore, the base station device 14 can perform analysis with higher accuracy than the wireless communication device 10 by using the AI ​​model 64a. The AI ​​model 64a may be an AI model that can be updated by acquiring abnormality determination information via the network communication unit 62.

[0070] The control unit 66 controls the operation of each unit of the base station device 14. The control unit 66 is realized, for example, by a CPU, an MPU, or the like executing a program stored in the storage unit 64 or the like using a RAM or the like as a working area. The control unit 66 may be realized, for example, by an integrated circuit such as an ASIC or an FPGA. The control unit 66 may be realized by a combination of hardware and software.

[0071] The control unit 66 includes a user information acquisition unit 70, an abnormality determination information acquisition unit 72, a determination unit 74, a response determination unit 76, a first communication control unit 78, and a second communication control unit 80.

[0072] The user information acquisition unit 70 acquires user information from the wireless communication device 10 via the communication unit 60. The user information may include ambient sound information related to sounds including ambient sounds of the user U, biometric information of the user U, information related to the type of abnormal state of the user U, and various types of information including notification sounds.

[0073] The abnormality determination information acquisition unit 72 acquires abnormality determination information for determining whether the state of the user U is abnormal or not from an external device via the network communication unit 62. The abnormality determination information includes information in which an event such as an accident or disaster is associated with a sound generated when the event occurs. The abnormality determination information includes, for example, information in which an event such as an accident or disaster is associated with biometric information of the user when the user is involved in the event.

[0074] The first communication control unit 78 controls the communication unit 60 to control communication between the base station device 14 and an external device. The first communication control unit 78 controls communication between the base station device 14 and the wireless communication device 10, for example.

[0075] The second communication control unit 80 controls the network communication unit 62 to control communication between the base station device 14 and an external device. The second communication control unit 80 controls communication between the base station device 14 and an external device that stores abnormality determination information, for example.

[0076] [Processing content] The processing contents of the base station device according to the embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an example of the flow of processing of the base station device according to the embodiment.

[0077] The control unit 66 acquires user information (step S50). Specifically, the user information acquisition unit 70 acquires user information including ambient sound information related to audio including ambient sound of the user U received by the communication unit 60, biometric information of the user U, information related to the type of abnormal state of the user U, and notification audio. Then, the process proceeds to step S52.

[0078] The control unit 66 acquires abnormality determination information (step S52). Specifically, the abnormality determination information acquisition unit 72 acquires the abnormality determination information received by the network communication unit 62. When acquiring the abnormality determination information, the control unit 66 updates the AI ​​model 64a stored in the storage unit 64. Then, the process proceeds to step S54.

[0079] The control unit 66 determines the situation of the user U (step S54). Specifically, the determination unit 74 determines the situation of the user based on the user information acquired in step S50 and using the abnormality determination information acquired in step S52. More specifically, the determination unit 74 analyzes the user information using the AI ​​model 64a generated (updated) based on the abnormality determination information, and determines whether the situation of the user U is an emergency or not. Then, the process proceeds to step S56.

[0080] The control unit 66 determines whether the determination results match (step S56). Specifically, the determination unit 74 determines whether the determination result of the wireless communication device 10 included in the user information acquired in step S50 matches the determination result of step S54. If it is determined that the determination results match (step S56; Yes), the process proceeds to step S62. If it is determined that the determination results do not match (step S56; No), the process proceeds to step S58.

[0081] If the result of the determination in step S56 is No, the control unit 66 generates a request signal for additional information (step S58). Specifically, the response determination unit 76 generates information to cause the wireless communication device 10 to reanalyze the situation of the user U. Then, the process proceeds to step S60.

[0082] The control unit 66 transmits a request signal for additional information to the wireless communication device 10 (step S60). Specifically, the first communication control unit 78 transmits the request signal for additional information generated in step S58 to the wireless communication device 10 via the communication unit 60. Then, the process in FIG. 9 ends.

[0083] If the result of the determination in step S56 is Yes, the control unit 66 arranges for rescue (step S62). Specifically, the first communication control unit 78 requests assistance from a corresponding private or public institution, arranges for an ambulance, etc. Then, the process proceeds to step S64.

[0084] The control unit 66 transmits a completion notification to the wireless communication device 10 (step S64). Specifically, the first communication control unit 78 transmits a completion notification to the wireless communication device 10, including a message such as "Understood. We will arrange for support and an ambulance." Then, the process of FIG. 9 ends.

[0085] As described above, in this embodiment, when a predetermined input equal to or greater than a threshold is received, the wireless communication device 10 determines whether or not an emergency has occurred to the user U based on the AI ​​model 28a. This allows the present embodiment to instantly determine whether an emergency has occurred to the user U.

[0086] Furthermore, in this embodiment, the base station device 14 receives user information from the wireless communication device 10 and determines whether or not an emergency has occurred for the user U based on the AI ​​model 64a generated using the abnormality determination information. The base station device 14 determines whether or not the analysis result based on the AI ​​model 64a matches the result of the wireless communication device 10. If the determination results match, the base station device 14 immediately arranges for rescue in accordance with the determination result and transmits a completion notification to the wireless communication device 10. If the determination results do not match, the base station device 14 transmits a reanalysis request to the wireless communication device 10.

[0087] Furthermore, in this embodiment, the wireless communication device 10 that has received the reanalysis request can make an accurate decision based on more information, including voice signals and biological information acquired after it has been determined that an emergency has occurred for the user U. This allows for an appropriate decision to be made that combines immediacy when an emergency occurs with accuracy in requesting rescue.

[0088] Although the embodiments of the present invention have been described above, the present invention is not limited to the contents of these embodiments. The above-described components include those that can be easily imagined by a person skilled in the art, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, the above-described components can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the above-described embodiments. [Explanation of symbols]

[0089] 1. Wireless communication systems 10 Wireless communication devices 12 Biometric sensors 14 Base station equipment 20 Input section 22. Mike 24 Display 26 Audio output section 28,64 Storage part 30,60 Communications Department 32 GNSS receiver 34 Control section 40 Audio signal acquisition unit 42 Biometric information acquisition unit 44 Location information acquisition unit 46,74 Judgment part 48 Voice Generation Unit 50 Memory control unit 52 Communication control section 62 Network Communication Department 70 User information acquisition unit 72 Abnormality judgment information acquisition unit 76 Response Decision Unit 78 First communication control unit 80 Second communication control unit

Claims

1. an ambient sound information acquisition unit that acquires ambient sound information related to a sound including an ambient sound of a user; a biometric information acquiring unit for acquiring biometric information of the user; a determination unit that determines whether the user is in an abnormal state based on at least one of the ambient sound information and the biological information; a voice generating unit that generates a notification voice according to a type of the abnormal state when the determination unit determines that the user is in an abnormal state; a communication control unit that transmits the ambient sound information, the biological information, information relating to the type of the abnormal state, and the notification voice to a base station device via a communication unit; a storage unit that stores the ambient sound information and the biological information, when the determination unit receives a signal requesting reanalysis from the base station device, the determination unit determines whether or not the user is in an abnormal state based on at least one of the ambient sound information and the biological information stored in the storage unit since the previous transmission. Wireless communication device.

2. The determination unit determines whether the user is in an abnormal state by using a model that has learned a relationship between at least one of the ambient sound information and the biological information and the abnormal state. The wireless communication device of claim 1 .

3. a user information acquisition unit that acquires ambient sound information related to audio including an ambient sound of a user, biometric information of the user, information related to a type of an abnormal state of the user, and a notification audio corresponding to the type of the abnormal state from a wireless communication device via a first communication unit; an abnormality determination information acquisition unit that acquires abnormality determination information for determining whether or not the user's state is abnormal from an external device via a second communication unit; a determination unit that determines whether or not the user is in an abnormal state by using the abnormality determination information based on at least one of the ambient sound information and the biological information; a response determination unit that switches processing depending on a determination result of the determination unit; the response determination unit generates a signal to request the wireless communication device to perform reanalysis when the determination result of the determination unit does not match the information on the type of the abnormal state of the user received from the wireless communication device; transmitting a signal requesting the reanalysis to the wireless communication device via the first communication unit; Base station equipment.

4. A wireless communication device according to claim 1 or 2; A base station device according to claim 3; 23. A wireless communication system comprising:

Citation Information

Patent Citations

  • Mobile radio telephone terminal

    JP1997107418A

  • Portable communication terminal

    JP2000307460A

  • Automatic emergency reporting device for home care patient

    JP2001190504A

  • Danger notification server, mobile terminal, danger notification method, factor information detection method and program

    JP2009193315A