Support device and support method

Abstract

To improve a technique for supporting a user who becomes sick inside a vehicle.SOLUTION: A support device 20 includes a control unit 26 which retrieves user information of a user when the user exhibiting an abnormal sign in a cabin of a vehicle 10 is identified by a camera image, and acquires information on medical care of the user registered in association with the retrieved user information from a database 32A of a server 30.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an assistance device and an assistance method. [Background technology]

[0002] Conventionally, there are known techniques for supporting a user who falls ill in a vehicle. For example, Patent Document 1 discloses a fall detection device that detects a fall of an occupant in a vehicle cabin based on a camera image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-96867 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when a driver needs to stop the vehicle to provide first aid to a passenger who suddenly falls ill while on board, they cannot provide appropriate treatment unless they know the passenger's medical history. Therefore, there is room for improvement in technology for supporting passengers who become ill while on board.

[0005] In view of the above circumstances, an object of the present disclosure is to improve technology relating to assistance for users who become ill while in a vehicle. [Means for solving the problem]

[0006] An information processing device according to one embodiment of the present disclosure is an assistance device mounted on a vehicle, and includes a control unit that, when a user exhibiting abnormal signs within the vehicle cabin is identified by a camera image, searches for user information about the user and obtains, from a server database, information related to the user's medical care that is registered in association with the searched user information.

[0007] An assistance method according to one embodiment of the present disclosure is an assistance method executed by an assistance device mounted on a vehicle, and includes, when a user exhibiting abnormal signs within the passenger compartment of the vehicle is identified by a camera image, searching for user information of the user, and obtaining, from a server database, information regarding the user's medical care that is registered in association with the searched user information. [Effects of the Invention]

[0008] According to one embodiment of the present disclosure, technology is improved for assisting occupants who become ill in a vehicle. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram illustrating a schematic configuration example of a system according to an embodiment of the present disclosure. [Figure 2] 10 is a flowchart illustrating an example of the operation of the support device. [Figure 3] FIG. 10 is a schematic diagram illustrating an example of the operation of the support device. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present disclosure will be described.

[0011] (Outline of the embodiment) An overview of a system 1 according to an embodiment of the present disclosure will be described with reference to Fig. 1. The system 1 includes a vehicle 10, an assistance device 20 mounted on the vehicle 10, and a server 30. The vehicle 10, the assistance device 20, and the server 30 are communicably connected to a network 2 including, for example, the Internet and a mobile communication network.

[0012] The vehicle 10 is, for example, an automobile, but is not limited to this and may be any vehicle. The automobile may be, but is not limited to, a gasoline-powered vehicle, a BEV (Battery Electric Vehicle), a HEV (Hybrid Electric Vehicle), a PHEV (Plug-in Hybrid Electric Vehicle), or a FCEV (Fuel Cell Electric Vehicle). In the present disclosure, the vehicle 10 is assumed to be a public bus (on-demand bus) that operates on a predetermined route, but is not limited to this. The number of vehicles 10 included in the system 1 may be determined arbitrarily. The vehicle 10 is capable of communicating with the assistance device 20 and the server 30 via the network 2. The vehicle 10 may also be capable of communicating with the assistance device 20 via a wired connection.

[0013] The assistance device 20 is a computer provided in the vehicle 10. The assistance device 20 provides assistance to a user 3 who has become ill inside the vehicle 10. The assistance device 20 is communicably connected to the vehicle 10 and the server 30 via the network 2. The assistance device 20 may also be capable of communicating with the vehicle 10 via a wired connection.

[0014] The server 30 is, for example, a computer owned by a business operator that operates the vehicle 10. The server 30 is capable of communicating with the vehicle 10 and the assistance device 20 via the network 2.

[0015] When a user 3 exhibiting abnormal signs is identified in a camera image in the cabin of a vehicle 10, the assistance device 20 searches for user information of the user 3 and acquires, from the database 32A of the server 30, information related to the medical care of the user 3 that is registered in association with the searched user information.

[0016] As described above, according to this embodiment, when a user 3 showing abnormal signs in the vehicle cabin is identified by a camera image, medical information about the user 3 is acquired. This allows the crew 4 of the vehicle 10 to provide appropriate first aid to the user 3. This improves the likelihood that the user 3's physical condition will improve, thereby improving the technology for supporting users who become ill in a vehicle.

[0017] Next, each component of the system 1 will be described in detail.

[0018] (Vehicle configuration) 1, the vehicle 10 includes a communication unit 11, a storage unit 12, and a control unit 13. The vehicle 10 further includes an assistance device 20. Details of the assistance device 20 will be described later.

[0019] The communication unit 11 includes both a communication interface for wireless connection to the network 2 and a communication interface for wired connection to a CAN (Controller Area Network). The communication interface for connection to the network 2 corresponds to a mobile communication standard such as, but not limited to, 4G (4th Generation) or 5G (5th Generation).

[0020] The storage unit 12 includes one or more memories. The memories may be, for example, semiconductor memories, magnetic memories, or optical memories, but are not limited to these. Each memory included in the storage unit 12 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 12 stores any information used in the operation of the vehicle 10. For example, the storage unit 12 may store system programs, application programs including car navigation applications, embedded software, operation information, map information, and the like. The information stored in the storage unit 12 may be updatable with information obtained from the network 2 via the communication unit 11, for example.

[0021] The control unit 13 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or a combination thereof. The processor may be, for example, a general-purpose processor such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or a dedicated processor specialized for a specific process, but is not limited to these. The programmable circuit may be, for example, but is not limited to, an FPGA (Field-Programmable Gate Array). The dedicated circuit may be, for example, but is not limited to, an ASIC (Application Specific Integrated Circuit). The control unit 13 controls the overall operation of the vehicle 10.

[0022] (Configuration of support device) As shown in FIG. 1, the support device 20 includes a communication unit 21, a positioning unit 22, an input unit 23, an output unit 24, a storage unit 25, and a control unit .

[0023] The communication unit 21 includes both a communication interface for wireless connection to the network 2 and a communication interface for wired connection to the CAN. The communication interface for connection to the network 2 corresponds to, for example, a mobile communication standard, but is not limited to these and may correspond to any communication standard.

[0024] The positioning unit 22 includes one or more devices that acquire position information of the vehicle 10. Specifically, the positioning unit 22 includes, for example, a receiver compatible with GPS, but is not limited to this and may include a receiver compatible with any satellite positioning system.

[0025] The input unit 23 is configured to include an input interface that can input images and voices of the user 3 riding in the vehicle 10. The input interface is, for example, a camera 23A that captures images of the user 3 and a microphone 23B that collects voices of the user 3. However, the input interface is not limited to these.

[0026] Camera 20A is, for example, a video camera installed at the entrance and inside the vehicle cabin, and captures moving or still images. Camera 23A captures images of the face and body of user 3. Camera 23A is, for example, installed on a wall or ceiling inside the vehicle cabin, and monitors the activities of user 3. Microphone 23B is, for example, a microphone installed at the entrance and inside the vehicle cabin, and captures the voice emitted by user 3.

[0027] The output unit 24 includes at least one audio output interface capable of outputting audio and at least one display interface capable of displaying text or video. The audio output interface is, for example, a speaker. The display interface is, for example, a display such as an LCD or an organic EL display.

[0028] The storage unit 25 includes one or more memories. Each memory included in the storage unit 25 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 25 stores any information used in the operation of the assistance device 20. For example, the storage unit 25 may store a system program, an application program, etc. The storage unit 25 registers user information of the user 3. The information stored in the storage unit 25 may be updatable with information obtained from the network 2 via the communication unit 21, for example.

[0029] The control unit 26 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or a combination thereof. The control unit 26 controls the overall operation of the assistance device 20.

[0030] (Server configuration) As shown in FIG. 1, the server 30 includes a communication unit 31, a storage unit 32, and a control unit 33.

[0031] The communication unit 31 includes one or more communication interfaces connected to the network 2. The communication interfaces may correspond to, for example, a mobile communication standard, a wired LAN standard, or a wireless LAN standard, but are not limited to these and may correspond to any communication standard. In this embodiment, the server 30 communicates with the vehicle 10 and the assistance device 20 via the communication unit 31 and the network 2.

[0032] The storage unit 32 includes one or more memories. Each memory included in the storage unit 32 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 32 stores any information used in the operation of the server 30. For example, the storage unit 32 may store a system program, a database, and an application program. Furthermore, the storage unit 32 includes a database 32A that associates and stores user information of the user 3 with information related to the user's medical care. The information stored in the storage unit 32 may be updatable with information obtained from the network 2 via the communication unit 31, for example.

[0033] The control unit 33 includes one or more processors, one or more programmable circuits, one or more dedicated circuits, or a combination thereof. The control unit 33 controls the overall operation of the server 30.

[0034] (Operation flow of the support device) Fig. 2 is a flowchart showing an example of the operation of the assistance device 20. The operation of the assistance device 20 according to this embodiment will be described with reference to Fig. 2. This operation relates to assistance for a user who has fallen ill in a vehicle.

[0035] S101: The control unit 26 receives a notification from the server 30 that the user 3 has purchased a ticket for the vehicle 10.

[0036] In the present disclosure, vehicle 10 is assumed to be an on-demand bus (public bus), but is not limited to this. User 3 purchases a boarding ticket online on a website published by server 30 owned by a business operator that operates vehicle 10. When the purchase of the boarding ticket is completed, control unit 26 receives a notification from server 30 that user 3 has completed the purchase of the boarding ticket for vehicle 10.

[0037] S102: The control unit 26 registers the user information of the user 3.

[0038] When purchasing a boarding ticket online, user 3 inputs user information on a website published by server 30. Control unit 33 of server 30 accepts the user information entered by user 3 and registers the accepted user information in database 32A provided in memory unit 32. Control unit 33 transmits the registered user information of user 3 to support device 20 provided in vehicle 10 for which user 3 makes a boarding reservation. Control unit 26 registers the received user information of user 3 in memory unit 25 as user information of the person who made the boarding reservation.

[0039] The user information includes basic information such as the address, name, and contact information (telephone number, email address) of the user 3. The user information also includes a user ID issued to the user 3 by the operator of the vehicle 10. Furthermore, the user information includes a facial image for identifying the user 3. Furthermore, the user information may include a voice model of the user 3 who uttered a predetermined phrase.

[0040] When user 3 gets on or off vehicle 10, input unit 23 uses camera 23A to capture a facial image of user 3. Input unit 23 may also use microphone 23B to collect the voice of user 3 uttering predetermined phrases such as "user 3's name" or "getting on, getting off." Control unit 26 verifies the identity of user 3 by comparing the facial image of user 3 with the facial image of user 3 included in the user information registered in storage unit 25. Control unit 26 may also verify the identity of user 3 by comparing the voice of user 3 uttering the predetermined phrase with a voice model of user 3 extracted by voiceprint analysis of the predetermined phrase uttered by user 3 included in the user information.

[0041] S103: The control unit 26 receives a notification that the medical information of the user 3 has been registered in the server 30.

[0042] FIG. 3 is a schematic diagram illustrating an example of the operation of the assistance device 20. In the example shown in FIG. 3, four users 3 (e.g., 3A, 3B, 3C, and 3D) are assumed to be riding in a vehicle 10. The users 3 access a website previously published by the server 30 and purchase tickets for the vehicle 10. When purchasing tickets, the users 3 (3A, 3B, 3C, and 3D) optionally enter medical information α (described below) on the website in addition to required user information. When the camera 23A identifies, for example, user 3C exhibiting an abnormal sign (described below) in the cabin of the vehicle 10 in which users 3A, 3B, 3C, and 3D are riding, the assistance device 20 performs the procedure described below to acquire the medical information α about user 3C registered in the server 30. Then, the crew member 4 of the vehicle 10 provides necessary first aid to user 3C based on the medical information α about user 3C.

[0043] The medical information α is information about the user 3's medical history and first aid measures to be taken when the medical history develops, which is voluntarily registered with the user 3's consent. The control unit 33 links the information about the user 3's medical history and first aid measures to be taken when the medical history develops with the user information and registers it in the database 32A provided in the storage unit 32. The control unit 33 may notify the control unit 26 of the support device 20 that the medical information about the user 3 has been registered in the server 30.

[0044] S104: The control unit 26 monitors whether the user 3 exhibiting an abnormal sign in the passenger compartment of the vehicle 10 is identified from the camera image. If the user 3 is identified, the process proceeds to S105, and if the user 3 is not identified, the process proceeds to S109.

[0045] An abnormal sign is when the user 3 falls to the floor in the vehicle cabin from a standing or seated position that they have maintained in the vehicle cabin, and the fall continues for a predetermined time (e.g., one minute or more). A fall may be defined as the user 3's head being within a predetermined height (e.g., within 40 cm) from the floor surface in the vehicle cabin. In such a case, the control unit 26 determines that the user 3 has fallen if the user's head, identified by the camera image, is 30 cm or less from the floor surface in the vehicle cabin for two minutes. However, the predetermined time, the predetermined height, and the definition of a fall are not limited to these and may be determined arbitrarily. Furthermore, an abnormal sign is not limited to these and may refer to any physical movement suggesting poor health, such as unsteadiness when walking, crouching in a seat, or a noticeable change in facial expression.

[0046] S105: The control unit 26 searches for the user information of the user 3 who exhibits an abnormal sign inside the vehicle 10.

[0047] The control unit 26 identifies the user 3 by comparing the facial image of the user 3 who shows the abnormal sign with the facial image of the user 3 included in the user information registered in the memory unit 25.

[0048] S106: The control unit 26 checks whether the user information of the searched user 3 is linked to and registered with information related to the medical care of the user 3. If the information related to the medical care of the user 3 is linked and registered, the process proceeds to S107; if not, the process proceeds to S108.

[0049] The medical information is information about the medical history of the user 3 and first aid measures to be taken when the medical history occurs, which is voluntarily registered with the consent of the user 3. When the user 3 provides the information with consent, the medical information about the user 3 and the user information are linked and registered in the database 32A of the server 30.

[0050] In S103, when the medical information of user 3 is registered, the control unit 26 receives a notification to that effect from the server 30. Therefore, the control unit 26 determines whether the medical information of user 3 is registered based on whether the notification to that effect has been received from the server 30.

[0051] S107: The control unit 26 acquires information relating to the medical care of the user 3 that is registered in the database 32A of the server 30 in association with the user information.

[0052] When the control unit 26 determines that information relating to the medical care of the user 3 is registered, it transmits, for example, the user ID of the user 3 registered in the storage unit 25 to the server 30 to request transmission of the information. When the user ID of the user 3 transmitted from the support device 20 matches the user ID of the user 3 registered in the server 30, the server 30 reads the information relating to the medical care of the user 3 from the database 32A and transmits it to the control unit 26 via the communication unit 31, the network 2, and the communication unit 21. However, the method of identity verification of the user 3 between the support device 20 and the server 30 is not limited to the method of verifying the user ID, and any method may be adopted.

[0053] S108: The control unit 26 instructs the crew member 4 of the vehicle 10 to provide first aid to the user 3.

[0054] The control unit 26 outputs the medical information about the user 3 received from the server 30 as audio from a speaker provided in the output unit 24, or displays it as text or images on a display. The crew member 4 of the vehicle 10 stops the vehicle 10 in a safe place and provides the necessary first aid to the user 3 based on the medical information about the user 3. Furthermore, if emergency transport to a hospital or other such service is necessary, the crew member 4 makes such arrangements. On the other hand, if the medical information about the user 3 is not registered, the control unit 26 provides the user 3 with first aid as specified in a predetermined manual or the like of the vehicle's operation management company, and makes arrangements for emergency transport to a hospital or other such service as necessary.

[0055] S109: The control unit 26 determines whether the vehicle 10 has arrived at the destination. If the vehicle 10 has arrived at the destination, the information processing ends, and if the vehicle 10 has not arrived at the destination, the control unit 26 returns to S104 and continues the information processing.

[0056] The positioning unit 22 determines whether the vehicle 10 has arrived at the destination and transmits the determination result to the control unit 26.

[0057] As described above, when a user 3 exhibiting abnormal signs is identified by a camera image in the cabin of the vehicle 10, the assistance device 20 of this embodiment searches for user information of the user 3 and obtains medical information about the user 3 that is registered in association with the searched user information from the database 32A of the server 30.

[0058] According to this configuration, when a user 3 showing abnormal signs in the vehicle cabin is identified by a camera image, medical information about the user 3 is acquired. This allows the crew 4 of the vehicle 10 to provide appropriate first aid to the user 3. This improves the likelihood that the user 3's physical condition will improve, thereby improving the technology for supporting users who become ill in a vehicle.

[0059] Although the present disclosure has been described based on the drawings and examples, it should be noted that those skilled in the art may make various modifications and alterations based on the present disclosure. Therefore, it should be noted that these modifications and alterations are included in the scope of the present disclosure. For example, the functions included in each component or step can be rearranged so as not to be logically inconsistent, and multiple components or steps can be combined or divided into one.

[0060] For example, in the above-described embodiment, the configuration and operation of the support device 20 may be distributed among multiple computers that can communicate with each other. Also, for example, an embodiment in which part or all of the medical information of the user 3 is stored in the storage unit 25 of the support device 20 is possible.

[0061] In the above-described embodiment, the assistance device 20 identifies abnormal signs shown by the user 3 in the vehicle cabin using camera images. However, when the assistance device 20 picks up a predetermined phrase that the user 3 has preliminarily decided to utter when he / she becomes unwell, or a voice such as "I'm not feeling well, please take me to the hospital," the assistance device 20 may be configured to compare the voice with a voice model of the user 3 registered in the user information to identify the user 3 who has shown abnormal signs.

[0062] Also, an embodiment is possible in which, for example, a general-purpose computer functions as the assistance device 20 according to the above-described embodiment. Specifically, a program describing the processing content for realizing each function of the assistance device 20 according to the above-described embodiment is stored in the memory of the general-purpose computer, and the program is read and executed by a processor. Therefore, the present disclosure can also be realized as a program executable by a processor, or a non-transitory computer-readable medium storing the program.

[0063] In one example, the assistance device 20 may be used to provide MaaS (Mobility as a Service), which is a service that utilizes mobility. [Explanation of symbols]

[0064] 1 System 2 Network 3 User 4 Crew 5. Entrance / exit 10 vehicles 11 Communications Department 12 Storage section 13 Control Unit 20 Support equipment 21 Communications Department 22 Positioning unit 23 Input section 23A Camera 23B Microphone 24 Output section 25 Memory section 26 Control Unit 30 servers 31 Communications Department 32 Storage section 32A Database 33 Control Unit

Claims

1. An assistance device mounted on a vehicle, The assistance device includes a control unit that, when a user exhibiting abnormal signs in the passenger compartment of the vehicle is identified by a camera image, searches for user information about the user and obtains, from a server database, information about the user's medical care that is registered in association with the searched user information.

2. The support device according to claim 1, The abnormal sign is that the user falls to the floor in the vehicle cabin from a standing or seated position that they have been maintaining in the vehicle cabin, and the fall continues for a predetermined period of time or more.

3. The support device according to claim 1, The user information includes a user ID issued to the user by the vehicle operator and a facial image for identifying the user.

4. The support device according to claim 1, The medical information is information about the user's medical history and first aid when the medical history develops.

5. An assistance method executed by an assistance device mounted on a vehicle, comprising: When a user who shows an abnormal sign in the passenger compartment of the vehicle is identified by a camera image, searching for user information of the user; Obtaining medical information about the user that is registered in association with the searched user information from a database of the server; and how to help.

6. A MaaS (Mobility as a Service) providing method using the assistance device according to claim 1.

Images