Electronic device for providing notification of vehicle collision, operation method thereof, and storage medium
The electronic device addresses the challenge of identifying users and collision positions within a vehicle by using sensors and processors to monitor the vehicle's state and detect collisions, providing timely and accurate notifications for efficient emergency responses.
Patent Information
- Application Number
- PCT/KR2024/008022
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-09-06
- Filing Date
- 2024-06-12
- Publication Date
- 2025-01-30
AI Technical Summary
Current electronic devices lack the capability to accurately identify users and collision positions within a vehicle during a collision, leading to potential delays in emergency responses due to insufficient information about the accident type and passenger conditions.
An electronic device equipped with sensors and processors that monitor the vehicle's driving state and detect collisions, identifying user information and collision positions through sensor fusion, voice recognition, and communication with wearable devices to provide timely and accurate notifications.
Enables efficient emergency response by accurately identifying users and collision details, facilitating rapid and targeted assistance based on the collision type and passenger conditions.
Smart Images

Figure KR2024008022_30012025_PF_FP_ABST
Abstract
Description
Electronic device for providing notification of vehicle collision, method of operation thereof and storage medium
[0001] One embodiment disclosed in this document relates to an electronic device, a method of operation thereof, and a storage medium for providing notification of a vehicle collision.
[0002] The variety of services and additional features offered through electronic devices such as smartphones is steadily increasing. For example, electronic devices include communication capabilities as well as sensing capabilities that detect the surrounding environment. Furthermore, the installation of additional applications can provide even more diverse functions. In addition to executing pre-installed applications or stored files, electronic devices can also access servers or other electronic devices via wired or wireless means to receive a variety of information in real time. Consequently, the various functions offered through electronic devices are also becoming increasingly sophisticated.
[0003] Additionally, wearable electronic devices can independently transmit and receive data, including communication modules, and can be used in conjunction with electronic devices such as smartphones. In this case, users can more easily utilize various services by utilizing both electronic devices and wearable electronic devices. Electronic devices and / or wearable electronic devices, which are convenient to carry and use, can be exposed to various operating environments.
[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.
[0005] According to one embodiment, the electronic device (101) may include at least one sensor (176, 376), at least one processor (120, 320) operatively connected to the at least one sensor, and a memory (130, 330) storing instructions.
[0006] According to one embodiment, the instructions, when executed by the at least one processor, may be configured to cause the electronic device to identify information about at least one user within the vehicle (210).
[0007] According to one embodiment, the instructions may be configured to cause the electronic device to periodically or aperiodically monitor the driving state of the vehicle using the at least one sensor.
[0008] In one embodiment, the instructions may be configured to cause the electronic device to identify a collision location for the vehicle based on a vehicle collision being detected during the monitoring.
[0009] In one embodiment, the instructions may be configured to cause the electronic device to provide a notification based on the identified collision location and information about the at least one user.
[0010] According to one embodiment, a method for providing a notification of a vehicle collision in an electronic device (101) may include an action of identifying information about at least one user within a vehicle (210).
[0011] According to one embodiment, the method may include an operation of periodically or aperiodically monitoring a driving state of the vehicle using at least one sensor (176, 376) of the electronic device.
[0012] In one embodiment, the method may include an action of identifying a collision location for the vehicle based on a vehicle collision being detected during the monitoring.
[0013] In one embodiment, the method may include providing a notification based on the identified collision location and information about the at least one user.
[0014] According to one embodiment, a storage medium storing at least one computer-readable instruction, wherein the at least one instruction, when executed by at least one processor (120, 320) of an electronic device (101), causes the electronic device (101) to perform at least one operation, wherein the at least one operation may include an operation of identifying information about at least one user within a vehicle (210).
[0015] According to one embodiment, the at least one operation may include an operation of periodically or aperiodically monitoring a driving state of the vehicle using at least one sensor (176, 376) of the electronic device.
[0016] In one embodiment, the at least one action may include identifying a collision location for the vehicle based on a vehicle collision being detected during the monitoring.
[0017] In one embodiment, the at least one action may include providing a notification based on the identified collision location and information about the at least one user.
[0018] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.
[0019] FIG. 2 is a system configuration diagram for providing notification of a vehicle collision according to one embodiment.
[0020] FIG. 3 is a block diagram illustrating an internal configuration of an electronic device and a wearable electronic device for providing a notification of a vehicle collision according to one embodiment.
[0021] FIG. 4 is a drawing for explaining a method for identifying whether a vehicle is boarded or not according to one embodiment.
[0022] FIG. 5 is a drawing for explaining a method for identifying a user riding in a vehicle according to one embodiment.
[0023] FIG. 6 is an exemplary diagram illustrating voice recognition for passenger identification according to one embodiment.
[0024] FIG. 7 is a flowchart illustrating an operation of an electronic device for providing a notification of a vehicle collision according to one embodiment.
[0025] Figure 8 is an exemplary diagram showing vehicle collision types according to one embodiment.
[0026] FIG. 9A is an exemplary diagram illustrating a method for obtaining driving-related information using sensor fusion in an electronic device installed in a vehicle according to one embodiment.
[0027] FIG. 9b is a diagram for explaining a change in driving acceleration predicted by an electronic device according to one embodiment.
[0028] FIG. 10 is a flowchart illustrating the operation of an electronic device for identifying a collision location for a vehicle according to one embodiment.
[0029] FIG. 11 is a drawing for explaining a method for identifying a collision location according to a rotation direction of a vehicle according to one embodiment.
[0030] FIG. 12 is a flowchart illustrating the operation of an electronic device for identifying a mounting state of an electronic device in a vehicle according to one embodiment.
[0031] Figure 13 is an example of a notification screen for collision location and seating location in the event of a vehicle collision according to one embodiment.
[0032] Figure 14 is an example of a notification screen showing a collision location and user information according to one embodiment.
[0033] Figure 15 is an example of an emergency notification screen based on a user abnormality according to one embodiment.
[0034] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.
[0035] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.
[0036] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment. Referring to FIG. 1 , in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0037] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0038] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0039] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0040] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0041] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0042] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0043] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0044] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0045] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0046] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0047] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0048] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0049] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0050] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0051] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0052] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0053] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0054] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0055] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.
[0056] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0057] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0058] In the detailed description below, reference numerals in the drawings may be used interchangeably or omitted for components that can be easily understood through the preceding embodiments, and their detailed descriptions may also be omitted. An electronic device according to an embodiment disclosed in this document may be implemented by selectively combining components of different embodiments, and components of one embodiment may be replaced by components of another embodiment. For example, it should be noted that the present invention is not limited to specific drawings or embodiments.
[0059] FIG. 2 is a system configuration diagram for providing notification of a vehicle collision according to one embodiment.
[0060] Referring to FIG. 2, a system (200a) for providing a notification of a vehicle collision may include an electronic device (101) (e.g., a smart phone) of a user riding in a vehicle (210) (e.g., the electronic device (101) of FIG. 1). The system (200a) may further include a wearable electronic device (102) (e.g., a smart watch) (e.g., the electronic device (102) of FIG. 1) that is linked based on the same user account as the electronic device (101). The system (200a) may further include an electronic device and / or a wearable electronic device of a passenger riding in the vehicle (210).
[0061] The electronic device (101) can detect a collision situation (or accident situation) of the vehicle (210) using various sensors included in the electronic device (101). When a vehicle collision occurs, the electronic device (101) can notify of an emergency situation and determine the actual collision situation based on user feedback. Accordingly, the electronic device (101) supporting emergency situation notification can request emergency rescue using the rescue sensor (220) or transmit the emergency situation by communicating with the server (108) via a communication network.
[0062] However, if emergency rescue calls are made based solely on the impact of a vehicle collision, the type of accident or the severity of the passengers' condition cannot be determined, potentially leading to a long delay in completing the rescue. Therefore, measures may be needed to enable electronic devices to quickly respond to various potential vehicle hazards, vehicle conditions, and passenger information.
[0063] In one embodiment, the present invention relates to an electronic device, an operating method thereof, and a storage medium for effectively providing notification of a vehicle collision by identifying an accident type or passenger information in the electronic device upon a vehicle collision.
[0064] FIG. 3 is a block diagram illustrating an internal configuration of an electronic device and a wearable electronic device for providing a notification of a vehicle collision according to one embodiment.
[0065] Referring to FIG. 3, the electronic device (101) (e.g., the electronic device (101) of FIG. 1 or FIG. 2) may include a sensor module (376) (e.g., the sensor module (176) of FIG. 1) and at least one processor (320) (e.g., the processor (120) of FIG. 1). The sensor module (376) may include at least one sensor. According to one embodiment, the electronic device (101) may further include a memory (330) (e.g., the memory (130) of FIG. 1), a display (360) (e.g., the display (160) of FIG. 1), at least one microphone (350) (e.g., the input module (150) of FIG. 1), or communication circuitry (390) (e.g., the communication module (190) of FIG. 1). According to one embodiment, the electronic device (101) may omit at least one of the components or additionally include other components.
[0066] According to one embodiment, the sensor module (376) may sense information (or data) for detecting a collision and / or accident of a vehicle (e.g., vehicle (210) of FIG. 2). The sensor module (376) may include at least one sensor. For example, the sensor module (376) may include an acceleration sensor for sensing acceleration, a gyro sensor for sensing attitude, a sound sensor for sensing a vehicle collision sound, or an air pressure sensor for sensing air pressure. Meanwhile, the sensors included in the sensor module (376) may not be limited thereto.
[0067] According to one embodiment, the processor (320) may control the overall operation of the electronic device (101). For example, the processor (320) may be implemented identically or similarly to the processor (120) of FIG. 1.
[0068] According to one embodiment, the processor (320) may establish a communication connection with a wearable electronic device (102) worn on a user's body through a communication circuit (390). For example, the communication circuit (390) may support a short-range communication technology (e.g., Bluetooth, Bluetooth low energy (BLE), WiFi). In addition, the communication circuit (390) may support an ultra-wide band (UWB) communication technology. The communication connection may be established using any one of the communication technologies supported by the communication circuit (390). For example, the wearable electronic device (102) may be implemented as a smart watch that can be worn on a user's wrist. In addition to a smart watch, the wearable electronic device (102) may also be implemented as a smart ring.
[0069] According to one embodiment, the processor (320) can identify whether a user is in the vehicle (210) through at least one of the sensor module (376) and the communication circuit (390). For a more detailed explanation, reference will be made to FIG. 4. FIG. 4 is a diagram illustrating a method for identifying whether a user is in the vehicle according to one embodiment.
[0070] Referring to FIG. 4, in one embodiment, the processor (320) can identify whether a user is in the vehicle (210) based on air pressure change data (420) according to the opening or closing of the vehicle's (210) door through a sensor module (376) (e.g., air pressure sensor).
[0071] In one embodiment, the processor (320) may identify whether the user is moving by utilizing the activity context information (410) of the user carrying the electronic device (101), and may identify the user's movement immediately before or after getting on or off the vehicle (210), thereby identifying the user's boarding or getting off the vehicle (210). For example, the user's activity context information (410) may include the user's physical state information, which is information indicating the user's state or the situation the user is in. The processor (320) may identify the user's physical state information based on the sensing information acquired through the sensor module (376). For example, the processor (320) may identify physical state information, such as whether the user's heart rate is stabilized when the user walks while carrying the electronic device (101) and then gets on the vehicle (210), or whether the user is motionless after walking.
[0072] In addition to the above, the user's activity context information (410) may include the user's schedule information registered in the scheduler function. The processor (320) may use the user's schedule information registered in the scheduler function to predict the time at which the user will board the vehicle (210), and may use the user's physical condition information at the predicted boarding time to identify whether the user is boarding the vehicle (210). In this way, the processor (320) may use the user's activity context information (410) to identify the user's boarding or disembarkation from the vehicle (210).
[0073] In one embodiment, the processor (320) can identify whether a vehicle (210) is boarded based on GNSS (global navigation satellite system) information or cell switching information (450). To this end, the processor (320) can detect movement above a certain speed or check cell switching information (450) through a GNSS module (not shown) or a GPS module (not shown). Here, the GNSS module can receive a signal capable of identifying the location of the electronic device (101). For example, the GNSS module can receive a signal capable of identifying the location of the electronic device (101) using at least one of GPS, GLONASS, Galileo, or Beidou.
[0074] In one embodiment, in addition to the above, the processor (320) may detect a vibration pattern of the vehicle (210) using a sensor module (376) (e.g., an acceleration sensor or a gyro sensor), detect a magnetic pattern, or detect a pattern of an engine sound of the vehicle (210) and / or a low-frequency sound output from the vehicle (210) using a sound sensor. Based on the detected pattern and / or information, the processor (320) may confirm or determine whether a user is in the vehicle (210).
[0075] In addition, the processor (320) may determine that a user is in the vehicle (210) when connected to a set-top device (not shown) (e.g., a vehicle application installed in the set-top device) (440) mounted on the vehicle (210) or connected to the set-top device using Bluetooth communication (430). For example, the processor (320) may be connected to the vehicle (210) using various communication methods (e.g., Bluetooth, low-power Bluetooth, or UWB) when the processor (320) approaches within a certain distance (e.g., a communication range) from the vehicle (210). The processor (320) may be connected to the vehicle (210) using Bluetooth communication (430) when the vehicle (210) is powered on or the engine is started. The processor (320) may determine that the user has boarded the vehicle (210) when the processor (320) attempts to connect to the vehicle (210) through a scanning process (e.g., BLE advertising operation) or is connected to the vehicle (210) through a set communication method (e.g., Bluetooth or UWB). Alternatively, when the user gets off the vehicle (210), the location information of the vehicle (210) is stored in the memory (330), and the processor (320) may determine that the user has approached or boarded the vehicle (210) when the location information of the electronic device (101) obtained from the GNSS module is within a certain distance (e.g., about 1 m, about 30 cm) from the location information of the vehicle (210).
[0076] As described above, the method for identifying whether a user is in the vehicle (210) may not be limited to what has been described above. In addition, it goes without saying that the operation for identifying whether a user is in the vehicle (210) may be performed substantially equally not only in the electronic device (101) but also in the wearable electronic device (102). For example, in the case of a wearable electronic device (102), if it can transmit and receive data independently by including a communication circuit, the wearable electronic device (102) is connected to a set-top device (not shown) (e.g., a vehicle application installed in the set-top device) (440) mounted on the vehicle (210) or connected to the set-top device using Bluetooth communication (430), it may be determined that a user wearing the wearable electronic device (102) is in the vehicle (210). In addition, when the electronic device (101) is in a state of communication connection with the wearable electronic device (102), it can receive information sensed by the wearable electronic device (102) from the wearable electronic device (102) and identify whether a user is in the vehicle (210) based on the received information. As described above, the identification operation for whether a user is in the vehicle (210) can be performed by the electronic device (101) and / or the wearable electronic device (102).
[0077] According to one embodiment, the processor (320) can identify information about a user who has boarded the vehicle (210) when it has identified that a user has boarded the vehicle. Since at least one user may be boarding the vehicle (210), if information about not only the user but also the passenger can be identified, more efficient response can be achieved in the event of an emergency rescue request. To explain this in detail, reference will be made to FIGS. 5 and 6. FIG. 5 is a diagram illustrating a method for identifying a user boarding a vehicle according to one embodiment, and FIG. 6 is an exemplary diagram illustrating voice recognition for passenger identification according to one embodiment.
[0078] Referring to FIG. 5, when it is detected that a user of an electronic device (101) in a vehicle (210) is on board, a processor (e.g., processor (320) of FIG. 3) can detect the direction of sound or detect external sound through at least one microphone (e.g., microphone (350) of FIG. 3) of the electronic device (101). Accordingly, the processor (320) can identify at least one of the number of users and seating positions within the vehicle (210) based on a voice signal received through at least one microphone (350) when a user speaks. For example, an audio digital signal processor (ADSP) can be utilized to continuously receive a user's voice signal through the microphone (350) in a low-power processor. If a voice signal is received through the microphone (350), the processor (320) can identify the number of users within the vehicle (210) by performing voice recognition on the received voice signal.
[0079] For example, referring to FIG. 6, when a voice signal (605) including the voice of at least one user is received through at least one microphone (e.g., the microphone (350) of FIG. 3), the processor (320) may separate the voice signals into individual signals based on sound separation technology (610). The processor (e.g., the processor (320) of FIG. 3) may identify the number of users through voice feature extraction (620) for each of the separated voice signals. The processor (320) may identify the number of users by utilizing the difference in patterns through voice feature extraction.
[0080] In addition, if voice features for a user of the electronic device (101) are stored in advance, the processor (320) may be able to identify the matched user as the driver of the vehicle (210) by performing speaker matching through voice feature extraction. Similarly, if voice features are stored in advance for the user and / or frequent passengers (e.g., family members), the user and / or passengers riding in the vehicle (210) may be identified by matching separated voice signals to the user and / or passengers through learning such as deep learning.
[0081] In addition, since at least one microphone (350) is arranged at different locations within the housing of the electronic device (101), the seating positions of the user and the passenger within the vehicle (210) can be identified, for example, through three-way microphone input. For example, as illustrated in FIG. 5, if the user and the passenger within the vehicle (210) are seated at different locations, the magnitudes of the voice signals obtained through the microphones (350) of the user seated in the driver's seat and the passenger seated in the rear seat may also be different. For example, since a user carrying an electronic device (101) while riding in the vehicle (210) drives with the device mounted at a designated location, the magnitudes of the voice signals received through at least one microphone (350) of the mounted electronic device (101) may also vary depending on the distance between the electronic device (101) and the seating position. Therefore, the processor (320) can identify the seating position based on the result of comparing the magnitudes of the voice signals. For example, the mounted state of the electronic device (101) may include a state in which it is fixed using a device such as a cradle mounted on the front of a dashboard in a vehicle (210), or a state in which it is placed in a location such as a console box or a seat. The processor (320) may detect the movement of the electronic device (101) itself using at least one sensor of the sensor module (376), and may determine that the electronic device (101) is mounted using the detected sensing information.
[0082] As described above, according to one embodiment, the processor (320) can identify a user boarding the vehicle (210) by analyzing a voice signal, and can identify the number of passengers and / or seating positions.
[0083] Meanwhile, the processor (320) can identify a user riding in the vehicle (210) in various ways other than using a voice signal.
[0084] In one embodiment, the processor (320) may be connected to a set-top device mounted on a vehicle (210) or may be connected to the set-top device using Bluetooth communication, and may recognize that the user of the electronic device (101) is on board based on connection information with the set-top device. For example, when the electronic device (101) carried by the user who primarily drives the vehicle (210) is connected to the set-top device, the processor (320) may recognize the user of the electronic device (101) as a driver through the connection information.
[0085] In one embodiment, when the processor (320) is connected to the wearable electronic device (102), the processor (320) can recognize a user riding in the vehicle (210) based on sensing information received from an inertial sensor (e.g., an acceleration sensor, a gyro sensor) of the wearable electronic device (102). For example, since a user wearing the wearable electronic device (102) mainly performs a motion of holding and turning the steering wheel, the processor (320) can detect a driving state based on the sensing information. Accordingly, the processor (320) can recognize that the user wearing the wearable electronic device (102) is a driver. In one embodiment, the method for identifying the number of passengers, seating positions, or the driver and / or passengers in the vehicle (210) is not limited to the above-described method, and various methods can be applied.
[0086] According to one embodiment, the memory (330) may store instructions for providing a notification of a vehicle collision when a vehicle collision occurs, and may be the memory (130) described above with reference to FIG. 1. In one embodiment, the memory (330) may store a voice recognition algorithm used for user identification based on a voice signal.
[0087] In one embodiment, the processor (320) may periodically or aperiodically monitor the driving state of the vehicle (210) using at least one sensor of the sensor module (376). For example, the processor (320) may periodically or aperiodically monitor the direction and speed of the vehicle (210). Here, the driving state of the vehicle (210) may include at least one of the direction of travel of the vehicle (210), the speed of the vehicle (210), a change in direction of the vehicle (210), an acceleration direction of the vehicle (210), or a rotational direction of the vehicle (210).
[0088] According to one embodiment, when a user is riding in a vehicle (210) (e.g., the vehicle (210) is driving), if an acceleration value sensed through a sensor module (376) (e.g., an acceleration sensor, a gyro sensor) is greater than a certain threshold, a GNSS movement speed is rapidly reduced, and a sound suspected of a collision of the vehicle (210) is detected, the processor (320) may determine that the vehicle (210) has been collided or an accident has occurred. In addition, the processor (320) may determine whether an angular velocity change amount is greater than a certain threshold through the sensor module (376). For example, when the direction of travel of the vehicle (210) is rapidly changed to a different direction due to a collision, the processor (320) may detect a rapid change in angular velocity through the sensor module (376). In addition, the processor (320) can detect a change in angular velocity by adjusting or increasing the weight of the horizontal movement (or impact amount) of the navigation frame sensed by the sensor module (376) because a pattern having a major meaning in the horizontal movement is generated due to the collision of the vehicle (210). The processor (320) can check whether the amount of change in air pressure is greater than a certain threshold value through the sensor module (376) (e.g., an air pressure sensor). For example, since the air pressure of the vehicle (210) may change rapidly when the window is broken or the airbag is deployed due to the collision of the vehicle (210), the processor (320) can detect the change in air pressure. The processor (320) can detect whether the vehicle (210) has collided (or has an accident) based on the above-described sensing values.
[0089] According to one embodiment, the processor (320) can detect whether the vehicle (210) has collided through the monitoring as described above. If a collision of the vehicle (210) is detected during the monitoring, the processor (320) can identify the location of the collision with respect to the vehicle (210). According to one embodiment, the processor (320) can identify the location of the collision with respect to the vehicle (210) based on the direction of acceleration of the vehicle (210) and / or the direction of rotation of the vehicle (210). In addition, the processor (320) can use the angle of the collision vector as well as the direction of acceleration indicating forward movement to identify the location of the collision with respect to the vehicle (210). For example, the processor (320) can identify various collision locations (or collision directions), such as the front of the vehicle (210), the rear of the vehicle (210), or the side of the vehicle (210), based on the acceleration direction of the vehicle (210) and / or the rotational direction of the vehicle (210).
[0090] In one embodiment, it may be assumed that the electronic device (101) is fixedly mounted inside the vehicle (210) in order to identify the collision location of the vehicle (210). For example, if the driving state of the vehicle (210) is identified while the electronic device (101) is mounted inside the vehicle (210), the accuracy of the driving state information (or data) acquired through monitoring may be further improved. For example, if the electronic device (101) falls inside the vehicle (210) due to various factors such as sudden braking or carelessness in use while the electronic device (101) is not mounted, a collision caused by the dropping of the electronic device (101) may be mistakenly recognized as a vehicle collision even though no actual vehicle collision has occurred. In one embodiment, in order to prevent a collision situation caused by the dropping of the electronic device (101) from being mistakenly recognized as a vehicle collision accident, an operation for identifying whether the electronic device (101) is in a mounted state must be performed prior to monitoring the driving state of the vehicle (210). A specific description related to identifying the mounted state will be described later in FIG. 12.
[0091] According to one embodiment, the processor (320) may display accident information via the display (360) based on the detection of the collision. Alternatively, the processor (320) may provide a notification indicating the accident to the user via a vibration element, and the method of outputting the notification is not limited thereto. For example, the processor (320) may provide a notification indicating the accident via an audio notification, such as a warning sound or a notification that outputs the accident details audibly.
[0092] In one embodiment, the processor (320) may provide a notification based on the collision location and information about an identified user within the vehicle (210). When connected to the wearable electronic device (102), the processor (320) may provide the notification to the wearable electronic device (102) so that the notification is displayed through the display of the wearable electronic device (102).
[0093] For example, the notification may include at least one of the following: the location of the collision with respect to the vehicle (210), the number of passengers in the vehicle (210), driver and / or passenger information, or the user's vital signs information. Additionally, the notification may include an option to select whether to initiate emergency rescue, and a designated agency or contact information (e.g., family, 119).
[0094] The processor (320) may optionally provide rescue notifications based on user feedback regarding the above notification. For example, in the case of a minor accident, the user may choose to disable emergency contact in response to the notification. Alternatively, if the user is identified as being in a high-risk situation where they cannot request emergency rescue, an emergency call may be made to a designated agency or contact (e.g., family, 119).
[0095] In one embodiment, in consideration of a situation where a user loses consciousness due to a vehicle (210) collision, the processor (320) may operate to automatically perform emergency rescue based on the user's bio-signal information.
[0096] In one embodiment, when a collision of a vehicle (210) is detected, the processor (320) may transmit a signal to the wearable electronic device (102) to obtain information (e.g., sensing information) corresponding to the time of the collision. The processor (320) may obtain or confirm information sensed by the wearable electronic device (102), such as bio-signal information such as heart rate. Accordingly, the processor (320) may identify an abnormal state of a user wearing the wearable electronic device (102) based on the bio-signal information. If the abnormal state of the user is an emergency state, the processor (320) may perform an emergency call. The processor (320) may transmit an emergency contact and / or a rescue signal to a pre-designated organization or a designated contact (e.g., family, 119). In addition, the processor (320) may transmit accident information indicating an accident situation caused by a collision of the vehicle (210) to the server (108). For example, the server (108) may be a server managed by a designated service provider, a server managed by an insurance company, or a server managed by an automobile manufacturer.
[0097] Accordingly, in one embodiment, more accurate guidance regarding vehicle collision and / or accident situations may be provided by using various information such as the collision location for the vehicle (210), the number of passengers in the vehicle (210), driver and / or passenger information, or the user's bio-signal information.
[0098] According to one embodiment, the electronic device (101) may include at least one sensor (176, 376), at least one processor (120, 320) operatively connected to the at least one sensor, and a memory (130, 330) storing instructions. According to one embodiment, the instructions, when executed by the at least one processor, may be configured to cause the electronic device to identify information about at least one user in the vehicle (210). According to one embodiment, the instructions may be configured to cause the electronic device to periodically or aperiodically monitor a driving condition of the vehicle using the at least one sensor. According to one embodiment, the instructions may be configured to cause the electronic device to identify a collision location with respect to the vehicle based on a vehicle collision being detected during the monitoring. In one embodiment, the instructions may be configured to cause the electronic device to provide a notification based on the identified collision location and information about the at least one user.
[0099] According to one embodiment, the driving state of the vehicle may include at least one of a direction of travel of the vehicle, a speed of the vehicle, a change in direction of the vehicle, an acceleration direction of the vehicle, or a rotation direction of the vehicle.
[0100] According to one embodiment, the instructions may be configured to cause the electronic device to identify a collision location for the vehicle based on an acceleration direction of the vehicle and / or a rotation direction of the vehicle.
[0101] According to one embodiment, the instructions may be configured to cause the electronic device to identify a state in which the electronic device is installed inside the vehicle using the at least one sensor, periodically or aperiodically monitor a driving state of the vehicle based on the identification of the state in which the electronic device is installed, and detect a vehicle collision based on the driving state of the vehicle.
[0102] In one embodiment, the instructions may be configured to cause the electronic device to identify whether at least one user is in the vehicle, and to identify information about the at least one user based on identifying that the at least one user is in the vehicle.
[0103] According to one embodiment, the instructions may be configured to cause the electronic device to identify whether the at least one user is on board the vehicle based on at least one of air pressure change data indicating a door closing or opening of the vehicle, communication connection information with the vehicle, global navigation satellite system (GNSS) information, or cell switching information.
[0104] According to one embodiment, the electronic device (101) further comprises at least one microphone (150, 350), and the instructions may be configured to cause the electronic device to identify, based on a voice signal received through the at least one microphone, information about the at least one user, including a number of users and at least one of seating positions within the vehicle.
[0105] According to one embodiment, the electronic device (101) further includes a communication circuit (e.g., a communication module (190) of FIG. 1, or a communication circuit (390) of FIG. 3), and the instructions may be configured to cause the electronic device to identify information about the at least one user based on sensing information received from an inertial sensor of the wearable electronic device when the electronic device is connected to the wearable electronic device (102) through the communication circuit.
[0106] According to one embodiment, the electronic device (101) further includes a display (160, 360), and the instructions may be configured to cause the electronic device to display the notification through the display based on the identified collision location and information about the at least one user, and to provide the notification to the wearable electronic device when connected to the wearable electronic device.
[0107] According to one embodiment, the instructions may be configured to cause the electronic device to identify an abnormal state of a user wearing the wearable electronic device based on a biometric signal received from a biometric sensor of the wearable electronic device, based on a vehicle collision being detected during the monitoring, and to perform an emergency call based on the identified collision location and the abnormal state of the user.
[0108] FIG. 7 is a flowchart illustrating an operation of an electronic device for providing a notification regarding a vehicle collision according to an embodiment. Referring to FIG. 7, the operation method may include operations 705 to 720. Each operation of the operation method of FIG. 7 may be performed by an electronic device (e.g., the electronic device (101) of FIGS. 1 to 5 ), at least one processor of the electronic device (e.g., at least one of the processor (120) of FIG. 1 or the processor (320) of FIG. 3 ). In an embodiment, at least one of operations 705 to 720 may be omitted, the order of some operations may be changed, another operation may be added, or at least two operations may be performed in parallel.
[0109] In operation 705, the electronic device (101) can identify information about at least one user within the vehicle (210).
[0110] According to one embodiment, the electronic device (101) can identify whether at least one user is on board the vehicle. Based on the identification that at least one user is on board the vehicle, the electronic device (101) can identify information about the at least one user.
[0111] According to one embodiment, information about at least one user in the vehicle may be identified based on at least one of air pressure change data indicating a door closing or opening of the vehicle, communication connection information with the vehicle, global navigation satellite system (GNSS) information, or cell switching information.
[0112] According to one embodiment, the electronic device (101) can identify information about at least one user within the vehicle, including the number of users and at least one of the seating positions within the vehicle, based on a voice signal received through at least one microphone (150, 350) of the electronic device (101).
[0113] According to one embodiment, the electronic device (101) can identify information about at least one user based on sensing information received from an inertial sensor of the wearable electronic device (102) when the electronic device (101) is connected to the wearable electronic device (102).
[0114] In operation 710, the electronic device (101) can periodically or aperiodically monitor the driving status of the vehicle using at least one sensor (176, 376) of the electronic device (101).
[0115] According to one embodiment, the driving state of the vehicle may include at least one of a direction of travel of the vehicle, a speed of the vehicle, a change in direction of the vehicle, an acceleration direction of the vehicle, or a rotation direction of the vehicle.
[0116] In operation 715, the electronic device (101) can identify a collision location for the vehicle based on the vehicle collision being detected during the monitoring.
[0117] According to one embodiment, the electronic device (101) can identify a collision location for the vehicle based on an acceleration direction of the vehicle and / or a rotation direction of the vehicle.
[0118] According to one embodiment, the electronic device (101) can identify a state in which the electronic device (101) is mounted inside the vehicle using the at least one sensor. The electronic device (101) can monitor the driving state of the vehicle periodically or non-periodically based on the identification of the mounted state of the electronic device (101). The electronic device (101) can detect a vehicle collision based on the driving state of the vehicle. In one embodiment, in order to detect a vehicle collision (210), it may be assumed that the electronic device (101) is fixedly mounted inside the vehicle (210). According to one embodiment, the electronic device (101) can identify whether the electronic device (101) is mounted when monitoring the driving state of the vehicle (210). According to one embodiment, the electronic device (101) can first perform an operation of identifying the mounted state of the electronic device (101) before monitoring the driving state of the vehicle. Accordingly, the electronic device (101) may perform an operation of monitoring the driving state of the vehicle after identifying that the electronic device (101) is mounted. According to one embodiment, the electronic device (101) may identify the mounting state of the electronic device (101) while monitoring the driving state of the vehicle. In this way, the order of the operation of identifying the mounting state of the electronic device (101) may not be limited to the above-described. Assuming that the electronic device (101) is fixedly mounted inside the vehicle (210), a collision situation due to sudden braking of the vehicle or the dropping of the electronic device (101) due to carelessness during use may not be mistakenly recognized as a vehicle collision accident.
[0119] In operation 720, the electronic device (101) may provide a notification based on the identified collision location and information about the at least one user. For example, the electronic device (101) may output a notification including detailed information such as the collision location for the vehicle (210), the number of passengers in the vehicle (210), driver and / or passenger information, using information about the at least one user in the vehicle, including the number of users and at least one of the seating positions in the vehicle, and the collision location.
[0120] According to one embodiment, the electronic device (101) may display the notification through the display (160, 360) of the electronic device (101). When the electronic device (101) is connected to the wearable electronic device (102), the notification may be provided to the wearable electronic device (102). In one embodiment, the notification may include a function to make an emergency call to an emergency contact set by the user or an emergency medical institution such as 119 according to the user's selection. In addition, the electronic device (101) may also provide a function to automatically make an emergency call to an emergency contact set by the user or an emergency medical institution such as 119 when the user is unable to make a report on his / her own.
[0121] Figure 8 is an exemplary diagram showing vehicle collision types according to one embodiment.
[0122] Figure 8 illustrates various vehicle collisions, such as a frontal collision (810), a rear-end collision while parked (820), a rear-end collision while in progress (830), and a side right-angle collision (830).
[0123] In the case of a vehicle collision, the risk of the accident may vary depending on the direction of the collision and / or the type of accident. For example, statistically, side collisions are classified as a type in which the occupant sitting in the driver's seat is more injured due to a side collision occurring in the driver's seat than a frontal collision. In one embodiment, the electronic device (101) can identify various collision locations (or collision directions), such as the front of the vehicle (210), the rear of the vehicle (210), or the side of the vehicle (210), based on the direction of acceleration of the vehicle (210) and / or the rotational direction of the vehicle (210). Therefore, the collision location and the type of accident can be identified, so that a quick and systematic rescue can be performed depending on the collision situation and / or the type of accident.
[0124] Reference may be made to FIGS. 9a and 9b to explain the acceleration direction of the vehicle (210) used to identify the vehicle (210) collision location and accident type.
[0125] FIG. 9a is an exemplary diagram illustrating a method for obtaining driving-related information using sensor fusion in an electronic device installed in a vehicle according to one embodiment, and FIG. 9b is a diagram illustrating a change in driving acceleration predicted by an electronic device according to one embodiment.
[0126] Referring to FIGS. 9a and 9b, by using the acceleration of the vehicle (210) and the sensor fusion (920) method, the component of gravity applied in the horizontal direction can be obtained by utilizing acceleration information in the Earth reference coordinate system.
[0127] According to one embodiment, an electronic device (101) located within a vehicle (210) may include a sensor module (e.g., sensor module (376) of FIG. 3) that detects information related to driving of the vehicle (210). For example, the electronic device (101) may include an acceleration sensor that senses acceleration in the direction of at least one axis among three axes (e.g., X-axis, Y-axis, and Z-axis) (910) of the vehicle (210). Alternatively, the electronic device (101) may include a gyro sensor that senses rotation of the vehicle (210) about one axis among rotation about the X-axis (roll), rotation about the Y-axis (pitch), or rotation about the Z-axis (yaw). Alternatively, the electronic device (101) may include a six-axis sensor that detects six degrees of freedom (DoF) of the vehicle (210), including at least one acceleration sensor and at least one gyro sensor.
[0128] The six degrees of freedom of the vehicle (210) may include three degrees of freedom representing a change in the position of the vehicle and three degrees of freedom representing a change in the orientation of the vehicle. The movement of the vehicle (210) may be expressed based on three axes centered on the center of gravity of the vehicle. For example, the six degrees of freedom of the vehicle may include three degrees of freedom representing a movement in the direction of at least one axis among the X-axis, the Y-axis, and the Z-axis of the vehicle, and three degrees of freedom representing a rotation around at least one axis among the X-axis, the Y-axis, and the Z-axis.
[0129] For example, assuming that the posture (e.g., body frame) in which the electronic device (101) is mounted is (X', Y', Z') and the three axes of the vehicle (210) are (X, Y, Z) (e.g., inertial frame), it can be assumed that the electronic device (101) is mounted in a state in which it is tilted by 'θ' in the X-axis and the Y-axis with respect to the three axes of the vehicle (210). Accordingly, based on the posture in which the electronic device (101) is mounted (or the posture in which it is mounted), if the acceleration values of the electronic device (101) in the X, Y, and Z directions that are perpendicular to each other have a constant value or at least one of the acceleration values in the X, Y, and Z directions has a pattern in which it increases or decreases at a specific incline (e.g., (cos θ, sin θ, 0)), it can be determined that the electronic device (101) is located in the moving vehicle (210).
[0130] Referring to FIG. 9b, the vehicle (210) mostly moves in a straight line, and the direction component (or acceleration direction or acceleration change) of the acceleration vector in the Earth coordinate system sensed by the sensor module (376) can be continuously calculated while the vehicle (210) is in motion. Accordingly, the electronic device (101) can predict the direction of impact, including the front, rear, and side (e.g., driver's seat) of the vehicle, based on the direction component of the acceleration vector calculated when a collision is detected. For example, if the direction component of the acceleration vector, i.e., the acceleration direction, is in the forward direction of FIG. 9b, it can be predicted that an impact has been applied to the rear of the vehicle. Alternatively, if the acceleration direction is in the backward direction, it can be predicted that an impact has been applied to the front of the vehicle. Alternatively, if the acceleration direction is in the side direction, it can be predicted that an impact has been applied to the side of the vehicle.
[0131] By utilizing the directional component of the acceleration vector, the location of the impact can be identified. Even if the impact is predicted to be on the side of the vehicle, identifying whether it's the driver's side or the passenger's side can provide more accurate information about the collision and / or accident situation. For a more detailed explanation, see Figure 10.
[0132] FIG. 10 is a flowchart illustrating an operation of an electronic device for identifying a collision location for a vehicle according to an embodiment. Referring to FIG. 10, the operation method may include operations 1005 to 1025. Each operation of the operation method of FIG. 10 may be performed by an electronic device (e.g., the electronic device (101) of FIGS. 1 to 5), at least one processor of the electronic device (e.g., at least one of the processor (120) of FIG. 1 or the processor (320) of FIG. 3). In an embodiment, at least one of operations 1005 to 1025 may be omitted, the order of some operations may be changed, another operation may be added, or at least two operations may be performed in parallel. To help understand the description of FIG. 10, reference will be made to FIG. 11. FIG. 11 is a diagram illustrating a method for identifying a collision location based on a rotation direction of a vehicle according to an embodiment.
[0133] In operation 1005, the electronic device (101) can monitor the driving status of the vehicle (e.g., acceleration or deceleration).
[0134] In operation 1010, the electronic device (101) can update the acceleration direction vector or the deceleration direction vector according to the change in speed.
[0135] In operation 1015, the electronic device (101) can identify whether a vehicle collision is detected. For example, if the speed change exceeds a certain threshold, such as when the vehicle's driving speed changes rapidly (e.g., when the vehicle's driving speed changes from about 100 km / h to about 0 km / h within a few seconds), the electronic device (101) can detect whether the vehicle (210) is in a collision (or an accident). If a vehicle collision is not detected, the electronic device (101) can return to operation 1005 and perform the aforementioned monitoring operation periodically or aperiodically.
[0136] Based on the detection of a vehicle collision, in operation 1020, the electronic device (101) may calculate the acceleration direction and / or the angle of the collision vector. Alternatively, the electronic device (101) may identify the rotational direction of the vehicle (210).
[0137] In operation 1025, the electronic device (101) can identify a collision location with respect to the vehicle. In one embodiment, the electronic device (101) can identify which side of the vehicle (210) (e.g., the front of the vehicle, the rear of the vehicle, or the side of the vehicle) was collided based on the direction of acceleration and / or the angle of the collision vector. In one embodiment, the electronic device (101) can also identify the front / rear location of the collision side of the vehicle (210) (e.g., the front of the vehicle, the rear of the vehicle, or the front side, the rear side of the vehicle) if it uses the rotational direction of the vehicle (210) in addition to the direction of acceleration and / or the angle of the collision vector.
[0138] For example, if the directional component of the acceleration vector is used as in the aforementioned FIGS. 9A and 9B, the location where the impact was applied to the vehicle (210) can be identified. Even if it is possible to identify which side (impact location) of the vehicle (210) was impacted, the rotational direction of the vehicle (210) can be used to identify whether it is the front side or the rear side of the vehicle. Referring to FIG. 11, as shown in 1100a, if it is assumed that a collision occurred on the left side of the vehicle (210), and if the vehicle (210) rotates clockwise (1115) using the vehicle dynamics, the electronic device (101) can identify that the collision occurred on the front left side (e.g., driver's seat) of the vehicle (210). In addition, as shown in 1100b of FIG. 11, if the vehicle (210) rotates counterclockwise (1125) using the dynamic relationship of the vehicle (210) under the assumption that a collision has occurred on the left side of the vehicle (210), the electronic device (101) can identify that a collision has occurred on the rear left side of the vehicle (210) (e.g., the rear seat of the driver's seat).
[0139] Fig. 12 is a flowchart illustrating an operation of an electronic device for identifying a mounting state of an electronic device in a vehicle according to an embodiment. Referring to Fig. 12, the operation method may include operations 1205 to 1225. Each operation of the operation method of Fig. 12 may be performed by an electronic device (e.g., the electronic device (101) of Figs. 1 to 5), at least one processor of the electronic device (e.g., at least one of the processor (120) of Fig. 1 or the processor (320) of Fig. 3). In an embodiment, at least one of operations 1205 to 1225 may be omitted, the order of some operations may be changed, another operation may be added, or at least two operations may be performed in parallel.
[0140] In operation 1205, the electronic device (101) may start monitoring the mounting state of the electronic device (101). According to one embodiment, assuming that the electronic device (101) is fixedly mounted inside the vehicle (210), a collision situation due to the dropping of the electronic device (101) may not be mistaken for a vehicle collision accident, and the vehicle collision situation may be determined more accurately. According to one embodiment, the electronic device (101) may start monitoring the mounting state of the electronic device (101) when monitoring the driving state of the vehicle (210). According to one embodiment, the electronic device (101) may first perform an operation of identifying the mounted state of the electronic device (101) before monitoring the driving state of the vehicle. According to one embodiment, the electronic device (101) may also identify the mounting state of the electronic device (101) while monitoring the driving state of the vehicle.
[0141] In operation 1210, the electronic device (101) can calculate the attitude of the electronic device (101) by driving a sensor (e.g., a sensor module (376) of FIG. 3) (e.g., an acceleration sensor, a gyro sensor).
[0142] In operation 1215, the electronic device (101) can identify whether the vehicle dynamics relationship change and attitude change amount are less than a threshold value. In response to identifying that the vehicle dynamics relationship change and attitude change amount are not less than the threshold value, the electronic device (101) may consider that the electronic device (101) is in a moving state rather than a stationary state, and may return to operation 1205 to repeat the aforementioned operation. For example, the electronic device (101) may detect acceleration and / or attitude change using an acceleration sensor and / or a gyro sensor. Based on information detected by the sensor, if the attitude change amount exceeds the threshold value, the electronic device (101) may determine that the acceleration and / or attitude change of the electronic device (101) is caused by a user's walking or running movement.
[0143] On the other hand, based on the identification that the vehicle dynamics relationship change and attitude change amount are less than the threshold value, in operation 1220, the electronic device (101) can determine the mounting state and attitude information of the electronic device (101). For example, acceleration and / or attitude change caused by the movement of the vehicle (210) in which the user is riding, rather than the body movement of the user carrying the electronic device (101), can be detected. For example, when the vehicle dynamics relationship change is less than the first threshold value and the attitude change amount of the electronic device (101) is also less than the second threshold value, the electronic device (101) can be determined to be mounted in the vehicle (210).
[0144] In operation 1225, the electronic device (101) may provide information on the mounting state. For example, the electronic device (101) may improve accuracy in identifying a vehicle collision location by using the information on the mounting state to predict an acceleration direction and / or a rotation direction. For example, the information on the mounting state of the electronic device (101) may include initial posture information (e.g., X, Y, or Z axis information) of the electronic device (101) mounted on the cradle based on the three axes of the vehicle (210) when the electronic device (101) is fixed using a mechanism such as a cradle mounted on the front of a dashboard in the vehicle (210).
[0145] Figure 13 is an example of a notification screen for collision location and seating location in the event of a vehicle collision according to one embodiment.
[0146] Referring to FIG. 13, as illustrated in 1300a, the location of a vehicle collision and the driver or passenger in the vehicle can be identified, so that when a vehicle collision occurs, an emergency notification (1310) including information about the passenger and information about the seating position can be output (or displayed). For example, if the user has activated (or turned on) the function of the emergency rescue request service when setting the function of the electronic device (101) in advance, an emergency notification (1310) as illustrated in 1300a can be output when a vehicle collision occurs. In addition, the electronic device (101) can provide a function (e.g., a call button) (1320) that can transmit an emergency contact and / or rescue signal to a designated agency or designated contact (e.g., 119) when a vehicle collision occurs.
[0147] According to one embodiment, if a user activates the function of the emergency rescue request service, in the event of a high-risk accident (e.g., driver alone driving, driver's seat collision), a rescue request may be immediately made to a designated contact (e.g., 119, guardian contact information) to enable quick emergency rescue.
[0148] Figure 14 is an example of a notification screen showing a collision location and user information according to one embodiment.
[0149] As illustrated in 1400a of FIG. 14, the electronic device (101) can preset a notification list (1410) in the event of a vehicle collision according to user selection. For example, the notification list (1410) may include emergency contacts set by the user. In one embodiment, when an emergency call is transmitted to a contact included in the notification list (1410) as illustrated in 1400a, a notification including detailed information such as the location of the collision, the number of passengers in the vehicle, driver and / or passenger information may be provided, thereby enabling more efficient emergency response.
[0150] According to one embodiment, the electronic device (101) may provide a function (1415) that enables an emergency call to be automatically made when a high-risk accident occurs due to a vehicle (210) collision that the user cannot report on his / her own. If the function (1415) is set to an on state (or an activated state) (1417), when a vehicle (210) collision occurs, the electronic device (101) may automatically execute a rescue request to a designated contact (e.g., 119, guardian contact information) so that emergency rescue can be performed.
[0151] According to one embodiment, as illustrated in 1400b of FIG. 14, the electronic device (101) may output a notification (1420) regarding the occurrence of an accident when a vehicle (210) crashes. The notification (1420) may include guidance information regarding the location of the vehicle (210) crash, the location of passengers in the vehicle (210), or the number of passengers. In addition, the notification (1420) may include a button (1425) for requesting rescue. In one embodiment, the information included in the notification (1420) may be output through the electronic device (101), but may also be provided to an emergency contact number set by the user, an emergency medical institution, or an emergency rescue center.
[0152] In one embodiment, utilizing information about actual users on board a vehicle and the vehicle's collision location can expedite emergency response in situations where the number of passengers and rescuers differs, such as in an "escape accident." For example, discrepancies in the number of passengers can be used to determine the number of evacuees, and providing the collision location can be used to estimate the evacuation location.
[0153] Meanwhile, since most car accidents are family accidents, in one embodiment, if all users included in the notification list (1410) are on board at the same time, a function may be provided to transmit an emergency contact and / or rescue signal to a designated contact (e.g., 119) rather than to the users included in the notification list (1410). To this end, the electronic device (101) may calculate the relative distance between the electronic device (101) (or wearable electronic device (102)) owned by each of the user and the passenger through the UWB function of the sensor module (e.g., the sensor module (376) of FIG. 3) or the BLE communication function of the communication circuit (e.g., the communication module (190) of FIG. 1 or the communication circuit (390) of FIG. 3) when a collision is detected.
[0154] If the relative distances are all within a certain range, the electronic device (101) can transmit an emergency contact and / or rescue signal to a designated contact (e.g., 119).
[0155] Figure 15 is an example of an emergency notification screen based on a user abnormality according to one embodiment.
[0156] Referring to FIG. 15, the electronic device (101) can operate to automatically perform emergency rescue based on the user's bio-signal information in consideration of a situation in which the user loses consciousness due to a vehicle (210) collision.
[0157] For example, if a user is unconscious, a notification (1510) may be provided indicating a high-risk condition along with detailed user profile information (e.g., age or blood type), as illustrated in 1500a. In one embodiment, the information included in the notification (1510) may be output via the electronic device (101), but may also be provided to an emergency contact, emergency medical facility, or emergency rescue center set by the user.
[0158] According to one embodiment, a notification may be provided in which the accident level is defined differently depending on the collision location or passenger information. In addition, for a user wearing a wearable electronic device (102) as well as an electronic device (101), the user's physical activity may be monitored by utilizing additional sensing information measured from the wearable electronic device (102) (e.g., a smart watch, a smart ring). For example, if the user suffers a serious injury after a car accident, a rapid change in heart rate may be monitored. In addition, in the case of a serious injury, the user is likely to lose consciousness, so it may be possible to determine unconsciousness by assessing the user's movements after the accident using the wearable electronic device (102) attached to the user's body. That is, the severity of the accident is determined through changes in the user's body and the presence or absence of movement after the accident, and if the user does not move, the electronic device (101) may send an emergency call directly to an emergency medical institution or an emergency rescue center instead of connecting to a registered emergency contact. In this way, according to one embodiment, by providing not only vehicle (210) accident information but also driver and / or passenger information, it is possible to contribute to rapid rescue activities, thereby enabling better emergency notification services.
[0159] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0160] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0161] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0162] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0163] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0164] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0165] According to one embodiment, a storage medium storing at least one computer-readable instruction, wherein the at least one instruction, when executed by at least one processor (120, 320) of an electronic device (101), causes the electronic device (101) to perform at least one operation, wherein the at least one operation may include an operation of identifying information about at least one user within a vehicle (210).
[0166] According to one embodiment, the at least one operation may include an operation of periodically or aperiodically monitoring a driving state of the vehicle using at least one sensor (176, 376) of the electronic device.
[0167] In one embodiment, the at least one action may include identifying a collision location for the vehicle based on a vehicle collision being detected during the monitoring.
[0168] In one embodiment, the at least one action may include providing a notification based on the identified collision location and information about the at least one user.
Claims
1. In an electronic device (101), At least one sensor (176, 376); At least one processor (120, 320) operatively connected to at least one sensor; and Contains a memory (130, 330) for storing instructions, The above instructions, when executed by the at least one processor, cause the electronic device to: Identifying information about at least one user within the vehicle (210), Using at least one sensor, the driving status of the vehicle is monitored periodically or aperiodically, Based on the detection of a vehicle collision during the above monitoring, the collision location for the vehicle is identified, An electronic device configured to provide a notification based on the identified collision location and information about at least one user.
2. In paragraph 1, the driving state of the vehicle is: An electronic device comprising at least one of a direction of travel of the vehicle, a speed of the vehicle, a change in direction of the vehicle, an acceleration direction of the vehicle, or a rotation direction of the vehicle.
3. In the first or second paragraph, the instructions cause the electronic device to: An electronic device configured to identify a collision location for said vehicle based on the direction of acceleration of said vehicle and / or the direction of rotation of said vehicle.
4. In any one of paragraphs 1 to 3, the instructions cause the electronic device to: Identifying the state in which the electronic device is installed inside the vehicle using at least one sensor, Based on the identification of the state in which the electronic device is installed, the driving state of the vehicle is monitored periodically or irregularly, An electronic device configured to detect a vehicle collision based on the driving condition of said vehicle.
5. In any one of paragraphs 1 to 4, the instructions cause the electronic device to: Identify whether at least one user is riding in the vehicle; An electronic device configured to identify information about said at least one user based on identifying that said at least one user is boarding said vehicle.
6. In any one of paragraphs 1 to 5, the instructions cause the electronic device to: An electronic device configured to identify whether at least one user is on board the vehicle based on at least one of air pressure change data indicating a door closing or opening of the vehicle, communication connection information with the vehicle, global navigation satellite system (GNSS) information, or cell switching information.
7. In any one of clauses 1 to 6, at least one microphone (150, 350) is further included, The above instructions cause the electronic device to: An electronic device configured to identify information about at least one user, including a number of users and at least one of seating positions within the vehicle, based on a voice signal received through said at least one microphone.
8. In any one of clauses 1 to 7, a communication circuit (communication module (190) of Fig. 1 or communication circuit (390) of Fig. 3) is further included, The above instructions cause the electronic device to: An electronic device configured to identify information about at least one user based on sensing information received from an inertial sensor of the wearable electronic device when the electronic device is connected to a wearable electronic device (102) through the communication circuit.
9. In any one of clauses 1 to 8, further comprising a display (160, 360), The above instructions cause the electronic device to: Based on the identified collision location and information about at least one user, displaying the notification through the display; An electronic device configured to provide said notification to said wearable electronic device when connected to said wearable electronic device.
10. In any one of paragraphs 1 to 9, the instructions cause the electronic device to: Based on the detection of a vehicle collision during the above monitoring, an abnormal condition of a user wearing the wearable electronic device is identified based on a biometric signal received from a biometric sensor of the wearable electronic device, An electronic device configured to perform an emergency call based on the identified collision location and the abnormal condition of the user.
11. A method for providing a notification of a vehicle collision in an electronic device (101), An action to identify information about at least one user within a vehicle (210); An operation of periodically or aperiodically monitoring the driving status of the vehicle using at least one sensor (176, 376) of the electronic device; An operation of identifying a collision location for the vehicle based on detection of a vehicle collision during the above monitoring; and A method for providing a notification of a vehicle collision, comprising: providing a notification based on the identified collision location and information about at least one user.
12. In paragraph 11, the driving state of the vehicle is: A method for providing a notification of a vehicle collision, comprising at least one of a direction of travel of the vehicle, a speed of the vehicle, a change in direction of the vehicle, an acceleration direction of the vehicle, or a turning direction of the vehicle.
13. In clause 11 or 12, the operation of identifying the collision location for the vehicle comprises: A method for providing notification of a vehicle collision, comprising the action of identifying a collision location for said vehicle based on an acceleration direction of said vehicle and / or a rotation direction of said vehicle.
14. In any one of paragraphs 11 to 13, the operation of identifying a collision location for the vehicle comprises: An action of identifying a state in which the electronic device is installed inside the vehicle using at least one sensor; An operation of periodically or aperiodically monitoring the driving state of the vehicle based on the identification of the state in which the electronic device is installed; and A method for providing a notification of a vehicle collision, comprising an action of detecting a vehicle collision based on a driving state of the vehicle.
15. A storage medium storing at least one computer-readable instruction, wherein the at least one instruction, when executed by at least one processor (120, 320) of an electronic device (101), causes the electronic device (101) to perform at least one operation, and the at least one operation comprises: An action to identify information about at least one user within a vehicle (210); An operation of periodically or aperiodically monitoring the driving status of the vehicle using at least one sensor (176, 376) of the electronic device; An operation for identifying a collision location for the vehicle based on detection of a vehicle collision during the above monitoring; and A storage medium comprising an action for providing a notification based on the identified collision location and information about at least one user.
Citation Information
Patent Citations
Accident analysis device for vehicle
JP2006131092A
Mobile terminal, Display apparatus for vehicle, Vehicle and Relief System including the same
KR1020160092818A
Passive mixer including LLC filter and RF transmitting circuit comprising passive mixer
KR1020220157736A
Apparatus and method for collecting information of a vehicle for accident notification
KR102201645B1
Server, vehicle terminal and method for providing emergency notification
KR102382185B1