Portable type safety device and evidence prevention method

Abstract

To provide a system and a method for processing and storing scene data acquired by a device.SOLUTION: An apparatus having a scene monitor that captures an image or a moving image, and storing a plurality of first data recently acquired over a predetermined period of time in a device, is characterized in that: a main controller includes a transceiver for wireless communication; a copy of the first data is continuously and periodically transmitted to another mobile computing terminal for safe storage; in the event of an attack or emergency situation, a transceiver of the personal security device transmits the plurality of first data and a plurality of second data to a mobile computing terminal; and the mobile computing terminal transmits the plurality of first data and the plurality of second data to a secure server.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] This application claims the benefit of a continuation-in-part of a United States application having serial number US17 / 430,501, filed on August 12, 2021, which is a national stage application of PCT / CN2020 / 075241, having a filing date of February 14, 2020, which application has priority to the filing date of a Hong Kong application having serial number HK19119426, entitled "PORTABLE PERSONAL SAFETY DEVICE", filed on February 14, 2019, the subject matter of which is incorporated herein by reference. This application relates generally to personal safety devices and methods, and more particularly to systems for enhancing personal safety through wireless communication and data processing. [Background technology]

[0002] The following description contains information that may be useful in understanding the present invention. No admission is made that any of the information provided herein is prior art or relevant to the presently claimed invention, or that any publication specifically or implicitly mentioned is prior art.

[0003] When working, studying, commuting, taking public transport, taking a taxi, playing sports or engaging in other common activities in open spaces such as streets, roads or countryside, a person comes into contact with the general public. In these environments, a person may be attacked, harassed, feel unsafe or be involved in an accident or emergency. It would be desirable to have a system or device that allows a person to feel safer in such adverse situations.

[0004] United States Patent No. 9,177,455B2 discloses a personal safety system. United States Patent No. 9,177,455B2 discloses a customization system having an electronic device for capturing images and sounds of the user's nearby environment and a smartphone for receiving the captured data from the electronic device and relaying the data to a secure, remote volumetric location. The electronic device is wearable by the user. The stored data can be used in the future as evidence that an attacker attacked the user, even if the electronic device is destroyed by the attacker. However, the smartphone can be removed and destroyed by the attacker. In addition, the user must turn on the electronic device when the user is being attacked or feels that he or she may be attacked. A drawback is that the user may not be able to turn on the electronic device, especially when under attack. For example, when both hands are fixed by the attacker. An automatic switch-on mechanism for the electronic device would be ideal. Another drawback is that it is not possible to record the situation before the attack unless the user is aware that danger is approaching. The scene before the attack may be valuable evidence for the police investigation, but such a thing cannot be done. United States Patent No. 9,177,455B2 discloses a personal safety system having an electronic device for capturing images and sounds of the user's nearby environment and a smartphone for receiving and relaying the captured data from the electronic device. United States Patent No. 9,177,455B2 discloses a customization system having an electronic device for capturing images and sounds of the user's nearby environment and a smartphone for receiving the captured data from the electronic device and relaying the data to a secure, remote volumetric location. The electronic device is wearable by the user and the smartphone is wearable by the user. The stored data can be used in the future, for example, as evidence that an attacker has attacked the user, even if the electronic device is subsequently destroyed by the attacker. However, the smartphone can be removed and destroyed by the attacker.Furthermore, when a user is being attacked or feels that he / she may be attacked, the user must turn on the electronic device. One drawback is that the user may not be able to turn on the electronic device, especially when he / she is being attacked. Ideally, there would be an automatic switch-on device for the electronic device, for example, when the attacker has both hands tied. Another drawback is that it is not possible to record the scene before the attack unless the person is aware of the imminent danger. The scene before the attack may be valuable evidence for the police investigation. It is also desirable to be able to record the scene before the attack.

[0005] United States Patent Application US20090066478 discloses a system, device and method for facilitating personal safety monitoring via a device with multiple sensors. The sensors may include multiple biometric sensors, including temperature sensors, pulse sensors, blood oxygen sensors and / or other sensors. The device may be configured to generate different alerts in response to combinations of signals generated by the sensors. For example, the device may generate different biometric stress alerts corresponding to different multi-dimensional biometric stress signatures associated with the multiple biometric sensors. The alerts generated by the device may be transmitted to a server or client terminal associated with the device for further processing, which may include generating a notification for display on the client terminal in response to receiving the alert from the device.

[0006] United States Patent Application US20170193306A1 A body worn camera activated security accessory including a motion sensor activated camera. The motion sensor is activated when there is motion in proximity to a wearer of the accessory. As a result, the camera is activated in response to the activation of the motion sensor. Facial information of the individual who caused the activation of the motion sensor is captured and recorded. The facial information is captured using facial recognition technology. The captured facial information is transmitted to a remote server accessible to both a mobile phone app and / or authorities.

[0007] US Patent 6,784,833B1 discloses a personal surveillance system that can be worn by a user, but image recording by the system is triggered remotely rather than automatically.

[0008] United States Patent 5,594,498A discloses a personal audio / video surveillance system that can be triggered by a user to record images and audio. U.S. Patent Application 2015 / 0316979A1 discloses a body-worn camera system in which image recording is also manually triggered by the user.

[0009] Patent Application No. 2006285749A (Patent Document 1): This is a disclosure of a school bag equipped with a camera that continuously captures the surroundings of a student and remotely transmits the photos to the student's guardian via a mobile communication network. If a student is attacked, the photos taken before the attack can be used, but this consumes a lot of battery power and requires data communication fees and other costs to continue transmitting the videos to a remote location. In addition, there is also the problem of what to do with the data if most of the captured data is useless. Automatic image recording in dangerous situations is effective in saving battery power.

[0010] There is a need in the art for a personal safety system or device that has at least the capability of detecting threats to a user and automatically detecting the user's surrounding environment.

[0011] It would also be nice to have the device record its surroundings before a threat is detected, without requiring significant battery or network overhead.

[0012] It would also be desirable not only to pre-record it to provide context, but also to have a copy of that data and to have the data available on the person's mobile computing device (smartphone / smartwatch) in case the listed device is damaged or destroyed. [Prior art documents] [Patent documents]

[0013] [Patent Document 1] U.S. Patent No. 9,177,455 [Patent Document 2] US Patent Application Publication No. 2009 / 0066478 [Patent Document 3] US Patent Application Publication No. 2017 / 0193306 [Patent Document 4] U.S. Pat. No. 5,594,495 [Patent Document 5] US Patent Application Publication No. 2015 / 0316979 [Patent Document 6] Patent Publication No. 2006-285749 Summary of the Invention [Problem to be solved by the invention]

[0014] This application solves the problem of safely storing a first set of multiple data and a second set of on-site data in the event of an attack or accident.

[0015] If a person uses a body-worn device, the risk is that an attacker could remove the device from the person and destroy it before the field data can be successfully uploaded to a secure server.

[0016] To solve this problem, the application filed in the United States, serial number US17 / 430,50, splits the terminal into two, allowing the transmission and memory elements to be hidden under clothing or in a bag. This provides valuable additional time for the terminal to transmit field data to a remote server. However, an attacker may be able to remove the terminal before enough data has been sent to the remote server.

[0017] And as technology improves, smaller, lighter, single-piece designs are becoming more feasible, which, while more convenient than having to wear two devices, still leaves the problem of protecting field data in the event of an attack, as a single device can easily be removed and destroyed by an attacker.

[0018] To save battery and size, the device (whether in a dual or single design) will transmit on-site data to a remote server during an emergency using a mobile computing device, for example a smartphone or smartwatch with cellular connectivity, or a tablet / laptop with wired or wireless connectivity.

[0019] It would therefore be advantageous to have copies of the data present locally at all times, with one copy held in the local memory of the personal protective device and a second copy held in the memory of a connected mobile computing device at the emergency site, providing advantages over prior art techniques.

[0020] If an attacker destroys the on-site monitoring device (body-worn camera), a second copy of the on-site data will be available on the mobile computing device and vice versa: two copies of the data will exist locally.

[0021] In the event of an emergency, the first plurality of data is immediately available to the mobile computing device (since a copy is already present in its memory) and can be uploaded to a remote secure server as quickly as possible. Other methods and techniques would simply send the data to a secure server, but this approach has several drawbacks: ● To do this, a wireless or cellular connection is required - location information cannot always guarantee stable data transmission. ● Continuous recording and sending to the cloud means that users have to store large amounts of data and decide what to do with it at a later date. ● Sending it to the cloud forever is expensive, also in terms of mobile carrier data charges. ● Permanent transmission to the cloud requires large battery capacity to communicate with the wireless network. So by creating a local copy of the data for the user and recording it in a loop, we can overcome many of the issues mentioned above. [Means for solving the problem]

[0022] The Summary of the Invention does not necessarily disclose all features essential to define the invention, and the invention may reside in any combination of the disclosed features, and various combinations and subcombinations are fully described in the Detailed Description.

[0023] The present application provides a system and method for processing and storing scene data acquired by a device, the device including a main controller and a scene monitor combined in a single device, for receiving scene data and storing a first plurality of data most recently acquired over a predetermined length of time in a local memory of the personal security device as well as in a memory of a mobile computing terminal of a user. The main controller includes a transceiver for wireless communication configured to subsequently transmit the first plurality of data to another nearby mobile computing terminal or to a mobile computing terminal of the user, such as a smartphone or smartwatch. Thus, two copies of the first plurality of data are always local to the user.

[0024] When an emergency occurs, the processor configures the transceiver to transmit a second plurality of scene data obtained after the emergency is detected, the second plurality of data is transmitted to a remote server via the user's mobile phone, smart watch, or other form of mobile computing terminal, and securely stores the data on the remote server for future use.

[0025] At the same time, a copy is also stored on the device and in the memory of the user's mobile computing device. Once secured on the remote server, the mobile computing device and personal security device can delete the copy of the data as desired, either manually or automatically, such as via a mobile app or other user-friendly interface, at the user's discretion.

[0026] and processing the scene data received therefrom and storing the first plurality of data most recently acquired over a predetermined length of time. The main controller may include a transceiver for performing wireless or cellular communications and may continuously / periodically transmit a copy of the first plurality of data to another mobile computing terminal local to the emergency location as a backup and for safekeeping.

[0027] First-matter scene data provides context to an emergency / incident. First-matter scene data is critical and valuable to allow authorities and the law to understand the context leading up to an emergency or crisis situation. Hence the need to preserve it is paramount for courts.

[0028] In another embodiment, the personal security device may or may not store the first and second pluralities of data. Different variations of the personal security device have different internal memories for storing the first and second pluralities of data. [Brief description of the drawings]

[0029] The accompanying drawings are included to provide a further understanding of the present disclosure, and are incorporated in and constitute a part of this specification, illustrating exemplary embodiments of the present disclosure, and together with the description, serve to explain the principles of the present disclosure.

[0030] BRIEF DESCRIPTION OF THE DRAWINGS The present disclosure is illustrated by way of example and not by way of limitation in the accompanying figures, in which like reference numerals indicate similar elements and in which: FIG. The figures are for illustrative purposes and are not intended to limit the disclosure. [Figure 1] 1 illustrates an exemplary personal mobility safety device in accordance with one embodiment of the present invention; [Diagram 2]1 is a diagram illustrating a personal safety device having a constant wireless connection with a mobile computing terminal according to one embodiment of the present invention; [Diagram 3] 1 illustrates a personal security device that records on a predetermined loop and transmits a transcript to a mobile computing terminal in accordance with one embodiment of the present invention. [Figure 4] 1 is a diagram illustrating a mobile computing terminal in an emergency state transmitting first and second plurality of data to a secure server according to one embodiment of the present invention. [Diagram 5] 1 is a diagram showing a personal safety device including a mobile computing terminal and a cloud server according to one embodiment of the present invention. [Figure 6] 1 is a diagram showing a flowchart of a method for communicating first and second pieces of data in accordance with one embodiment of the present invention. [Figure 7] 1 is a diagram showing examples of suitable positions on a user's body for placing personal safety equipment according to one embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0031] The following is a detailed description of embodiments of the present disclosure that are illustrated in the accompanying drawings. The embodiments are in sufficient detail to clearly communicate the disclosure. However, the amount of detail provided is not intended to limit the anticipated variations of the embodiments, but rather to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the disclosure.

[0032] In the following description, numerous specific details are set forth in order to provide a thorough understanding of embodiments of the present invention. It will be apparent to one skilled in the art that embodiments of the present invention may be practiced without some of these specific details.

[0033] Embodiments of the present invention include various steps, which are described below, that may be performed by hardware components, that may be embodied in machine-executable instructions that may be used to cause a general-purpose or special-purpose processor that is programmed with the instructions to perform the steps, or that may be performed by a combination of hardware, software, firmware, and / or by a human operator.

[0034] In this application, it is to be understood that "at least one" refers to one or more, and "multiple" refers to two or more. The term "and / or" is used to express an association relationship between related objects and indicates that three relationships may exist. For example, "A and / or B" refers to three cases: when only A is present, when only B is present, and when both A and B are present. The character " / " generally indicates an "or" relationship between related objects. "At least one of the following items" or similar expressions means any combination of these items, including any combination of a single item or multiple items. For example, at least one of a, b, or c may refer to a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, and c may be singular or plural.

[0035] The device consists of a scene monitor and a main controller, which is a low-power processing unit and thus may be a single-piece design, but two or more piece designs can also use this approach to data protection.

[0036] 1 illustrates an exemplary personal mobile safety device according to an embodiment of the present invention. The personal mobile safety device includes a scene monitor for detecting the user's surrounding environment, a main controller for controlling the scene monitor and processing scene data received therefrom, a battery, a transceiver, sensors such as a GPS, an image sensor, an ion emission sensor, a PM measurement sensor, a gas sensor, a microphone, a motion sensor such as a gyroscope and an acceleration sensor, a processing unit, a memory, etc. The terminal may be integrated or divided into two or more parts.

[0037] This application provides a system and method for processing and storing scene data acquired by a device. The device includes a main controller and a scene monitor, receives the scene data, and stores a first plurality of data most recently acquired over a predetermined time period in a local memory of the device and simultaneously (or as close to simultaneously as technology permits) transmits a copy of the first plurality of data to a local memory of a user's mobile computing device. The memory of the personal security device is used to store computer readable instructions and other executable modules for operating the device.

[0038] The main controller also includes a transceiver for wireless communication, which is configured to subsequently transmit the first plurality of data to another mobile computing terminal located locally to the user or to the user's mobile computing terminal for secure storage. Local means in the same vicinity as the user, within range of wireless communication, and not in a remote location, e.g., in another city or country. Thus, during an emergency / event, it is possible to have two copies of the first plurality of data locally. In the event of an emergency, the processor configures the transceiver to immediately transmit the second plurality of scene data obtained after the emergency is detected. This second plurality of data is securely stored in a remote server for future use, and copies are stored simultaneously (or as close to simultaneously as technology allows) in the user's mobile computing terminal and in the memory of the device. Thus, there are multiple copies of the first and second plurality of data.

[0039] and processing the scene data received therefrom and storing the first plurality of data most recently acquired over a predetermined length of time. The main controller includes a transceiver for performing wireless or cellular communication and continuously / periodically transmits a copy of the first plurality of data to another mobile computing terminal local to the user for secure storage.

[0040] A significance is identified between a first plurality of scene data before the emergency and a second plurality of scene data after the emergency, where the first plurality of scene data provides context to the situation and the second plurality of scene data describes the emergency situation.

[0041] Context is important because a woman who goes to court and claims some kind of sexual assault (victims are mostly women, but can be men) needs to provide evidence not only of what happened, but that she was not a willing participant. This often comes down to one person's word against another's, which is why so few cases go to court and even fewer result in convictions.

[0042] Emergency context adds value in understanding the circumstances that led to the emergency. Furthermore, initial multiple scene data provides the information that led to the emergency and also sheds light on who was responsible for the emergency, what happened, and more importantly, how it happened, which can be used as evidence to prove innocence in court.

[0043] Therefore, video, audio, and potentially other sensor data recorded prior to an accident can provide valuable insight into what happened to workers and the circumstances of the accident. Embodiments of the present invention may provide various advantages and / or technical effects.

[0044] By subsequently transmitting the first plurality of copies of the data to the user's mobile terminal or another mobile computing terminal local to the user, the system ensures that the most recently acquired copies of the scene data are safely stored in the event of an attack or accident, thereby providing a reliable backup of the data and reducing the risk of data loss or corruption in the event an attacker is able to damage either the device or the local mobile computing terminal.

[0045] In the event of an emergency, the apparatus is configured to transmit the second plurality of scene data obtained after the emergency is detected to a secure remote server via the user's local mobile computing terminal's connection to the Internet, such that the critical scene data is securely stored on the remote server for future use.

[0046] Even if a personal security device is damaged, the user's mobile computing device can continue to record and transmit any data available through its sensors, such as the smartphone's camera and microphone. Although mobile computing devices are not optimized for such a task, they can still provide data in an emergency that can be useful for future investigations.

[0047] The backup or copy is also stored simultaneously on the user's mobile computing device, even if the device is subsequently tampered with or destroyed. This feature increases the reliability and availability of the data for analysis and research purposes. If for any reason the mobile computing device does not have a wireless connection to the Internet (e.g. in a basement or in a remote location), a copy exists on the mobile computing device that can be transferred to a secure server once Internet connectivity is restored. The personal security device can also have its own second copy of the data. In this way, multiple copies of the data exist at the scene of an emergency.

[0048] The personal security device / equipment must be worn on the outside of the garment, or at least visible to cameras or other sensors to record scene data, so that an attacker could, in theory, relatively easily wrest the device from the user and destroy or damage it in such a way that it does not give the device sufficient time to upload the first or second plurality of data to a secure remote server, as described in US Patent US17 / 430,501.

[0049] Therefore, it would be advantageous to protect the first and second plurality of data without the need to transmit the data to a cloud or secure server, which consumes battery power and data from the user's data plan. Alternatively, if the user is in a location without cellular connectivity, it would be advantageous to have the scene data stored on both the personal security device and the person's mobile computing device, as an attacker would need to remove both devices to destroy the data / evidence of involvement.

[0050] The personal security device is configured to be connected to a mobile computing device (e.g., smartphone / smartwatch / laptop / table, etc.) and to transmit a first plurality of copies of data from the personal security device to the mobile computing device as a backup using the wireless connection (e.g., Wi-Fi, hotspot, Bluetooth, LTE, other wireless data transfer, etc.) of the mobile computing device. In this way, two copies of data are kept locally at all times in the event of an incident, and an attacker needs to destroy both the wearable device and the mobile computing device (e.g., smartphone / smartwatch / laptop / tablet, etc.) to destroy evidence of the attack.

[0051] Only in the event of an emergency would the data need to be pushed up to a secure server and consume mobile data charges, otherwise the initial data would simply be kept locally within the device's memory and backed up locally to the mobile computing terminal's memory.

[0052] Having a copy of the data already stored on the mobile computing device also increases the speed of delivering evidence to a secure location in the cloud / remote server or to authorities, as in the event of an emergency the first few copies of data are already available on the mobile computing device and then transmitted to a remote secure server.

[0053] In addition to the approach of having multiple copies of data locally at the user / "crime scene", a second plurality of data is also created by the wearable device / personal security device and sent to a secure server via the mobile computing device's internet connection when an emergency is recognized. Again, when an emergency is recognized, the mobile computing device can not only enable the transfer of the second plurality of data to the secure server via its internet connection, but also keep a copy of that data in case something goes wrong or there is a lack of wireless connectivity due to location or other external factors. The mobile computing device can also use its own scene monitor to record the emergency. Examples include GPS location, cell tower information, searching for Bluetooth enabled devices and Wi-Fi signals, microphone recordings, etc.

[0054] This allows the wearable device and the mobile computing device to have multiple copies of the data on the first and second devices, essentially providing the user with a backup scenario if one or the other device is damaged by an attacker, giving them time to secure the data to a remote secure server before both physical devices are damaged and tampered with.

[0055] Once successfully uploaded to the secure server, the mobile computing terminal can be notified that the data has been securely stored and the mobile computing terminal can free up memory as needed. The mobile computing terminal can also notify the wearable terminal that the data has been securely stored and free up memory as needed, which can be done at the user's discretion via an app displayed on the mobile computing terminal, a memory area on the mobile computing terminal, or a personal security device, and recycled.

[0056] The most common use of such a method is expected to be a mobile computing device, a smartphone, but other scenarios are conceivable, such as a nearby police or patrol vehicle using vehicle-to-vehicle (v2v) communication. In this case, the initial data may be continuously transmitted to the vehicle via a device worn by the officer. This is to store it in case something happens to the officer and provide background on the incident. In most cases, there is no incident or emergency, so the data is in the loop, not stored for more than a pre-determined period, and serves no purpose. Only when an emergency or incident occurs should the vehicle / mobile computing device transmit the pre-recorded scene data and the subsequent scene data to another remote server. Additionally, it can notify or alert authorities or nearby police vehicles.

[0057] Similar scenarios include the option to store images, audio, on-site surveillance data (gas readings, radiation readings, air quality, temperature or other ambient factors) or video data received from first responders, ambulances, fire departments and personal security devices for emergency notification.

[0058] Bouncers at bars and security guards at sports venues - Connect an Ethernet-connected laptop to the guards' personal security devices / body cameras and record the transcripts locally on the laptop or over Wi-Fi ___(33) to a local computer. Send data to a remote server only in the event of an emergency or incident.

[0059] Food delivery drivers on scooters are likely to have a backup of the scene data on their mobile phones or other devices in case of an accident, and personal security devices / body cameras are likely to be attached to helmets or other devices that are easily damaged in an accident, allowing for a backup of the scene data (video recording) before the accident.

[0060] Bicyclists and motorcyclists involved in accidents would do well to have a transcript of the on-scene data stored on their mobile phone, smartwatch or other mobile computing device (such as a bike computer), again because the collision may have destroyed their personal security equipment (which in this case may have been attached to a fixed location on the bicycle or motorbike / scooter, such as a helmet or handlebars), so that a transcript exists and is sent to a secure server where authorities and friends and family can see what happened and what happened.

[0061] Another example for someone working in a courier delivery service might be where the delivery vehicle itself, or a mobile computing terminal housed or embedded in the vehicle, is constantly receiving a copy of the scene data on a pre-determined loop, so that in combination with the "memory mode" of the terminal, a permanent record of the delivery is created and transmitted to a remote server, allowing the company to prove that a delivery was successfully made to a particular location at a particular time. Nurses are in contact with the public and the wearable terminals / devices are connected to a locally based computing terminal via the hospital's Wi-Fi network.

[0062] The processor of the device provides the advantage of protection by subsequently transmitting copies of the first plurality of data to another mobile computing terminal, which ensures that the data is backed up in the event of an attack or accident, further enhancing the safety and protection of the data, and further increasing the possibility that the perpetrator of a crime or incident will be recorded and that recording will be seen by others, thereby holding them accountable for their actions.

[0063] The processor of the apparatus provides the advantage of mobility by configuring the transceiver to transmit the second plurality of scene data via the mobile computing terminal, thereby allowing the data to be securely stored on a remote server and a transcript stored in the memory of the mobile computing terminal, even if the apparatus is subsequently tampered with or damaged. This is only performed in the event of an emergency, thereby conserving power the majority of the time the terminal is in use and operating in normal, safe conditions.

[0064] The device's processor provides a monitoring advantage by detecting the occurrence of an emergency and transmitting a second set of scene data obtained after the emergency is detected, ensuring the most up-to-date data is captured and stored for future use.

[0065] The device's processor provides the advantage of security by securely storing the second plurality of scene data on a remote server, ensuring that even if the device is tampered with or damaged, the data is protected and accessible for future use.

[0066] The device's processor provides the advantage of security by securely storing the second plurality of scene data on a remote server, ensuring that even if the device is tampered with or damaged, the data is protected and accessible for future use.

[0067] In one embodiment, the processor is configured, in response to detecting the occurrence of an emergency event, to configure the transceiver to transmit via the mobile computing terminal a second plurality of scene data obtained after the emergency event is detected, securely store the second plurality of scene data on a remote server for future use, and thereafter store a copy of the data in a memory of the mobile computing terminal, even if the device is tampered with or damaged.

[0068] The system contains a processor capable of processing field data received from equipment, allowing it to be analysed and interpreted in real time, enabling rapid decision making and response to emergency situations.

[0069] The apparatus further includes a memory within the mobile computing terminal for storing copies of the first plurality of data, thereby providing additional data redundancy and ensuring that the most recent scene data is safely stored and readily accessible for analysis, even in the event of failure or damage to the primary apparatus, this feature improves the overall reliability and resiliency of the system.

[0070] 1 illustrates an exemplary personal mobile safety device according to one embodiment of the present invention, comprising a scene monitor for sensing a user's surrounding environment, a main controller for controlling the scene monitor and processing scene data received therefrom, and a memory for storing a copy of the data within a terminal, which may be of single or multi-piece design.

[0071] The device includes a processor (151) for executing computer readable instructions stored in a memory (153) of the mobile personal safety device, a scene monitor (110) for sensing the user's surrounding environment to obtain scene data, and a main controller (140) for controlling the scene monitor (110) and processing the scene data received therefrom.

[0072] The device stores in a memory of the device a first plurality of data most recently acquired within a predetermined time period and transmits the data to a mobile computing terminal (172) to provide a second copy of the data.

[0073] The main controller (140) further comprises a transceiver (152) for wireless communication (177, 178) and continuously / periodically transmits a copy of the first plurality of data to another mobile computing terminal (172) in the event of an attack or accident.

[0074] The processor (151) is configured to detect the occurrence of an emergency adverse to the user, and in response to detecting the occurrence of the emergency, configures the transceiver (152) to notify the mobile computing terminal (172) of the emergency, which then transmits a copy of the first plurality of data to a remote secure server (175) having a database (170) for future use, even if the personal safety device (100) or the mobile computing terminal (172) is subsequently tampered with or damaged.

[0075] 2. The method of claim 1, wherein the processor (151) is further configured to, in response to detecting the occurrence of the emergency event, configure the transceiver (151) to transmit via the mobile computing terminal (172) a second plurality of scene data obtained after the emergency event is detected, securely store the second plurality of scene data on the remote server for future use and store a copy of the data in a memory of the mobile computing terminal (172), and thereafter transmit the second plurality of scene data via the mobile computing terminal (172) even if the device is tampered with or damaged.

[0076] Another mobile computing device (172) local to the user may be configured to be a smartphone, a smartwatch, a tablet, a laptop, or a vehicle such as a police car, a fire engine, a delivery van, a commercial vehicle, a private car, an ambulance, etc.

[0077] The scene monitor (110) comprises a camera (121) for capturing images and / or video of the surrounding environment, and the scene data includes the captured images or video.

[0078] The personal safety device includes an artificial intelligence module that predetermines the type of emergency, and when it detects a new emergency, the processor self-learns, trains and updates the list of predefined emergency situations. The system is currently evolving by detecting new emergency situations and the same is added to the predefined emergency list.

[0079] The method of claim 1, wherein the processor is further configured to process the captured image to determine whether or not a predetermined object / person is present in the surrounding environment to detect the occurrence of an emergency situation, and as opposed to detecting the presence of the predetermined dangerous object / person, identify that an emergency situation has occurred, thereby causing the mobile computing terminal to automatically initiate transmission of the first plurality of scene data and the second plurality of scene data to a remote server without the need for a user to initiate the transmission.

[0080] The scene monitor (110) includes a microphone (122) for capturing audio signals emanating from the surrounding environment, the scene data including the captured audio signals, and further processes the captured audio signals to determine whether an audio segment indicative of a predetermined hazard is present in the surrounding environment to detect the occurrence of an emergency condition, and upon detecting the presence of the audio segment indicative of the predetermined hazard, identifies that an emergency condition has occurred thereby initiating transmission of a first plurality of scene data by the mobile computing terminal, and causing a second transmission of the scene data to the remote server to be initiated automatically without the need for a user to initiate the transmission.

[0081] The scene monitor (110) further includes a GPS tracking unit (126), an ion rad sensor (125), a PM measurement sensor (124), a hazardous gas sensor (123), and an emergency button (162). The scene monitor and main controller may be built into a single chip, or may be connected via a cable (130) or wires on the pub.

[0082] The separate mobile computing terminal may remain a trusted terminal connected to the user's electronic computing terminal or device using Wi-Fi, one or more terrestrial mobile communications protocols, LTE, Bluetooth Low Energy (BLE), or connection via a hotspot to provide wireless connectivity.

[0083] The scene monitor or main controller or separate mobile computing terminal includes a Global Positioning System (126) tracking unit for determining the location of the device or separate mobile computing terminal, acquiring the location data, and transmitting the location information to a remote server.

[0084] the main controller or the separate mobile computing terminal further includes a power button or an on-screen power button for allowing a user to manually turn on / off the device or a connection between the mobile terminal and the device to enter a power saving mode, and the processor is further configured to: in response to detecting the occurrence of an emergency condition, temporarily deactivate the power button to disable powering off the device at least until the processor receives a message from the remote server that the remote server has successfully received the first and second plurality of scene data, thereby preventing an attacker attacking the user from forcibly stopping the transmission of the first plurality of scene data to the remote server. The device further includes a battery holder for receiving a battery and a cable for charging or reverse charging the device and the portable electrical terminal. The mobile computing terminal can control the movement of the camera connected to the device to capture accidents caused by third parties.

[0085] The device's processor is configured to identify emergency situations before processing images of nearby faces and matching them against a database of known criminals and terrorists. Once identified, a notification or alert is sent to a remote server and law enforcement authorities indicating the identified location.

[0086] The invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment containing both hardware and software elements. In a preferred embodiment, the invention is implemented in software, including but not limited to firmware, resident software, microcode, etc. Furthermore, the invention may take the form of a computer program product accessible from a computer usable or computer readable medium providing program code for use by or in connection with a computer, or any instruction execution system. As used herein, computer usable or computer readable may refer to any device that can store, retain, communicate, propagate, or transport a program for use by or in connection with an instruction execution system, device, or terminal.

[0087] The following definitions are used in this specification and the appended claims: "Cloud" or "Computing Cloud" is interpreted in the sense of cloud computing or, synonymously, distributed computing over a network, unless otherwise specified. "Server" is interpreted in the sense of computing. That is, a server is a computing server. A server typically has one or more (computing) processors for executing programming instructions and one or more capacities for storing data. A server may be a standalone computing server (i.e., a physical server), a distributed server on a cloud, or a virtual server for processing customer instructions. The capacity or capacities may be, for example, a hard disk or a solid-state disk drive. "Mobile computing terminal" is a portable electronic terminal having computing capabilities and configured to be used by a human user. For example, a mobile computing terminal may be a smartphone or a portable tablet computer.

[0088] The present invention relates to a mobile personal safety device configured to sense a user's surrounding environment to generate scene data, detect the occurrence of an emergency condition detrimental to the user, and automatically transmit the scene data obtained immediately before the emergency condition to a remote server for safe storage. To illustrate the disclosed device, FIG. 1 is a diagram illustrating an exemplary personal mobile safety device 100.

[0089] The device 100 is wearable by a user and comprises a scene monitor 110 and a main controller 140. The scene monitor 110 is used to sense the user's surrounding environment to obtain scene data. The main controller 140 is used to control the scene monitor 110 and process the scene data received from the scene monitor 110. The main controller 140 comprises a transceiver 152 and a processor 151. The transceiver 152 is used for wireless communication between the personal security device 100 and other locations outside the device 100. In particular, the transceiver simultaneously transmits a copy of the most recently recorded scene data (first plurality of data) to a connected mobile computing terminal in order to keep a copy of that scene data separate from the personal security device. The transceiver 152 is controllable by the processor 151. In particular, the processor 151 is preferably configured to (1) detect the occurrence of an emergency adverse to the user, and (2) upon detecting the occurrence of the emergency, configure the transceiver 152 to notify the mobile computing terminal to transmit a copy of a first plurality of scene data most recently acquired over a predetermined time period to a secure server and transmit a copy of the second plurality of data via the mobile computing terminal to a remote server while storing a copy of the second plurality of data in an internal memory of the mobile computing terminal. In this manner, by securely storing the first and second plurality of scene data on the remote server 170 and storing a copy of the first and second plurality of data in the memory of the mobile computing terminal, the device 100 or the mobile computing terminal may be available for future use even if it is subsequently tampered with or corrupted, for example, by an attacker attacking the user.

[0090] The first plurality of scene data includes scene data recorded immediately before the occurrence of an emergency condition, and thus can provide evidential information regarding the occurrence of the emergency condition. A person skilled in the art may determine the predetermined length of time by considering how much evidential information is needed to understand the surrounding environment leading up to the occurrence of the emergency condition. For example, 30 seconds to 5 minutes may be sufficient.

[0091] Apart from the first plurality of scene data, the scene data obtained after the emergency condition is detected is also valuable since it records the surrounding environment when the user is exposed to the hazardous situation. Preferably and advantageously, the processor 151 controllers the scene monitor 110 to continue sensing the surrounding environment after the emergency condition is detected. Further, the processor 151 configures the transceiver 152 to transmit the second plurality of scene data obtained after the emergency condition is detected and thereafter securely stores the second plurality of scene data on the remote server 170 via the mobile computing terminal for future use even if the device 100 is tampered with or damaged. The personal safety device and the mobile computing terminal maintain a copy of the scene data in a local memory of the incident. The device 110 includes one or more sensors for sensing the surrounding environment.

[0092] In some embodiments, the scene monitor 110 is equipped with a camera 121, or multiple cameras, for capturing images of the surrounding environment. Thus, the scene data includes the captured images. Optionally, the processor 151 is configured to determine whether violent motion has occurred, indicative of a user facing a physical attack or accident, to detect the occurrence of an emergency condition. Whether violent motion has occurred is determined by processing the captured images. If violent motion is determined to have occurred, the occurrence of an emergency condition is detected or confirmed. Upon detection or confirmation of the occurrence of an emergency condition, the device 100 automatically initiates transmission of the first plurality of scene data and the second plurality of scene data to the remote server 170 using the mobile computing terminal, without the need for a user to initiate the transmission, and the mobile computing terminal retains a copy of the data locally for safekeeping.

[0093] Typically, violent motion is detected by estimating the amount of shaking applied to the camera 121 or the change in speed from successively captured images. The amount of shaking and the change in speed can be determined according to teachings in the art, such as US 2011 / 0310262A1, US Pat. No. 9,888,180B2, and US Pat. No. 9,973,698B2. Violent motion is determined when the amount of shaking is too large or the change in speed is large and sudden. Since violent motion is the result of a user facing a physical attack or accident, a person skilled in the art may conduct daily life experiments to determine the amount of shaking and / or the change in speed when determining the occurrence of violent motion. In addition, the processor 151 detects violent motion by detecting abnormal behavior of the user. When a user and an attacker are fighting, the user usually performs a series of actions such as being pushed, shaken, and punched in a short period of time. All of these actions are not actions that a user normally performs, so the occurrence of an emergency can be detected.

[0094] It is observed that before an emergency condition is detected, the customized safety device need not continually capture video of the surrounding environment in order to conserve battery power of the device 100. In one embodiment, images of the surrounding environment may be captured periodically, for example, taking 4-8 snapshots per second, while simultaneously collecting and storing audio data and other scene data captured via the scene monitor 110 in the memory of the personal safety device and in the memory of the mobile computing device. In another embodiment, video may be captured, but at a reduced rate, such as 10 frames per second, prior to the emergency event, while during the emergency event, the frame rate may be increased to a higher rate to capture more detail, such as 30 frames per second or more.

[0095] After an emergency condition is detected, it is advantageous to take a video, or a series of snapshots, to collect details of the surrounding environment. In one embodiment, the processor is further configured to perform the following tasks: If no emergency condition is detected, the processor 151 controls the camera 121 to periodically take still images of the surrounding environment. In response to detecting the occurrence of an emergency, the processor 151 controls the camera 121 to take a video, or further a series of snapshots, of the surrounding environment in real time. The processor 151 further configures the transceiver 152 to transmit the video or series of snapshots to the mobile computing terminal and to the remote server 170, and to securely store the video on the remote server for future use, even if the device 100 is subsequently tampered with or damaged. The scene data is stored in the memory 153 of the personal safety device 140 until it is deleted by the user or the main controller 140 is notified by the remote server 170 or the mobile computing terminal that the data has been successfully and securely received and stored. This is controlled via software located on the mobile computing terminal and available to the user through a user interface of the mobile computing terminal, such as a mobile application on the user's smartphone.

[0096] To determine whether a violent movement or a fall by the user (e.g., if the user is elderly) has occurred, a mechanical device and / or an artificial intelligence module and / or a number of sensors configured to detect the movement of the device 100 may be useful. Optionally, the device 100 further comprises a motion sensor 160 for detecting the movement of the user to generate motion data. In practice, the motion sensor 160 is typically realized as a three-axis accelerometer, a gyroscope, a barometer or other air pressure sensor, or a combination thereof. Preferably, the processor 151 is further configured to process the motion data to make a second determination of whether a violent movement has occurred, to be combined with the first determination made by processing the captured image in determining whether a violent movement has occurred. The process of combining the first determination and the second determination to make a final determination of whether a violent movement has occurred can be implemented as follows. In one option, the final determination is made when the processor 151 determines that both the captured image and the motion data indicate the occurrence of a violent movement. Using this option can reduce the possibility of false alarms. In another option, the final determination is made when the captured image or the motion data indicate the occurrence of a violent movement. This option can be used to reduce the chance of a miss, and it is possible to develop algorithms that make the final decision in a way that minimizes the chance of a miss while reducing the chance of a false alarm.

[0097] Alternatively, the processor 151 may process only the motion data (using the accelerometer and / or gyroscope and / or barometer) to detect the occurrence of intense motion without processing captured images. Because the motion sensor 160 outputs motion data directly, the processor 151 may process the motion data to detect intense motion using less computational effort than processing captured images, which may result in battery savings.

[0098] The motion sensor 160 may be disposed in the main controller 140 of the device 100 as one of the sensors for sensing the surrounding environment, so that the scene data further includes motion data.

[0099] Apart from detecting the occurrence of an emergency by identifying violent motion from the captured image, an emergency may also be detected by uniquely identifying other events. In some embodiments, the processor 151 is configured to process the captured image to determine whether a predetermined hazard is present in the surrounding environment to detect the occurrence of an emergency. If it is determined that the predetermined hazard is present, the occurrence of an emergency is detected. This causes the processor 151 to execute a pre-defined procedure in response to the occurrence of the emergency, including sending the first of a plurality of scene data to the remote server 170. Examples of hazards include fires, certain types of weapons, specific people known to the user, or people with criminal records. In general, to detect the predetermined hazard from the captured image, an object recognition algorithm is performed by the processor 151. In the case of detecting fires, the detection problem is simplified by detecting a large number of very bright pixels on the captured image. See U.S. Patent No. 7,542,585 B2 for related algorithms. In the case of identifying known criminals, a facial recognition algorithm, such as that disclosed in U.S. Patent No. 7,643,671 B2, may be used. In the case of a specific person known to the user. An image of the subject may be placed in the software of the mobile computing terminal. The software can then be used to configure the personal security device to monitor that individual, for example a stalker or ex-lover. Many aggressors against women are people the woman knows well. Alternatively, the personal security device can be set to record certain sounds (e.g. keywords, sirens, etc.), take images of individuals, detect situations through scene monitors, or add to its internal memory as scenarios that will initiate an emergency if they come within range of the sensor.

[0100] Apart from the camera 121, other sensors may be used to sense the surrounding environment. Further, multiple scene data generated from these sensors and the camera 121 may be used individually and independently to identify the occurrence of an emergency. The processor 151 may also be configured to select scene data generated from only a subset of all sensors in the device 100 to identify the occurrence of an emergency.

[0101] In some embodiments, the scene monitor 110 is equipped with a microphone 122, or a plurality of microphones, for capturing audio signals emanating from the surrounding environment. As a result, the scene data includes the captured audio signals. Optionally, the processor 151 is configured to process the captured audio signals to determine whether a predefined danger sound segment is present in the surrounding environment to detect the occurrence of an emergency. If it is determined that a predefined danger sound segment is present, an emergency is identified, which will automatically initiate transmission of at least a first plurality of scene data already held in the memory of the mobile computing terminal without the need for a user to initiate the transmission. Examples of danger sound segments include gunshots, explosions, screams, sirens, and one or more predefined sounds associated with danger. Such sounds include "gun," "help," "I've been shot," etc. The plurality of data is then created by the personal safety device and transmitted to the remote server 170 via the mobile computing terminal, and is automatically initiated without the need for a user to initiate the transmission. Both the wearable terminal and the mobile computing terminal retain a copy of the data, at least until it is confirmed that it has been safely stored on the remote server.

[0102] In some embodiments, the scene monitor 110 includes a hazardous gas sensor 123, or multiple hazardous gas sensors, for measuring the concentration of a predetermined hazardous gas to obtain hazardous gas concentration data. Typical examples of hazardous gases include carbon monoxide and hydrogen cyanide. Optionally, the processor 151 is configured to process the hazardous gas concentration data to detect the occurrence of an emergency. If the hazardous gas concentration data reveals that the concentration of the predetermined hazardous gas exceeds a predetermined concentration, an emergency is identified, which automatically initiates a process to transmit at least a first plurality of scene data already held in the memory of the mobile computing terminal to the secure server, and automatically initiates a process to generate a second plurality of data on the personal safety device and transmit it via the mobile computing terminal to the remote server 170, without the need for a user to initiate the transmission. Both the personal safety device and the mobile computing terminal retain copies of the data, at least until it is confirmed that the data has been securely stored on the remote server.

[0103] In some embodiments, the scene monitor 110 is equipped with a PM measurement sensor 124, or a number of PM measurement sensors, which measure the PM concentration in the surrounding environment and generate PM concentration data. Portable PM measurement sensors are available in the art, for example as described in US 2009 / 0056416 A1 and patent no. 9,995,667 B2. Optionally, the processor 151 may be configured to process the PM concentration data to detect the occurrence of an emergency. If the PM concentration data indicates that the concentration of PM exceeds a certain pre-defined concentration, an emergency is identified and a process is automatically initiated in which at least the first scene data held in the memory of the mobile computing terminal is transmitted to the secure server and the second data generated by the personal safety device is transmitted via the mobile computing terminal to the remote server 170. The transmission does not have to be initiated by the user. Also, both the personal safety device and the mobile computing terminal retain at least a copy of the data until it is confirmed that the data is securely stored on the remote server.

[0104] In some embodiments, the scene monitor 110 includes a radiation sensor 125 or multiple radiation sensors for measuring radiation intensity to obtain radiation intensity data. Radiation is typically emitted by radioactive materials and poses a hazard to a user. Portable radiation sensors are available in the art, such as those disclosed in U.S. Pat. No. 8,466,425 B2 and International Publication WO 2015 / 026261 A1. Optionally, the processor 151 may be configured to process the radiation intensity data and detect the occurrence of an emergency. If the measured radiation intensity exceeds a predefined level:

[0105] The emergency is identified and an automatic transmission of at least a first plurality of scene data held in the memory of the mobile computing terminal to the secure server and a second plurality of data generated by the personal safety device is initiated via the mobile computing terminal to the remote server 170. This process occurs without the need for a user to manually initiate the transmission, and the personal safety device and the mobile computing terminal retain a copy of the data at least until it is confirmed that the data has been securely stored on the remote server.

[0106] Other useful sensors to attach to the Scene Monitor 110 include an IR camera and a UV sensor. The IR camera is particularly useful for capturing the environment at night. The IR camera can also be used for thermal imaging, which is useful for identifying fires and identifying people nearby who have a high fever. The UV sensor provides the ability to raise an alarm if there are high levels of UV radiation.

[0107] In some embodiments, the mobile computing device may use sensors on the device or sensors separate from but connected to the device as a means of detecting an emergency. When two devices are connected, they may work together in detecting an emergency or compare field data to avoid false triggers.

[0108] Once an emergency situation is recognized by the mobile computing device, the device can notify a personal security device of the emergency and instruct it to begin transmitting secondary scene data. For example, if the mobile computing device has access to a window sensor in a building or a front door sensor in a person's home, when it is notified that a window or door has been opened without authorization, it can initiate an emergency response (which may include an alarm to wake the user), begin collecting secondary scene data, and instruct the personal security device to do the same.

[0109] In addition to using various sensors to detect the occurrence of an emergency, it is also possible to detect the occurrence by verifying that scene data is being properly received during normal operation. An unexpected cessation of transmission of scene data from the scene monitor 110 to the main controller 140 may indicate that an adverse event has occurred, such as a burglar attempting to attack a user and destroy the scene monitor 110. In some embodiments, the processor 151 is configured to monitor the transmission of scene data and detect an unexpected cessation of scene data transmission. When an unexpected cessation is detected, the processor 151 recognizes that an emergency has occurred and automatically transmits the first scene data and possibly the second scene data to the mobile computing terminal and / or remote server 170 without the user having to initiate the transmission.

[0110] In actual use, the user wears the device 100 by attaching it to clothing. The device is placed on the outside of the clothing and senses the surrounding environment. Preferably, the device is provided with a waterproof case, for example a waterproof case made of hard plastic. In other embodiments, the device may be incorporated into glasses, ear pieces, hats, or other items worn by the user. When used on a bicycle or motorcycle, an attachment is used to mount the device on the handlebars or in a position close to the user to ensure a clear view. On the other hand, mobile computing terminals (smartphones) are typically hidden in clothing, attached to a strap, secured to the body or belongings by a pocket or other means to prevent malicious persons from picking up the device and damaging it or stopping its recording or transmission functions.

[0111] In some embodiments, the device 100 may further include a cable 130 or IC chip connection connecting the scene monitor 110 and the main controller 140, allowing the scene monitor 110 and the main controller 140 to communicate and be in separate locations, allowing the main controller to be hidden from view, such as under clothing, in a bag or pocket.

[0112] In some embodiments, the main controller 140 may include a battery holder 156 to house a battery 155. The battery 155 may be a replaceable or rechargeable battery. The cable 130 may be configured to provide power from the battery 155 to the scene monitor 110 to operate the scene monitor 110. In some embodiments, the battery 155 may be a self-contained, rechargeable battery that is located inside the main controller 140 to provide power to the device 100. Additionally, the device's battery may also be used to reverse charge a mobile computing terminal.

[0113] If the battery 155 is a coin-type lithium-ion battery, the size and weight of the device can be reduced, making it easier for the user to carry. This makes the device lighter, smaller, and more comfortable to wear on clothing.

[0114] For user convenience, the device 100 preferably further includes a mounting device 112 for mounting the scene monitor 110 to the user's clothing or a nearby location, such as the handlebars of a bicycle. The mounting device 112 can be anything from a simple clip onto clothing or a bag, to a snap onto a variety of wearable items, such as a neck lanyard, arm band, bag, leg band, headband, cap, chest strap, etc. The mounting device 112 may include a Velcro band, a magnetic fastener, or other snap-attaching accessories.

[0115] It is sometimes useful for a user to record their location as they move around. In some embodiments, the scene monitor 110 or main controller 140 includes a GPS tracking unit 126 to determine the geographic location of the device 100 and generate location data. The scene data also includes location data. In other embodiments, GPS data is collected from a mobile computing terminal and obtained when the device is in an emergency state or simply when the device is operational. Also, separate sensors connected to the system may be used.

[0116] Mobile computing devices may have access to other data that can help authorities improve their investigations, such as records of nearby Bluetooth or other devices (which may suggest the presence of people at the time of an incident), cell tower strength, and recordings from their own cameras and microphones. This data may also be uploaded to a secure server in the event of an emergency. The intent of the mobile computing device is to use its sensors and capabilities to "enhance" or "add to" the scene data generated by the personal security device.

[0117] Typically, the main controller 140 is further provided with a memory 153 for storing scene data received from the scene monitor 110. The processor 151 is configured to store the scene data in the memory 153 and in the memory of the mobile computing terminal. The memory 153 may be a volatile memory (e.g., a random access memory module) or a non-volatile memory (e.g., a solid-state storage or a magnetic disk). The memory may also use a "buffering" approach to store data for a period of time. In any case, the intention is to use the memory to provide a user with a record of what is happening or was happening. Those skilled in the art may be able to utilize hardware and software to achieve a similar result. Whether the memory used is volatile, non-volatile, or some other form is determined by the technician depending on the situation considered.

[0118] The processor 151 may be implemented as a single processing element or as a group of processing elements connected in a network. The processing elements may take various forms, such as a general processor, a digital signal processor, a processor specific for image processing, a microcontroller, a programmable logic device, a field programmable gate array, or any other type of device designed to perform the required tasks. The processor 151 is configured or programmed according to the teachings of the present disclosure. Computer instructions or software code executed by the processor 151 may be readily prepared by practitioners skilled in software and electronic engineering based on the teachings of the present disclosure.

[0119] The transceiver 152 is configured to support one or more communication protocols to allow the device 100 to communicate with external devices, such as a remote server 170. Typically, the remote server 170 is located in a computing cloud 175 and is addressable through the Internet. In some embodiments, the transceiver 152 is configured to support at least one or more terrestrial mobile communication protocols (e.g., LTE, 5G mobile communication standards, etc.). A wireless connection between the remote server 170 and the device 100 is provided through a terrestrial mobile communication link 177 and the computing cloud 175. In some embodiments, the transceiver 152 is also configured to support at least one or more short-range communication protocols (e.g., BLE protocol, Wi-Fi, etc.). For example, the device 100 can wirelessly communicate with a mobile computing terminal 172 (e.g., a smartphone) through a wireless channel 178 using Wi-Fi. The mobile computing terminal 172 is typically accessible to the computing cloud 175. A wireless connection between the device 100 and the remote server 170 is established through the wireless channel 178 and the mobile computing terminal 172. If a laptop computer is a mobile computing device, a wired LAN or some form of telephone line might also provide access to the Internet and secure servers.

[0120] 2 illustrates a personal safety device permanently connected wirelessly to a mobile computing terminal, which can take many forms from a smart phone to a delivery truck, in accordance with one embodiment of the present invention.

[0121] These different forms of mobile computing devices have wireless communication connectivity or can be connected to personal safety devices, which can be attached to helmets, headgear, bicycles, or clothing of the user. The purpose of a personal safety device is to remain closed or attached to the user.

[0122] FIG. 3 illustrates a personal safety device recording in a predefined loop and transmitting a transcript to a mobile computing device, according to one embodiment of the present invention.

[0123] If no emergency situation occurs, we store normal surrounding data in the form of images or videos on your device and mobile computing device. For security reasons, the data is not sent to our servers. Two local transcripts are stored on your device and mobile computing device. However, these copies can be deleted after a pre-defined period of time, either manually by the user or an administrator, or automatically.

[0124] 4 illustrates a mobile computing terminal in an emergency state transmitting first and second plurality of data to a secure server, according to one embodiment of the present invention. The figure also illustrates copies of the first and second plurality of data being stored in the mobile computing terminal and the personal security device. In an emergency, the mobile computing terminal is used to transmit the first and second plurality of data to the secure server. The first copy of the first plurality of data is FP1, and the first copy of the second plurality of data is SP1, which are stored in the personal security device.

[0125] A copy of the second plurality of data is stored within the mobile computing terminal as a second copy of the first plurality of data (FP2) and a second copy of the second plurality of data (SP2). A third copy of the first plurality of data is FP3 and a third copy of the second plurality of data is SP3, which is stored on a secure server. Among the multiple pieces of data stored on the secure server, the first and second multiple pieces of data cannot be deleted or accessed without authentication or authorization certificates.

[0126] What is important to note here is that the personal security device communicates with a mobile computing device, which in turn communicates with a secure server - there may or may not be direct communication between the personal security device and the secure server. FIG. 5 illustrates a personal safety device with a mobile computing terminal and a cloud server according to one embodiment of the present invention.

[0127] Once the first and / or second plurality of data has been received by the secure server, a notification is sent to the mobile computing terminal and personal security device. The user may choose to erase or clean the data manually or have it erased automatically after a pre-set period of time or upon reaching home or a specific destination, which is at the user's discretion. Home and destinations may be pre-determined or may also be determined by the system when the mobile computing terminal or device approaches a known radio range or location.

[0128] Data on your mobile computing devices and personal security devices may be deleted using our mobile application, desktop application, software or interface. FIG. 6 first illustrates, next, a flowchart of a method for multiple data communication according to one embodiment of the present invention. Step 610: The personal security device begins loop recording the first number of data items and stores them within the device.

[0129] Step 620: The personal security device constantly or periodically transmits the loop recording to the mobile computing terminal, which stores a second copy of the first of the plurality of data in a memory of the mobile computing terminal. Step 630: Decision to determine whether an emergency has occurred In step 640: If no, resume normal operation and continue loop recording.

[0130] If so, it means that an emergency has occurred, and the mobile computing terminal transmits an initial copy of the plurality of data to a secure server, step 650 .

[0131] Step 660: In the event of an emergency, the personal security device transmits a plurality of data to a secure server via the mobile computing terminal. Step 670: The mobile computing terminal stores copies of the second plurality of data in its own capacity. In step 680: The system checks whether the first and second plurality of data have been successfully stored in the secure server.

[0132] In step 684, if the first and second plurality of data are successfully stored, the system notifies the mobile computing terminal and the personal safety device accordingly.

[0133] In step 688, the memory of the personal safety device and the mobile computing terminal can be manually erased, wiped, cleaned by the user, or automatically erased after a predetermined period of time or upon arrival at a home or destination, which may be predetermined or may be determined by the system when the mobile computing terminal and / or device is within range of a known radio or location.

[0134] At 690: if the data is not successfully uploaded to the secure server, the system continues to attempt to upload to the secure server. Maintain copies of the first and second plurality of data in memory of the mobile computing terminal and the personal security device.

[0135] It is desirable for a user to be able to send configuration commands to the device 100 using a smartphone, smartwatch, laptop, or tablet computer. The processor 151 should be configured to configure the transceiver 152 to communicate with an external mobile computing terminal (e.g., mobile computing terminal 172), receive commands therefrom, and execute the received commands. Commands from the smartphone or tablet may be provided using a short-range wireless protocol (e.g., Bluetooth) or may be configured over-the-air (OTA) through a hotspot or mobile network connection. This may simplify the design and reduce the cost of the personal security device. Control and configuration are accomplished through a smartphone app or other user interface on the mobile computing terminal, eliminating the need for a complex interface on the personal security device itself.

[0136] The main controller 140 may or may not include a display screen (not shown in FIG. 1) to provide a user interface with the user. The main controller may or may not include a physical or digital keypad to allow for entry of personal safety device information and configuration.

[0137] The main controller 140 or scene monitor 110 may be provided with an emergency button 162 to enable a user to manually notify the processor 151 that an emergency has occurred.

[0138] For user convenience, the device 100 may be equipped with a power button 163 or a virtual power button on the interface of the mobile computing terminal to allow the user to manually turn the device 100 on and off. However, the presence of the power button 163 provides an opportunity for an attacker to turn off the device 100 to prevent the scene monitor 110 from sensing the surrounding environment or the main controller 140 from transmitting scene data to the remote server 170 for secure storage. For this reason, disabling the power button 163 after an emergency condition is detected is a desirable and effective countermeasure. Specifically, the processor 151 is configured to disable the power button 163 upon detection of an emergency condition to prevent the device 100 from being turned off. Since the mobile computing terminal is critical to the connection with the remote server, it is desirable for the mobile computing terminal to also be locked during an emergency condition. For a smartphone, this may include a lock screen requiring an additional passcode. Additionally, an additional level of security would ideally be a lock screen within an app or device interface dedicated to controlling or configuring the personal security device. Authentication means other than a passcode may also be used. For example, facial recognition, fingerprint recognition, or other biometric approaches may be used to prevent attackers from gaining access to and turning off a mobile computing device.

[0139] Ideally, the temporary disabling of the power button 163 is maintained until the processor 151 receives a message from the remote server 170 or the mobile computing terminal that the remote server 170 has successfully received the first set of scene data, which would prevent an attacker from forcibly stopping the transmission of the first set of scene data to the remote server 170. It is also desirable to maintain the temporary disabling of the power button 163 for a longer period of time so that the scene monitor 110 continues to sense the surrounding environment after the emergency condition is detected, and so that a second set of scene data obtained after the emergency condition is also transmitted to the remote server 170.

[0140] To further illustrate the use of the disclosed portable personal safety device, a practical realization of device 100 and a support platform for supporting a user wearing device 100 are described below. Remote Data Capacity

[0141] The scene data should be stored outside the device 100 to reduce the risk of data destruction at the scene by a hostile party after an emergency or adverse situation occurs. Adverse situations or incidents include physical attacks, robberies, accidents, natural disasters, and other distress events. The collected scene data is stored on the mobile computing terminal and the remote server 170 in a data storage account identified by an account name or identification information. This designated account is preferably a cloud-based account, and the data storage space is cloud-based and operated by the service provider. The service provider may operate a personal security service platform that provides customized services to registered users providing personal security support. The platform may include predefined schemes and measures to react or counter upon receiving a signal indicating an emergency situation (e.g., personal danger of the registered user). The platform may continuously monitor signals emitted from the device 100 when the device 100 is in a protection mode. If the platform receives a signal indicating the occurrence of an emergency situation from the device 100, the platform may react or counter by reporting to the police or other responsible authorities, or by contacting a person preregistered by the account user. For example, the person may be a relative or family member, or a trusted friend. The User may grant different levels of access to the data depending on the situation. For example, friends may only be able to see the location information, while the police may see both the video and the location information. This is at the User's discretion and controlled by selecting the options in the User's server storage account. The Platform may also, by executing stored instructions, excerpt or extract information from the scene data and provide the excerpt or extracted information to assist in rescue operations or provide assistance.In order to have access to an external data storage account on the remote server 170, the user must set up a designated storage account with the platform when first activating the device 100. Contact information must also be entered during or after account setup to allow the platform to contact the desired person in the event of an emergency. Operation form

[0142] To mitigate the risk of data destruction, a choice may be set in the user's data storage account so that files sent to the mobile computing terminal and / or remote server 170 in emergency mode (or other mode at the user's discretion) will not be deleted for a period of time (e.g., 72 hours). This would prevent an adversary from coercing a victim into abandoning the password protection set in the system and deleting the files through the web interface or mobile application. During this lockdown period, friends and family or emergency services configured in the system would be able to access the files and respond appropriately. Operational Mode

[0143] The mobile personal safety device 100 is operable in multiple operating modes, and the main controller 140 is configured to operate in the multiple operating modes upon execution of stored instructions forming an "application." Basic Mode (Featured)

[0144] Regardless of the momentary operating mode being performed, the main controller 140 of the device 100 should always include an operating mode identified as "basic mode" during execution of the pre-stored instructions of the application software. In basic mode, the main controller 140 operates to continuously record scene data, such as video or a series of snapshots, audio recordings, temperature measurements, etc., and stores those recordings in a loop in memory 153. This ensures that any recordings that have elapsed a pre-set period of time are first overwritten with new recordings. This period can be, for example, 30 seconds to 5 minutes, 5 minutes to 15 minutes, or any other period selected or set by the user. To reduce power consumption in basic mode, the main controller 140 has the option to record at a lower power setting by reducing image resolution, reducing the frame rate of video capture, turning off certain sensors, or a combination thereof. These settings may be at the user's discretion or may be programmed into the operating system of the main controller 140.

[0145] For example, the frame rate during normal operation is 10 frames per second. When the battery level falls below 20%, the frame rate drops to 5 frames per second or less in basic mode to conserve battery life. 155 At the same time, the device has the capability to send the same loop recording to the mobile computing device, and a copy of the loop recording is stored on both the mobile computing device and the wearable device. Emergency Mode (Protection) The main controller 140 may be instructed to enter emergency mode if an adverse event occurs, such as if one or more of the following events occur: A user manually activates an emergency trigger

[0146] The scene monitor 110 detects sudden or violent movement, meaning the scene monitor 110 is being snatched from the user or the user is being physically attacked. The transmission of scene data from the scene monitor 110 to the main controller 140 stopped unexpectedly. If the user experiences a sudden fall or other accident involving violent movement A scene monitor 110 that experiences / senses images that can recognize obvious threats, such as fire, weapons, specific people pre-programmed by the user, or known criminals. For example, a scene monitor 110 that experiences / detects audible alerts in the environment, such as gunshots, screams, sirens, or keywords that trigger an emergency. Scene monitor 110 that detects specific hazards in the surrounding environment (radiation, specific particles in the air, gas emissions, etc.) Scene monitor that recognizes aggressive behavior or movements of people captured on camera.

[0147] If the person expects to be alone at all times, the perception of people entering the environment may also be perceived as a threat, for example someone entering someone else's home or bedroom. After successfully saving to the Internet or an external location, you can clear memory 153 to save memory space.

[0148] Your selected friends, family and emergency services (emergency contacts) will be notified of the event, for example by email, SMS or other known means of communication.

[0149] Emergency contacts are provided with a web link to access the data to view and respond to it. These files can be viewed but not tampered with by emergency contacts to maintain the integrity of the evidence. These files cannot be deleted for a certain period of time to provide additional security to users. Sensor Mode in Monitoring Mode

[0150] Many women are attacked in their own homes or dorm rooms. The sensor mode is designed to detect someone entering the room. If the main controller is set to expect only one or two people in the room, an emergency will be triggered if a third person enters the room. Remember Mode Other Modes

[0151] Sometimes, a person may wish to record certain incidents even if they do not perceive them as threatening, for example if staff are rude or abusive. With the press of a button, voice command, or other pre-configured trigger, the Main Controller will lock down the recorded data for a pre-configured period of time and then continue recording for an additional configured period of time. This results in the first plurality of data and the second plurality of data being stored on the mobile computing device and on a secure server. This data may be tagged differently in the user interface, for example, as "Stored Mode Video." Adverse situations and emergency situations The illustrated modes are merely exemplary to illustrate example operations of the device 100. Other modes may be devised without loss of generality.

[0152] The main controller 140, during execution of the pre-stored instructions of the application software, is in continuous data communication with the scene monitor 110 to receive real-time scene data. The scene data is typically transmitted in real-time as electronic signals, but may also be transmitted as optical signals, infrared signals, sonic signals, ultrasonic signals, or other signals suitable for generally applicable data communication. In executing the pre-stored instructions, the main controller 140 processes and analyzes the received scene data to determine whether the received scene data represents a harmful or non-harmful situation. The application software instructions are pre-stored in the memory 153 of the main controller 140 and later retrieved and executed by the main controller 140 to facilitate personal safety monitoring.

[0153] If the main controller 140 determines, as a result of its analysis of the received scene data, that a worsening situation is warranted, or that evidence needs to be recorded and safely stored in the cloud 175, or that outside assistance or intervention needs to be notified, the main controller 140 automatically generates and transmits an emergency report to an external destination. The aforementioned external destination is geographically remote from the user, and the emergency report can be transmitted by the main controller 140 through the transceiver 152 using a wide area network such as the Internet or public Wi-Fi. It can also be transmitted by connecting to the Internet via a mobile computing terminal. The device 100 may be preconfigured to transmit the emergency report to a service provider's reporting center. The service provider may be a dedicated emergency rescue agency operated platform, for example a law enforcement operated call center, or a private security company operating an online rescue facility. The emergency report may include an emergency signal indicating that a safety threatening event has occurred, an emergency message containing vital information, and optionally a transcript of the scene data. The vital information may include a timestamp indicating when the emergency report was transmitted, the location of the scene, and the urgency of the scene. Urgency may be classified into multiple levels and / or degrees of urgency based on a predefined system to indicate the urgency of rescue. For example, the order of urgency of rescue may be: (1) Life-threatening injury (urgent assistance required); (2) danger to life (urgent assistance required); (3) safety is threatened (immediate relief required); (4) endangering safety (rescue required); and (5) Caution Required (Highest Priority)

[0154] The critical information and on-site data may be transmitted as an attachment to the distress report, or may be transmitted following the distress call of the distress report to send an alert to a platform, which may be either manually operated or an automated platform that has been pre-trained (e.g., through AI training) specifically to process distress reports.

[0155] The distress report may include a protected recording of the attack or portions of it if an attack is detected or apparent. When the platform responds to a distress report, it may attempt to establish communication with the user to verify if the distress call is genuine or a false alarm. The platform may also remotely take over control of the device 100 and perform emergency interventions to intimidate the attacker, reassure the victim, or monitor the scene until distress assistance arrives.

[0156] The main controller 140, when executing the pre-stored instructions of the application software, has the ability to identify critical situations based on the received scene data and transmit a rescue report to the platform by machine operation. To identify critical situations by referring to the captured scene data by machine operation, the application software, when executed by the main controller 140, includes instructions to analyze the content of the scene data and identify whether it contains a safety threatening scene or whether scenes constituting a critical situation are embedded in the scene data. It is also possible to extract the safety threatening scenes and transmit them to a remote destination for rescue assistance or store them as evidence. The main controller 140 can extract the relevant scene data for summary evaluation by the platform.

[0157] To reference the scene data acquired by the machine operation and to facilitate identification of critical situations, the application software may include instructions, when executed by the main controller 140, for analyzing the image content of the scene data and identifying emergency scene images that present a threat to safety. Examples of emergency scene images include images of weapons, body parts, violent expressions, bloody scenes, fight scenes, fires, etc.

[0158] The instructions may be based on motion and sound detection and analysis algorithms to determine if the on-site data contains a crisis situation. The main controller 140 may be equipped with AI to recognize crisis situations and determine whether a situation is crisis or non-crisis.

[0159] In order for the device 100 to make an internal determination as to whether a set of received scene data corresponds to the occurrence of a harmful event, the conditions under which a situation will be recognized as a harmful event must be predefined and preprogrammed into the stored instructions.

[0160] In some instances, scene situations are broadly categorized as unfavorable or non-unfavorable. Scene situations may be categorized as unfavorable, non-unfavorable, or neutral. Unfavorable situations refer to situations that are unpleasant. Non-unfavorable situations refer to situations where the user performs the activity as scheduled or planned and there are no negative indications. Neutral situations refer to situations that are intermediate between unfavorable and non-unfavorable, and refer to situations where the user does not require any outside assistance or intervention.

[0161] Critical situations are classified into different rescue levels according to the severity or severity of the situation, and appropriate response actions or measures are implemented accordingly. For example, critical situations may be classified as "personal safety threatening situations" and "non-personal safety threatening situations". "Personal safety threatening situations" may be further classified as "life threatening situations" and "non-life threatening situations". Life threatening critical situations are assigned the highest priority or severity level and are provided with the most urgent response or outside intervention. Life threatening situations may be further classified as "imminent life threatening" and "non-imminent life threatening". Non-life threatening safety threatening situations are assigned a lower priority than the highest priority, but are given a higher priority than non-safety threatening situations. Non-life threatening safety threatening situations may be further classified as "major incidents" or "non-major incidents". For example, a "personal injury that is not immediately life-threatening" would be classified as a "serious incident," while an "accident in which the individual recovers from a fall within a specified time frame" would be classified as a "non-serious incident."

[0162] The platform may automatically generate and transmit distress reports via machine-activated data communication when a critical safety situation is detected to external destinations, which may include police or rescue call centers or the user's personal contacts. A protected copy of the captured scene data is attached to the distress report, reducing the risk of data tampering. Below are some examples of unfavorable situations: users under attack; If the user accidentally trips or falls; If a user experiences unusual or unexpected changes in speed; If the user anticipates or foresees danger to himself; The scene monitor 110 has been disconnected during operation and has not been reconnected within the prescribed time; The on-site monitor 110 experiences / senses images that are clearly threatening, such as fire, weapons, criminals, etc.; The on-site monitor 110 experiences / senses an audible alarm in the surrounding environment, e.g., gunshots, screams, sirens, keywords that trigger an emergency, etc.; The presence of one or more people within the camera's field of view, closer than has been pre-determined to be safe; There are more people within the camera's field of view than is pre-determined to be safe.

[0163] Aggression can be physical or verbal. Physical aggression can include assault that can lead to bodily harm or injury. Verbal aggression usually involves the use of verbal abuse, but can also escalate to physical violence, bodily harm or injury.

[0164] To detect and determine whether the user is under physical attack, e.g., punched or hit, the scene monitor 110 is equipped with a 3-axis accelerometer and / or barometer (as a motion sensor 160), and the main controller 140 makes such determination from the motion data that is part of the scene data. If a free-fall-like fall, a hard fall, or violent movement is detected, the critical situation may correspond to a physical attack on the user or an accidental fall of the user. To distinguish between a physical attack and an accidental fall, the main controller 140 executes the stored instructions and further analyzes the captured scene data to determine whether an attacker is in the vicinity. If no attacker is identified in the vicinity, the situation is classified as a non-attack and a non-attack procedure is executed by the main controller 140. On the other hand, if an attacker is identified in the vicinity, an attack procedure is executed by the main controller 140. If the user responds to communication requests from the platform after the fall, this indicates that the user remains conscious, and the platform continues to communicate with the user and respond until the emergency is resolved. However, if the user does not respond to the platform's communication requests after a fall, potentially because the user is unconscious or restrained, the platform will initiate life-threatening emergency intervention procedures.

[0165] To determine if an attacker is present, the application software may include attacker identification instructions to analyze the captured scene data. The attacker identification instructions assist the main controller 140 in determining the presence of an attacker based on the captured scene data. The attacker identification instructions may include a facial recognition function to reference the video and image portions of the captured scene data to identify and determine the facial features and expressions of people and animals in the user's vicinity. The captured scene data may have been recorded immediately prior to, during, or after the attack. If the facial features of an attacker are not detected immediately after the attack, the platform may remotely operate the scene monitor 110 to conduct an investigation by rotating the camera 121 in all directions to search for possible attackers.

[0166] To more reliably determine if an attacker is nearby, the platform can reference the audio portion of the captured scene data and use audio recordings made at the scene. For example, a platform operator can listen to audio recordings made before, during and after a fall to determine whether there was any verbal abuse or violence, providing a more detailed picture of whether and how an attack occurred.

[0167] The aggressor identification procedures may include voice or voice recognition instructions that operate automatically to identify and determine whether voice characteristics indicate the possibility of abuse and / or violence. Attacker identification procedures may include instructions to facilitate both facial and voice recognition to enable more efficient and reliable situational assessment.

[0168] While a user is performing an activity, any sudden, abrupt or violent change in speed within a defined speed range may indicate a critical situation such as a physical attack, a vehicle accident, or other road or non-road incident. If a user is involved in a road accident, they may be inside or outside of a vehicle, which may cause a sudden speed change. Whether a user's speed change is sudden, abrupt or violent is determined based on the activity they are performing. For example, if a user is jogging at a speed between 5 km / h and 10 km / h, if their speed or speed change exceeds a safety threshold, it will be classified as a sudden or violent change. For example, if a user suddenly increases their speed to 25 km / h, it is likely to indicate a critical situation that requires external attention. Also, if a sudden speed increase is followed by a sudden stop, it is highly likely that a critical situation has occurred.

[0169] The main controller 140 may include a setting option for entering the mode of activity the user is performing. The setting option may also include other activity parameters or metrics. Examples of modes of activity include walking, jogging, running, sprinting, cycling, hiking, skiing, swimming, etc. The change in speed may be an increase or decrease in speed and / or a change in direction. After the activity mode is set, the main controller 140 monitors the user's activity and determines the average speed or velocity from time to time to set a criteria for determining whether an anomaly has occurred.

[0170] The main controller 140 configuration options allow the user to pre-set a maximum speed value. Also, a maximum allowable speed change rate can be set, called the change threshold or change threshold value. If the maximum speed change rate exceeds the set change threshold value, the main controller 140 will generate a distress signal indicating a critical situation. The change threshold value is defined as a threshold percentage change within a predefined time period. This predefined time period is a very short period, typically 1-2 seconds, corresponding to the occurrence of a critical situation or accident.

[0171] The application software may provide the user with the choice to set a range of average speeds, a maximum safe speed, and / or a threshold of change in percentage. The instructions may be AI-trained instructions to determine if there are rapid, sudden, or drastic changes in speed.

[0172] If the main controller 140 detects a sudden change in speed followed by a complete stop or a continued extremely high speed, a safety procedure may be initiated by the main controller 140.

[0173] The application software may include instructions for detecting changes in sequences and rates of motion and determining whether the sequences and rates of motion indicate abnormal user behavior and, if abnormal behavior is detected, initiating an emergency response.

[0174] The application software may include voice recognition instructions that enable the main controller 140 to identify audible signals indicating danger. Examples of audible signals indicating danger include fire alarms and the buzzers of emergency response vehicles such as police cars, ambulances, and fire engines. Typically, the voice detection functionality of the main controller 140 works in conjunction with other detection mechanisms before determining whether to generate and transmit a distress signal to an external destination via the transceiver 152.

[0175] The application software may include pattern recognition instructions that enable the main controller 140 to identify scenes, items, or objects that present a personal hazard. For example, guns, rifles, butcher knives, and hand gestures are examples of items or objects that present a personal hazard. Additionally, scenes of fire or explosions are examples of scenes that present a personal hazard.

[0176] The application software may include hazardous environment recognition instructions. The main controller 140 may execute the hazardous environment element recognition instructions to provide an alert to the presence of particulates or other elements in the environment that may pose a hazard to individuals. Radiation, asbestos, illegal drugs, explosives, and toxic gases are examples of elements that may pose a hazard to individuals.

[0177] The application software may include a manually operable distress signal initiator or generator. For example, a soft distress button (which may be a remote control switch wirelessly connected to the main controller 140 and stored in the user's pocket) may be configured on the main controller 140 or the scene monitor 110 to allow the user to manually activate the main controller 140 to send a distress report to an external rescue destination and perform life-threatening intervention procedures in the event of predicted danger or imminent attack (e.g., the soft distress button may be realized as an emergency button 162 on the main controller 140). The soft distress button may also be realized as a pre-set action via a smartwatch, or may be connected to a personal security device through Bluetooth or other wireless means. Upon receiving a manually triggered distress report, the platform may communicate with the user or, optionally, remotely operate the scene monitor 110 to inspect the scene and assess the immediate risk level before establishing voice communication with the user. The application software may also include a silent distress mode to conceal the user's exact location and avoid exposure to hostile parties by audio signals from the device 100.

[0178] An unexpected loss of physical or data connection between the local monitor 110 and the main controller 140 may be classified as an undesirable or emergency situation. For example, if the local monitor 110 becomes disconnected from the main controller 140 without warning, the main controller 140 will classify the loss as an undesirable situation. To reduce the risk of false alarms, a condition can be set (but is not required) to check if the connection is re-established within a given time after the loss. The false alarm will be removed and the device 100 will reset to a non-emergency state.

[0179] The main controller 140 can reference the captured scene data to determine whether the scene monitor 110 experienced sudden or violent movement immediately prior to disconnection. For example, if the scene monitor 110 experiences a sudden detachment equivalent to being ripped away from the user, the main controller 140 can generate and transmit a life-threatening distress signal to an external destination to call for emergency medical assistance.

[0180] In use, a user wears the scene monitor 110 (see FIG. 7). The scene monitor 110 can be worn on the forehead 511, shoulder 512, arm 513, chest 514, or waist 515. This allows it to capture an image in front of the user. The scene monitor 110 can be interchangeable depending on the needs of the user to provide a wider field of view or to have additional sensors attached. It can also be worn protruding from the shoulder 512 or forehead 511 for 360 degree scene capture. In one embodiment, the main controller and scene monitor are integrated, while in other embodiments the main controller 140 may be carried separately from the scene monitor 110. For example, the main controller 140 can be secured in a pocket or waistband, on a woman's bra strap, around the neck with a neck strap, on an armband separate from the scene monitor 110, or in a backpack or bag. The main controller 140 is intended to be out of sight and not easily removed from the user. On the other hand, the scene monitor 110 should be placed in an easily visible position to "see" and "hear" what is happening near the user using the camera 121 and microphone 122. This provides additional protection for the data and provides additional time for the main controller 140 to transmit data to a secure remote location if the user is under attack. The scene monitor 110 and the main controller 140 are connected by an insulated cable 130 to facilitate data and power connections. They may also be connected using a low-power wireless connection (such as Bluetooth). In addition, an external control device can remotely operate the scene monitor 110 to perform a search of the scene and receive the resulting scene data. The search can be facilitated by changing the orientation and focus of the camera 121 of the scene monitor 110. The external destination can also converse with the user or people near the device 100 via the microphone and speaker. The user can also wear the scene monitor 110 to capture scene data from behind or to the side of the user.The scene monitor may be worn on the forehead 511, shoulder 512, or hip 515 and allows for capturing images at an angular range of 180 degrees, 270 degrees, or 360 degrees. It is also possible for multiple scene monitors to be worn and provided with different sensors. For example, a camera and a separate radiation sensor may be connected to the main controller 140.

[0181] Before the device 100 is put into operation, the user must create an account on the service platform for storing remote rescue data and stress relief. When creating an account, the user must provide his / her personal information and contact information (phone number and email address). In addition, the personal information of the emergency contact, their mobile phone number and email address must also be provided to the platform. Once the account is registered and configured, the device 100 is operational.

[0182] As an example, when a user wears the device 100 and enters an unknown area, the device 100 switches to a protection mode. While operating in the protection mode, the main controller 140 monitors the user's movements, records or learns how to operate the activities being performed, records geographic location information and other metrics, continuously captures scene data, and transmits some or all of the captured scene data to an external destination or remote server 170. The geographic location data is obtained through the device 100's built-in GPS or an associated smartphone (e.g., mobile computing terminal 172), or based on the instantaneous cell tower ID connected to the main controller 140. As an example, the user experiences an accidental fall, and the main controller 140 detects the fall by analyzing the motion data received from the motion sensor 160. When a fall is detected, the main controller 140 enters a reporting mode, immediately stores the loop data in the main memory, and prepares to trigger a distress report. If the user returns to the original posture and activity within a pre-set guarding period (e.g., 3-5 seconds) after the fall, the main controller 140 will reset, delete the stored data from the memory 153, and enter the standby mode to continue operation in the guarding mode. On the other hand, if the user operates the main controller 140 to send a cancel instruction indicating that the alarm is a false alarm, the main controller 140 will reset to the standby mode. This cancel instruction may require a cancel code. If the user does not return to the original posture and activity within the guarding period or does not send a cancel instruction, the main controller 140 will send a distress report and send all or part of the stored data before the accident to the platform. In response, the platform will attempt to establish communication with the user and confirm whether a critical situation has occurred. An emergency event can also be canceled through the smartphone app. If no comforting communication is received from the user, the platform may perform a life-threatening rescue procedure.

[0183] As an example, if the user is in an area where he feels danger or anticipates an attack, he presses the manual emergency button 162 on the main controller 140 to initiate a life-threatening rescue procedure. During this, data from a pre-configured loop (the length of the loop is determined by the device settings) is stored in the persistent memory (memory 153) of the main controller 140 and then securely stored in a cloud service through a wireless connection to the Internet (e.g., a mobile computing device, a smartphone hotspot, a smartwatch, a laptop, a tablet, or a connected vehicle in commercial applications, Wi-Fi, a proprietary cellular connection, etc.). If a connection is not available, the main controller 140 continues to record the data and stores it in the memory 153 until a connection is re-established. It also stores a copy of the data in the memory of a mobile computing device (e.g., smartphone, smartwatch, vehicle, laptop, tablet, etc.) located near the user. When a signal is available, the main controller 140 uploads the stored data to the Internet for secure storage.

[0184] A user may use the device 100 together with a smartphone (referred to briefly as 172). As an example, the main controller 140 sends scene data to the smartphone 172, which acts as a hotspot and configures the main controller 140 using the BLE protocol. The scene data is sent from the main controller 140 to the smartphone 172, which then forwards it to the computing cloud 175 as an external destination for data storage. The smartphone also keeps a copy of the scene data in its internal memory to ensure data storage. When the platform needs to take over control of the scene monitor 110, the platform sends data and instructions to the smartphone 172, which sends control commands to the scene monitor 110 for scene data collection. The platform also sends data and instructions to the main controller 140, which acts as a hotspot for data communication. The smartphone 172 serves to relay messages between the main controller 140 and the computing cloud 175. However, the hotspot connection enabled by the smartphone 172 allows the smartphone 172 and the main controller 140 to communicate when necessary. For example, you can send instructions and settings, start and stop recordings, and report emergency events.

[0185] Although the present disclosure has been described with reference to exemplary embodiments, exemplary processes, and exemplary modes, these examples are merely intended to facilitate understanding of the present disclosure and are not intended as limiting examples. definition As used in this document, the term "scene monitor" may refer to a device that monitors the user's surrounding environment and transmits scene data. As used in this document, the term "processing" refers to the execution of instructions on a processor. As used herein, the term "latest data" refers to the most recent data obtained over a given period of time. As used herein, the term "predetermined length" refers to a predetermined period of time.

[0186] As used herein, the term "transceiver" may refer to a terminal capable of performing wireless communication and continuously / periodically transmitting initial multiple copies of data to another secure server for future use. As used herein, the term "wireless communication" refers to wireless communication over a network.

[0187] As used herein, the term "individual mobile computing device" refers to an individual personal safety device that can be worn by a user in the event of an attack or accident. As used in this document, the term "processor" may refer to a single processor or multiple processors. As used in this document, the term "emergency situation" refers to any situation in which the User is at risk of attack or injury.

[0188] The verb "detect" (meaning to detect, observe, find, discover, become aware of) can be replaced with "discover" or "determine the existence, presence, fact." As used herein, the term "emergency situation" may refer to situations that arise during an emergency.

[0189] As used herein, the term "remote secure server for future use" refers to a secure server that can provide information to a remote server for future use even if the personal secure device or mobile computing terminal is subsequently tampered with or destroyed.

[0190] As used in this document, the term "memory" may refer to either the physical memory units of a mobile computing terminal, or to memory that has been "buffered" in some manner to be temporarily stored. As used in this document, the term "surrounding area" may refer to any environment in which the user may be exposed to danger or injury. As used herein, the term "scene data" may refer to any information about an incident or situation. As used herein, the term "event" may refer to an incident such as an attack, fire, explosion, or other hazardous occurrence.

[0191] The term "turn" refers to any action taken by a personal safety device that may be in the hands of an individual, such as a police officer, firefighter, or other individual. As used herein, the term "most recent plurality" refers to the group of data most recently acquired over a given period of time.

[0192] As used herein, the term "remote secure server" refers to a computer system that can store and transmit data for future use, even if the personal safety device or mobile computing terminal is subsequently tampered with or damaged.

[0193] As used herein, the term "remote server" refers to a computer program that executes and stores software in memory on a local computer.

[0194] In order to clarify the purpose, technical solution and advantages of this application, the technical solution in this application is described clearly and completely below with reference to the accompanying drawings. Obviously, the described embodiments are only some of the embodiments of this application, not all of them. Based on the embodiments of this application, all other embodiments that a technician can obtain without creative efforts fall within the scope of protection of this application.

Claims

1. A mobile personal safety device (100) wearable by a user, the device comprising: a processor (151) adapted to execute computer readable instructions stored in a memory (153) of the mobile personal safety device; a scene monitor (110) that senses the user's surrounding environment and generates scene data; a main controller (140) for controlling the scene monitor (110) and processing the scene data (19) received therefrom, and the main controller (140) including a transceiver (152) for wireless communication, which continuously / periodically transmits the most recently acquired initial plurality of data over a predetermined length of time (5) to another locally located mobile computing terminal (172) in the event of an attack, incident or accident, and the mobile personal safety device may or may not store the initial plurality of data in its own memory.

2. In the apparatus of claim 1, the processor (151) is configured to detect the occurrence of an emergency adverse to a user, and upon detecting the occurrence of the emergency, configures the transceiver (152) to notify the mobile computing terminal (172) of the emergency, and the mobile computing terminal (172) transmits a copy of a first of the plurality of data to the remote secure server (175) for future use of the copy, even if the personal safety device (100) or the mobile computing terminal (172) is subsequently tampered with or damaged.

3. The apparatus of claim 1, further configured such that if the upload is successful, all or a portion of the first and / or second plurality of data is deleted from the memory of the personal safety device and / or the mobile computing terminal at the discretion of the user.

4. The apparatus of claim 1, wherein the processor (151) is further configured to: upon detecting the occurrence of an emergency, configure the transceiver (152) to transmit, via the mobile computing terminal (172), a second plurality of on-site data acquired after the emergency is detected for secure storage in a remote server (175) for future use, even if the apparatus is subsequently tampered with or damaged.

5. 2. The apparatus of claim 1, wherein the processor (151) is further configured to store a copy of the second plurality of data in an internal memory of the mobile personal security device for safe keeping at least until the first and / or second plurality of data have been successfully transmitted to the remote server.

6. In the apparatus of claim 1, the mobile computing terminal (172) is further configured to securely store a copy of the second plurality of data in its internal memory at least until and until the first and / or second plurality of data have been successfully transmitted to the remote server.

7. In the device of claim 1, the mobile computing terminal (172) is configured to detect the occurrence of an emergency (11) adverse to the user, and upon detecting (12) the occurrence of the emergency (11), transmits a first plurality of data in its memory to a secure server and notifies the personal security device to transmit a second plurality of data (4) to a remote server via the mobile computing terminal (172), even if it is subsequently tampered with or damaged.

8. In the apparatus of claim 1, the separate mobile computing terminal may be a smartphone, a smartwatch, a tablet, a laptop, or any other form of portable or wearable computing terminal.

9. The apparatus of claim 1, wherein a separate mobile computing terminal is installed in a vehicle used by law enforcement, emergency personnel, ambulances, military, commercial or personal purposes to securely store a local scene transcript of the user, reducing the need to transmit data to a remote server.

10. An apparatus as claimed in claim 1, wherein a mobile computing terminal is connectable to the mobile personal security device and allows configuration and / or updating of the settings and / or software of the mobile personal security device.

11. The device according to claim 1, wherein the personal safety device comprises an artificial intelligence module that predetermines the type of emergency when a new emergency is detected, and the processor self-learns and updates the predefined list, so that the system evolves with the detection of new emergency situations.

12. In the apparatus of claim 1, the scene monitor includes a camera for capturing images and / or video of the surrounding environment, and the scene data includes the captured images or video.

13. 13. The apparatus of claim 1, wherein the processor is further configured to: and processing the captured image to determine whether a predetermined object or person is present in the surrounding environment to detect the occurrence of an emergency, and if the presence of a predetermined dangerous object or person is detected, determining that an emergency has occurred, and in response, the mobile personal safety device notifies the mobile computing terminal to initiate transmission of a first plurality of scene data, and the mobile personal safety device initiates transmission of a second plurality of scene data to a remote server via the mobile computing terminal, without the need for a user to initiate the transmission.

14. In the apparatus of claim 1, the scene monitor including a microphone for capturing audio signals emanating from the surrounding environment, the scene data including the captured audio signals, and further processing the captured audio signals to determine whether an audio segment indicative of a predetermined hazard is present in the surrounding environment to detect the occurrence of an emergency situation; and Upon detecting the presence of an audio segment indicative of a predetermined hazard, an emergency situation is identified and, in response, the mobile personal safety device notifies the mobile computing terminal to initiate transmission of a first plurality of scene data and automatically initiates transmission of a second plurality of scene data to the remote server, without the need for a user to initiate the transmission.

15. In the apparatus of claim 1, the individual mobile computing terminal may be a trusted terminal connected to a user's personal electronic safety device, or a terminal using Wi-Fi, or one or more terrestrial mobile communications protocols, or LTE, or Bluetooth, or Bluetooth Low Energy (BLE), or connection via a hotspot to provide wireless connectivity.

16. The apparatus of claim 1, wherein the scene monitor includes a microphone for capturing audio signals generated from the surrounding environment, the scene data including the captured audio signals, and further processing the captured audio signals to determine whether an audio segment indicative of a predetermined hazard is present in the surrounding environment to detect the occurrence of an emergency; and upon detecting the presence of the audio segment indicative of the predetermined hazard, determining that an emergency has occurred, and in response, the mobile personal safety device notifies the mobile computing terminal to initiate transmission of a first plurality of scene data and automatically initiates transmission of a second plurality of scene data to the remote server, without the need for a user to initiate the transmission.

17. In the apparatus of claim 1 : The main controller or another mobile computing device a power button or on-screen power button for a user to manually turn the apparatus or a connection to a mobile device on and off, and for entering a power saving mode; and the processor further configured: When an emergency occurrence is detected, the power button is temporarily disabled to disable powering off the device, and maintained until the processor receives a message from the remote server that the first and second plurality of scene data have been successfully received, thereby preventing an attacker attacking the user from forcibly stopping the transmission of the first plurality of scene data to the remote server.

18. In the device of claim 1, the mobile computing terminal can control the movement of a camera connected to the device to capture third-party incidents.

19. The apparatus of claim 1, wherein the processor of the mobile personal security device is configured to identify an emergency situation prior to image processing of nearby faces, and if identified, match them against a database of known criminals or terrorists, and if identified, send a notification or alert to a remote server and law enforcement authorities along with their location information.

20. The apparatus of claim 1 allows an associated mobile computing device to record its own scene data via its own physically or wirelessly connected scene monitor, thereby adding that data to the scene data transmitted from the apparatus of claim 1 to a remote server.

Images