A method and apparatus for intrusion detection

Abstract

This application provides a method and apparatus for infringement identification, relating to the security field. The method includes: acquiring first data and second data, wherein the first data is sound data of the user's environment, and the second data describes the user's state, including motion data and / or heart rate data; determining first voice information and second voice information, wherein the first voice information is the user's voice information in the first data, and the second voice information is voice information not belonging to the user in the first data; and determining whether the user has been infringed upon based on the first voice information, the second voice information, and the second data. This allows for the determination of whether a user has been infringed upon based on user voice, non-user voice, user actions, and / or user heart rate, expanding the coverage of infringement identification scenarios and improving the accuracy of infringement identification compared to the single-condition judgment method in current technologies.

Description

Technical Field

[0001] This application relates to the field of security, and more specifically, to a method and apparatus for infringement identification. Background Technology

[0002] Violations can cause varying degrees of harm to victims, and video surveillance is insufficient for comprehensive coverage, often serving only as post-incident evidence. Current proactive infringement detection solutions primarily rely on simple voice recognition technology for assessment, failing to consider the specific context and prone to misjudgments.

[0003] Therefore, improving the accuracy of infringement identification is an urgent problem to be solved. Summary of the Invention

[0004] This application provides a method and apparatus for infringement identification, which improves the accuracy of infringement identification and reduces the harm caused to the victim.

[0005] Firstly, an infringement identification method is provided, which can be executed by a first device. Unless otherwise specified, the "first device" in this application can refer to a first device (e.g., a terminal device), a component of the first device, or a logic module or software that can implement all or part of the functions of the first device. For ease of description, the following description uses execution by a first device as an example.

[0006] The method includes: acquiring first data and second data, wherein the first data is sound data of the user's environment, and the second data is used to describe the user's state, and the second data includes motion data and / or heart rate data; determining first voice information and second voice information, wherein the first voice information is the user's voice information in the first data, and the second voice information is voice information of a person other than the user in the first data; and determining whether the user has been harmed based on the first voice information, the second voice information, and the second data.

[0007] Based on the above scheme, the first device can determine whether a user has been harmed based on user voice, non-user voice, user actions and / or user heart rate. Compared with the single-condition judgment method in the current technology, it expands the coverage of harm identification and improves the accuracy of harm identification.

[0008] In conjunction with the first aspect, in certain implementations of the first aspect, determining whether the user has been harmed based on the first voice information, the second voice information, and the second data includes: acquiring a first corpus and a second corpus; processing the first voice information based on the first corpus to obtain a first result, the first result indicating the number of successful matches between the first voice information and the first corpus; processing the second voice information based on the second corpus to obtain a second result, the second result indicating the number of successful matches between the second voice information and the second corpus; determining that the user has been harmed when the first result is greater than or equal to a first value, and / or the second result is greater than or equal to a second value, and the action data satisfies a first condition, and / or the heart rate data is greater than or equal to a third value; wherein the first condition includes at least one of the following: the action corresponding to the action data is a help-seeking action of the first device; the rate of change of the action data is greater than or equal to a fourth value.

[0009] Based on the above scheme, the determination based on the first voice information can be applied to scenarios where the user speaks but the perpetrator does not; the determination based on the second voice information can be applied to scenarios where the user does not speak but the perpetrator does; and the determination based on both the first and second voice information can be applied to scenarios where both the user and the perpetrator speak. Furthermore, the determination based on specific user actions and / or user physical indicators can reduce the probability of misjudgment on top of voice recognition, further improving the accuracy of the infringement identification results.

[0010] In conjunction with the first aspect, in some implementations of the first aspect, when it is determined that the user has been harmed, the method further includes: performing a first process, the first process including at least one of the following: activating a distress signal, the distress signal including a light signal and / or a sound signal; sending distress information, the distress information including the user's location information and / or harm information, the harm information being determined based on the first voice information and / or the second voice information; and making a distress call.

[0011] Based on the above scheme, when the first device determines that the user has been harmed, it can promptly provide assistance and other related services, thereby deterring the perpetrator, preventing the perpetrator from continuing to harm the user, and reducing the user's risk of being harmed.

[0012] In conjunction with the first aspect, in some implementations of the first aspect, when it is determined that the user has been harmed, the method further includes: performing a second process, the second process including: activating the recording and / or recording function when the recording and / or recording function is not activated; storing and / or sending audio and / or video data of the user's environment collected by the recording and / or recording function.

[0013] Based on the above solution, when the first device determines that the user has been harmed, it can also activate the audio and / or video recording function to collect evidence of the situation on site, so that there is evidence to follow in subsequent processing and to protect the user's rights from infringement.

[0014] In conjunction with the first aspect, in certain implementations of the first aspect, when it is determined that the user has been harmed, the method further includes: performing a third process, the third process including at least one of the following: obtaining first information, the first information being used to instruct the user to perform a key operation; and / or, the first information being used to indicate that the duration for which the user's heart rate data is greater than or equal to the third value exceeds a first duration; and sending emergency information based on the first information, the emergency information including the user's location information.

[0015] Based on the above scheme, when the first device determines that the user has been harmed, the first device can further determine whether the user's life and health are threatened, and if necessary, can send emergency information to ensure the user's safety.

[0016] In conjunction with the first aspect, in certain implementations of the first aspect, before determining whether the user has been harmed based on the first voice information, the second voice information, and the second data, the method further includes: acquiring second information, the second information being used to instruct the user to perform a key operation; and / or, the second information being used to instruct the user to perform a first action, the first action being an evidence-gathering action of the first device; and / or, the second information being used to indicate that the user's heart rate data is greater than or equal to a fourth value, the fourth value being less than a third value; and in response to the second information, activating the recording and / or video recording function.

[0017] Based on the above solution, by the time the first device determines that a user has been harmed, the harm has often already occurred. Enabling audio and / or video recording at this point may result in incomplete evidence. Therefore, before determining that a user has been harmed, the first device can also monitor the user's actions and / or heart rate to collect evidence in advance; alternatively, the user can initiate early evidence collection to ensure the completeness of the evidence and protect the user's rights afterward.

[0018] In conjunction with the first aspect, in some implementations of the first aspect, before determining whether the user has been harmed based on the first voice information, the second voice information, and the second data, the method further includes: if the recording and / or video recording function is enabled and the duration of its operation exceeds a second duration, disabling the recording and / or video recording function.

[0019] Based on the above solution, the energy consumption of the first device can be reduced, and when the audio and / or video recordings are stored locally, the storage resource consumption of the first device can also be reduced.

[0020] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: acquiring user voiceprint data; determining the first voice information and the second voice information includes: recognizing the first data based on the user voiceprint data to acquire the first voice information and the second voice information in the first data.

[0021] Based on the above scheme, the user's own voice can be more accurately identified from the first data, avoiding interference from ambient sounds and improving the accuracy of infringement identification.

[0022] Secondly, an infringement identification device is provided for performing the method provided in the first aspect. Specifically, the infringement identification device may include units and / or modules for performing the method provided in any of the above implementations of the first aspect, such as a processing unit and an acquisition unit.

[0023] In one implementation, the acquisition unit can be a transceiver or an input / output interface; the processing unit can be at least one processor. Optionally, the input / output interface can be an input / output circuit.

[0024] In another implementation, the transceiver unit can be an input / output interface, interface circuit, output circuit, input circuit, pin, or related circuit on the chip, chip system, or circuit; the processing unit can be at least one processor, processing circuit, or logic circuit.

[0025] For example, if the infringement identification device is the first device described above or a component of the first device (e.g., a chip or circuit), then the infringement identification device includes:

[0026] The processing unit is configured to determine first voice information and second voice information, wherein the first voice information is the voice information of the user in the first data, and the second voice information is the voice information of a non-user in the first data;

[0027] The user is determined to have been harmed based on the first voice information, the second voice information, and the second data.

[0028] The acquisition unit is used to acquire first data and second data. The first data is sound data of the user's environment, and the second data is used to describe the user's state. The second data includes motion data and / or heart rate data.

[0029] Thirdly, a processor is provided for executing the methods provided in the above aspects.

[0030] Unless otherwise specified, or if it does not contradict its actual function or internal logic in the relevant description, the transmission and acquisition / reception operations involved in the processor can be understood as processor output and reception, input and other operations, or as transmission and reception operations performed by radio frequency circuits and antennas. This application does not limit them in this regard.

[0031] Fourthly, a computer-readable storage medium is provided that stores program code for execution by a device, the program code including methods for performing any of the implementations of the first aspect described above.

[0032] Fifthly, a chip is provided, which includes a processor and a communication interface. The processor reads instructions stored in a memory through the communication interface and executes the method provided by any of the implementations of the first aspect.

[0033] Optionally, as one implementation, the chip also includes a memory storing computer programs or instructions, and a processor for executing the computer programs or instructions stored in the memory. When the computer programs or instructions are executed, the processor is used to execute the method provided by any of the implementations of the first aspect described above.

[0034] A sixth aspect provides a terminal device, including a first means for performing the method provided in the first aspect.

[0035] In a seventh aspect, a computer program product containing instructions is provided, which, when run on a computer, causes the computer to perform the method provided by any implementation of the first aspect described above. Attached Figure Description

[0036] Figure 1 This is a schematic diagram of a communication system 100 applicable to embodiments of this application.

[0037] Figure 2 This is a schematic diagram of an infringement identification method 200 applicable to embodiments of this application.

[0038] Figure 3 This is a schematic diagram of the structure of an infringement identification device 300 provided in an embodiment of this application.

[0039] Figure 4 This is a schematic diagram of the structure of an infringement identification device 400 provided in an embodiment of this application.

[0040] Figure 5 This is a schematic diagram of the structure of a chip system 500 provided in an embodiment of this application. Detailed Implementation

[0041] The technical solutions in this application will now be described with reference to the accompanying drawings.

[0042] The technical solutions provided in this application can be applied to various communication systems, such as: 5th generation (5G) systems (or new radio (NR) systems), beyond 5G (B5G) mobile communication systems, long term evolution (LTE) systems, LTE frequency division duplex (FDD) systems, and LTE time division duplex (TDD) systems. The technical solutions provided in this application can also be applied to future communication networks. Furthermore, the technical solutions provided in this application can be applied to device-to-device (D2D) communication, vehicle-to-everything (V2X) communication, machine-to-machine (M2M) communication, machine-type communication (MTC), and Internet of Things (IoT) communication systems or other communication systems.

[0043] Furthermore, the technical solution provided in this application also supports short-range communication. Short-range communication enables communication between electronic devices that are relatively close to each other. Currently, mainstream access technologies for short-range communication include Wireless Fidelity (Wi-Fi), Bluetooth, and ZigBee. With the development of the Internet of Things (IoT), new application scenarios such as smart cars, smart homes, smart terminals, and smart manufacturing have emerged, leading to the development of next-generation short-range access technologies (e.g., Sparklink Alliance access technology). Taking Sparklink Alliance access technology as an example, it includes, but is not limited to, Sparklink Basic (SLB) access technology and Sparklink Low Energy (SLE) access technology. SLB access technology can support high-bandwidth services such as screen projection, virtual reality (VR), and in-vehicle communication, while SLE access technology can support low-bandwidth, low-rate, and low-power services such as audio playback, keyboard, mouse, and electronic pen input. For ease of description, in the following embodiments, SLB access technology will be referred to as SLB, and SLE access technology as SLE.

[0044] Figure 1This is a schematic diagram of a communication system 100 applicable to embodiments of this application.

[0045] like Figure 1 As shown, the communication system 100 may include network device 110 and terminal device 120.

[0046] The solution in this application embodiment can be applied to terminal device 120. Terminal device 120 can be a user-side device with wireless transceiver capabilities, such as a fixed device, mobile device, handheld device (e.g., mobile phone, student card, etc.), wearable device (e.g., smartwatch, etc.), or a wireless device (e.g., communication module, modem, or chip system, etc.) built into the above devices. Terminal devices are used to connect people, things, machines, etc., and can be widely used in various scenarios, such as: cellular communication, device-to-device (D2D) communication, V2X communication, machine-to-machine / machine-type communications (M2M / MTC) communication, Internet of Things, virtual reality (VR), augmented reality (AR), industrial control, self-driving, remote medical, smart grid, smart furniture, smart office, smart wearables, smart transportation, smart city, drones, robots, etc. For example, a terminal device can be a handheld terminal in cellular communication, a communication device in D2D, an IoT device in MTC, a surveillance camera in intelligent transportation and smart cities, or a communication device on a drone, etc. Terminal devices are sometimes referred to as user equipment (UE), user terminal, user device, user unit, user station, terminal, access terminal, access station, UE station, remote station, mobile device, or wireless communication device, etc. In the embodiments of this application, the device used to implement the functions of the terminal device can be the terminal device itself, or it can be a device capable of supporting the terminal device in implementing that function, such as a chip system or a combination of devices or components capable of implementing the functions of the terminal device. This device can be installed in the terminal device.

[0047] Optionally, the communication system 100 may also include a terminal device 121, and the terminal device 120 and the terminal device 121 may communicate with each other through the network device 110.

[0048] Network device 110 can be any communication device with wireless transceiver capabilities used for communicating with terminal devices. The network device can be a device in a radio access network (RAN) that provides wireless communication capabilities to terminal devices, referred to as RAN equipment. For example, the network device can be a base station, an evolved NodeB (eNodeB), a next-generation NodeB (gNB) in a 5G mobile communication system, a 3GPP subsequent evolution base station, a transmission reception point (TRP), an access node in a WiFi system, a wireless relay node, a wireless backhaul node, etc. In communication systems employing different radio access technologies (RATs), the name of the device with base station functionality may differ. For example, in an LTE system, it may be called an eNB or eNodeB, and in a 5G or NR system, it may be called a gNB. This application does not limit the specific name of the base station. The network device can include one or more co-located or non-co-located transmission and reception points. For example, a network device may include one or more central units (CUs), one or more distributed units (DUs), or one or more CUs and one or more DUs. Exemplarily, the functionality of a CU can be implemented by a single entity or different entities. For instance, the functionality of a CU can be further divided, separating the control plane and user plane and implementing them through different entities, namely a control plane CU entity (i.e., CU-CP entity) and a user plane CU entity (i.e., CU-UP entity). The CU-CP and CU-UP entities can be coupled with DUs to jointly complete the functions of the access network device. In this way, some functions of a radio access network device can be implemented through multiple network function entities. These network function entities can be network elements in hardware devices, software functions running on dedicated hardware, or virtualized functions instantiated on a platform (e.g., a cloud platform). As another example, in vehicle-to-everything (V2X) technology, the access network device can be a roadside unit (RSU). Multiple access network devices in a communication system can be base stations of the same type or different types. Base stations can communicate with terminal devices directly or through relay stations.

[0049] In this application embodiment, the device for implementing the network device function can be the network device itself, or a device capable of supporting the network device in implementing the function, such as a chip system or a combination device or component capable of implementing the access network device function. This device can be installed in the network device. In different systems, CU (or CU-CP and CU-UP), DU, or RU may have different names, but those skilled in the art will understand their meaning. For example, in an ORAN system, CU can also be called O-CU (open CU), DU can also be called O-DU, CU-CP can also be called O-CU-CP, CU-UP can also be called O-CU-UP, and RU can also be called O-RU. For ease of description, this application uses CU, CU-CP, CU-UP, DU, and RU as examples. In this application embodiment, the chip system can be composed of chips or may include chips and other discrete devices.

[0050] Furthermore, the solutions of this application can also be applied to numerous general-purpose or special-purpose computer system environments or configurations. For example: terminal devices, server computers, tablet devices, multiprocessor systems, microprocessor-based systems, network PCs, minicomputers, mainframe computers, and distributed computing environments including any of the above systems or devices, etc. This application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform specific tasks or implement specific abstract data types. This application can also be practiced in distributed computing environments where tasks are performed by remote processing devices connected via communication networks. In distributed computing environments, program modules can reside in local and remote computer storage media, including storage devices.

[0051] It should be noted that in all specific embodiments of this application, when processing data related to user identity or characteristics, such as user information, user behavior data, user historical data, and user location information, user permission or consent is obtained first. Furthermore, the collection, use, and processing of this data comply with relevant laws, regulations, and standards. In addition, when embodiments of this application require access to sensitive personal information of users, separate permission or consent from the user is obtained through pop-ups or redirection to confirmation pages. Only after obtaining the user's separate permission or consent is the necessary user-related data required for the proper functioning of these embodiments acquired.

[0052] It should be understood that the network architecture and business scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the evolution of network architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0053] Violations cause varying degrees of harm to victims, and reducing or even preventing such incidents is a matter of social concern. When a violation occurs, conventional response methods primarily include two approaches: passive and active.

[0054] (1) Passive approach: This refers to the method of identifying and dealing with infringement that requires the victim to initiate the process themselves. That is, the victim is subjectively aware of the danger and takes the initiative to seek help. In this case, it is impossible to prevent the infringement from happening in time, and the victim's actions may be restricted, and there may be a lag in the transmission of information.

[0055] (2) Proactive Approach: This refers to the identification and handling of infringements without requiring the victim's own initiative. For example, video surveillance can identify the occurrence of an infringement, but video surveillance is difficult to implement comprehensively and often only serves as evidence after the fact. Another example is the use of voice recognition technology to identify infringements, but current technologies mostly rely on simple voice recognition, which is prone to misjudgment. Furthermore, in such cases, help is often only triggered when the infringement becomes quite severe, making it impossible to prevent the infringement from occurring in a timely manner.

[0056] In view of this, embodiments of this application provide a method and apparatus for infringement identification, which improves the accuracy of infringement identification and reduces the harm caused to the victim.

[0057] Figure 2 This is a schematic diagram of an infringement identification method 200 applicable to embodiments of this application.

[0058] It should be understood that Figure 2 The steps or operations of the infringement identification method are illustrated, but these steps or operations are merely to help those skilled in the art understand the embodiments of this application, and are not intended to limit the embodiments of the application to... Figure 2 The specific numerical values ​​or specific scenarios illustrated. Those skilled in the art will understand based on... Figure 2 The examples given below can obviously be modified or varied in various ways, and such modifications and variations also fall within the scope of the embodiments of this application. The embodiments of this application can also perform other operations or... Figure 2 Variations of various operations within it.

[0059] It should be understood that the embodiments shown below do not particularly limit the specific structure of the execution subject of the method provided in the embodiments of this application, as long as it is possible to perform infringement identification according to the method provided in the embodiments of this application by running a program that records the code of the method provided in the embodiments of this application. For ease of understanding, the method 200 is applied to a first device (e.g., a terminal device) as an example for explanation.

[0060] like Figure 2 As shown, method 200 may include the following steps:

[0061] S201: Obtain the first data and the second data.

[0062] The first data is sound data of the user's environment, and the second data is used to describe the user's state, including motion data and / or heart rate data.

[0063] Optionally, the first device may integrate a sound sensor, so that the first data can be acquired through the sound sensor, such as a microphone.

[0064] Optionally, the first device may integrate a state sensor, so that the motion data can be collected by the state sensor, such as a gravity sensor, an angular (accelerometer) sensor, or a gyroscope.

[0065] Optionally, noise reduction processing can be performed on the first data to improve speech clarity.

[0066] For example, the first data can be input to a filtering unit, a nonlinear scattering noise filtering unit, and / or a time-frequency statistical separation unit. The nonlinear scattering noise filtering unit can filter out environmental noise, and the time-frequency statistical separation unit can remove residual noise.

[0067] Optionally, the first data and the second data can be acquired in real time. In other words, the first device can continuously acquire the first data and the second data and process them accordingly.

[0068] S202: Determine the first voice information and the second voice information.

[0069] Wherein, the first voice information is the voice information of the user in the first data, and the second voice information is the voice information of the user who is not in the first data.

[0070] It should be noted that the first data can be filtered and recognized based on a speech recognition model to extract human-produced speech data from the sound data of the user's environment, and further obtain the first speech information and / or the second speech information. For the specific structure and implementation of the speech recognition model, please refer to the relevant descriptions in the current technology; this application does not limit the specific implementation details.

[0071] Optionally, speech enhancement (e.g., volume enhancement) can also be applied to the first speech information and / or the second speech information.

[0072] Optionally, the speech recognition model can recognize speech including Mandarin Chinese pronunciation, pronunciation of common foreign languages ​​(e.g., English) and / or dialect pronunciation.

[0073] Optionally, before step S202, method 200 further includes S202a: acquiring user voiceprint data.

[0074] Therefore, corresponding to S202a, determining the first voice information and the second voice information in S202 includes: recognizing the first data based on the user's voiceprint data, and obtaining the first voice information and the second voice information in the first data.

[0075] Optionally, the first device may integrate a voice chip (e.g., National Chip GX8003), so that step S202 can be performed by the voice chip located in the first device.

[0076] In this scenario, the user's own voice can be more accurately identified from the primary data, avoiding interference from ambient sounds and improving the accuracy of infringement detection.

[0077] S203: Determine whether the user has been harmed based on the first voice information, the second voice information, and the second data.

[0078] In this scenario, the first device can determine whether a user has been harmed based on user voice, non-user voice, user actions, and / or user heart rate. Compared to the single-condition judgment method in current technology, this expands the coverage of harm identification scenarios and improves the accuracy of harm identification.

[0079] Optionally, determining whether the user has been harmed can be achieved through steps S203a-S203c:

[0080] S203a: Obtain the first corpus and the second corpus.

[0081] The first corpus includes keywords used by victims when they cry for help. For example, "help," "hit someone," "save me," "don't hit me," etc.

[0082] Optionally, the first corpus may also include user-defined help-seeking vocabulary.

[0083] The second corpus includes commonly used speech keywords by perpetrators when committing crimes. Examples include phrases like "looking for a beating," "robbery," and "give me the money."

[0084] S203b: Process the first speech information based on the first corpus to obtain a first result.

[0085] The first result is used to indicate the number of successful matches between the first speech information and the first corpus.

[0086] For example, when any keyword existing in the first corpus appears in the first voice information, it can be recorded as a successful match.

[0087] S203c: Process the second speech information based on the second corpus to obtain a second result.

[0088] The second result is used to indicate the number of successful matches between the second speech information and the second corpus.

[0089] For example, when any keyword existing in the second corpus appears in the first speech information, it can be recorded as a successful match.

[0090] Corresponding to steps S203a-S203c above, if the first result is greater than or equal to the first value, and / or the second result is greater than or equal to the second value, and the action data satisfies the first condition, and / or the heart rate data is greater than or equal to the third value, it is determined that the user has been harmed.

[0091] The first condition includes at least one of the following: the action corresponding to the action data is a help-seeking action of the first device; the rate of change of the action data is greater than or equal to the fourth value.

[0092] In this context, the determination based on the first voice information can be applied to scenarios where the user speaks but the perpetrator does not; the determination based on the second voice information can be applied to scenarios where the user does not speak but the perpetrator does; and the determination based on both the first and second voice information can be applied to scenarios where both the user and the perpetrator speak. Furthermore, determinations based on specific user actions and / or user physical indicators can reduce the probability of misjudgment on top of voice recognition, further improving the accuracy of infringement identification results.

[0093] Optionally, the distress signal of the first device can be preset by the user and / or the first device. That is, when the user makes a certain action (e.g., a certain number of back-and-forth swings), the first device determines that the user may be in a dangerous environment.

[0094] It should be noted that the first value, the second value, the third value and / or the fourth value may be the same or different, and the specific values ​​are not limited in the embodiments of this application.

[0095] Optionally, if it is determined that the user has been harmed, method 200 further includes performing a first process.

[0096] The first process includes at least one of the following: activating a distress signal; sending a distress message; or making a distress call.

[0097] The distress signal includes light signals and / or sound signals.

[0098] Optionally, the first device may integrate an indicator light, thereby serving as a warning through flashing lights.

[0099] Optionally, the first device may integrate a speaker or horn to serve as a warning through a distress signal; or the sound signal may also include specific voice information, such as a loud warning and / or distress voice, to expand the range of the warning and / or call for help.

[0100] The request for help includes the user's location information and / or information about the infringement.

[0101] Optionally, the first device may integrate an electronic map positioning function and obtain the user's location through this function so that the recipient of the request for help can quickly locate the user's position.

[0102] Optionally, the infringement information is determined based on the first voice information and / or the second voice information. For example, the infringement information may include the infringement scenario in which the user is located (e.g., fighting, kidnapping, etc.) so that the party receiving the request for help can make a more accurate judgment on the dangerous situation.

[0103] The emergency contact number can be an official emergency contact number; or it can be a user-defined emergency contact number (for example, it can be the phone number of a school, workplace, and / or community; or, when the user is a child, it can be the phone number of a guardian).

[0104] In this situation, when the first device determines that the user has been harmed, it can promptly provide assistance and other relevant services, thereby deterring the perpetrator, preventing the perpetrator from continuing to harm the user, and reducing the user's risk of being harmed.

[0105] Optionally, if it is determined that the user has been harmed, method 200 further includes performing a second process.

[0106] The second process includes: enabling the recording and / or recording function when it is not enabled; storing and / or sending the audio and / or video data of the user's environment collected by the recording and / or recording function.

[0107] In this situation, when the first device determines that the user has been harmed, it can also activate the audio and / or video recording function to collect evidence of the scene so that there is evidence to follow in subsequent processing and to protect the user's rights from infringement.

[0108] Optionally, if it is determined that the user has suffered harm, method 200 further includes:

[0109] The third process includes at least one of the following: acquiring first information, which instructs the user to perform a key operation; and / or, the first information indicates that the duration for which the user's heart rate data is greater than or equal to the third value exceeds a first duration; and sending emergency information based on the first information, wherein the emergency information includes the user's location information.

[0110] In this situation, when the first device determines that the user has been harmed, it can further determine whether the user's life and health are threatened, and if necessary, send emergency information to ensure the user's safety.

[0111] It should be noted that the specific value of the first duration is not limited in the embodiments of this application.

[0112] Optionally, the emergency information may include text messages and / or phone calls, and may be sent to guardians, administrators, and / or professional emergency personnel.

[0113] Optionally, the first device includes a button, the specific content of which can be preset by the user (e.g., number of consecutive button presses, button press duration, etc.) to indicate that the user's physical condition has a problem and requires immediate medical attention.

[0114] Optionally, after determining that the user has been harmed, the first device will continue to monitor the user's heart rate indicators. If there are obvious abnormalities in the heart rate indicators, the first device can provide local voice prompts. If the user does not provide further feedback or calls for help through specific button operations, the first device can send emergency information.

[0115] Optionally, before step S203, method 200 further includes steps S203d and S203e:

[0116] S203d: Obtain the second information.

[0117] Wherein, the second information is used to instruct the user to perform a key operation; and / or, the second information is used to instruct the user to perform a first action, the first action being an evidence-gathering action of the first device; and / or, the second information is used to indicate that the user's heart rate data is greater than or equal to a fourth value, the fourth value being less than a third value.

[0118] S203e: In response to the second information, the recording and / or video recording function is enabled.

[0119] In such cases, by the time the first device determines that the user has been harmed, the harm has often already occurred, and activating the audio and / or video recording function at this point may result in incomplete evidence. Therefore, before the first device determines that the user has been harmed, it can also monitor the user's actions and / or heart rate to collect evidence in advance; alternatively, the user can initiate early evidence collection to ensure the completeness of the evidence and protect the user's rights afterward.

[0120] Optionally, the evidence collection action of the first device can be preset by the user and / or the first device, that is, when the user performs a certain action, the first device starts the evidence collection operation.

[0121] Optionally, the first device includes a button, and the specific content of the button operation can be preset by the user (e.g., the number of consecutive button presses, the duration of button presses, etc.) to instruct the first device to start the evidence collection operation.

[0122] Optionally, if the recording and / or video recording function is enabled and the duration of its operation exceeds the second duration, the recording and / or video recording function is disabled.

[0123] In this case, the energy consumption of the first device can be reduced, and when the audio and / or video recordings are stored locally, the storage resource consumption of the first device can also be reduced.

[0124] It should be noted that the specific value of the second duration is not limited in the embodiments of this application.

[0125] To facilitate understanding of the above embodiments provided in this application, the following points are made.

[0126] (1) In the embodiments of this application, "instruction" may include direct instruction, indirect instruction, explicit instruction, and implicit instruction. When describing a certain instruction information for indicating A, it can be understood that the instruction information carries A, directly indicates A, or indirectly indicates A. In this application, the information indicated by the instruction information is called the information to be instructed. In the specific implementation process, there are many ways to indicate the information to be instructed, such as, but not limited to, directly indicating the information to be instructed, such as the information to be instructed itself or the index of the information to be instructed. It is also possible to indirectly indicate the information to be instructed by indicating other information, wherein there is an association between the other information and the information to be instructed. It is also possible to indicate only a part of the information to be instructed, while the other parts of the information to be instructed are known or agreed in advance. For example, the instruction of specific information can also be achieved by using the arrangement order of various information agreed in advance (e.g., stipulated by the protocol), thereby reducing the instruction overhead to a certain extent. In addition, the information to be instructed can be sent as a whole or divided into multiple sub-information to be sent separately, and the sending period and / or sending time of these sub-information can be the same or different.

[0127] (2) In this application, "send" and "receive" indicate the direction of signal transmission. For example, "send information to XX" can be understood as the destination of the information being XX, which may include direct transmission via the air interface or indirect transmission via the air interface by other units or modules. "Receive information from YY" can be understood as the source of the information being YY, which may include direct reception from YY via the air interface or indirect reception from YY via the air interface by other units or modules. "Send" can also be understood as the "output" of the chip interface, and "receive" can also be understood as the "input" of the chip interface. In other words, sending and receiving can occur between devices, such as between network devices and terminal devices, or within a device, such as between components, modules, chips, software modules, or hardware modules within the device via a bus, wiring, or interface.

[0128] (3) In the various embodiments of this application, unless otherwise specified or logically conflicting, the terms and / or descriptions of different embodiments are consistent and can be referenced by each other. The technical features of different embodiments can be combined to form new embodiments according to their inherent logical relationship.

[0129] (4) In this application, "first" and "second" are used for descriptive convenience only to distinguish objects and are not intended to limit the scope of the embodiments of this application. They are not used to describe the order or sequence of features. It should be understood that the objects described in this way can be interchanged where appropriate so as to describe solutions other than those in the embodiments of this application.

[0130] (5) In this application, “predefined” can be achieved by pre-storing the corresponding code, table or other means that can be used to indicate relevant information in the device. This application does not limit the specific implementation method.

[0131] (6) In this application, the words “exemplary,” “for example,” “exemplary,” “as another example,” etc., are used to indicate that they are examples, illustrations, or descriptions. Any embodiment or design that is described as an “exemplary” in this application should not be construed as being more preferred or advantageous than other embodiments or designs.

[0132] (7) In this application, “comprising,” “including,” “having,” and variations thereof mean “including but not limited to,” unless otherwise specifically emphasized. “At least one” means one or more, and “more” means two or more.

[0133] (8) In this application, "and / or" describes the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist simultaneously, or B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, and c can mean: a, or, b, or, c, or, a and b, or, a and c, or, b and c, or, a, b, and c. Where a, b, and c can be single or multiple.

[0134] (9) Some optional features in the various embodiments of this application may not depend on other features in some scenarios, or may be combined with other features in some scenarios, without limitation.

[0135] In the above text, combined with Figure 2 The methods of the embodiments of this application have been described in detail. In order to implement the functions of the methods provided in this application, both the transmitting device and the receiving device may include hardware structures and / or software modules, and the above functions may be implemented in the form of hardware structures, software modules, or hardware structures plus software modules. Whether a certain function is implemented in the form of hardware structures, software modules, or hardware structures plus software modules depends on the specific application and design constraints of the technical solution.

[0136] The following is combined with Figures 3 to 5 This application describes a communication device according to an embodiment of the present application.

[0137] Figure 3 This is a schematic diagram of the structure of an infringement identification device 300 provided in an embodiment of this application.

[0138] The device 300 includes an acquisition unit 310 and a processing unit 320. The acquisition unit 310 can communicate with the outside world, and the processing unit 320 is used for data processing. The acquisition unit 310 can also be referred to as a communication interface or a communication unit.

[0139] Optionally, the acquisition unit 310 may also be referred to as a communication interface or communication unit. The acquisition unit 310 may be a transceiver (including a transmitter and / or receiver), an input / output interface (including input and / or output interfaces), or pins or circuits, etc. The acquisition unit 310 can be used to perform the sending and / or receiving steps in the above method embodiments.

[0140] Optionally, the processing unit 320 may be a processor (which may include one or more) or a processing circuit with processor functions, and may be used to perform other steps in the above method embodiments besides sending and receiving.

[0141] Optionally, the device 300 further includes a storage unit, which may be a memory, an internal storage unit (e.g., a register or cache), or an external storage unit (e.g., a read-only memory or a random access memory). The storage unit stores instructions, and the processing unit 320 executes the instructions stored in the storage unit to cause the infringement identification device to perform the aforementioned method.

[0142] In addition, the aforementioned acquisition unit 310 can also be an acquisition circuit, and the processing unit 320 can be a processing circuit.

[0143] It should be pointed out that, Figure 3 The device in the application can also be a chip or a system-on-a-chip (SoC). The acquisition unit can be an input / output circuit or a communication interface; the processing unit is a processor, microprocessor, or integrated circuit integrated on the chip. This application does not impose any limitations on this.

[0144] The device 300 can be used to perform the actions performed by the first device in the above method embodiment. In this case, the device 300 can be the first device or a component that can be configured in the first device.

[0145] The acquisition unit 310 is used to perform acquisition-related operations on the first device side in the above method embodiment, for example, to acquire first data and second data, wherein the first data is sound data of the user's environment, and the second data is used to describe the user's state, and the second data includes motion data and / or heart rate data.

[0146] The processing unit 320 is used to perform processing-related operations on the first device side in the above method embodiment, for example, to determine first voice information and second voice information, wherein the first voice information is the voice information of the user in the first data, and the second voice information is the voice information of a non-user in the first data; and to determine whether the user has been harmed based on the first voice information, the second voice information and the second data.

[0147] Optionally, the acquisition unit 310 is also used to acquire the first corpus and the second corpus.

[0148] Optionally, the processing unit 320 is further configured to process the first voice information based on the first corpus to obtain a first result, the first result indicating the number of successful matches between the first voice information and the first corpus; process the second voice information based on the second corpus to obtain a second result, the second result indicating the number of successful matches between the second voice information and the second corpus; and determine that the user has been harmed if the first result is greater than or equal to a first value, and / or the second result is greater than or equal to a second value, and the action data satisfies a first condition, and / or the heart rate data is greater than or equal to a third value; wherein the first condition includes at least one of the following: the action corresponding to the action data is a help-seeking action of the first device; the rate of change of the action data is greater than or equal to a fourth value.

[0149] Optionally, the processing unit 320 is further configured to perform a first process, the first process including at least one of the following: activating a distress signal, the distress signal including a light signal and / or a sound signal; sending distress information, the distress information including the user's location information and / or infringement information, the infringement information being determined based on the first voice information and / or the second voice information; and making a distress call.

[0150] Optionally, the processing unit 320 is further configured to perform a second processing, the second processing including: enabling the recording and / or recording function when the recording and / or recording function is not enabled; storing and / or sending the audio and / or video data of the user's environment collected by the recording and / or recording function.

[0151] Optionally, the processing unit 320 is further configured to perform a third processing, the third processing including at least one of the following: acquiring first information, the first information being used to instruct the user to perform a key operation; and / or, the first information being used to indicate that the duration for which the user's heart rate data is greater than or equal to the third value exceeds a first duration; and sending emergency information based on the first information, the emergency information including the user's location information.

[0152] Optionally, the acquisition unit 310 is further configured to acquire second information, the second information being used to instruct the user to perform a key operation; and / or, the second information being used to instruct the user to perform a first action, the first action being an evidence-gathering action of the first device; and / or, the second information being used to indicate that the user's heart rate data is greater than or equal to a fourth value, the fourth value being less than a third value.

[0153] Optionally, the processing unit 320 is also configured to activate the recording and / or video recording function in response to the second information.

[0154] Optionally, the acquisition unit 310 is also used to acquire user voiceprint data.

[0155] Optionally, the processing unit 320 is further configured to identify the first data based on the user voiceprint data, and obtain the first voice information and the second voice information in the first data.

[0156] It should be understood that the device 300 here is embodied in the form of a functional unit. The term "unit" here may refer to application-specific integrated circuits (ASICs), electronic circuits, processors (e.g., shared processors, proprietary processors, or group processors) and memories for executing one or more software or firmware programs, combined logic circuits, and / or other suitable components that support the described functions.

[0157] The apparatus 300 of each of the above-described schemes has the function of implementing the corresponding steps performed by the infringement identification device (such as the first device) in the above-described methods. The function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions, and other units, such as processing units, can be replaced by a processor to respectively execute the transmission and reception operations and related processing operations in each method embodiment.

[0158] Figure 4 This is a schematic diagram of the structure of an infringement identification device 400 provided in an embodiment of this application.

[0159] like Figure 4 As shown, the device 400 includes a processor 410 and a transceiver 420. The processor 410 and the transceiver 420 communicate with each other through an internal connection path. The processor 410 is used to execute instructions to control the transceiver 420 to transmit and / or receive signals.

[0160] Optionally, the device 400 may further include a memory 430, which communicates with the processor 410 and the transceiver 420 via an internal connection path. The memory 430 is used to store instructions, and the processor 410 can execute the instructions stored in the memory 430.

[0161] In one possible implementation, the device 400 is used to implement the various processes and steps corresponding to the first device in the above method embodiments.

[0162] It should be understood that the device 400 may specifically be the first device in the above embodiments, or it may be a chip or a chip system. Correspondingly, the transceiver 420 may be the acquisition circuit of the chip, which is not limited here. For example, the device 400 may be used to execute the various steps and / or processes corresponding to the first device in the above method embodiments.

[0163] Optionally, the memory 430 may include read-only memory and random access memory, and provide instructions and data to the processor. A portion of the memory may also include non-volatile random access memory. For example, the memory may also store device type information. The processor 410 may be used to execute instructions stored in the memory, and when the processor 410 executes instructions stored in the memory, the processor 410 is used to perform the various steps and / or processes of the method embodiment corresponding to the first device described above.

[0164] In implementation, each step of the above method can be completed by integrated logic circuits in the processor's hardware or by instructions in software. The steps of the method disclosed in the embodiments of this application can be directly implemented by a hardware processor, or by a combination of hardware and software modules in the processor. The software modules can reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method. To avoid repetition, detailed descriptions are omitted here.

[0165] It should be noted that the processor in the embodiments of this application can be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method embodiments can be completed by the integrated logic circuits in the processor's hardware or by instructions in software form. The processor can be a general-purpose processor, a digital signal processor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The processor in the embodiments of this application can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly embodied as being executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules can be located in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory; the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above methods.

[0166] It is understood that the memory in the embodiments of this application may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. Non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory may be random access memory (RAM), which serves as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory, dynamic random access memory, synchronous dynamic random access memory, double data rate synchronous dynamic random access memory, enhanced synchronous dynamic random access memory, synchronous linked dynamic random access memory, and direct memory bus random access memory. It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0167] Figure 5 This is a schematic diagram of the structure of a chip system 500 provided in an embodiment of this application.

[0168] like Figure 5As shown, the chip system 500 (or processing system) includes logic circuitry 510 and input / output interface 520.

[0169] The logic circuit 510 can be a processing circuit in the chip system 500. The logic circuit 510 can be coupled to the storage unit, calling instructions from the storage unit, enabling the chip system 500 to implement the methods and functions of the embodiments of this application. The input / output interface 520 can be an input / output circuit in the chip system 500, outputting processed information or inputting data or signaling information to be processed into the chip system 500 for processing.

[0170] As one option, the chip system 500 is used to implement the operations performed by the first device in the various method embodiments described above.

[0171] This application also provides a computer-readable medium having a computer program stored thereon, which, when executed by a computer, implements the functions of any of the above method embodiments.

[0172] This application also provides a computer program product that, when executed by a computer, implements the functions of any of the above method embodiments.

[0173] This application also provides a terminal device, including functions for performing any of the above method embodiments.

[0174] Optionally, the terminal device may be a smart wearable device and / or a student card.

[0175] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., high-density digital video discs (DVDs)), or semiconductor media (e.g., solid-state disks (SSDs)).

[0176] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0177] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0178] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0179] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0180] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0181] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0182] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An infringement identification method, applied to a first device, characterized in that, include: Acquire first data and second data, wherein the first data is sound data of the user's environment, and the second data is used to describe the user's state, including motion data and / or heart rate data; The first data is identified based on the user's voiceprint data to determine first voice information and second voice information from the first data. The first voice information is the user's voice information in the first data, and the second voice information is the voice information of a non-user in the first data. Determine whether the user has been harmed based on the first voice information, the second voice information, and the second data; The step of determining whether the user has been harmed based on the first voice information, the second voice information, and the second data includes: Obtain the first and second corpora; The first speech information is processed based on the first corpus to obtain a first result, wherein the first result is used to indicate the number of times the first speech information is successfully matched with the first corpus; The second speech information is processed based on the second corpus to obtain a second result, which is used to indicate the number of successful matches between the second speech information and the second corpus. If the first result is greater than or equal to a first value, and / or the second result is greater than or equal to a second value, and the action data satisfies a first condition, and / or the heart rate data is greater than or equal to a third value, it is determined that the user has been harmed; wherein, the first condition includes at least one of the following: the action corresponding to the action data is a help action of the first device; the rate of change of the action data is greater than or equal to a fourth value.

2. The method of claim 1, wherein, If it is determined that the user has been harmed, the method further includes: Perform a first process, which includes at least one of the following: Activate the distress signal, which includes a light signal and / or a sound signal; Send a distress message, the distress message including the user's location information and / or infringement information, the infringement information being determined based on the first voice information and / or the second voice information; Call for help.

3. The method of claim 1, wherein, If it is determined that the user has been harmed, the method further includes: Perform a second process, which includes: Enable the recording and / or recording function when it is not enabled; Store and / or transmit the audio and / or video data of the user's environment collected by the recording and / or recording function.

4. The method according to any one of claims 1 to 3, characterized in that, If it is determined that the user has been harmed, the method further includes: A third process is performed, which includes at least one of the following: Acquire first information, the first information being used to instruct the user to perform a key operation; and / or, the first information being used to indicate that the duration for which the user's heart rate data is greater than or equal to the third value exceeds a first duration; Emergency medical information is sent based on the first information, and the emergency medical information includes the user's location information.

5. The method of claim 3, wherein, Before determining whether the user has been harmed based on the first voice information, the second voice information, and the second data, the method further includes: The system acquires second information, which is used to instruct the user to perform a key operation; and / or, the second information is used to instruct the user to perform a first action, which is an evidence collection action of the first device; and / or, the second information is used to indicate that the user's heart rate data is greater than or equal to a fourth value, which is less than a third value. In response to the second information, the audio recording and / or video recording function is activated.

6. The method of claim 5, wherein, The method further includes: If the audio and / or video recording function is enabled and the duration of its operation exceeds the second duration, the audio and / or video recording function shall be disabled.

7. An apparatus for violation identification, the apparatus comprising: The apparatus includes a unit for performing the method as described in any one of claims 1 to 6.

8. A terminal device, comprising: Includes the infringement identification device as described in claim 7.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program or instructions that, when executed on a computer, cause the computer to perform the method as described in any one of claims 1 to 6.

10. A chip or chip system, characterized by include: A processor for retrieving and running a computer program from memory, causing a communication device equipped with the chip system to perform the method of any one of claims 1 to 6.

Images