Equipment state detection method and device, equipment and storage medium

Abstract

The embodiment of the invention provides an equipment state detection method and device, equipment and a storage medium, and relates to the field of artificial intelligence. The equipment state detection method comprises the following steps: acquiring displacement information of equipment through a gyroscope module, and determining a motion state of the equipment according to the displacement information; if the motion state of the equipment is a static state, acquiring environment sound through a recording module, and identifying the environment sound to obtain a sound source identification result; determining an equipment use condition of the equipment according to the sound source identification result, and determining a working state of the equipment according to the equipment use condition of the equipment; acquiring position information of the equipment or environment information of the equipment according to the working state of the equipment; according to the position information of the equipment or the environment information of the equipment, the equipment state of the equipment is determined, and the equipment state comprises an idle state and a lost state. The invention aims to solve the problems of low equipment utilization rate and high equipment loss risk in a specific scene.

Description

Technical Field

[0001] The present application relates to the field of artificial intelligence, and in particular to a device status detection method, a device status detection apparatus, a computer device, and a computer-readable storage medium. Background Art

[0002] At present, in the financial field, such as in banking scenarios, when bank employees serve customers' business needs, such as filling out business forms, calling numbers in queues, remote seat video review, etc., they often need to operate through banking devices such as tablets, so as to quickly handle customers' business needs.

[0003] However, since banking equipment is not used by bank employees on a daily basis, it is possible that the equipment may be lost but not discovered in time, or may be idle for a long time, resulting in low equipment utilization and a high risk of equipment loss. Summary of the invention

[0004] The present application provides a device status detection method, a device status detection apparatus, a computer device and a computer-readable storage medium, aiming to solve the problems of low device utilization and high risk of device loss in specific scenarios.

[0005] To achieve the above object, the present application provides a device status detection method, the device includes a gyroscope module and a recording module, and the method includes:

[0006] Acquiring displacement information of the device through the gyroscope module, and determining the motion state of the device according to the displacement information;

[0007] If the motion state of the device is a stationary state, the ambient sound is acquired through the recording module, and the ambient sound is recognized to obtain a sound source recognition result;

[0008] Determine the device usage of the device according to the sound source recognition result, and determine the working state of the device according to the device usage of the device;

[0009] Acquire location information of the device or environmental information of the device according to the working state of the device;

[0010] The device state of the device is determined according to the location information of the device or the environment information of the device, where the device state includes an idle state and a lost state.

[0011] To achieve the above object, the present application provides a device state detection device, the device state detection device comprising:

[0012] a motion state determination module, configured to obtain displacement information of the device through the gyroscope module, and determine the motion state of the device according to the displacement information;

[0013] A sound source recognition module, used for obtaining ambient sound through the recording module and recognizing the ambient sound to obtain a sound source recognition result if the motion state of the device is a stationary state;

[0014] A working state determination module, used to determine the device usage of the device according to the sound source recognition result, and determine the working state of the device according to the device usage of the device;

[0015] An information acquisition module, used to acquire the location information of the device or the environment information of the device according to the working status of the device;

[0016] The device status determination module is used to determine the device status of the device according to the location information of the device or the environmental information of the device, and the device status includes an idle state and a lost state.

[0017] To achieve the above-mentioned purpose, the present application provides a computer device, which includes a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program and implement the device status detection method as described above when executing the computer program.

[0018] To achieve the above objectives, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the device status detection method as described above.

[0019] The device status detection method, device status detection apparatus, computer device and computer-readable storage medium disclosed in the embodiments of the present application obtain the displacement information of the device through the gyroscope module, and determine the motion state of the device according to the displacement information; if the motion state of the device is a static state, the ambient sound is obtained through the recording module, and the ambient sound is identified to obtain the sound source identification result; the device usage of the device is determined according to the sound source identification result, and the working state of the device is determined according to the device usage of the device; the location information of the device or the environmental information of the device is obtained according to the working state of the device; the device status of the device is determined according to the location information of the device or the environmental information of the device, and the device status includes an idle state and a lost state. This can help improve the utilization rate of the equipment, thereby achieving the effect of reducing costs and increasing efficiency, and can also timely discover and take relevant measures when the equipment is in a lost state, thereby reducing the risk of equipment loss. At the same time, the device status detection process does not require manual intervention and monitoring, thereby achieving a fully automatic effect and reducing labor costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0021] Figure 1 It is a scenario diagram of a device status detection method provided in an embodiment of the present application;

[0022] Figure 2 It is a flow chart of a device status detection method provided in an embodiment of the present application;

[0023] Figure 3 is a schematic block diagram of a device state detection apparatus provided by an embodiment of the present application;

[0024] Figure 4 It is a schematic block diagram of a computer device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0026] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor do they have to be executed in the order described. For example, some operations / steps can also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions. In addition, although the functional modules are divided in the device schematic, in some cases, the module division can be different from that in the device schematic.

[0027] The term "and / or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0028] In the financial field, such as banking scenarios, smart tablets and other devices are important equipment for bank employees. Bank staff mainly use smart tablets to handle important business such as expense change account information, product inquiry and purchase, authorization, etc. Smart tablets are unique among various office equipment in banks. The loss and idleness of smart tablets have an immeasurable impact on the development of banking business.

[0029] The present application proposes a device status detection method, a device status detection device, a computer device and a computer-readable storage medium, which can help improve the utilization rate of the equipment, thereby achieving the effect of reducing costs and increasing efficiency. It can also timely discover and take relevant measures when the equipment is in a lost state, thereby reducing the risk of equipment loss. At the same time, the device status detection process does not require manual intervention and monitoring, thereby achieving a fully automatic effect and reducing labor costs.

[0030] The method can be applied to a server, and of course can also be applied to a terminal device, wherein the terminal device may include a fixed terminal such as a mobile phone, a tablet computer, a personal digital assistant (PDA), etc. The server may be, for example, a separate server or a server cluster. However, for ease of understanding, the following embodiments will be described in detail with the device status detection method applied to the server.

[0031] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0032] like Figure 1 As shown, the device status detection method provided in the embodiment of the present application can be applied to Figure 1In the application environment shown. The application environment includes a terminal device 110 and a server 120, wherein the terminal device 110 can communicate with the server 120 through a network. Specifically, the server 120 obtains the displacement information of the device through the gyroscope module, and determines the motion state of the device according to the displacement information; if the motion state of the device is a static state, the ambient sound is obtained through the recording module, and the ambient sound is identified to obtain a sound source identification result; the device usage of the device is determined according to the sound source identification result, and the working state of the device is determined according to the device usage of the device; the location information of the device or the environmental information of the device is obtained according to the working state of the device; the device state of the device is determined according to the location information of the device or the environmental information of the device, and the device state includes an idle state and a lost state, and the device state of the device is sent to the terminal device 110. Among them, the server 120 can be an independent server, or it can be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and big data and artificial intelligence platforms. The terminal device 110 may be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, etc., but is not limited thereto. The terminal and the server may be directly or indirectly connected via wired or wireless communication, and this application does not limit this.

[0033] See also Figure 2 , Figure 2 This is a schematic flow chart of a device status detection method provided in an embodiment of the present application. The device status detection method can help improve the utilization rate of the device, thereby achieving the effect of reducing costs and increasing efficiency, and can also timely detect and take relevant measures when the device is in a lost state, thereby reducing the risk of device loss. At the same time, the device status detection process does not require manual intervention and monitoring, thereby achieving a fully automatic effect and reducing labor costs.

[0034] The device may be a terminal device, such as a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, etc., but is not limited thereto.

[0035] Exemplarily, the device may include a gyroscope module, a recording module, and a shooting module.

[0036] Among them, the gyroscope module can be an accelerometer for detecting the displacement information of the device; the recording module can be used to record the environment near the device; and the shooting module can be a camera for capturing the environment of the device.

[0037] like Figure 2As shown, the device status detection method includes steps S101 to S105.

[0038] S101. Acquire displacement information of a device through a gyroscope module, and determine a motion state of the device according to the displacement information.

[0039] The device may be a device that needs to be detected, such as a smart phone, tablet computer, laptop computer, desktop computer, smart speaker, smart watch, etc. The displacement information is used to indicate the displacement of the device. The motion state of the device may include a moving state and a stationary state. The moving state is used to indicate that the device has undergone lateral, longitudinal or vertical displacement, and the stationary state is used to indicate that the device has not undergone lateral, longitudinal or vertical displacement.

[0040] The embodiments of the present application can acquire and process relevant data based on artificial intelligence technology. Among them, artificial intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.

[0041] AI basic technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics, etc. AI software technologies mainly include computer vision technology, robotics technology, biometrics technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0042] Specifically, the displacement information of the device can be obtained through the gyroscope module. If the displacement generated by the device is detected to be 0, it is determined that the device has not undergone lateral, longitudinal or vertical displacement, and is in a stationary state; if the displacement generated by the device is detected to be not 0, it is determined that the device has undergone lateral, longitudinal or vertical displacement, and is in a moving state.

[0043] Exemplarily, the displacement information of the device can be obtained through the gyroscope module. If the displacement of the device is detected to be 0 within a certain period of time, such as 5 minutes, it is determined that the device has no lateral, longitudinal or vertical displacement, that is, it is in a static state.

[0044] S102: If the motion state of the device is a stationary state, the ambient sound is acquired through a recording module, and the ambient sound is recognized to obtain a sound source recognition result.

[0045] The ambient sound may be an ambient recording of the environment in which the device is located, and the sound source recognition result is used to represent the matching result of the human voice in the ambient recording.

[0046] In some embodiments, human voice detection is performed on the ambient sound to obtain a human voice detection result; if the human voice detection result is that a human voice is detected, voiceprint extraction is performed on the human voice in the ambient sound to obtain a voiceprint feature; the identity corresponding to the sound source is identified based on the voiceprint feature to obtain a sound source identification result. In this way, the voiceprint feature can be accurately extracted from the ambient sound and the identity corresponding to the sound source can be identified to obtain a sound source identification result.

[0047] The human voice detection result is used to indicate whether the ambient sound contains human voice. The voiceprint feature may be a feature of the human voiceprint in the ambient sound.

[0048] Specifically, human voice detection processing is performed on the ambient sound to determine whether the ambient sound contains human voice. If it is determined that the ambient sound does not contain human voice, no sound source recognition result is generated, and the ambient sound is continuously acquired. If it is determined that the ambient sound contains human voice, voiceprint extraction is performed on the human voice in the ambient sound to obtain the voiceprint feature corresponding to the human voice. The identity corresponding to the sound source is identified based on the voiceprint feature to obtain the sound source recognition result.

[0049] In some embodiments, the matching degree between the voiceprint feature and the preset voiceprint feature is determined; if the matching degree between the voiceprint feature and the preset voiceprint feature exceeds the preset matching degree, the sound source recognition result is determined to be a successful match; if the matching degree between the voiceprint feature and the preset voiceprint feature does not exceed the preset matching degree, the sound source recognition result is determined to be a failed match. In this way, the sound source recognition result can be accurately generated based on the voiceprint feature.

[0050] The preset voiceprint feature may be a pre-recorded voiceprint feature of a human voice. For example, in a banking scenario, the preset voiceprint feature may be a voiceprint feature of a bank employee. The preset matching degree may be any matching degree, which may be set according to actual conditions and is not specifically limited here.

[0051] Specifically, the voiceprint feature can be compared with the preset voiceprint feature to obtain the matching degree between the voiceprint feature and the preset voiceprint feature; if the matching degree between the voiceprint feature and the preset voiceprint feature exceeds the preset matching degree, the sound source recognition result is determined to be a successful match; if the matching degree between the voiceprint feature and the preset voiceprint feature does not exceed the preset matching degree, the sound source recognition result is determined to be a failed match.

[0052] Exemplarily, assuming that the preset matching degree is 80%, if it is determined that the matching degree between the voiceprint feature and the preset voiceprint feature is 90%, and the matching degree between the voiceprint feature and the preset voiceprint feature exceeds the preset matching degree, then the sound source recognition result is determined to be a successful match; if it is determined that the matching degree between the voiceprint feature and the preset voiceprint feature is 70%, and the matching degree between the voiceprint feature and the preset voiceprint feature does not exceed the preset matching degree, then the sound source recognition result is determined to be a failed match.

[0053] The device usage of the device is determined according to the sound source recognition result, and the working state of the device is determined according to the device usage of the device.

[0054] Among them, the device usage status can be used to indicate whether the device is in a waiting state or in an unused state. The working state of the device can include a standby state and a loss detection state. The standby state indicates that the device can be switched to the use state at any time, and the loss detection state indicates that the device has a high probability of being lost and the user needs to be reminded to perform a loss detection.

[0055] Specifically, if the sound source recognition result is a successful match, it can be determined that the voiceprint features of the pre-recorded human voice are basically the same as the voiceprint features of the human voice extracted from the ambient sound, that is, it can be determined that the device is near the user to be used, and therefore the device usage status of the device is the waiting-to-use status; if the sound source recognition result is a failed match, it can be determined that the voiceprint features of the pre-recorded human voice are different from the voiceprint features of the human voice extracted from the ambient sound, that is, it can be determined that the device is not near the user to be used, and therefore the device usage status of the device is the not-in-use status.

[0056] In some embodiments, if the device usage status is a waiting status, the working state of the control device is switched to a standby status; if the device usage status is a non-use status, the working state of the control device is switched to a loss detection status.

[0057] For example, if the sound source recognition result is a successful match, it can be determined that the voiceprint features of the pre-recorded human voice are basically the same as the voiceprint features of the human voice extracted from the ambient sound, that is, it can be determined that the device is near a bank employee, so the device is likely to need to be used at any time, so the working state of the device can be controlled to switch to standby state.

[0058] For example, if the sound source recognition result is a match failure, it can be determined that the voiceprint features of the pre-recorded human voice are different from the voiceprint features of the human voice extracted from the ambient sound, that is, it can be determined that the device is not near the bank employees, so the device is most likely not needed and is not near the employees, and there is a high probability of loss, so the working state of the device can be controlled to switch to the loss detection state.

[0059] S104: Acquire location information of the device or environment information of the device according to the working status of the device.

[0060] The location information of the device is used to indicate the geographical location of the device, and the environment information of the device may be an environment picture captured by the device.

[0061] In some embodiments, if the working state of the device is the standby state, the device usage of the device is monitored within a preset time period, and when the device usage of the device is monitored to be unused within the preset time period, the device environment information is obtained through the camera module; if the working state of the device is the loss detection state, the device location information is obtained. In this way, the device location information or environment information can be accurately obtained according to the working state of the device.

[0062] The preset time period may be any time period, such as 5 days or 10 days, and may be set according to actual conditions, and is not specifically limited here. The shooting module may be a camera or other device.

[0063] For example, if the working state of the device is standby, it means that the device is near a bank employee during the status detection, and then the device usage is continuously monitored within a preset time period. If the device usage is monitored as not being used within the preset time period, it can be considered that the device has not been used for a long time, and the environmental information of the device can be obtained through the shooting module to further determine the device status of the device later.

[0064] For example, if the working state of the device is the lost detection state, it can be considered that the device is most likely not needed and is not near the employee, and there is a high probability of loss. Then the location information of the device can be obtained to further determine the device status of the device.

[0065] S105: Determine a device state of the device according to the location information of the device or the environment information of the device, where the device state includes an idle state and a lost state.

[0066] The idle state is used to indicate that the device has not been used for a long time, and the lost state is used to indicate that the device has not been near a user to be used for a long time.

[0067] In some embodiments, the deviation value between any one frame of the environment picture and the environment picture of the adjacent frame is determined; whether there is a fluctuation between the environment picture of the frame and the environment picture of the adjacent frame is determined according to the deviation value; if there is no fluctuation between all the environment pictures and the environment pictures of the adjacent frames, it is determined that the device state is an idle state. In this way, it can be accurately determined that the device state of the device is an idle state.

[0068] The deviation value between the environment picture of the frame and the environment picture of the adjacent frame is used to determine whether the picture is stable.

[0069] Specifically, each frame of the environment picture is obtained, and each frame of the environment picture and its corresponding adjacent frame of the environment picture are determined, and the deviation value between each frame of the environment picture and the environment picture of the adjacent frame is determined, and whether there is a fluctuation between each frame of the environment picture and the environment picture of the adjacent frame is determined according to the deviation value. If there is no fluctuation between all the environment pictures and the environment pictures of the adjacent frames, then the device state of the device is determined to be an idle state; if one or more of the deviation values ​​show that there is a fluctuation between the environment pictures, then the device state of the device is determined to be a standby state.

[0070] For example, if the device status is determined to be idle, the user can be reminded that the device has been idle for 6 days and needs to be recycled for other usage scenarios, which is conducive to improving the utilization rate of important assets and achieving the effect of reducing costs and increasing efficiency.

[0071] In some embodiments, device information of the device is obtained, a preset geographical location corresponding to the device is determined according to the device information, and the distance between the location information and the preset geographical location is determined; if the distance between the location information and the preset geographical location exceeds a preset distance threshold, the device state of the device is determined to be a lost state. Thus, the device state of the device can be accurately determined to be a lost state.

[0072] The device information may include information such as a device serial number that can be used to obtain a preset geographic location. The preset geographic location may be a pre-set address, such as an address corresponding to a bank. The preset distance threshold may be any value, such as 1 km, and may be set according to actual conditions, and is not specifically limited here.

[0073] Specifically, the device information of the device is obtained, and a preset geographic location corresponding to the device is determined based on the device information; the distance between the location information and the preset geographic location is determined, and whether the distance exceeds a preset distance threshold is determined; if the distance between the location information and the preset geographic location exceeds the preset distance threshold, the device state of the device is determined to be a lost state; if the distance between the location information and the preset geographic location does not exceed the preset distance threshold, the geographic location of the device is continuously detected.

[0074] Exemplarily, the latitude and longitude information of the device and the device serial number are obtained, and the bank branch to which the device belongs is found based on the device serial number. The distance between the device and the bank branch is determined by the latitude and longitude information of the device. If the distance exceeds 200 meters, the device status is determined to be lost.

[0075] For example, if it is determined that the device status is lost, the device is controlled to automatically clean up applications and data to ensure that there are no important applications on the device. At the same time, the latitude and longitude of the current device can be obtained at fixed intervals so that bank branch personnel can retrieve the device in time, which is conducive to reducing the situation of device loss. Even if the device is in a lost state, it can be discovered in time and relevant measures can be taken, thereby reducing the risk of device management.

[0076] The device status detection method disclosed in the embodiment of the present application obtains the displacement information of the device through the gyroscope module, and determines the motion state of the device based on the displacement information; if the motion state of the device is a stationary state, the ambient sound is obtained through the recording module, and the ambient sound is identified to obtain a sound source identification result; the device usage of the device is determined based on the sound source identification result, and the working state of the device is determined based on the device usage of the device; the location information of the device or the environmental information of the device is obtained based on the working state of the device; the device status of the device is determined based on the location information of the device or the environmental information of the device, and the device status includes an idle state and a lost state. This can help improve the utilization rate of the equipment, thereby achieving the effect of reducing costs and increasing efficiency, and can also timely discover and take relevant measures when the equipment is in a lost state, thereby reducing the risk of equipment loss. At the same time, the device status detection process does not require manual intervention and monitoring, thereby achieving a fully automatic effect and reducing labor costs.

[0077] See also Figure 3 , Figure 3 It is a schematic block diagram of a device status detection apparatus provided in an embodiment of the present application. The device status detection apparatus can be configured in a server to execute the aforementioned device status detection method.

[0078] like Figure 3 As shown, the device state detection apparatus 200 includes: a motion state determination module 201, a sound source recognition module 202, a working state determination module 203, an information acquisition module 204 and a device state determination module 205.

[0079] A motion state determination module 201, configured to obtain displacement information of the device through the gyroscope module, and determine the motion state of the device according to the displacement information;

[0080] A sound source identification module 202 is used to obtain environmental sounds through the recording module if the motion state of the device is a stationary state, and identify the environmental sounds to obtain a sound source identification result;

[0081] A working state determination module 203, used to determine the device usage of the device according to the sound source recognition result, and determine the working state of the device according to the device usage of the device;

[0082] An information acquisition module 204 is used to acquire the location information of the device or the environment information of the device according to the working status of the device;

[0083] The device status determination module 205 is used to determine the device status of the device according to the location information of the device or the environment information of the device, and the device status includes an idle state and a lost state.

[0084] In some embodiments, the sound source identification module 202 is also used to perform human voice detection on the ambient sound to obtain a human voice detection result; if the human voice detection result is that a human voice is detected, voiceprint extraction is performed on the human voice in the ambient sound to obtain a voiceprint feature; the identity corresponding to the sound source is identified according to the voiceprint feature to obtain a sound source identification result.

[0085] In some embodiments, the sound source identification module 202 is also used to determine the degree of match between the voiceprint feature and the preset voiceprint feature; if the degree of match between the voiceprint feature and the preset voiceprint feature exceeds the preset degree of match, the sound source identification result is determined to be a successful match; if the degree of match between the voiceprint feature and the preset voiceprint feature does not exceed the preset degree of match, the sound source identification result is determined to be a failed match.

[0086] In some embodiments, the working status determination module 203 is also used to control the working status of the device to switch to the standby status if the device is in use; if the device is not in use, control the working status of the device to switch to the loss detection status.

[0087] In some embodiments, the information acquisition module 204 is also used to monitor the device usage of the device within a preset time period if the working state of the device is a standby state, and when it is monitored that the device usage of the device is not in use within the preset time period, obtain the environmental information of the device through the shooting module; if the working state of the device is a loss detection state, obtain the location information of the device.

[0088] In some embodiments, the device status determination module 205 is also used to determine the deviation value between the environment picture of any frame and the environment picture of the adjacent frame; determine whether there is a fluctuation between the environment picture of the frame and the environment picture of the adjacent frame according to the deviation value; if there is no fluctuation between all the environment pictures and the environment pictures of the adjacent frames, then determine that the device status of the device is idle.

[0089] In some embodiments, the device status determination module 205 is also used to obtain device information of the device, determine a preset geographic location corresponding to the device based on the device information; determine the distance between the location information and the preset geographic location; if the distance between the location information and the preset geographic location exceeds a preset distance threshold, determine that the device status of the device is a lost state.

[0090] It should be noted that those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices, modules and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0091] The method and apparatus of the present application can be used in many general or special computing system environments or configurations, such as personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer terminal devices, network PCs, minicomputers, mainframe computers, and distributed computing environments including any of the above systems or devices.

[0092] Exemplarily, the above method and apparatus may be implemented in the form of a computer program. The computer program may be implemented in the form of a computer program. Figure 4 Runs on the computer device shown.

[0093] See also Figure 4 , Figure 4 1 is a schematic diagram of a computer device provided in an embodiment of the present application. The computer device may be a server.

[0094] like Figure 4 As shown, the computer device includes a processor, a memory and a network interface connected through a system bus, wherein the memory may include a volatile storage medium, a non-volatile storage medium and an internal memory.

[0095] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions, and when the program instructions are executed, the processor can execute any device status detection method.

[0096] The processor is used to provide computing and control capabilities and support the operation of the entire computer equipment.

[0097] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor can execute any device status detection method.

[0098] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art can understand that the structure of the computer device is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0099] It should be understood that the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0100] Among them, in some embodiments, the processor is used to run a computer program stored in the memory to implement the following steps: obtaining the displacement information of the device through the gyroscope module, and determining the motion state of the device based on the displacement information; if the motion state of the device is a stationary state, obtaining the ambient sound through the recording module, and identifying the ambient sound to obtain a sound source identification result; determining the device usage of the device based on the sound source identification result, and determining the working state of the device based on the device usage of the device; obtaining the location information of the device or the environmental information of the device based on the working state of the device; determining the device state of the device based on the location information of the device or the environmental information of the device, and the device state includes an idle state and a lost state.

[0101] In some embodiments, the processor is further used to perform human voice detection on the ambient sound to obtain a human voice detection result; if the human voice detection result is that a human voice is detected, voiceprint extraction is performed on the human voice in the ambient sound to obtain a voiceprint feature; and the identity corresponding to the sound source is identified based on the voiceprint feature to obtain a sound source identification result.

[0102] In some embodiments, the processor is further used to determine the degree of match between the voiceprint feature and a preset voiceprint feature; if the degree of match between the voiceprint feature and the preset voiceprint feature exceeds the preset degree of match, the sound source recognition result is determined to be a successful match; if the degree of match between the voiceprint feature and the preset voiceprint feature does not exceed the preset degree of match, the sound source recognition result is determined to be a failed match.

[0103] In some embodiments, the processor is further used to control the working state of the device to switch to a standby state if the device is in a waiting state; and to control the working state of the device to switch to a loss detection state if the device is in a non-use state.

[0104] In some embodiments, the processor is also used to monitor the device usage of the device within a preset time period if the working state of the device is a standby state, and when it is monitored that the device usage of the device is not in use within the preset time period, obtain the environmental information of the device through the shooting module; if the working state of the device is a loss detection state, obtain the location information of the device.

[0105] In some embodiments, the processor is also used to determine the deviation value between the environmental picture of any frame and the environmental picture of an adjacent frame; determine whether there is a fluctuation between the environmental picture of the frame and the environmental picture of the adjacent frame based on the deviation value; if there is no fluctuation between all the environmental pictures and the environmental pictures of their adjacent frames, determine that the device state of the device is an idle state.

[0106] In some embodiments, the processor is further used to obtain device information of the device, determine a preset geographic location corresponding to the device based on the device information; determine the distance between the location information and the preset geographic location; if the distance between the location information and the preset geographic location exceeds a preset distance threshold, determine that the device status of the device is a lost state.

[0107] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. The computer program includes program instructions, and when the program instructions are executed, any device status detection method provided in the embodiment of the present application is implemented.

[0108] The computer-readable storage medium may be an internal storage unit of the computer device described in the foregoing embodiment, such as a hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a smart memory card (SmartMedia Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., equipped on the computer device.

[0109] Furthermore, the computer-readable storage medium may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function, etc.; the data storage area may store data created according to the use of the blockchain node, etc.

[0110] The present invention refers to a new application model of computer technologies such as storage, peer-to-peer transmission, consensus mechanism, encryption algorithm, etc. of the blockchain language model. Blockchain is essentially a decentralized database, a string of data blocks generated by cryptographic methods. Each data block contains a batch of network transaction information, which is used to verify the validity of its information (anti-counterfeiting) and generate the next block. Blockchain can include the blockchain underlying platform, platform product service layer, and application service layer.

[0111] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A device status detection method, characterized in that: The device includes a gyroscope module and a recording module, and the method includes: Acquiring displacement information of the device through the gyroscope module, and determining the motion state of the device according to the displacement information; If the motion state of the device is a stationary state, the ambient sound is acquired through the recording module, and the ambient sound is recognized to obtain a sound source recognition result; Determine the device usage of the device according to the sound source recognition result, and determine the working state of the device according to the device usage of the device; Acquire location information of the device or environmental information of the device according to the working state of the device; The device state of the device is determined according to the location information of the device or the environment information of the device, where the device state includes an idle state and a lost state.

2. The method according to claim 1, characterized in that The step of identifying the ambient sound to obtain a sound source identification result includes: Performing human voice detection on the environmental sound to obtain a human voice detection result; If the human voice detection result is that a human voice is detected, extracting a voiceprint of the human voice in the environmental sound to obtain a voiceprint feature; The identity corresponding to the sound source is identified according to the voiceprint feature to obtain a sound source identification result.

3. The method according to claim 2, characterized in that The identifying the identity corresponding to the sound source according to the voiceprint feature to obtain a sound source identification result includes: Determining a degree of match between the voiceprint feature and a preset voiceprint feature; If the matching degree between the voiceprint feature and the preset voiceprint feature exceeds the preset matching degree, the sound source recognition result is determined to be a successful match; If the matching degree between the voiceprint feature and the preset voiceprint feature does not exceed the preset matching degree, the sound source recognition result is determined to be a matching failure.

4. The method according to claim 1, characterized in that: The determining the working state of the device according to the device usage of the device includes: If the usage status of the device is a standby status, controlling the working status of the device to switch to a standby status; If the usage status of the device is unused, the working status of the device is controlled to switch to a loss detection status.

5. The method according to claim 1, characterized in that: The device further includes a shooting module, and the acquiring the location information of the device or the environment information of the device according to the working state of the device includes: If the working state of the device is the standby state, the device usage of the device is monitored within a preset time period, and when the device usage of the device is monitored to be unused within the preset time period, the environmental information of the device is acquired through the camera module; If the working state of the device is a lost detection state, the location information of the device is obtained.

6. The method according to claim 1, characterized in that The environmental information includes an environmental picture, and determining the device state of the device according to the environmental information of the device includes: Determine a deviation value between the environment picture of any frame and the environment picture of an adjacent frame; Determine whether there is fluctuation between the environment picture of the frame and the environment picture of the adjacent frame according to the deviation value; If there is no fluctuation between all the environment pictures and the environment pictures of adjacent frames, it is determined that the device state is an idle state.

7. The method according to claim 1, characterized in that The determining the device state of the device according to the location information of the device includes: Acquire device information of the device, and determine a preset geographical location corresponding to the device according to the device information; Determining the distance between the location information and the preset geographical location; If the distance between the location information and the preset geographical location exceeds a preset distance threshold, it is determined that the device state of the device is a lost state.

8. A device status detection device, characterized in that: The device state detection device comprises: a motion state determination module, configured to obtain displacement information of the device through the gyroscope module, and determine the motion state of the device according to the displacement information; A sound source identification module, used for obtaining ambient sound through the recording module and identifying the ambient sound to obtain a sound source identification result if the motion state of the device is a stationary state; A working state determination module, used to determine the device usage of the device according to the sound source recognition result, and determine the working state of the device according to the device usage of the device; An information acquisition module, used to acquire the location information of the device or the environment information of the device according to the working status of the device; The device status determination module is used to determine the device status of the device according to the location information of the device or the environmental information of the device, and the device status includes an idle state and a lost state.

9. A computer device, characterized in that: The computer device includes a memory and a processor; The memory is used to store computer programs; The processor is configured to execute the computer program and implement, when executing the computer program: A device status detection method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the device status detection method according to any one of claims 1 to 7.

Images