Information processing method and device, equipment, storage medium and computer program product

Abstract

The embodiment of the invention discloses an information processing method, and the method comprises the steps: collecting first image information of an outdoor environment in a target range corresponding to a user through an image collection unit in a first working mode when the user is in the outdoor environment; when it is determined that the abnormal object exists based on the first image information, second image information of the outdoor environment within the target range is collected through the image collection unit in a second working mode; when it is determined that abnormity exists based on the second image information, current position information of the user is obtained, and the current position information and the second image information are sent to a server; when it is determined that the abnormal degree meets the first threshold value, the first alarm information is output in a target mode, so that the problem that the use function of equipment capable of being used outdoors in the related technology is limited is solved, the deployment and maintenance difficulty is reduced, and the applicable range is expanded. The embodiment of the invention further discloses an information processing device and equipment, a computer storage medium and a computer program product.

Description

Technical Field

[0001] The present application relates to information processing technology in the computer field, and in particular to an information processing method, apparatus, device, storage medium and computer program product. Background Art

[0002] With the advancement of science and technology and the development of intelligence, people are increasingly concerned about safety issues. In outdoor environments, especially when users are alone in unfamiliar environments, there may be various potential threats or abnormal situations. In order to ensure the safety of users, it is particularly important to provide a method that can promptly and accurately detect and respond to abnormalities in outdoor environments. At present, traditional monitoring and alarm systems usually rely on fixed devices such as cameras and sensors. However, these devices in related technologies that can be used outdoors to ensure user safety are inconvenient to deploy and maintain in outdoor environments, and the functions of devices that can be used outdoors are relatively limited, resulting in a relatively limited coverage range. Summary of the Invention

[0003] In order to solve the above technical problems, the embodiments of the present application provide an information processing method, apparatus, equipment, storage medium and computer program product, which solve the problem of limited functions of equipment that can be used outdoors in related technologies, reduce the difficulty of deployment and maintenance, and expand the scope of applicability.

[0004] To achieve the above objectives, the technical solution of the embodiment of the present application is implemented as follows:

[0005] An information processing method, the method comprising:

[0006] When the user is in an outdoor environment, first image information of the outdoor environment within a target range corresponding to the user is collected by the image collection unit in a first working mode;

[0007] When it is determined based on the first image information that an abnormal object exists, collecting second image information of an outdoor environment within the target range by the image acquisition unit in a second working mode;

[0008] When it is determined that an abnormality exists based on the second image information, obtaining the current location information of the user, and sending the current location information and the second image information to a server;

[0009] When it is determined that the abnormality degree meets the first threshold, the first alarm information is output in a targeted manner.

[0010] In the above solution, when determining that an abnormality exists based on the second image information, obtaining the current location information of the user includes:

[0011] When it is determined based on the second image information that an abnormality exists and the degree of the abnormality meets a second threshold, the target information determination model is used to process the second image information to determine an abnormality result;

[0012] When the abnormal result indicates that a target abnormal event exists, the current location information is obtained.

[0013] In the above solution, the method further includes:

[0014] Acquiring first sample image information for the outdoor environment, and processing the first sample image information to obtain first processed image information;

[0015] determining image feature information of the first processed image information;

[0016] The initial information determination model is trained based on the image feature information to obtain the target information determination model.

[0017] In the above solution, the method further includes:

[0018] When it is determined based on the second image information that an abnormality exists and the degree of the abnormality does not meet the second threshold, sending the second image information to a terminal device;

[0019] After receiving the alarm instruction sent by the terminal device, a second alarm message is generated based on the alarm instruction and the current location information is obtained.

[0020] In the above solution, the sending of the second image information and the current location information to the server includes:

[0021] Sending a transmission request carrying encrypted information to the server;

[0022] receiving a response message from the server carrying an encrypted password, and decrypting the encrypted password using decryption information corresponding to the encryption information to obtain a session password; wherein the encrypted password is generated by the server based on the encryption information;

[0023] The second image information and the current location information are encrypted using the session password, and the encrypted image information and the encrypted location information are sent to the server.

[0024] In the above solution, the step of encrypting the second image information and the current location information using the session password and sending the encrypted image information and the encrypted location information to the server includes:

[0025] Based on a first target encryption algorithm, encrypting the second image information and the current location information using the session password to obtain the encrypted image information and the encrypted location information;

[0026] Processing the second image information and the current location information using a second target encryption algorithm to obtain first verification information and second verification information;

[0027] The encrypted image information and the first verification information are sent to the server, and the encrypted location information and the second verification information are sent to the server.

[0028] In the above solution, obtaining the current location information includes:

[0029] Using multiple positioning technologies to obtain multiple location information, and fusing the multiple location information to obtain initial location information;

[0030] The current position information is determined based on the initial position information.

[0031] In the above solution, when determining the presence of an abnormal object based on the first image information, before collecting second image information of the outdoor environment within the target range by the image acquisition unit in the second working mode, the method further includes:

[0032] The first image information is processed using a target anomaly determination model to determine whether an abnormal object exists.

[0033] In the above solution, the method further includes:

[0034] acquiring second sample image information, sample environment information, and sample location information for the outdoor environment, and processing the second sample image information, the sample environment information, and the sample location information;

[0035] determining first feature information of the processed sample image information;

[0036] Determining second characteristic information of the processed sample environment information;

[0037] Determine the third characteristic information of the processed sample position information;

[0038] Based on the first feature information, the second feature information, and the third feature information, an initial abnormality determination model is trained to obtain the target abnormality determination model.

[0039] An information processing device, comprising:

[0040] a collection unit configured to collect, when a user is in an outdoor environment, first image information of an outdoor environment within a target range corresponding to the user through an image collection unit in a first working mode;

[0041] The acquisition unit is further configured to acquire second image information of the outdoor environment within the target range in a second working mode by the image acquisition unit when it is determined that an abnormal object exists based on the first image information;

[0042] a processing unit, configured to, when determining that an abnormality exists based on the second image information, obtain the current location information of the user, and send the current location information and the second image information to a server;

[0043] The output unit is configured to output first alarm information in a targeted manner when it is determined that the abnormality degree meets a first threshold.

[0044] An information processing device, comprising: a processor, a memory, and a communication bus;

[0045] The communication bus is used to realize the communication connection between the processor and the memory;

[0046] The processor is used to execute the information processing program in the memory to implement the steps of the above-mentioned information processing method.

[0047] A computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the above-mentioned information processing method.

[0048] A computer program product includes a computer program, which implements the above-mentioned information processing method when executed by a processor.

[0049] The information processing method, apparatus, device, storage medium and computer program product provided by the embodiments of the present application, when a user is in an outdoor environment, first image information of the outdoor environment within the target range corresponding to the user is collected by the image acquisition unit in a first working mode; when it is determined that an abnormal object exists based on the first image information, second image information of the outdoor environment within the target range is collected by the image acquisition unit in a second working mode; when it is determined that an abnormality exists based on the second image information, the user's current location information is obtained, and the current location information and the second image information are sent to the server; when it is determined that the degree of abnormality meets the first threshold, a first alarm message is output in a targeted manner. In this way, in an outdoor environment, the outdoor environment where the user is located can be monitored by the image acquisition unit, and an alarm can be automatically triggered when it is determined that there is an abnormality in the outdoor environment where the user is located and the degree of abnormality meets the first threshold. This solves the problem of limited usage functions of equipment that can be used outdoors in related technologies, reduces the difficulty of deployment and maintenance, and can be applied to various outdoor environments. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 A flowchart of an information processing method provided in an embodiment of the present application;

[0051] Figure 2 A flowchart of another information processing method provided in an embodiment of the present application;

[0052] Figure 3 A schematic structural diagram of a device corresponding to an information processing method provided in an embodiment of the present application;

[0053] Figure 4 A schematic diagram of the structure of an information processing device provided in an embodiment of the present application;

[0054] Figure 5 A schematic diagram of the structure of an information processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application.

[0056] It should be understood that the “embodiments of the present application” or “the aforementioned embodiments” mentioned throughout the specification mean that the specific features, structures or characteristics related to the embodiments are included in at least one embodiment of the present application. Therefore, “in the embodiments of the present application” or “in the aforementioned embodiments” appearing throughout the specification do not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. In the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.

[0057] Unless otherwise specified, when an electronic device performs any step in the embodiments of the present application, the processor of the electronic device may perform the step. It is also worth noting that the embodiments of the present application do not limit the order in which the electronic device performs the following steps. In addition, the methods used to process data in different embodiments may be the same method or different methods. It should also be noted that any step in the embodiments of the present application can be independently executed by the electronic device, that is, when the electronic device performs any step in the following embodiments, it can be independent of the execution of other steps.

[0058] It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application.

[0059] The present invention provides an information processing method, which can be applied to an information processing device. Figure 1 As shown, the method may include the following steps:

[0060] Step 101: When a user is in an outdoor environment, first image information of the outdoor environment within a target range corresponding to the user is collected by an image collection unit in a first working mode.

[0061] In the embodiments of the present application, the image acquisition unit may refer to a module on an information processing device that can acquire image information, and may refer to a surveillance camera. Specifically, the first working mode may refer to a working mode that can realize the monitoring function and has relatively low power consumption; the image acquisition function in the first working mode may refer to a low-power infrared monitoring function. Among them, the target range corresponding to the user may refer to an area formed by taking the user's current outdoor environment position as the center and the target distance as the radius; it should be noted that the target distance can be set based on the actual application scenario and actual needs.

[0062] In other embodiments of the present application, when a user is outdoors, the low-power infrared monitoring function of the surveillance camera can be automatically activated to monitor information within the target range corresponding to the user and to capture first image information within the target range in real time. The first image information can be a picture or a video.

[0063] Step 102: When it is determined based on the first image information that an abnormal object exists, the image acquisition unit acquires second image information of an outdoor environment within the target range in a second working mode.

[0064] In an embodiment of the present application, the information processing device can analyze the first image information to determine whether there is an abnormal object within the target range corresponding to the user; wherein, the abnormal object may refer to an object other than the user, that is, the abnormal object may include objects such as people or animals other than the user.

[0065] It should be noted that the second operating mode may refer to the first operating mode or the operating mode that can realize the monitoring function and has normal power consumption; the power consumption of the image acquisition unit in the second operating mode is greater than the power consumption in the first operating mode. The second image information may refer to a picture or a video.

[0066] Step 103: When it is determined that an abnormality exists based on the second image information, the user's current location information is obtained, and the current location information and the second image information are sent to the server so that the server stores the current location and performs a target operation based on the second image information.

[0067] In an embodiment of the present application, the information processing device can further analyze the second image information to determine whether there is abnormal information within the target range corresponding to the user; wherein, abnormal information may refer to information within the target range corresponding to the user that may pose a certain threat to the user, that is, information that is dangerous to the user.

[0068] It should be noted that after analyzing the second image information, the information processing device determines that there is abnormal information within the target range. At that time, the user's current location information can be located, and then the current location information and the second image information can be transmitted to the server; in this way, the server can save the current location and second image information with abnormalities for subsequent use.

[0069] Step 104: When it is determined that the abnormality degree meets the first threshold, output the first alarm information in a targeted manner.

[0070] In an embodiment of the present application, the first threshold value may be a numerical range pre-set based on the actual application scenario and actual needs. If the abnormality level exceeds the first threshold value, it indicates that the current abnormality problem is serious and may even threaten the user's personal safety. In this case, the first alarm information may be output by emitting an alarm voice or continuously flashing a light of a specific color. The target mode may be a specific color light or alarm sound set according to the actual application needs. In one feasible implementation, the target mode may also be an alarm sound emitted by a buzzer.

[0071] The information processing method provided in the embodiments of the present application can monitor the outdoor environment in which the user is located through an image acquisition unit in an outdoor environment, and can automatically trigger an alarm when it is determined that there is an abnormality in the outdoor environment in which the user is located and the degree of abnormality meets a first threshold. This solves the problem of limited usage functions of equipment that can be used outdoors in related technologies, reduces the difficulty of deployment and maintenance, and can be applied to various outdoor environments.

[0072] Based on the above embodiments, the embodiments of the present application provide an information processing method, referring to Figure 2 As shown, the method may include the following steps:

[0073] Step 201: When a user is in an outdoor environment, the information processing device collects first image information of the outdoor environment within a target range corresponding to the user through an image acquisition unit in a first working mode.

[0074] Step 202: The information processing device processes the first image information using a target anomaly determination model to determine whether an abnormal object exists.

[0075] The target anomaly determination model may refer to a model used to analyze image information to determine whether an abnormal object exists in the actual environment corresponding to the image information. The target anomaly determination model may be obtained by training the initial anomaly determination model based on the second sample image information of the outdoor environment, the sample environment information, and the sample location information.

[0076] It should be noted that the first image information can be used as an input parameter of the target abnormality determination model, that is, the first image information can be directly input into the target abnormality determination model, and the first image information can be processed by the target abnormality determination model. After that, the target abnormality determination model can output the result of whether there is an abnormal object in the actual outdoor environment corresponding to the first image information.

[0077] Step 203: When it is determined based on the first image information that an abnormal object exists, the information processing device collects second image information of an outdoor environment within the target range through the image acquisition unit in a second working mode.

[0078] It should be noted that, after step 203 , steps 204 to 205 may be executed, or steps 206 to 207 may be executed.

[0079] Step 204: When it is determined based on the second image information that an abnormality exists and the degree of the abnormality meets the second threshold, the information processing device uses the target information determination model to process the second image information to determine an abnormality result.

[0080] In an embodiment of the present application, the target information determination model may refer to a model used to analyze image information to determine whether a target abnormal event will occur in the actual environment corresponding to the image information. The target information determination model may be obtained by training the initial information determination model based on the first sample image information of the outdoor environment. The second threshold value may be a numerical range set in advance based on the actual application scenario and actual needs; the second threshold value may be different from the first threshold value; if the degree of abnormality meets the second threshold value, it means that the abnormality at this time is relatively serious and may threaten the user's life.

[0081] It should be noted that the second image information can be used as an input parameter of the target information determination model, that is, the second image information is directly input into the target information determination model, and the second image information is processed by the target information determination model. After that, the target information determination model can output an abnormal result of whether the target abnormal event will occur in the actual outdoor environment corresponding to the second image information. In addition, the trained target information determination model can be used to analyze the second image information to achieve tasks such as target detection, image classification, and image generation. In addition, an object tracking algorithm can be introduced to achieve continuous tracking of specific targets (such as people or wild animals); at the same time, we can also add some advanced functions, such as behavior recognition (identifying the target's behavior by analyzing its motion trajectory) and anomaly detection (discovering abnormal situations by comparing new images with historical images).

[0082] It should be noted that it is also possible to consider introducing a feedback mechanism, that is, adjusting the image acquisition and preprocessing strategies according to the results of image analysis to optimize the subsequent image analysis results.

[0083] Step 205: When the abnormal result indicates the existence of the target abnormal event, the information processing device obtains the current location information.

[0084] The target abnormal event may refer to an event that threatens the user's life and safety; in one feasible implementation, the target abnormal event may include a burial event, the appearance of a wild animal, and the like. It should be noted that if the target information determination model processes the second image information and determines that a target abnormal event has occurred within the target range corresponding to the user, the information processing device will then obtain the user's current location information.

[0085] Step 206: When it is determined based on the second image information that an abnormality exists and the degree of the abnormality does not meet the second threshold, the information processing device sends the second image information to the terminal device.

[0086] In an embodiment of the present application, if the degree of abnormality does not meet the second threshold, it means that the abnormality at this time is not very serious (that is, the abnormal problem is relatively minor) and will not threaten the user's life safety; then, the collected second image information can be transmitted to the user's terminal device.

[0087] Specifically, the second image information can be transmitted to the user's terminal device through the 4th generation mobile communication technology (4G) or the 5th generation mobile communication technology (5G) network; then, after receiving the second image information, the user can analyze the second image information again and judge the severity of the abnormal problem within the target range corresponding to the user based on the analysis result of the second image information; if the user judges that the abnormality at this time is minor and does not pose a threat to the user's life, the user will drive away the abnormal object on his own. If the user judges that the abnormality at this time is relatively serious and will pose a threat to the user's life, the user can trigger an alarm event through his own terminal device and then generate an alarm instruction. It should be noted that the user can trigger an alarm event by touching the alarm button on his own terminal device.

[0088] Step 207: After receiving the alarm instruction sent by the terminal device, the information processing device generates second alarm information based on the alarm instruction and obtains current location information.

[0089] The information processing device can generate various types of second alarm information in response to the alarm instruction. Specifically, the information processing device can issue a second alarm information that can attract the attention of the outside world, for example, the buzzer of the information processing device can issue an alarm sound to attract the attention of the outside world; of course, the second alarm information can also be output in other ways that can attract the attention of the user. At the same time, by Figure 3 The positioning module shown determines the user's current location information.

[0090] In the embodiment of the present application, the "obtaining current location information" in step 205 and step 207 can be implemented in the following manner:

[0091] A1. Use multiple positioning technologies to obtain multiple location information, and fuse the multiple location information to obtain the initial location information.

[0092] The information processing device may obtain the user's current location information through various positioning technologies. Specifically, the multiple positioning technologies may include different types of positioning technologies, such as Global Positioning System (GPS) positioning technology, Wireless Fidelity (Wi-Fi) positioning technology, and inertial navigation positioning technology. In other words, different positioning technologies may be used to obtain the user's current multi-source location information, and algorithms such as Kalman filtering or Bayesian filtering may be used to fuse the multi-source data (multiple initial location information) to obtain the initial location information.

[0093] A2. Determine current location information based on initial location information.

[0094] In the embodiments of the present application, the initial location information can be processed and the data can be sorted to obtain the current location information. It should be noted that the initial location information can include data such as latitude and longitude, altitude, and timestamp; further, the initial location information can also include data such as speed, direction, and accuracy that can improve the usability of the data.

[0095] It should be noted that step 208 may be executed after both step 205 and step 207.

[0096] Step 208: The information processing device sends a transmission request carrying encrypted information to the server.

[0097] In the embodiment of the present application, the encrypted information may be the public key of the information processing device itself; the transmission request is a request initiated by the information processing device for a common key with the server and for the agreed data transmission.

[0098] Step 209: The information processing device receives the response information carrying the encrypted password sent by the server, and uses the decryption information corresponding to the encryption information to decrypt the encrypted password to obtain the session password.

[0099] The encrypted password is generated by the server based on the encrypted information.

[0100] In an embodiment of the present application, after receiving a transmission request from an information processing device, the server generates a random session key and encrypts the session key with the public key carried in the transmission request to obtain an encrypted password; the server then sends the encrypted password to the information processing device. Specifically, the information processing device may refer to a client. It should be noted that in order to improve data security, a one-time password (OTP) mechanism may be considered, that is, a new session key is used each time the information processing device communicates with the server.

[0101] Among them, the decryption information corresponding to the encrypted information may refer to the private key corresponding to the session key; then, after the information processing device receives the encrypted password sent by the server, it can use its own private key to decrypt the encrypted password to obtain the session password (i.e., the session key).

[0102] Step 210: The information processing device encrypts the second image information and the current location information using the session password, and sends the encrypted image information and the encrypted location information to the server.

[0103] In an embodiment of the present application, the second image information and current location information to be sent are encrypted using a session key to obtain encrypted image information and encrypted location information; the encrypted image information and encrypted location information are then transmitted to the server; in this way, the server uses the session key to ensure the integrity of the received encrypted image information and encrypted location information (i.e., the second image information and current location information).

[0104] It should be noted that during data transmission between the information processing device and the server, in order to improve transmission efficiency, it is possible to consider introducing a data compression algorithm, that is, compressing the encrypted image information and the encrypted location information before transmitting them to the server; and, protocols such as the Transmission Control Protocol (TCP) / Internet Protocol (IP) or the User Datagram Protocol (UDP) / IP can be used to ensure the reliable transmission of the encrypted image information and the encrypted location information.

[0105] In other embodiments of the present application, step 210 may be implemented in the following manner:

[0106] Step 210a: The information processing device encrypts the second image information and the current location information using a session password based on the first target encryption algorithm to obtain encrypted image information and encrypted location information.

[0107] The first target encryption algorithm may refer to some advanced encryption algorithms that can improve encryption strength; in a feasible implementation, the first target encryption algorithm may include: Advanced Encryption Standard (AES), RSA, Elliptic Curve Cryptography (ECC), etc. In other words, the information processing device may use the advanced encryption algorithm to re-encrypt the second image information and the current location information encrypted using the session key, thereby obtaining the encrypted image information and the encrypted location information.

[0108] Step 210b: The information processing device processes the second image information and the current position information using a second target encryption algorithm to obtain first verification information and second verification information.

[0109] The second target encryption algorithm may refer to an encryption algorithm capable of generating data for data integrity verification; in a feasible implementation, the second target encryption algorithm may include algorithms such as hash functions, digital signatures, and Open Authorization (OAuth). The first verification information may refer to information corresponding to the second image information and used to verify the integrity of the second image information, and the second verification information may refer to information corresponding to the current location information and used to verify the integrity of the current location information. In a feasible implementation, a hash function may be used to generate a summary or signature for the second image information and the current location information, and the summary or signature may be sent to the server together.

[0110] Step 210c: The information processing device sends the encrypted image information and the first verification information to the server, and sends the encrypted location information and the second verification information to the server.

[0111] In an embodiment of the present application, after the server decrypts and obtains the second image information and the current location information, it can further decrypt the received encrypted first verification information and second verification information to obtain the first verification information and the second verification information; thereafter, the completeness of the second image information and the current location information can be verified based on the first verification information and the second verification information, that is, the digests in the second image information and the current location information are compared with the received digest to see whether they are consistent, and the comparison results are fed back to the information processing device.

[0112] It should be noted that the server may perform corresponding operations on the second image information and the current location information, such as data storage or data analysis.

[0113] Step 211: When it is determined that the abnormality degree meets the first threshold, the information processing device outputs the first alarm information in a targeted manner.

[0114] Among them, information processing equipment can Figure 3 The alarm module in the information processing device shown in FIG outputs a first alarm message and, if the severity of the anomaly is particularly severe, notifies the operator to conduct a manual review. The signal transmission module also reports the anomaly and current location information to relevant agencies for assistance. It should be noted that if the human review confirms no issues, the server can instruct the information processing device to release the alarm.

[0115] In other embodiments of the present application, the method may further include the following steps:

[0116] Step 212: The information processing device obtains first sample image information for an outdoor environment, and processes the first sample image information to obtain first processed image information.

[0117] In the embodiment of the present application, the information processing device can Figure 3 The video surveillance module shown in the figure obtains first sample image information for an outdoor environment. Then, the first sample image is subjected to a first preprocessing operation. The first preprocessing operation may include image denoising, color space conversion, image enhancement, and lighting adjustment.

[0118] Step 213: The information processing device determines image feature information of the first processed image information.

[0119] In an embodiment of the present application, the information processing device may process the first processed image information to obtain image feature information. Specifically, the first processed image information may be converted to obtain image feature information. In one feasible implementation, computer vision technology may be used to extract useful features from the first processed image information, and a convolutional neural network (CNN) method may be used to perform end-to-end feature extraction on the first processed image information to obtain image feature information.

[0120] It should be noted that in order to improve the effect of extracting image feature information, it is possible to consider introducing more advanced deep learning models, such as Residual Neural Network (ResNet), Inception, EfficientNet, etc.

[0121] Step 214: The information processing device performs model training on the initial information determination model based on the image feature information to obtain a target information determination model.

[0122] In an embodiment of the present application, image feature information can be used as an input parameter of the initial information determination model, that is, the image feature information can be input into the initial information determination model for processing to realize model training of the initial information determination model, thereby obtaining the target information determination model.

[0123] It should be noted that the initial information determination model can be trained using labeled training data. To avoid overfitting or underfitting, strategies such as cross-validation, regularization, and early stopping can be implemented. Furthermore, to improve the efficiency of model training, graphics processing units (GPUs) can be used to accelerate computation, and even distributed training can be considered.

[0124] In other embodiments of the present application, the method may further include the following steps:

[0125] Step 215: The information processing device obtains second sample image information, sample environment information, and sample position information for an outdoor environment, and processes the second sample image information, sample environment information, and sample position information.

[0126] In the embodiment of the present application, the information processing device can Figure 3 The video monitoring module in the system obtains second sample image information for the outdoor environment, obtains sample environment information through the environment perception module, and obtains sample location information through the positioning module.

[0127] It should be noted that the acquired second sample image information, sample environment information and sample location information may also be subjected to a second preprocessing; wherein the second preprocessing may refer to operations such as image denoising, color space conversion, lighting adjustment, image enhancement, and standardization of environmental parameters and geographic location information.

[0128] Step 216: The information processing device determines first feature information of the processed sample image information.

[0129] In an embodiment of the present application, the information processing device may process the processed sample image information to obtain the first feature information. Specifically, the processed sample image information may be converted to obtain the first feature information.

[0130] Step 217: The information processing device determines the second characteristic information of the processed sample environment information.

[0131] In an embodiment of the present application, the information processing device may process the processed sample environment information to obtain the second feature information. Specifically, the processed sample environment information may be converted to obtain the second feature information.

[0132] Step 218: The information processing device determines the third feature information of the processed sample position information.

[0133] In an embodiment of the present application, the information processing device may process the processed sample position information to obtain the third feature information. Specifically, the processed sample position information may be converted to obtain the third feature information.

[0134] Step 219: The information processing device performs model training on the initial abnormality determination model based on the first feature information, the second feature information, and the third feature information to obtain a target abnormality determination model.

[0135] In an embodiment of the present application, the first feature information, the second feature information, and the third feature information can be used as input parameters of the initial abnormality determination model, that is, the first feature information, the second feature information, and the third feature information can be input into the initial abnormality determination model for processing to realize model training of the initial abnormality determination model, thereby obtaining the target abnormality determination model.

[0136] In other embodiments of the present application, the information processing device may be an outdoor mobile power supply with video monitoring and alarm functions, such as Figure 3 The system shown here may include a power module, video surveillance module, alarm module, positioning module, and environmental perception module. The power module provides power for the video surveillance module and alarm module. The video surveillance module includes monitoring control and signal transmission functions, providing video acquisition and public network communication capabilities, respectively. The power module consists of a battery pack, a photovoltaic power supply device, a power control module, and a power panel. The video surveillance module includes a surveillance camera assembly, external lighting equipment, a microphone, a monitoring control module, and a signal transmission module.

[0137] It should be noted that, for the description of the same steps and contents in this embodiment as those in other embodiments, reference can be made to the description in other embodiments and will not be repeated here.

[0138] The information processing method provided by the embodiments of the present application can monitor the outdoor environment in which the user is located through an image acquisition unit in an outdoor environment, and can automatically trigger an alarm when it is determined that there is an abnormality in the outdoor environment in which the user is located and the degree of abnormality meets a first threshold, thereby solving the problem of limited usage functions of equipment that can be used outdoors in related technologies; at the same time, only this one device needs to be deployed to effectively ensure the safety of the user, thereby reducing the difficulty of deployment and maintenance, and can be applied to various outdoor environments.

[0139] Based on the above embodiments, the present invention provides an information processing device, which can be applied to Figures 1-2 In the information processing method provided in the corresponding embodiment, refer to Figure 4As shown, the device 4 may include: a collection unit 31, a processing unit 32 and an output unit 33, wherein:

[0140] The acquisition unit 31 is configured to acquire first image information of the outdoor environment within a target range corresponding to the user through the image acquisition unit in a first working mode when the user is in an outdoor environment;

[0141] The acquisition unit 31 is further configured to acquire second image information of an outdoor environment within a target range through the image acquisition unit in a second working mode when it is determined that an abnormal object exists based on the first image information;

[0142] The processing unit 32 is configured to obtain the user's current location information when determining that an abnormality exists based on the second image information, and send the current location information and the second image information to the server;

[0143] The output unit 33 is configured to output the first alarm information in a targeted manner when it is determined that the abnormality degree meets the first threshold.

[0144] In other embodiments of the present application, the processing unit 32 is further configured to perform the following steps:

[0145] When it is determined based on the second image information that an abnormality exists and the degree of the abnormality meets a second threshold, the target information determination model is used to process the second image information to determine an abnormality result;

[0146] When the abnormal result indicates the existence of the target abnormal event, the current location information is obtained.

[0147] In other embodiments of the present application, the processing unit 32 is further configured to perform the following steps:

[0148] Acquiring first sample image information for an outdoor environment, and processing the first sample image information to obtain first processed image information;

[0149] determining image feature information of the first processed image information;

[0150] The initial information determination model is trained based on the image feature information to obtain a target information determination model.

[0151] In other embodiments of the present application, the processing unit 32 is further configured to perform the following steps:

[0152] When it is determined based on the second image information that an abnormality exists and the degree of the abnormality does not meet a second threshold, sending the second image information to the terminal device;

[0153] After receiving the alarm instruction sent by the terminal device, a second alarm message is generated based on the alarm instruction and the current location information is obtained.

[0154] In other embodiments of the present application, the processing unit 32 is further configured to perform the following steps:

[0155] Sending a transmission request carrying encrypted information to the server;

[0156] Receiving a response message from the server containing an encrypted password, and decrypting the encrypted password using decryption information corresponding to the encrypted information to obtain a session password; wherein the encrypted password is generated by the server based on the encrypted information;

[0157] The second image information and the current location information are encrypted using the session password, and the encrypted image information and the encrypted location information are sent to the server.

[0158] In other embodiments of the present application, the processing unit 32 is further configured to perform the following steps:

[0159] Based on the first target encryption algorithm, the second image information and the current position information are encrypted using the session password to obtain encrypted image information and encrypted position information;

[0160] Processing the second image information and the current location information using a second target encryption algorithm to obtain first verification information and second verification information;

[0161] The encrypted image information and the first verification information are sent to the server, and the encrypted location information and the second verification information are sent to the server.

[0162] In other embodiments of the present application, the processing unit 32 is further configured to perform the following steps:

[0163] Use multiple positioning technologies to obtain multiple location information, and fuse the multiple location information to obtain the initial location information;

[0164] Current position information is determined based on the initial position information.

[0165] In other embodiments of the present application, the processing unit 32 is further configured to process the first image information using a target anomaly determination model to determine whether an abnormal object exists.

[0166] In other embodiments of the present application, the processing unit 32 is further configured to perform the following steps:

[0167] Acquiring second sample image information, sample environment information, and sample location information for an outdoor environment, and processing the second sample image information, sample environment information, and sample location information;

[0168] determining first feature information of the processed sample image information;

[0169] Determining second characteristic information of the processed sample environment information;

[0170] Determine the third characteristic information of the processed sample position information;

[0171] The initial abnormality determination model is trained based on the first feature information, the second feature information, and the third feature information to obtain a target abnormality determination model.

[0172] It should be noted that the specific description of the steps performed by each unit can be referred to Figures 1-2 The information processing method provided in the corresponding embodiment will not be described in detail here.

[0173] The information processing device provided in the embodiments of the present application can monitor the outdoor environment in which the user is located through an image acquisition unit in an outdoor environment, and can automatically trigger an alarm when it is determined that there is an abnormality in the outdoor environment in which the user is located and the degree of abnormality meets a first threshold. This solves the problem of limited usage functions of equipment that can be used outdoors in related technologies, and can be applied to various outdoor environments.

[0174] Based on the above embodiments, the embodiments of the present application provide an information processing device, which can be applied to Figures 1-2 In the information processing method provided in the corresponding embodiment, refer to Figure 5 As shown, the information processing device 4 may include: a processor 41, a memory 42 and a communication bus 43, wherein:

[0175] The communication bus 43 is used to realize the communication connection between the processor 41 and the memory 42;

[0176] The processor 41 is used to execute the information processing program in the memory 42 to implement the following steps:

[0177] When the user is in an outdoor environment, first image information of the outdoor environment within a target range corresponding to the user is collected by the image collection unit in a first working mode;

[0178] When it is determined based on the first image information that an abnormal object exists, collecting second image information of an outdoor environment within the target range by the image acquisition unit in a second working mode;

[0179] When it is determined that an abnormality exists based on the second image information, obtaining the user's current location information, and sending the current location information and the second image information to the server;

[0180] When it is determined that the abnormality degree meets the first threshold, the first alarm information is output in a targeted manner.

[0181] In other embodiments of the present application, the processor 41 is configured to execute the information processing program in the memory 42 to obtain the user's current location information when determining that an abnormality exists based on the second image information, so as to implement the following steps:

[0182] When it is determined based on the second image information that an abnormality exists and the degree of the abnormality meets a second threshold, the target information determination model is used to process the second image information to determine an abnormality result;

[0183] When the abnormal result indicates the existence of the target abnormal event, the current location information is obtained.

[0184] In other embodiments of the present application, the processor 41 is used to execute the information processing program in the memory 42, and may further implement the following steps:

[0185] Acquiring first sample image information for an outdoor environment, and processing the first sample image information to obtain first processed image information;

[0186] determining image feature information of the first processed image information;

[0187] The initial information determination model is trained based on the image feature information to obtain a target information determination model.

[0188] In other embodiments of the present application, the processor 41 is used to execute the information processing program in the memory 42, and may further implement the following steps:

[0189] When it is determined based on the second image information that an abnormality exists and the degree of the abnormality does not meet a second threshold, sending the second image information to the terminal device;

[0190] After receiving the alarm instruction sent by the terminal device, a second alarm message is generated based on the alarm instruction and the current location information is obtained.

[0191] In other embodiments of the present application, the processor 41 is configured to execute the information processing program in the memory 42 to send the current location information and the second image information to the server, so as to implement the following steps:

[0192] Sending a transmission request carrying encrypted information to the server;

[0193] Receiving a response message from the server containing an encrypted password, and decrypting the encrypted password using decryption information corresponding to the encrypted information to obtain a session password; wherein the encrypted password is generated by the server based on the encrypted information;

[0194] The second image information and the current location information are encrypted using the session password, and the encrypted image information and the encrypted location information are sent to the server.

[0195] In other embodiments of the present application, the processor 41 is configured to execute the information processing program in the memory 42 to encrypt the second image information and the current location information using the session password, and send the encrypted image information and the encrypted location information to the server, so as to implement the following steps:

[0196] Based on the first target encryption algorithm, the second image information and the current position information are encrypted using the session password to obtain encrypted image information and encrypted position information;

[0197] Processing the second image information and the current location information using a second target encryption algorithm to obtain first verification information and second verification information;

[0198] The encrypted image information and the first verification information are sent to the server, and the encrypted location information and the second verification information are sent to the server.

[0199] In other embodiments of the present application, the processor 41 is configured to execute the information processing program in the memory 42 to obtain the current location information, so as to implement the following steps:

[0200] Use multiple positioning technologies to obtain multiple location information, and fuse the multiple location information to obtain the initial location information;

[0201] Current position information is determined based on the initial position information.

[0202] In other embodiments of the present application, the processor 41 is used to execute the information processing program in the memory 42, and may further implement the following steps:

[0203] The target anomaly determination model is used to process the first image information to determine whether an abnormal object exists.

[0204] In other embodiments of the present application, the processor 41 is used to execute the information processing program in the memory 42, and may further implement the following steps:

[0205] Acquiring second sample image information, sample environment information, and sample location information for an outdoor environment, and processing the second sample image information, sample environment information, and sample location information;

[0206] determining first feature information of the processed sample image information;

[0207] Determining second characteristic information of the processed sample environment information;

[0208] Determine the third characteristic information of the processed sample position information;

[0209] The initial abnormality determination model is trained based on the first feature information, the second feature information, and the third feature information to obtain a target abnormality determination model.

[0210] It should be noted that the specific description of the steps performed by the processor can be referred to Figures 1-2 The information processing method provided in the corresponding embodiment will not be described in detail here.

[0211] The information processing device provided in the embodiments of the present application can monitor the outdoor environment in which the user is located through an image acquisition unit in an outdoor environment, and can automatically trigger an alarm when it is determined that there is an abnormality in the outdoor environment in which the user is located and the degree of abnormality meets a first threshold. This solves the problem of limited usage functions of devices that can be used outdoors in related technologies, and can be applied to various outdoor environments.

[0212] Based on the above embodiments, the embodiments of the present application provide a computer-readable storage medium, which stores one or more programs, and the one or more programs can be executed by one or more processors to implement Figure 1 and 2 The corresponding embodiments provide steps of the information processing method.

[0213] Based on the above embodiments, the embodiments of the present application provide a computer program product, including a computer program, which can be executed by the processor 41 to complete Figure 1 and 2 The corresponding embodiments provide steps of the information processing method.

[0214] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of hardware embodiments, software embodiments, or embodiments combining software and hardware. Furthermore, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage and optical storage, etc.) containing computer-usable program code.

[0215] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the steps in the process. Figure 1a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0216] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0217] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 The steps for the function specified in one or more boxes.

[0218] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. An information processing method, characterized in that: The method comprises: When the user is in an outdoor environment, first image information of the outdoor environment within a target range corresponding to the user is collected by the image collection unit in a first working mode; When it is determined based on the first image information that an abnormal object exists, collecting second image information of an outdoor environment within the target range by the image acquisition unit in a second working mode; When it is determined that an abnormality exists based on the second image information, obtaining the current location information of the user, and sending the current location information and the second image information to a server; When it is determined that the abnormality degree meets the first threshold, the first alarm information is output in a targeted manner.

2. The method according to claim 1, characterized in that The acquiring the current location information of the user when determining that an abnormality exists based on the second image information includes: When it is determined based on the second image information that an abnormality exists and the degree of the abnormality meets a second threshold, the target information determination model is used to process the second image information to determine an abnormality result; When the abnormal result indicates that a target abnormal event exists, the current location information is obtained.

3. The method according to claim 2, characterized in that The method further comprises: Acquiring first sample image information for the outdoor environment, and processing the first sample image information to obtain first processed image information; determining image feature information of the first processed image information; The initial information determination model is trained based on the image feature information to obtain the target information determination model.

4. The method according to claim 2, characterized in that The method further comprises: When it is determined based on the second image information that an abnormality exists and the degree of the abnormality does not meet the second threshold, sending the second image information to a terminal device; After receiving the alarm instruction sent by the terminal device, a second alarm message is generated based on the alarm instruction and the current location information is obtained.

5. The method according to claim 1, wherein The sending the second image information and the current location information to the server includes: Sending a transmission request carrying encrypted information to the server; receiving a response message from the server carrying an encrypted password, and decrypting the encrypted password using decryption information corresponding to the encryption information to obtain a session password; wherein the encrypted password is generated by the server based on the encryption information; The second image information and the current location information are encrypted using the session password, and the encrypted image information and the encrypted location information are sent to the server.

6. The method according to claim 5, characterized in that The step of encrypting the second image information and the current location information by using the session password, and sending the encrypted image information and the encrypted location information to the server comprises: Based on a first target encryption algorithm, encrypting the second image information and the current location information using the session password to obtain the encrypted image information and the encrypted location information; Processing the second image information and the current location information using a second target encryption algorithm to obtain first verification information and second verification information; The encrypted image information and the first verification information are sent to the server, and the encrypted location information and the second verification information are sent to the server.

7. The method according to claim 2 or 4, characterized in that The obtaining of the current location information includes: Using multiple positioning technologies to obtain multiple location information, and fusing the multiple location information to obtain initial location information; The current position information is determined based on the initial position information.

8. The method according to claim 1, characterized in that Before collecting second image information of the outdoor environment within the target range by the image acquisition unit in the second working mode when determining that an abnormal object exists based on the first image information, the method further includes: The first image information is processed using a target anomaly determination model to determine whether an abnormal object exists.

9. The method according to claim 8, characterized in that The method further comprises: acquiring second sample image information, sample environment information, and sample location information for the outdoor environment, and processing the second sample image information, the sample environment information, and the sample location information; determining first feature information of the processed sample image information; Determining second characteristic information of the processed sample environment information; Determine the third characteristic information of the processed sample position information; Based on the first feature information, the second feature information, and the third feature information, an initial abnormality determination model is trained to obtain the target abnormality determination model.

10. An information processing device, characterized in that: The device comprises: a collection unit configured to collect, when a user is in an outdoor environment, first image information of an outdoor environment within a target range corresponding to the user through an image collection unit in a first working mode; The acquisition unit is further configured to acquire second image information of the outdoor environment within the target range in a second working mode by the image acquisition unit when it is determined that an abnormal object exists based on the first image information; a processing unit, configured to, when determining that an abnormality exists based on the second image information, obtain the current location information of the user, and send the current location information and the second image information to a server; The output unit is configured to output the first alarm information in a targeted manner when it is determined that the abnormality degree meets the first threshold.

11. An information processing device, characterized in that: The device includes: a processor, a memory and a communication bus; The communication bus is used to realize the communication connection between the processor and the memory; The processor is used to execute the information processing program in the memory to implement the steps of the information processing method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that The computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the information processing method according to any one of claims 1 to 9.

13. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the computer program implements the information processing method according to any one of claims 1 to 9.

Images