Travel safety intervention method, system and device for children with autism and wearable equipment
Through electronic devices, the environmental and status information of autistic children are obtained and analyzed, and matching instructions are generated for real-time intervention, which solves the problem that parents cannot monitor the status and emotions of children for a long time, and realizes safety monitoring and emotional management of travel for autistic children.
Patent Information
- Application Number
- CN202510470370.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-15
- Publication Date
- 2025-07-08
AI Technical Summary
Parents are unable to monitor the status and emotions of autistic children for a long time, resulting in the inability to intervene in time for children's emotional extremes.
Current environmental information, location information and operating status data are obtained through electronic devices, feature recognition is used to use preset content recognition models, matching instructions are generated and sent to the connection terminal for information intervention, real-time monitoring and emotional intervention for autistic children.
It improves the timeliness and accuracy of travel safety for autistic children, enhances monitoring efforts, can remotely soothe children's emotions, promote their independent growth, and ensure information security.
Smart Images

Figure CN120279657A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of wearable devices, and particularly to a method, system, device and wearable device for intervening in the travel safety of autistic children. Background Art
[0002] Autism Spectrum Disorder (ASD) is a disease classified as a neurodevelopmental disorder. Individuals with autism spectrum disorder usually exhibit two types of symptoms: problems in social communication or social interaction, and restricted or repetitive patterns of behavior, interests or activities. Autistic patients have long-term difficulties in creating and maintaining social relationships, as well as difficulties in maintaining work and performing daily tasks. The clinical manifestations of autism mainly include language disorders, social communication disorders, narrow range of interests, stereotyped behavior patterns and intellectual disabilities. Language and communication disorders are important symptoms of autism and the main reason for most children to seek medical treatment.
[0003] Autism is a public health problem that urgently needs attention nowadays, bringing a huge economic and mental burden to society and families. Data shows that there are 35 million autistic patients globally, 40% of whom are children. For the travel of autistic children, parents are surely concerned. Due to the congenital lack of communication in children, it is easy to cause children to have extreme emotions in a strange environment. Therefore, there is an urgent need to design a method for intervening in the travel safety of autistic children, so that parents can monitor the children's status and emotions for a long time. Summary of the Invention
[0004] In view of this, the present invention provides a method, system, device and wearable device for intervening in the travel safety of autistic children to solve the problem that parents cannot monitor the children's status and emotions for a long time, resulting in the inability to intervene in the extreme emotions of autistic children.
[0005] In a first aspect, the present invention provides a method for intervening in the travel safety of autistic children, which is applied to an electronic device. The method includes:
[0006] After successfully connecting to a connected terminal, obtain the current environmental information, positioning information and operating status data of the electronic device, and obtain a feature recognition result corresponding to the current environmental information of the electronic device based on the current environmental information of the electronic device and a preset content recognition model;
[0007] Obtain the current environmental feature information based on the feature recognition result and a preset recognition result threshold;
[0008] Capture the data feature record in the current environment data feature information, detect whether there is a corresponding matching request in the specified item of the connection terminal based on the data feature record, and when there is a corresponding matching request, convert the corresponding matching request into a corresponding matching instruction;
[0009] The matching instruction, the electronic device location information and the current operation status data of the electronic device are then sent to the connection terminal, so that the connection terminal performs information intervention on the electronic device.
[0010] The present invention provides a method for intervening in the travel safety of children with autism. By acquiring the current environmental information of electronic devices and obtaining feature recognition results with the help of a preset content recognition model, the environmental conditions of children with autism can be understood in real time and accurately. The current environmental feature information is determined based on the feature recognition results and the preset recognition result threshold, and then the data feature records are captured to detect the matching request in the specified item of the connection terminal and convert it into a matching instruction. This intelligent matching mechanism can quickly respond to environmental changes and automatically generate corresponding instructions for different environmental features without manual intervention, greatly improving the timeliness and accuracy of intervention, and sending matching instructions, electronic device location information, and electronic device current operating status data to the connection terminal, so that the connection terminal can perform information intervention on the electronic device. This means that parents or guardians can fully understand the location, device status and environmental intervention instructions of autistic children, so as to achieve multi-faceted collaboration to ensure the safety of children's travel, and facilitate the connection terminal to know the user's current mental state, which can not only monitor the pulse, but also enhance the monitoring of electronic equipment; it can conduct all-round monitoring of human health, facilitate the remote reception of various matching instructions and matching voice information, and enable the connection terminal to conduct long-term information intervention on electronic devices, so as to achieve the effect of remotely soothing the user's emotions, and quickly train the user's independence, so that the user can grow quickly, and solve the problem that parents cannot monitor the child's status and emotions for a long time and cannot intervene in the extreme emotions of autistic children.
[0011] In an optional implementation, the travel safety intervention method for children with autism further includes: the electronic device is connected to the connection terminal in the following manner:
[0012] Receiving a connection request sent by a connection terminal through a preset network, the connection request is used to request to establish a connection with the electronic device and carries a request to obtain current environment information, location information, and operating status data of the electronic device;
[0013] Based on the connection request, it is detected whether the current account of the connection terminal is the target account. If the current account of the connection terminal is the target account, the connection terminal is connected based on the connection request.
[0014] A travel safety intervention method for autistic children provided by the present invention. After the electronic device receives a connection request from a connected terminal, it will detect whether the current account of the connected terminal is the target account based on the connection request. Only when the current account of the connected terminal is the target account, will the electronic device connect to the connected terminal based on the connection request. This mechanism effectively prevents unauthorized devices or personnel from connecting to the electronic device, avoids the risk of leakage of information related to autistic children, and ensures the information security of the entire safety intervention system.
[0015] In an alternative embodiment, the current environmental information includes current environmental image information;
[0016] Obtaining an identification result corresponding to the current environmental information of the electronic device based on the current environmental information of the electronic device and a preset content recognition model includes:
[0017] Performing image processing on the current environmental image information to obtain a two-dimensional image set, extracting contour nodes from the two-dimensional image set, calculating the proportional distances of all contour nodes, and obtaining an overall image proportional distance set;
[0018] Obtaining the three-dimensional coordinates of each contour node based on the overall image proportional distance set, mapping the three-dimensional coordinates to a three-dimensional module to obtain a current environmental three-dimensional model, and then inputting the current environmental three-dimensional model into a preset content recognition model to obtain an image recognition result corresponding to the current environmental information of the electronic device.
[0019] A travel safety intervention method for autistic children provided by the present invention. By performing image processing on the current environmental image information, generating a two-dimensional image set and extracting contour nodes, and then calculating the proportional distances of all contour nodes to obtain an overall image proportional distance set, it can accurately capture various detailed features in the environment, providing a very accurate basis for subsequent safety intervention decisions. The entire processing flow of the current environmental image information, from two-dimensional to three-dimensional, and then to obtaining an identification result by inputting into a preset model, ultimately aims to support safety intervention decisions. Precise environmental restoration, comprehensive information processing, and accurate identification results make the safety intervention decisions based on this information more scientific.
[0020] In an alternative embodiment, the current environmental information further includes current environmental sound information, temperature information, and user physiological information. Obtaining an identification result corresponding to the current environmental information of the electronic device based on the current environmental information of the electronic device and a preset content recognition model further includes:
[0021] Inputting the current environmental sound information, temperature information, and user physiological information into corresponding preset content recognition models to respectively obtain a sound recognition result, a temperature recognition result, and a user physiological recognition result corresponding to the current environmental information of the electronic device.
[0022] A method for intervening in the travel safety of autistic children provided by the present invention, in addition to the original processing of environmental image information, incorporates current environmental sound information, temperature information, and user physiological information, and inputs them into corresponding preset content recognition models, greatly enriching the perception dimension of the environment. The sound information can reflect whether there are dangerous traffic noises, warning sounds, etc. around; the temperature information can judge whether the environment where the child is located is comfortable or there is an extreme temperature risk; the user physiological information (such as heart rate, body temperature, etc.) can directly understand the physical state of the child. By integrating these multi-dimensional information, the system can more comprehensively and three-dimensionally perceive the environmental conditions of autistic children, providing more sufficient data support for subsequent safety interventions.
[0023] In an alternative implementation manner, based on the recognition result and a preset recognition result threshold, obtain the current environmental data feature information, including:
[0024] Extract the current environmental features from the image recognition result, sound recognition result, temperature recognition result, and user physiological recognition result respectively. The current environmental features include environmental image features, sound features, temperature features, and user physiological features;
[0025] Compare the sound features, temperature features, and user physiological features with the corresponding preset recognition result thresholds respectively, and at the same time compare the actual brightness of the environmental image features with the preset brightness to obtain the activity state features of the electronic device user in the current environment, and use the activity state features in the current environment as the current environmental data feature information.
[0026] A method for intervening in the travel safety of autistic children provided by the present invention extracts the corresponding environmental features from multiple recognition results, covering environmental image features, sound features, temperature features, and user physiological features. This comprehensive extraction method ensures the detailed capture of all important aspects of the environment. Through the above comprehensive feature extraction and reasonable comparison method, the activity state features of the electronic device user in the current environment are finally obtained. This method comprehensively considers the influence of multiple key factors in the environment on the child's activity state.
[0027] In an alternative implementation manner, based on the data feature record, detect whether there is a corresponding matching request in the specified item of the connection terminal, including:
[0028] Select the specified item of the connection terminal through a preset input box. The specified item of the connection terminal includes multiple matching options;
[0029] Match the multiple matching options of the specified item of the connection terminal in the data feature record. If the match is successful, it is determined that there is a corresponding matching request; otherwise, it is determined that there is a corresponding matching request.
[0030] A method for intervening in the travel safety of autistic children provided by the present invention matches multiple matching options for a specified item of a connection terminal during data feature recording. This mechanism can ensure accurate screening of eligible data. When the system performs matching in a large number of data feature records, it can accurately find the corresponding information according to the preset matching options. The connection terminal specified item includes multiple matching options, which provides great flexibility for information interaction. Different application scenarios or user requirements may require attention to different data features. By setting multiple matching options, users can make customized selections according to the actual situation.
[0031] In a second aspect, the present invention provides a travel safety intervention system for autistic children, which includes:
[0032] An electronic device for executing the travel safety intervention method for autistic children according to the first aspect or any corresponding embodiment thereof;
[0033] An MCU control unit, connected to the electronic device, and the MCU control unit is used to control the electronic device to execute the travel safety intervention method for autistic children according to the first aspect or any corresponding embodiment thereof.
[0034] In an optional embodiment, the electronic device includes a charging unit, and the charging unit is used to perform solar charging for the electronic device.
[0035] In a third aspect, the present invention provides a travel safety intervention device for autistic children, which is applied to an electronic device, and the device includes:
[0036] A feature recognition module, which is used to obtain the current environment information, location information and operating status data of the electronic device after successfully connecting to the connection terminal, and obtain a feature recognition result corresponding to the current environment information of the electronic device based on the current environment information of the electronic device and a preset content recognition model;
[0037] A current environment feature information determination module, which is used to obtain the current environment feature information based on the feature recognition result and a preset recognition result threshold;
[0038] A matching instruction generation module, which is used to capture the data feature record in the current environment data feature information, detect whether there is a corresponding matching request in the connection terminal specified item based on the data feature record, and convert the corresponding matching request into a corresponding matching instruction when there is a corresponding matching request;
[0039] An information intervention module, which is used to send the matching instruction, the location information of the electronic device and the current operating status data of the electronic device to the connection terminal, so that the connection terminal intervenes in the information of the electronic device.
[0040] Fourth aspect, the present invention provides a wearable device, which is the electronic device of the first aspect above. The wearable device is used to execute the autism children travel safety intervention method of the first aspect above or any corresponding implementation manner thereof; the wearable device includes: a bracelet body, and a video recording module, a microphone, a receiver, an ambient light sensor, a distance sensor, an infrared camera, a solar panel, a collection element and an adjustment button provided on the bracelet body.
[0041] Fifth aspect, the present invention provides a computer device, including: a memory and a processor, which are communicatively connected to each other. The memory stores computer instructions, and the processor executes the computer instructions to execute the autism children travel safety intervention method of the first aspect above or any corresponding implementation manner thereof.
[0042] Sixth aspect, the present invention provides a computer-readable storage medium, on which computer instructions are stored. The computer instructions are used to cause a computer to execute the autism children travel safety intervention method of the first aspect above or any corresponding implementation manner thereof.
[0043] Seventh aspect, the present invention provides a computer program product, including computer instructions, which are used to cause a computer to execute the autism children travel safety intervention method of the first aspect above or any corresponding implementation manner thereof. Description of the Drawings
[0044] In order to more clearly illustrate the specific implementation manners of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings required for use in the description of the specific implementation manners or the prior art. Obviously, the following drawings are some implementation manners of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.
[0045] Figure 1 is a schematic flowchart of the autism children travel safety intervention method according to an embodiment of the present invention;
[0046] Figure 2 is a schematic flowchart of another autism children travel safety intervention method according to an embodiment of the present invention;
[0047] Figure 3 is a schematic flowchart of yet another autism children travel safety intervention method according to an embodiment of the present invention;
[0048] Figure 4 is a schematic flowchart of receiving a connection request sent by a connection terminal in the autism children travel safety intervention method according to an embodiment of the present invention;
[0049] Figure 5It is a schematic flowchart of yet another travel safety intervention method for autistic children according to an embodiment of the present invention;
[0050] Figure 6 It is a schematic structural diagram of a travel safety intervention system for autistic children according to an embodiment of the present invention;
[0051] Figure 7 It is a schematic structural diagram of a charging unit in a travel safety intervention system for autistic children according to an embodiment of the present invention;
[0052] Figure 8 It is a schematic structural diagram of a wearable device according to an embodiment of the present invention;
[0053] Figure 9 It is a schematic back view structural diagram of a wearable device according to an embodiment of the present invention;
[0054] Figure 10 It is a structural block diagram of a travel safety intervention device for autistic children according to an embodiment of the present invention;
[0055] Figure 11 It is a schematic hardware structure diagram of a computer device according to an embodiment of the present invention;
[0056] In the figure, 1 - bracelet body, 2 - video recording module, 3 - microphone, 4 - earpiece, 5 - ambient light sensor, 6 - distance sensor, 7 - infrared camera, 8 - solar panel, 9 - acquisition element, 10 - adjustment button. Detailed implementation manners
[0057] To make the objectives, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Apparently, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.
[0058] According to an embodiment of the present invention, an embodiment of a travel safety intervention method for autistic children is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.
[0059] In this embodiment, a travel safety intervention method for autistic children is provided, which can be used in electronic devices such as smart bracelets and smart watches. Figure 1 It is a flowchart of a travel safety intervention method for autistic children according to an embodiment of the present invention, as Figure 1As shown, the process includes the following steps:
[0060] Step S101: After successfully connecting to the connection terminal, obtain the current environmental information, location information, and operating status data of the electronic device, and obtain the feature recognition result corresponding to the current environmental information of the electronic device based on the current environmental information of the electronic device and the preset content recognition model.
[0061] Specifically, the connection terminal refers to a usage terminal that can be connected to the electronic device, such as a mobile phone, a tablet computer, etc.
[0062] The electronic device uses various sensors it is equipped with to collect surrounding environmental information. For example, it captures the current environmental image information through a camera, recording pictures of objects, people, and scene layouts in the scene where the child is located; collects the current environmental sound information through a microphone, such as traffic noise, human voices, warning sounds, etc.; obtains real-time temperature information through a temperature sensor; at the same time, if the electronic device is equipped with a device that can monitor the user's physiological information (such as a smart bracelet), it will also collect user physiological information such as heart rate, body temperature, and skin conductance response.
[0063] Location information acquisition: Rely on the built-in Global Positioning System (GPS) module of the electronic device to accurately determine the geographical location coordinates of the device, including longitude, latitude, and possible altitude information, etc. This information can reflect the position of the autistic child on the map in real time.
[0064] Collection of operating status data: The system automatically detects the operating status of the electronic device itself, such as the remaining percentage of battery power, the network connection status of the device (whether Wi-Fi or mobile data network is normally connected and the signal strength), the CPU and memory usage of the device, etc. These data are used to evaluate whether the device can operate stably to ensure the continuous effectiveness of the safety intervention function.
[0065] After collecting the current environmental information, the system inputs it into the preset content recognition model for processing to obtain the feature recognition result corresponding to the current environmental information of the electronic device.
[0066] Step S102: Obtain the current environmental feature information based on the feature recognition result and the preset recognition result threshold.
[0067] Specifically, after obtaining various feature recognition results, the system further determines the current environmental feature information based on these results and the preset recognition result threshold. For example, extract environmental image features from the recognition results, including key features such as object shape, color, and scene layout; sound features, such as sound type and intensity; temperature features, that is, the current temperature value; user physiological features, such as heart rate value and whether in a stress state, etc.
[0068] Compare the voice feature, temperature feature, and user physiological feature with their corresponding preset recognition result thresholds respectively. For example, the preset voice threshold may specify the normal ambient sound intensity range, and when the recognized sound intensity exceeds this range, there may be a dangerous sound; the preset temperature threshold specifies the temperature range suitable for children's activities, and when the temperature exceeds this range, it is an abnormal temperature.
[0069] Step S103: Capture the data feature record in the current environmental data feature information, and based on the data feature record, detect whether there is a corresponding matching request in the specified item of the connection terminal. When there is a corresponding matching request, convert the corresponding matching request into a corresponding matching instruction.
[0070] Specifically, for the specified item of the connection terminal: on the operation interface of the connection terminal, there is a preset input box. Users (such as parents, guardians, or relevant staff) can select the specified item of the connection terminal through this input box. For example, the matching options may include "dangerous sound detection", "high-temperature environment detection", "abnormal child heart rate detection", etc.
[0071] Search and match multiple matching options of the specified item of the connection terminal in the current environmental data feature record. Taking "dangerous sound detection" as an example, if the voice recognition result contains the preset dangerous sound types (such as sudden braking sound, alarm sound, etc.), it is determined that this matching option is successfully matched; for "high-temperature environment detection", if the temperature recognition result shows that the temperature exceeds the preset upper limit of the suitable temperature, it is determined that this matching option is successfully matched. If any one of the matching options is successfully matched, it is determined that there is a corresponding matching request. When it is determined that there is a corresponding matching request, the system converts this matching request into a corresponding matching instruction. For example, if "dangerous sound detection" is successfully matched, the converted matching instruction may be "issue a dangerous sound alarm"; if "high-temperature environment detection" is successfully matched, the matching instruction may be "prompt the high-temperature environment risk and suggest taking cooling measures".
[0072] Step S104: After the matching instruction, the electronic device location information, and the current operating state data of the electronic device are sent to the connection terminal, so that the connection terminal can perform information intervention on the electronic device.
[0073] Specifically, after receiving these data, the connection terminal performs corresponding information intervention operations according to the matching instruction. For example, a prominent alarm prompt pops up on the interface of the connection terminal to inform the user (parent or guardian) of the detected dangerous situation, and at the same time, the location information of the electronic device is displayed so that the user can quickly find the location of the child.
[0074] The travel safety intervention method for autistic children provided in this embodiment can obtain the current environmental information of the electronic device and obtain the feature recognition result with the help of the preset content recognition model, so as to understand the environmental conditions of the autistic children in real time and accurately, determine the current environmental feature information based on the feature recognition result and the preset recognition result threshold, and then capture the data feature record to detect the matching request in the specified item of the connection terminal and convert it into a matching instruction. This intelligent matching mechanism can quickly respond to environmental changes, automatically generate corresponding instructions for different environmental characteristics, without manual intervention, greatly improve the timeliness and accuracy of intervention, and send the matching instruction, electronic device location information and the current operating status data of the electronic device to the connection terminal, so that the connection terminal can perform information intervention on the electronic device. This means that parents or guardians can fully understand the location, device status and environmental intervention instructions of autistic children, so as to achieve multi-faceted collaboration to ensure the safety of children's travel, and facilitate the connection terminal to know the user's current mental state, which can not only monitor the pulse, but also enhance the monitoring of electronic equipment; it can conduct all-round monitoring of human health, facilitate the remote reception of various matching instructions and matching voice information, and enable the connection terminal to conduct long-term information intervention on electronic devices, so as to achieve the effect of remotely soothing the user's emotions, and quickly train the user's independence, so that the user can grow quickly, and solve the problem that parents cannot monitor the child's status and emotions for a long time and cannot intervene in the extreme emotions of autistic children.
[0075] In this embodiment, a method for intervening in travel safety for children with autism is provided, which can be used in electronic devices such as smart bracelets, smart watches, etc. Figure 2 is a flow chart of a method for intervening in travel safety for children with autism according to an embodiment of the present invention. Figure 2 As shown, the process includes the following steps:
[0076] In step S201, the electronic device is connected to the connection terminal in the following manner: a connection request sent by the connection terminal is received through a preset network, the connection request is used to request to establish a connection with the electronic device, and carries a request to obtain the current environment information, positioning information and operating status data of the electronic device; based on the connection request, it is detected whether the current account of the connection terminal is the target account, and if the current account of the connection terminal is the target account, the connection terminal is connected based on the connection request.
[0077] Specifically, the preset network includes one or a combination of 3G network, 4G network, 5G network, and WIFI network.
[0078] like Figure 4As shown in the figure, on the side of the connection terminal, the user (parent, guardian or relevant staff) starts the connection program. The connection terminal sends a connection request through the preset network. The electronic device constantly monitors the preset network port and waits for the connection request to arrive. After receiving the connection request and performing preliminary processing, the electronic device starts to detect whether the current account of the connection terminal is the target account. The electronic device usually maintains a local account database, which stores the authorized target account information. The account information may include the username, the hash value of the password (to ensure security, the plaintext password is not directly stored), and relevant permission settings, etc. The electronic device compares the account information obtained from the connection request with the records in the local account database one by one. If both the username and password match successfully, and the account is marked as the target account in the database (with the permission to access the relevant data of the electronic device), it is determined that the current account of the connection terminal is the target account; otherwise, it is determined as a non-target account. If the account detection result shows that the current account of the connection terminal is the target account, the electronic device will establish a connection with the connection terminal based on the connection request.
[0079] Step S202: After successfully connecting to the connection terminal, obtain the current environment information, location information, and operating status data of the electronic device, and obtain the feature recognition result corresponding to the current environment information of the electronic device based on the current environment information of the electronic device and the preset content recognition model.
[0080] Specifically, the current environment information includes current environment image information, current environment sound information, temperature information, and user physiological information. The preset content recognition model includes multiple recognition models, which are set according to the actual situation, including but not limited to image content recognition models, sound content recognition models, temperature recognition models, and user physiological feature recognition models, etc. The preset content recognition model is usually a deep learning model trained with a large amount of environmental image data, such as a convolutional neural network (CNN). During the training process, the model learns the mapping relationship between the three-dimensional model features in a large number of different environmental scenarios and the corresponding scene categories, object categories, etc.
[0081] The above step S202 includes:
[0082] Step S2021: Perform image processing on the current environment image information to obtain a two-dimensional image set, extract the contour nodes in the two-dimensional image set, calculate the proportional distances of all contour nodes to obtain the overall image proportional distance set; obtain the three-dimensional coordinates of each contour node based on the overall image proportional distance set, map the three-dimensional coordinates to a three-dimensional module to obtain the current environment three-dimensional model, and then input the current environment three-dimensional model into the preset content recognition model to obtain the image recognition result corresponding to the current environment information of the electronic device.
[0083] Specifically, when the electronic device obtains the current environmental image information, a series of image processing operations are first performed to obtain a two-dimensional image set. This process starts with the adjustment of the original image format, mainly for adjusting the image format and resolution. After the format and resolution are adjusted, the image forms a two-dimensional image set suitable for subsequent processing.
[0084] For the generated two-dimensional image set, the edge detection algorithm is then used to extract contour nodes. After the contour nodes are extracted, it is necessary to calculate the proportional distances between all the contour nodes to obtain the overall image proportional distance set. For each contour node, the system calculates the Euclidean distance between it and all other contour nodes. The Euclidean distance calculates the straight-line distance between two nodes on the two-dimensional plane through the Pythagorean theorem. After calculating the Euclidean distances between all nodes, in order to eliminate the influence of image size and scale changes on distance calculation, these distance values are normalized to be converted into proportional distances. Normalization can be achieved by dividing each distance value by the diagonal length of the image or other appropriate reference lengths. After normalization, all the obtained proportional distance values constitute the overall image proportional distance set.
[0085] For the details of the edge detection algorithm for extracting contour points and the Euclidean distance, reference can be made to the relevant technologies and will not be elaborated here.
[0086] The electronic device needs to obtain the image information of the same environment from at least two different angles (if the electronic device has multiple cameras, it can directly obtain images from different perspectives; if there is only one camera, it may obtain images from different perspectives by moving or rotating the device at different times). For each contour node, the corresponding homologous points are found in the images from different perspectives. According to the principle of triangulation, knowing the positions of the two cameras (or the positions of the same camera at different times) and the internal parameters of the cameras (such as focal length, etc.), by calculating the parallax of the homologous points in different perspectives (i.e., the position difference of the homologous points in different images), and combining geometric relationships, the coordinates of the contour node in the three-dimensional space can be solved. Finally, the constructed three-dimensional model of the current environment is input into the image content recognition model to obtain the image recognition result.
[0087] Step S2022: Input the current environmental sound information, temperature information, and user physiological information into the corresponding preset content recognition models to obtain the sound recognition result, temperature recognition result, and user physiological recognition result corresponding to the current environmental information of the electronic device respectively.
[0088] Specifically, the preprocessed voice feature vectors after noise reduction and the like are input into a preset voice recognition model. Inside the model, through a series of neuron layers and weight calculations, the input voice features are analyzed and pattern-matched. For example, the model has learned the feature patterns of various voice categories, including human voices, vehicle sounds, alarm sounds, etc. After the operation of the model, the voice recognition result is finally output, clarifying what type the current environmental sound belongs to, such as identifying it as traffic noise, bird chirping, or the conversation of people around.
[0089] The electronic device uses a temperature sensor to obtain the current environmental temperature information. The current environmental temperature information is input into a preset temperature recognition model. The input temperature data is judged. For example, the model may divide the temperature range into different intervals, and by comparing the input temperature value with the boundaries of these intervals, determine its category. Finally, the temperature recognition result is output, informing what state the current environmental temperature is in, such as whether it is within the temperature range suitable for children's activities, or whether there is a risk of overheating or overcooling.
[0090] For the collection of user physiological information, the electronic device may be connected to specialized physiological monitoring devices, such as smart bracelets, smart watches, etc., or integrate some physiological monitoring functions itself. Taking heart rate monitoring as an example, the device may use a photoelectric sensor, by emitting and receiving light, and using the absorption characteristics of blood for light to detect the heart rate. For body temperature monitoring, contact or non-contact temperature sensors may be used. The collected physiological data, such as heart rate values, body temperature values, etc., are transmitted to the electronic device through wireless communication technology (such as Bluetooth) and stored in the device memory. The user physiological feature data is input into a preset user physiological recognition model. During the training process, the model has learned the relationship between a large amount of feature data in different physiological states and the corresponding physiological state labels (such as normal, nervous, fatigued, etc.). When the physiological feature data of the current user is input, the model outputs the user physiological recognition result through the analysis and pattern matching of these features, judging the current physiological state of the user, such as whether the user is in a state of nervous anxiety, or whether there are signs of physical fatigue, etc., providing an important basis for subsequent judgment of the adaptation of autistic children in the current environment and taking corresponding intervention measures.
[0091] Step S203, obtaining the current environmental data feature information based on the recognition result and the preset recognition result threshold.
[0092] Specifically, the above step S203 includes:
[0093] Step S2031, extracting the current environmental features from the image recognition result, voice recognition result, temperature recognition result, and user physiological recognition result respectively. The current environmental features include environmental image features, voice features, temperature features, and user physiological features.
[0094] Specifically, environmental image feature extraction: When extracting environmental image features from the image recognition results, multiple aspects will be concerned, including object recognition features and scene layout features, etc. The object recognition features can obtain the shape and position of the object through the category label and the corresponding bounding box information output by the recognition model, and its color information can be obtained from the pixel value statistics of the image. The scene layout features determine the positional relationship of various scene elements by analyzing the semantic segmentation results of different regions in the image, and judge whether it is an urban street scene, a park scene or an indoor scene, etc. In addition, the brightness and contrast features of the image will also be extracted. The brightness can be measured by calculating the average brightness of the image pixel values, and the contrast is determined by analyzing the distribution range and difference degree of the pixel values. These environmental image features comprehensively reflect the visual presentation of the current environment.
[0095] Sound feature extraction: Based on the sound recognition results, the sound feature extraction focuses on aspects such as the type, intensity, and frequency of the sound. The sound type feature directly comes from the output result of the sound recognition model, such as identifying sound features such as traffic noise, human voice, and bird song.
[0096] The temperature feature directly obtains the temperature value of the current environment from the temperature recognition result.
[0097] The physiological features extracted from the user's physiological recognition results include indicators such as heart rate, body temperature, and skin conductance response.
[0098] Step S2032: Compare the sound feature, temperature feature, and user physiological feature with the corresponding preset recognition result thresholds respectively, and at the same time compare the actual brightness of the environmental image feature with the preset brightness to obtain the activity state feature of the electronic device user in the current environment, and use the activity state feature in the current environment as the current environmental data feature information.
[0099] Specifically, the preset recognition result thresholds include the image recognition result threshold, such as the brightness threshold, as well as the sound recognition result threshold, temperature recognition result threshold, user physiological feature threshold, etc.
[0100] The preset sound recognition result threshold is set according to different environmental scenarios and safety standards. For example, for a quiet environment suitable for autistic children's activities, the preset sound intensity threshold may be set between 40dB - 60dB. When the extracted sound intensity feature exceeds this threshold range, such as the sound intensity reaches 80dB, it indicates that the current environmental sound intensity is too high and there may be a risk of noise interference.
[0101] The preset temperature threshold is also set according to the physiological needs and activity suitability of children. Generally speaking, the temperature range suitable for children's activities is set at 20℃-28℃. When the extracted temperature feature is lower than 20℃, it is judged as a low temperature environment and warming measures may be needed; if it is higher than 28℃, it is a high temperature environment and there may be a risk of heat stroke.
[0102] There are also corresponding preset thresholds for user physiological characteristics. Taking heart rate as an example, the heart rate range of normal children in a quiet state may be preset at 60 beats / minute-100 beats / minute. If the extracted user heart rate characteristics exceed this range, such as the heart rate reaches 120 beats / minute and lasts for a period of time (such as 10 minutes), it may indicate that the user is in a state of tension, exercise or physical discomfort. For body temperature, the normal human body temperature range is preset at 36℃-37.2℃. When the body temperature exceeds this range, such as the body temperature reaches 37.5℃, it may indicate that the user has fever symptoms. Skin electrical response also has corresponding thresholds. Based on a large amount of experimental data and clinical experience, the skin electrical response value range under normal conditions is set. When the measured skin electrical response characteristics exceed this range, it means that the user may be in a state of emotional stress.
[0103] The preset environment image brightness is set according to the normal lighting conditions of different scenes. For example, under normal outdoor lighting conditions during the day, the average brightness value of the preset image may be 150-200 (grayscale value range 0-255). When the actual brightness value in the extracted environment image feature is lower than 150, it may mean that the ambient light is dark, such as on a cloudy day or in an area with insufficient indoor light; if the actual brightness value is higher than 200, it may mean that the ambient light is too strong, such as outdoors under direct sunlight. Through this brightness comparison, it is possible to determine whether the lighting conditions of the current environment are appropriate and whether it may affect children's visual perception and activities.
[0104] Based on the comparison results of the above characteristics and the threshold, the activity status characteristics of the electronic device user in the current environment are determined. If the sound characteristics exceed the threshold range, and the temperature characteristics show high temperature, and the user's physiological characteristics show high heart rate and abnormal skin electrical response, combined with the hot outdoor scene that may be shown in the environmental image characteristics, it can be judged that the user may be in an uncomfortable and irritable activity state. If the sound characteristics, temperature characteristics, and user physiological characteristics are all within the normal range, and the environmental image characteristics show a quiet and comfortable indoor scene, then it can be determined that the user is in a relatively calm and suitable state for activities. The activity status characteristics derived from these comprehensive judgments are used as the current environmental data feature information.
[0105] Step S204, capture the data feature record in the current environment data feature information, detect whether there is a corresponding matching request in the connection terminal specified item based on the data feature record, and when there is a corresponding matching request, convert the corresponding matching request into a corresponding matching instruction. For details, please refer toFigure 1 Step S103 of the illustrated embodiment will not be elaborated here.
[0106] Step S205: After matching the instruction, the electronic device positioning information, and the current operating status data of the electronic device, send them to the connection terminal so that the connection terminal can perform information intervention on the electronic device. For details, please refer to Figure 1 Step S104 of the illustrated embodiment will not be elaborated here.
[0107] For the autism children travel safety intervention method provided in this embodiment, after the electronic device receives a connection request from the connection terminal, it will detect whether the current account of the connection terminal is the target account based on the connection request. Only when the current account of the connection terminal is the target account will the electronic device connect to the connection terminal based on the connection request. This mechanism effectively prevents unauthorized devices or personnel from connecting to the electronic device, avoids the risk of leakage of information related to autism children, and ensures the information security of the entire safety intervention system. In addition to the original environmental image information processing, current environmental sound information, temperature information, and user physiological information are incorporated and input into the corresponding preset content recognition models, greatly enriching the perception dimension of the environment. Sound information can reflect whether there are dangerous traffic noises, warning sounds, etc. around; temperature information can judge whether the environment where the child is located is comfortable or there is an extreme temperature risk; user physiological information (such as heart rate, body temperature, etc.) can directly understand the child's physical state. By integrating these multi-dimensional information, the system can more comprehensively and stereoscopically perceive the environmental conditions of autism children, providing more sufficient data support for subsequent safety interventions.
[0108] In this embodiment, a method for intervening in the travel safety of autistic children is provided, which can be used in electronic devices such as smart bracelets and smart watches. Figure 3 is a flowchart of the method for intervening in the travel safety of autistic children according to an embodiment of the present invention, as Figure 3 shown, and this process includes the following steps:
[0109] Step S301: After successfully connecting to the connection terminal, obtain the current environmental information, electronic device positioning information, and electronic device operating status data of the electronic device, and obtain a feature recognition result corresponding to the current environmental information of the electronic device based on the current environmental information of the electronic device and the preset content recognition model. For details, please refer to Figure 2 Step S202 of the illustrated embodiment will not be elaborated here.
[0110] Step S302: Obtain the current environmental feature information based on the feature recognition result and the preset recognition result threshold. For details, please refer to Figure 2 Step S203 of the illustrated embodiment will not be elaborated here.
[0111] Step S303: Capture the data feature records in the current environmental data features, detect whether there is a corresponding matching request in the specified items of the connected terminal based on the data feature records, and when there is a corresponding matching request, convert the corresponding matching request into a corresponding matching instruction.
[0112] Specifically, the above Step S303 includes:
[0113] Step S3031: Select the specified items of the connected terminal through a preset input box. The specified items of the connected terminal include multiple matching options.
[0114] Specifically, obtain the specified items of the connected terminal in the data features, detect whether there is a corresponding matching request for the specified items of the connected terminal, that is, display the multiple corresponding matching options and the input box in the specified items of the connected terminal in the data feature records, obtain the data feature information input in the input box, and obtain the matching option specified by the connected terminal among the multiple matching options.
[0115] Furthermore, on the user interface of the connected terminal, there is a preset input box designed. Its appearance usually presents in the form of a rectangular box, and there may be prompt text around it to inform the user that specific specified items of the connected terminal can be selected here. This input box has an interactive function. When the user clicks on the input box, a drop-down menu or a list area will pop up, which lists multiple matching options. These matching options are displayed in clear and easy-to-read text form, such as "Dangerous sound matching", "High-temperature environment matching", "Abnormal heart rate matching", etc. Each option corresponds to a specific environmental or user status feature. The user can select one or more data feature types to be matched as expected from these options by clicking the mouse or touching the screen. Each matching option has specific data feature conditions preset corresponding to it in the system. Taking "Dangerous sound matching" as an example, the system will define a series of characteristic parameters of dangerous sounds, such as a specific sound frequency range (for example, the frequency range of the alarm sound is between 2 kHz - 5 kHz), a sound intensity threshold (such as higher than 80 dB), and a duration requirement (such as lasting for more than 5 seconds). These characteristic parameters are set based on the research of dangerous sounds and the experience of actual application scenarios.
[0116] Step S3032: Match the multiple matching options of the specified items of the connected terminal in the data feature records. If the match is successful, it is determined that there is a corresponding matching request; otherwise, it is determined that there is a corresponding matching request.
[0117] Specifically, once the user selects the matching option, the connection terminal will send this selection information to the data processing module. The data processing module then performs a matching operation in the stored data feature records. The data feature records are a set of data stored after processing the acquired environmental information, user physiological information, etc. during the operation of the electronic device. For example, after the environmental sound information is processed by the sound recognition model, the obtained data such as sound type, frequency, and intensity will be recorded in the data feature records; the environmental temperature data and user physiological information (such as heart rate and body temperature) are also recorded. When performing the matching, for the "dangerous sound matching" option, the data processing module will traverse the sound data feature records to find out if there is a data segment that meets the preset dangerous sound feature parameters. It will check if the sound frequency is within the range of 2 kHz - 5 kHz, if the sound intensity is higher than 80 dB, and if the duration exceeds 5 seconds. If such a data segment is found, it is considered that the matching option is successfully matched. For the "high-temperature environment matching", it will check in the temperature data feature records if there is a data record with a temperature value higher than 28 °C. If so, this option is successfully matched.
[0118] If there is a corresponding matching request for the specified item of the connection terminal, determine each data feature in the matching request, convert the matching request into matching instructions for each data feature, and send the matching voice information corresponding to the matching instructions to the output interface of the connection terminal.
[0119] Step S304: After the matching instructions, the electronic device positioning information, and the current operating state data of the electronic device are sent to the connection terminal, so that the connection terminal can perform information intervention on the electronic device.
[0120] Specifically, after receiving each matching instruction and matching voice information, return the data feature record that captures the current environmental data feature information. In the data feature record, fill in the positioning information carrying the matching instruction and the current operating state data of the electronic device, and complete the information transmission to the connection terminal, realizing the information intervention of the connection terminal on the electronic device. This technical solution can not only monitor the pulse condition and enhance the monitoring intensity of the bracelet, but also comprehensively monitor the human health condition. At the same time, it can obtain and generate the user's current environmental information, compare the recognition result with the preset recognition result range, compare the actual brightness of the current environmental recognition result with the preset brightness, and output the image set captured by the camera module according to the comparison result, so that the connection terminal can know the user's current mental state, facilitate remotely receiving each matching instruction and matching voice information to achieve the effect of remotely soothing the user's emotions, realize the rapid exercise of the user's independence, and facilitate the user's rapid growth.
[0121] The autism children's travel safety intervention method provided in this embodiment matches multiple matching options for the specified items of the connection terminal during data feature recording. This mechanism can ensure the accurate screening of eligible data. When the system performs matching among a large number of data feature records, it can accurately find the corresponding information according to the preset matching options. The specified items of the connection terminal include multiple matching options, which provides great flexibility for information interaction. Different application scenarios or user requirements may require attention to different data features. By setting multiple matching options, users can make customized selections according to the actual situation.
[0122] As one or more specific application embodiments of the embodiment of the present invention, in combination with Figure 5 the autism children's travel safety intervention method provided by the present invention is further described in detail. As Figure 5 shown, the specific process is as follows:
[0123] S501: Receive the connection request sent by the connection terminal. The connection request carries the request to obtain the current environmental information, positioning information, and operating status data of the electronic device;
[0124] Among them, obtaining the current environmental information of the electronic device includes:
[0125] Receive the connection request sent by the connection terminal through the preset network. The connection request is used to request to establish a connection with the electronic device;
[0126] Detect whether the current account of the connection terminal is the target account;
[0127] If the current account of the connection terminal is the target account, connect to the connection terminal according to the connection request. After the connection is completed, obtain the current environmental information of the electronic device.
[0128] S502: Obtain the current environmental information of the electronic device, input the current environmental information of the electronic device into the preset content recognition model, and obtain the recognition result output by the content recognition model based on the current environmental information of the electronic device;
[0129] Among them, obtaining the current environmental information of the electronic device and inputting the current environmental information of the electronic device into the preset content recognition model includes:
[0130] Obtain multiple content recognition models and sort the multiple content recognition models in sequence;
[0131] Obtain the current environmental information of the electronic device, perform image processing on the environmental information to obtain a two-dimensional image set, extract the contour nodes in the two-dimensional image set, calculate the proportional distances of all contour nodes, and obtain the overall image proportional distance set;
[0132] Obtain the three-dimensional coordinates of each contour node according to the overall image ratio distance set, map the three-dimensional coordinates to the three-dimensional module to obtain the three-dimensional model of the current environment, and then input the three-dimensional model of the current environment into the content recognition model ranked first.
[0133] Similarly, obtain the voice recognition result, temperature recognition result, and user physiological recognition result based on the voice content recognition model, temperature recognition model, and user physiological feature recognition model.
[0134] S503: Compare the recognition result with the preset recognition result range, compare the actual brightness of the current environmental recognition result with the preset brightness, and output the image set captured by the camera module according to the comparison result to obtain the current environmental data feature information;
[0135] Among them, comparing the recognition result with the preset recognition result range and comparing the actual brightness of the current environmental recognition result with the preset brightness includes:
[0136] Obtain the feature information recognized by the content recognition model based on the three-dimensional model of the current environment, including environmental image features, voice features, temperature features, and user physiological features;
[0137] Compare the recognized image features, voice features, temperature features, user physiological features, as well as the actual brightness of the current environmental recognition result with the preset brightness to obtain the activity state features of the user in the current environment, and use the activity state features of the user in the current environment as the current environmental data feature information.
[0138] S504: Grab the data features of the current environmental data feature information, obtain the connection terminal specified item in the data features, detect whether there is a corresponding matching request for the connection terminal specified item. If there is a corresponding matching request for the connection terminal specified item, determine the data features in the matching request, convert the matching request into a matching instruction for each data feature, and send the matching instruction and matching voice information to the output interface;
[0139] Among them, obtaining the connection terminal specified item in the data features and detecting whether there is a corresponding matching request for the connection terminal specified item includes:
[0140] Display multiple matching options and input boxes corresponding to the connection terminal specified item in the data features;
[0141] Obtain the data feature information input by the input control of the input box, and obtain the matching option specified by the connection terminal among the multiple matching options.
[0142] S505: After receiving each matching instruction and matching voice information, return the data feature record of the captured current environment data features. In the data feature record, fill in the positioning information carrying the matching instruction and the current operating state data of the electronic device, and complete the information transmission to the connected terminal to enable the connected terminal to perform information intervention on the electronic device.
[0143] In S505 of this embodiment, in the data feature record, fill in the positioning information carrying the matching instruction and the current operating state data of the electronic device, and complete the information transmission to the connected terminal to enable the connected terminal to perform information intervention on the electronic device, including:
[0144] Obtain the activity state feature comparison result information of the user in the current environment, and obtain the data feature record with obvious fluctuations in the user data features in the specified item of the connected terminal in the data features;
[0145] Filter out the data feature records with obvious fluctuations in the user data features, and establish a matching instruction in the data feature records with obvious fluctuations in the user data features to supplement the positioning information and the current operating state data of the electronic device;
[0146] After the supplement is completed, send it to the connected terminal. After the connected terminal checks it, send real-time voice or edit instruction information to the electronic device to complete the intervention.
[0147] The autism children travel safety intervention method provided in this embodiment can not only monitor the pulse condition, enhancing the monitoring intensity of the electronic device; it can comprehensively monitor the human health condition, and at the same time can obtain and generate the current environment information of the user, compare the recognition result with the preset recognition result range, compare the actual brightness of the current environment recognition result with the preset brightness, and output the image set captured by the camera module according to the comparison result, so as to facilitate the connected terminal to know the current mental state of the user, perform long-term monitoring and information intervention on the wearer of the electronic device, facilitate remotely receiving each matching instruction and matching voice information, so as to achieve the effect of remotely calming the user's emotions, realize rapid exercise of the user's independence, and facilitate the user to grow rapidly.
[0148] In this embodiment, there is also provided an autism children travel safety intervention system, as Figure 6 shown, the system includes:
[0149] An electronic device for executing the above Figures 1 to 4 and Figure 5 shown autism children travel safety intervention method.
[0150] An MCU control unit, connected to the electronic device, controls the electronic device to execute the above Figures 1 to 4 and Figure 5The travel safety intervention methods for children with autism are shown.
[0151] In an optional embodiment, the electronic device includes a charging unit, and the charging unit is used to charge the electronic device by solar energy, that is, to achieve the completion of the system power recharge in an emergency state, such as Figure 7 As shown, the charging unit includes: a photovoltaic panel, which is used for users to recharge the system's electric energy in an outdoor emergency state; a micro inverter, which is used to convert the energy received by the photovoltaic panel into electric energy; a power module, which is used to store the electric energy converted by the micro inverter; a voltage stabilizing module, which is used to perform constant voltage processing on the electric energy output obtained by the power module, and transmit it to the system after constant voltage processing, complete the system restart or continuous operation, and realize various functions such as danger warning, anti-loss positioning and emergency rescue, increase the safety of the wearer, and can effectively reduce the occurrence of accidental hazards.
[0152] like Figure 6 As shown, the travel safety intervention system for children with autism also includes:
[0153] The voice unit is used to realize voice interaction between the user and the connected terminal.
[0154] Interaction unit, used to realize the interaction between users and AI devices.
[0155] The projection unit is used to realize entertainment output between the user and the system. The user can control the projection to the outside to watch the animation for the user's own enjoyment.
[0156] The positioning unit is used to enable the connection terminal to determine the user's position. After the positioning unit completes the positioning determination, it sends it to the connection terminal.
[0157] The monitoring unit is used to collect and monitor the user's physiological characteristic data and feed it back to the connection terminal for query and conclusion output.
[0158] The recording unit is used to record, acquire and analyze the user's current environment information and data features.
[0159] The MCU control unit is also used to process and feedback the model sent and received by the system, and send it to each unit for signal processing and execution.
[0160] The autism children's travel safety intervention system provided by the embodiments of the present invention can realize multiple functions such as danger prompt, anti-loss positioning, and emergency call for help, improve the safety of the wearer, effectively reduce the occurrence of accidental hazards, ensure the personal safety of the wearer, and at the same time set up the system energy charging, interaction and projection entertainment functions in an emergency state, which can enable the user to carry out self-entertainment and AI interaction activities in a separate environment, facilitate distracting the user's attention, thereby enhancing the user's psychological construction and having a good effect on alleviating and curing autism.
[0161] In this embodiment, a wearable device is also provided, such as Figure 8 and Figure 9 shown, the wearable device is the above-mentioned electronic device, and the wearable device is used to execute the above Figures 1 to 3 and Figure 5 shown autism children's travel safety intervention method; the wearable device includes: a bracelet body 1, and a video recording module 2, a microphone 3, a receiver 4, an ambient light sensor 5, a distance sensor 6, an infrared camera 7, a solar panel 8, a collection element 9 and an adjustment button 10 provided on the bracelet body.
[0162] The wearable device provided in this embodiment realizes the positioning, identification and intervention of the travel safety of autism children. The bracelet body 1 can not only monitor the pulse condition, enhancing the monitoring intensity of the bracelet, but also comprehensively monitor the human health condition, and at the same time can obtain and generate the current environmental information of the user, compare the recognition result with the preset recognition result range, compare the actual brightness of the current environmental recognition result with the preset brightness, and output the image set taken by the camera module according to the comparison result, so as to facilitate the connection terminal to know the current mental state of the user, facilitate receiving various matching instructions and matching voice information remotely, so as to achieve the effect of remotely soothing the user's emotions. In addition, it can realize multiple functions such as danger prompt, anti-loss positioning, and emergency call for help, improve the safety of the wearer, effectively reduce the occurrence of accidental hazards, ensure the personal safety of the wearer, and at the same time set up the system energy charging, interaction and projection entertainment functions in an emergency state, which can enable the user to carry out self-entertainment and AI interaction activities in a separate environment, facilitate distracting the user's attention, thereby enhancing the user's psychological construction and having a good effect on alleviating and curing autism.
[0163] It should be noted that the entire operation process of the autism children's travel safety intervention can be controlled by a computer, plus a PLC, etc., to achieve automatic operation control. And in each operation link, sensors can be set to perform signal feedback to realize the sequential progress of the steps. These are all common knowledge of current automatic control and will not be elaborated one by one in this embodiment.
[0164] In this embodiment, a travel safety intervention device for autistic children is further provided. This device is used to implement the above-mentioned embodiments and preferred implementation manners, and those that have been described will not be repeated. As used hereinafter, the term "module" can be a combination of software and / or hardware that realizes a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware is also possible and contemplated.
[0165] This embodiment provides a travel safety intervention device for autistic children, which is applied to an electronic device, such as Figure 10 shown, including:
[0166] A feature recognition module 1001, configured to obtain the current environment information, location information, and operation status data of the electronic device after successfully connecting to a connection terminal, and obtain a feature recognition result corresponding to the current environment information of the electronic device based on the current environment information of the electronic device and a preset content recognition model.
[0167] A current environment feature information determination module 1002, configured to obtain current environment feature information based on the feature recognition result and a preset recognition result threshold.
[0168] A matching instruction generation module 1003, configured to capture data feature records in the current environment data feature information, detect whether there is a corresponding matching request in the specified items of the connection terminal based on the data feature records, and convert the corresponding matching request into a corresponding matching instruction when there is a corresponding matching request.
[0169] An information intervention module 1004, configured to send the matching instruction, the location information of the electronic device, and the current operation status data of the electronic device to the connection terminal, so that the connection terminal performs information intervention on the electronic device.
[0170] In some alternative implementation manners, the current environment information includes current environment image information, current environment sound information, temperature information, and user physiological information. The feature recognition module 1001 includes:
[0171] An image information recognition unit, configured to perform image processing on the current environment image information to obtain a two-dimensional image set, extract contour nodes in the two-dimensional image set, calculate the proportional distances of all contour nodes to obtain an overall image proportional distance set; obtain the three-dimensional coordinates of each contour node based on the overall image proportional distance set, map the three-dimensional coordinates to a three-dimensional module to obtain a current environment three-dimensional model, and then input the current environment three-dimensional model into a preset content recognition model to obtain an image recognition result corresponding to the current environment information of the electronic device.
[0172] A sound, temperature, and physiological information recognition unit for inputting the current ambient sound information, temperature information, and user physiological information into corresponding preset content recognition models to obtain a sound recognition result, a temperature recognition result, and a user physiological recognition result corresponding to the current ambient information of the electronic device, respectively.
[0173] In some alternative embodiments, the current ambient feature information determination module 1002 includes:
[0174] A feature extraction unit for extracting current ambient features from the image recognition result, sound recognition result, temperature recognition result, and user physiological recognition result respectively. The current ambient features include ambient image features, sound features, temperature features, and user physiological features.
[0175] A feature comparison unit for comparing the sound features, temperature features, and user physiological features with corresponding preset recognition result thresholds respectively, and at the same time comparing the actual brightness of the ambient image features with the preset brightness to obtain the activity state features of the user of the electronic device in the current environment, and taking the activity state features in the current environment as the current ambient data feature information.
[0176] In some alternative embodiments, the matching instruction generation module 1003 includes:
[0177] A connection terminal specified item input unit for selecting a connection terminal specified item through a preset input box. The connection terminal specified item includes multiple matching options.
[0178] A matching request judgment unit for matching multiple matching options of the connection terminal specified item in the data feature record. If the match is successful, it is determined that there is a corresponding matching request; otherwise, it is determined that there is a corresponding matching request.
[0179] In some alternative embodiments, the autism child travel safety intervention device further includes:
[0180] A connection module for receiving a connection request sent by a connection terminal through a preset network. The connection request is used to request to establish a connection with the electronic device and carries a request to obtain the current ambient information, location information, and operating status data of the electronic device; based on the connection request, it detects whether the current account of the connection terminal is a target account. If the current account of the connection terminal is a target account, it connects to the connection terminal based on the connection request.
[0181] The further function descriptions of the above-mentioned various modules and units are the same as those in the corresponding above embodiments and will not be elaborated here.
[0182] The autism children travel safety intervention device in this embodiment is presented in the form of functional units. Here, the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and a memory that execute one or more software or fixed programs, and / or other devices that can provide the above functions.
[0183] The embodiment of the present invention further provides a computer device having the above Figure 10 autism children travel safety intervention device shown.
[0184] Please refer to Figure 11 , Figure 11 which is a schematic structural diagram of a computer device provided by an optional embodiment of the present invention. As Figure 11 shown, the computer device includes: one or more processors 50, a memory 20, and interfaces for connecting various components, including a high-speed interface and a low-speed interface. Each component communicates with each other using different buses and can be installed on a common motherboard or installed in other ways as needed. The processor can process instructions executed within the computer device, including instructions stored in the memory or on the memory to display graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (such as an array of servers, a set of blade servers, or a multi-processor system). Figure 11 In
[0185] FIG. 4, a processor 50 is taken as an example.
[0186] The memory 20 stores instructions executable by at least one processor 50, so that the at least one processor 50 executes the method shown in the above embodiment.
[0187] The memory 20 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system and application programs required for at least one function; the data storage area may store data created according to the use of the computer device and the like. In addition, the memory 20 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some alternative embodiments, the memory 20 may optionally include a memory remotely provided with respect to the processor 50, and these remote memories may be connected to the computer device through a network. Examples of the above-mentioned network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0188] The memory 20 may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as flash memory, a hard disk, or a solid-state drive; the memory 20 may further include a combination of the above types of memory.
[0189] The computer device further includes an input device 30 and an output device 40. The processor 50, the memory 20, the input device 30, and the output device 40 may be connected through a bus or other means. Figure 11 Taking connection through a bus as an example.
[0190] The input device 30 may receive input digital or character information, and generate key signal inputs related to the user settings and function control of the computer device, such as a touch screen, a keypad, a mouse, a trackpad, a touchpad, a pointing stick, one or more mouse buttons, a trackball, a joystick, etc. The output device 40 may include a display device, an auxiliary lighting device (such as an LED), and a haptic feedback device (such as a vibration motor), etc. The above-mentioned display device includes but is not limited to a liquid crystal display, a light-emitting diode, a display, and a plasma display. In some alternative embodiments, the display device may be a touch screen.
[0191] Embodiments of the present invention also provide a computer-readable storage medium. The method according to the embodiments of the present invention can be implemented in hardware, firmware, or be implemented as computer code that can be recorded on a storage medium, or be implemented as computer code that is originally stored in a remote storage medium or a non-transitory machine-readable storage medium and downloaded through a network and will be stored in a local storage medium, so that the method described herein can be stored as such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, a flash memory, a hard disk, or a solid-state drive, etc.; further, the storage medium can also include a combination of the above-mentioned types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by the computer, the processor, or the hardware, the method shown in the above embodiments is implemented.
[0192] A part of the present invention can be applied as a computer program product, for example, computer program instructions. When executed by a computer, through the operation of the computer, the method and / or technical solution according to the present invention can be called or provided. Those skilled in the art should be able to understand that the forms of existence of computer program instructions in a computer-readable medium include, but are not limited to, source files, executable files, installation package files, etc. Correspondingly, the ways in which computer program instructions are executed by a computer include, but are not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Herein, the computer-readable medium can be any available computer-readable storage medium or communication medium accessible by the computer.
[0193] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations all fall within the scope defined by the appended claims.
Claims
1. A method for intervening in the travel safety of autistic children, characterized in that, Applied to an electronic device, the method includes: After successfully connecting to a connection terminal, obtain the current environment information, location information, and operating status data of the electronic device, and obtain a feature recognition result corresponding to the current environment information of the electronic device based on the current environment information of the electronic device and a preset content recognition model; Obtain the current environment feature information based on the feature recognition result and a preset recognition result threshold; Grab the data feature record in the current environment data feature information, and based on the data feature record, detect whether there is a corresponding matching request in the specified item of the connection terminal. When there is a corresponding matching request, convert the corresponding matching request into a corresponding matching instruction; Send the matching instruction, the location information of the electronic device, and the current operating status data of the electronic device to the connection terminal, so that the connection terminal can perform information intervention on the electronic device.
2. The method according to claim 1, wherein The method further includes: The electronic device is connected to the connection terminal in the following manner: Receive a connection request sent by the connection terminal through a preset network. The connection request is used to request to establish a connection with the electronic device and carries a request to obtain the current environment information, location information, and operating status data of the electronic device; Based on the connection request, detect whether the current account of the connection terminal is a target account. If the current account of the connection terminal is a target account, connect to the connection terminal based on the connection request.
3. The method according to claim 1, wherein The current environment information includes current environment image information; Obtaining a recognition result corresponding to the current environment information of the electronic device based on the current environment information of the electronic device and a preset content recognition model includes: Perform image processing on the current environment image information to obtain a two-dimensional image set, extract the contour nodes in the two-dimensional image set, calculate the proportional distances of all the contour nodes, and obtain an overall image proportional distance set; Obtain the three-dimensional coordinates of each contour node based on the overall image proportional distance set, map the three-dimensional coordinates to a three-dimensional module to obtain a current environment three-dimensional model, and then input the current environment three-dimensional model into the preset content recognition model to obtain an image recognition result corresponding to the current environment information of the electronic device.
4. The method according to claim 3, wherein The current environment information further includes current environment sound information, temperature information, and user physiological information. Obtaining a recognition result corresponding to the current environment information of the electronic device based on the current environment information of the electronic device and a preset content recognition model further includes: Input the current environment sound information, temperature information, and user physiological information into the corresponding preset content recognition models respectively to obtain a sound recognition result, a temperature recognition result, and a user physiological recognition result corresponding to the current environment information of the electronic device.
5. The method according to claim 4, wherein The obtaining the current environment data feature information based on the recognition result and a preset recognition result threshold includes: Extract the current environment features from the image recognition result, the sound recognition result, the temperature recognition result, and the user physiological recognition result respectively. The current environment features include environment image features, sound features, temperature features, and user physiological features; Compare the sound feature, temperature feature, and user physiological feature with their corresponding preset recognition result thresholds respectively, and at the same time compare the actual brightness of the environmental image feature with the preset brightness to obtain the activity state feature of the electronic device user in the current environment, and use the activity state feature in the current environment as the current environmental data feature information.
6. The method according to claim 1, characterized in that, The detecting whether there is a corresponding matching request in the specified item of the connection terminal based on the data feature record includes: Select the specified item of the connection terminal through a preset input box, and the specified item of the connection terminal includes multiple matching options; Match the multiple matching options of the specified item of the connection terminal in the data feature record. If the match is successful, it is determined that there is a corresponding matching request; otherwise, it is determined that there is a corresponding matching request.
7. An autism children travel safety intervention system, characterized in that, The system includes: An electronic device for executing the autism children travel safety intervention method according to any one of claims 1 to 6; An MCU control unit connected to the electronic device, and the MCU control unit is used to control the electronic device to execute the autism children travel safety intervention method according to any one of claims 1 to 6.
8. The system according to claim 7, wherein The electronic device includes a charging unit, and the charging unit is used to perform solar charging for the electronic device.
9. An intervention device for the travel safety of autistic children, characterized in that, Applied to an electronic device, the device includes: A feature recognition module, which is used to obtain the current environmental information, electronic device positioning information, and electronic device operation state data of the electronic device after successfully connecting to the connection terminal, and obtain the feature recognition result corresponding to the current environmental information of the electronic device based on the current environmental information of the electronic device and a preset content recognition model; A current environmental feature information determination module, which is used to obtain the current environmental feature information based on the feature recognition result and a preset recognition result threshold; A matching instruction generation module, which is used to capture the data feature record in the current environmental data feature information, detect whether there is a corresponding matching request in the specified item of the connection terminal based on the data feature record, and when there is a corresponding matching request, convert the corresponding matching request into a corresponding matching instruction; An information intervention module, which is used to send the matching instruction, electronic device positioning information, and electronic device current operation state data to the connection terminal, so that the connection terminal performs information intervention on the electronic device.
10. A wearable device, characterized in that, The wearable device is the electronic device described in claim 1, and the wearable device is used to execute the autism children travel safety intervention method according to any one of claims 1 to 6; the wearable device includes: a bracelet body, and a video recording module, a microphone, a receiver, an ambient light sensor, a distance sensor, an infrared camera, a solar panel, a collection element, and an adjustment button provided on the bracelet body.