Cooling method and device of wearable equipment, equipment and storage medium

Abstract

The invention discloses a cooling method and device of wearable equipment, equipment and a storage medium, and discloses the cooling method of the wearable equipment. Determining a surrounding environment state of an environment where the wearable device is located according to at least one of audio data acquired by an audio acquisition device and an environment image acquired by an image acquisition device; determining a cooling strategy of the wearable device according to the surrounding environment state; and cooling the wearable device according to the cooling strategy. Through the above mode, the surrounding environment state of the wearable device is identified in combination with one or more of the audio data and the environment image, adaptive adjustment is performed on the cooling strategy of the wearable device based on the surrounding environment state, the whole machine temperature is reduced, interference to a user is reduced as much as possible, and the user experience is improved. Therefore, equipment cooling is carried out under the condition that a user is non-inductive, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the technical field of wearable devices, and in particular to a cooling method, device, equipment and storage medium for wearable devices. Background Art

[0002] Wearable devices are currently in a stage of rapid development, such as XR (Extended Reality) devices, and various XR device products are emerging in an endless stream. Due to the increase in cameras and the powerful running software, the entire device will heat up very seriously under heavy load, which will have a certain impact on human perception. The current cooling solution for XR devices is to use the fans equipped with them, but when cooling through fans, it will generate a lot of noise, affecting the user experience.

[0003] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0004] The main purpose of this application is to provide a cooling method, device, equipment and storage medium for a wearable device, aiming to solve the technical problem of how to reduce interference to users and improve user experience while cooling the wearable device.

[0005] To achieve the above object, the present application proposes a cooling method for a wearable device, the method comprising: When the detected temperature of the wearable device is greater than the cooling temperature threshold, determining the surrounding environment state of the environment in which the wearable device is located according to at least one of the audio data collected by the audio collection device and the environment image collected by the image collection device; Determining a cooling strategy for the wearable device according to the surrounding environment state; The wearable device is cooled according to the cooling strategy.

[0006] In one embodiment, the step of determining the surrounding environment state of the environment in which the wearable device is located according to at least one of the audio data collected by the audio collection device and the environment image collected by the image collection device includes: Determining a first environmental state of the environment in which the wearable device is located according to audio data collected by an audio collection device; When the first environmental state is a first preset state, determining a second environmental state of the environment in which the wearable device is located according to the environmental image captured by the image acquisition device; When the second environmental state is a second preset state, the surrounding environmental state is determined to be a first target state.

[0007] In one embodiment, the step of determining the first environmental state of the environment in which the wearable device is located according to the audio data collected by the audio collection device includes: Performing decibel calculation based on the audio data collected by the audio collection device to determine the overall environmental decibel of the environment in which the wearable device is located; Performing sound source localization on the audio data to determine a sound source localization result of the audio data; Performing sound source separation on the audio data according to the sound source localization result to determine the number of sound sources present in the audio data; An environmental assessment is performed according to the overall environmental decibels and the number of sound sources to determine a first environmental state of the environment in which the wearable device is located.

[0008] In one embodiment, the step of determining the second environmental state of the environment in which the wearable device is located according to the environmental image captured by the image acquisition device includes: Analyzing the environment image captured by the image acquisition device to determine the objects existing in the environment image; Matching the sound source in the audio data with the object in the environment image to determine a sound source matching result; When there is a preset result in the sound source matching result, it is determined that the second environmental state of the environment in which the wearable device is located is a second preset state.

[0009] In one embodiment, the step of determining the surrounding environment state of the environment in which the wearable device is located according to at least one of the audio data collected by the audio collection device and the environment image collected by the image collection device includes: Determining a first environmental state of the environment in which the wearable device is located according to audio data collected by an audio collection device; When the first environmental state is not a first preset state, the surrounding environmental state is determined to be a second target state.

[0010] In one embodiment, the step of cooling the wearable device according to the cooling strategy includes: When the cooling strategy is the first cooling strategy, determining a target control parameter of the cooling component according to the first cooling strategy, and controlling the cooling component to operate according to the target control parameter; When the cooling strategy is the second cooling strategy, the target operating frequency is determined according to the second cooling strategy, and the current operating frequency is adjusted to the target operating frequency for cooling operation.

[0011] In one embodiment, before the step of determining the surrounding environment state of the environment in which the wearable device is located according to at least one of the audio data collected by the audio collection device and the environment image collected by the image collection device when the detected temperature of the wearable device is greater than the cooling temperature threshold, it also includes: Obtain the current temperature corresponding to multiple detection locations in the wearable device in real time; When there is at least one detection location corresponding to a current temperature greater than a cooling temperature threshold, determining an average temperature corresponding to the detection location within a target time period; When the temperature average is greater than the cooling temperature threshold, it is determined that the detected temperature of the wearable device is greater than the cooling temperature threshold.

[0012] In addition, to achieve the above-mentioned purpose, the present application also proposes a cooling device for a wearable device, the cooling device for the wearable device comprising: a processing module, for determining the surrounding environment state of the environment in which the wearable device is located according to at least one of the audio data collected by the audio collection device and the environment image collected by the image collection device when the detected temperature of the wearable device is greater than the cooling temperature threshold; The processing module is further used to determine a cooling strategy for the wearable device according to the surrounding environment state; A cooling module is used to cool the wearable device according to the cooling strategy.

[0013] In addition, to achieve the above-mentioned purpose, the present application also proposes a wearable device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the cooling method of the wearable device as described above.

[0014] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by the processor, the steps of the cooling method of the wearable device as described above are implemented.

[0015] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, it implements the steps of the cooling method of the wearable device as described above.

[0016] The present application provides a method for cooling a wearable device. When the detected temperature of the wearable device is greater than a cooling temperature threshold, the present application determines the surrounding environment state of the wearable device according to at least one of the audio data collected by the audio acquisition device and the environmental image collected by the image acquisition device; determines the cooling strategy of the wearable device according to the surrounding environment state; and cools the wearable device according to the cooling strategy. Through the above method, the surrounding environment state of the wearable device is identified by combining one or more of the audio data and the environmental image, and the cooling strategy of the wearable device is adaptively adjusted based on the surrounding environment state. While reducing the temperature of the entire device, the interference to the user is minimized as much as possible, so that the device is cooled without the user noticing, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0018] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0019] Figure 1 A schematic diagram of a flow chart provided for a first embodiment of a cooling method for a wearable device of the present application; Figure 2 A schematic diagram of a flow chart provided for the second embodiment of the cooling method for a wearable device of the present application; Figure 3 A schematic diagram of a flow chart provided for a third embodiment of a cooling method for a wearable device of the present application; Figure 4 A brief flowchart of the third embodiment of the present invention is provided. Figure 5 This is a schematic diagram of the module structure of a cooling device for a wearable device according to an embodiment of the present application; Figure 6 Schematic diagram of the device structure of the hardware operating environment involved in the cooling method of the wearable device in the embodiment of the present application.

[0020] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0021] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0022] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0023] The main solution of the embodiment of the present application is: when the detected temperature of the wearable device is greater than the cooling temperature threshold, the surrounding environment state of the environment in which the wearable device is located is determined according to at least one of the audio data collected by the audio collection device and the environmental image collected by the image collection device; the cooling strategy of the wearable device is determined according to the surrounding environment state; and the wearable device is cooled according to the cooling strategy.

[0024] XR equipment products are currently in a stage of rapid development, and various types of XR equipment products are emerging in an endless stream. Due to the increase in cameras and the powerful running software, the whole device heats up very seriously under heavy load, which has a certain impact on people's perception. At present, many products are equipped with fans for cooling. According to the feedback from the current user market, users expect to reduce the user's perception of fan noise without affecting the user experience, and be able to reduce the temperature of the whole device to achieve a more skin-friendly feeling.

[0025] This application identifies and determines the external environment of the XR smart device, collects the sound of the environment, and matches the collection of the camera. The two collection devices can be used separately or together for application. By judging the external environment, the fan speed is controlled, so that the device can be cooled without the user noticing, giving the user a better user experience.

[0026] This application identifies the surrounding environment status of the wearable device by combining one or more of the audio data and the environmental image, and adaptively adjusts the cooling strategy of the wearable device based on the surrounding environment status. While reducing the temperature of the entire device, it minimizes interference to the user, thereby cooling the device without the user noticing, thereby improving the user experience.

[0027] It should be noted that the execution subject of this embodiment can be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device capable of realizing the above functions, a wearable device, etc. The following takes a wearable device as an example to illustrate this embodiment and the following embodiments.

[0028] Based on this, the present application embodiment provides a cooling method for a wearable device, referring to Figure 1 , Figure 1 This is a flow chart of the first embodiment of the cooling method for a wearable device of the present application.

[0029] In this embodiment, the cooling method of the wearable device includes steps S10 to S30: Step S10, when the detected temperature of the wearable device is greater than the cooling temperature threshold, determining the surrounding environment state of the environment in which the wearable device is located according to at least one of the audio data collected by the audio collection device and the environment image collected by the image collection device.

[0030] It should be noted that the wearable device includes but is not limited to a central processing unit, an image acquisition device, an audio acquisition device, a cooling component, a distance sensor, and multiple NTC (Negative Temperature Coefficient) and other components. The image acquisition device is used to acquire images of the external environment. The image acquisition device can be an integrated camera or other devices, and this embodiment does not limit this. The audio acquisition device is used to acquire audio data in the external environment. The audio acquisition device can be a microphone array, and its arrangement is not limited in this embodiment. The cooling component is used to cool the wearable device. In this embodiment, the cooling component is a fan located inside the wearable device. Multiple NTCs are installed at different locations inside the wearable device to detect temperature changes at different locations.

[0031] In this embodiment, the wearable device may be an XR device such as a VR (Virtual Reality) device, an AR (Augmented Reality) device, or an MR (Mixed Reality) device, or other devices. This embodiment is not limited to this. This embodiment is described by taking the wearable device as a VR device as an example.

[0032] It is understandable that determining that the detected temperature of the wearable device is greater than the cooling temperature threshold can be done in any of the following ways: the real-time temperature corresponding to any detection position of the wearable device is greater than the cooling temperature threshold; or, the real-time temperature corresponding to more than a preset number of detection positions in the wearable device is greater than the cooling temperature threshold; or, the average temperature of any detection position in the wearable device within the target time period is greater than the cooling temperature threshold; or other ways can be used to determine that the detected temperature of the wearable device is greater than the cooling temperature threshold. In this embodiment, the cooling temperature threshold is a pre-set temperature critical value, which can be adjusted according to needs, and this embodiment does not limit this.

[0033] In a specific implementation, the state of the surrounding environment can clearly indicate whether the wearable device is in a noisy environment, and the state of the surrounding environment includes but is not limited to a noisy state and a non-noisy state. When the detected temperature of the wearable device is greater than the cooling temperature threshold, the number of sound sources and the sound decibels in the environment where the wearable device is located can be determined based on the audio data collected by the audio acquisition device; when the number of sound sources reaches a preset number and the sound decibels exceed the preset decibels, it is necessary to further determine whether the wearable device is in a noisy environment in combination with the environmental image collected by the image device. If the wearable device is determined to be outdoors through analysis of the environmental image, or the wearable device is indoors but there are multiple objects other than multimedia devices around it that emit audio, then the state of the surrounding environment is determined to be a noisy state. When any one or more of the following conditions are met: the number of sound sources does not reach a preset number or the sound decibels do not exceed the preset decibels, the state of the surrounding environment is determined to be a non-noisy state. When the number of sound sources reaches a preset number and the sound decibel exceeds a preset decibel, but the wearable device is indoors and only multimedia devices emit audio in the surrounding area, the surrounding environment state is determined to be a non-noisy state; or, when the number of sound sources reaches a preset number and the sound decibel exceeds a preset decibel, but the wearable device is indoors and the number of objects that emit audio in the surrounding environment other than multimedia devices does not exceed a set number, the surrounding environment state is determined to be a non-noisy state; or, when the number of sound sources reaches a preset number and the sound decibel exceeds a preset decibel, but the wearable device is indoors, the surrounding environment state can be determined to be a non-noisy state. The surrounding environment state can also be identified in other ways, which are not limited in this embodiment.

[0034] It should be noted that the distance sensor can be used to detect whether the wearable device is worn correctly by the user. The distance sensor can continuously monitor the distance between the user's body and the device. When the distance between the two reaches the expected range, it is determined that the wearable device is worn correctly by the user. At this time, the wearing detection passes, and the detection temperature of the wearable device is detected to be greater than the cooling temperature threshold. If so, the surrounding environment state of the wearable device is determined based on at least one of the audio data collected by the audio acquisition device and the environmental image collected by the image acquisition device.

[0035] In a feasible implementation manner, before step S10, steps A11 to A13 may be included: Step A11, obtaining the current temperatures corresponding to multiple detection positions in the wearable device in real time.

[0036] It should be noted that the NTC installed in different detection positions in the wearable device can obtain the temperature changes at each detection position respectively, and send the value of the NTC corresponding to each detection position to the central processor in real time through the internal circuit, so as to obtain the current temperature corresponding to each detection position.

[0037] Step A12, when there is at least one detection position corresponding to a current temperature greater than the cooling temperature threshold, determine the average temperature corresponding to the detection position within the target time period.

[0038] It should be noted that when there is a current temperature corresponding to any detection position that is greater than the cooling temperature threshold, the collection time of the current temperature greater than the cooling temperature threshold is determined. The collection time is used as the starting time point of the target time period, and all temperature values ​​of the detection position within the preset time period are collected, and the average is calculated to obtain the temperature average corresponding to the detection position within the target time period. In this embodiment, the target time period refers to when the current temperature corresponding to the detection position is greater than the cooling temperature threshold, the collection time of the current temperature is used as the starting time point of the target time period, and the preset time period is used as the time length of the target time period. In this embodiment, the preset time period can be set according to needs, for example, 1 minute.

[0039] Step A13: When the temperature average is greater than the cooling temperature threshold, determine that the detected temperature of the wearable device is greater than the cooling temperature threshold.

[0040] It should be noted that when the temperature average at the detection position is greater than the cooling temperature threshold, it is determined that the detection temperature of the wearable device is greater than the cooling temperature threshold.

[0041] In this embodiment, in addition to the above method, other methods may be used to determine that the detected temperature of the wearable device is greater than the cooling temperature threshold, which is not limited in this embodiment.

[0042] In a feasible implementation, step S10 may include steps B11-B12: Step B11, determining a first environmental state of the environment in which the wearable device is located according to audio data collected by an audio collection device.

[0043] It should be noted that the first environmental state can clarify whether the wearable device is in an audio-chaotic environment, and the first environmental state includes but is not limited to an audio-noisy state and a non-audio-noisy state. The audio data collected by the audio acquisition device is analyzed to determine the number of sound sources and the sound decibels in the environment where the wearable device is located. When the number of sound sources reaches a preset number and the sound decibels exceed the preset decibels, the first environmental state is determined to be an audio-noisy state; when any one or more of the number of sound sources does not reach a preset number or the sound decibels does not exceed the preset decibels, the first environmental state is determined to be a non-audio-noisy state.

[0044] Step B12: when the first environmental state is not the first preset state, determining the surrounding environmental state to be a second target state.

[0045] It should be noted that the first preset state refers to the audio noisy state. When the first environment state is not the first preset state, it means that the environment where the wearable device is located is not noisy. At this time, the surrounding environment state is determined to be a non-noisy state. In this embodiment, the second target state refers to a non-noisy state.

[0046] Step S20: determining a cooling strategy for the wearable device according to the surrounding environment state.

[0047] It should be noted that different ambient environment states correspond to different cooling strategies. In this embodiment, the cooling strategy includes but is not limited to reducing the operating frequency of the central processing unit, reducing the refresh rate of the display component, and adjusting the control parameters of the cooling component. In this embodiment, the control parameters include but are not limited to the rotation speed of the cooling component and other operating parameters.

[0048] In this embodiment, when the detected temperature of the wearable device is greater than the cooling temperature threshold and the surrounding environment state of the wearable device is in a non-noisy state, the cooling strategy may be determined to reduce the operating frequency of the central processing unit; when the detected temperature of the wearable device is greater than the cooling temperature threshold and the surrounding environment state of the wearable device is in a noisy state, the cooling strategy may be determined to adjust the control parameters of the cooling component.

[0049] Step S30, cooling the wearable device according to the cooling strategy.

[0050] It should be noted that the wearable device is cooled by a cooling strategy. For example, the control parameters of the cooling component are determined by the cooling strategy, and the cooling component is controlled to operate according to the control parameters, so as to achieve the purpose of cooling the wearable device.

[0051] This embodiment provides a method for cooling a wearable device. This embodiment determines the state of the surrounding environment of the wearable device according to at least one of the audio data collected by the audio collection device and the environmental image collected by the image collection device when the detected temperature of the wearable device is greater than the cooling temperature threshold; determines the cooling strategy of the wearable device according to the surrounding environment state; and cools the wearable device according to the cooling strategy. In the above manner, the surrounding environment state of the wearable device is identified by combining one or more of the audio data and the environmental image, and the cooling strategy of the wearable device is adaptively adjusted based on the surrounding environment state. While reducing the temperature of the entire device, the interference to the user is minimized as much as possible, so that the device is cooled without the user noticing, thereby improving the user experience.

[0052] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated in the following. Figure 2, step S10, the cooling method of the wearable device further includes steps S11 to S13: Step S11, when the detected temperature of the wearable device is greater than the cooling temperature threshold, determining a first environmental state of the environment in which the wearable device is located according to audio data collected by an audio collection device.

[0053] It should be noted that the audio data collected by the audio collection device is analyzed to determine the number of sound sources and the sound decibels in the environment where the wearable device is located. When the number of sound sources reaches a preset number and the sound decibels exceed the preset decibels, the first environment state is determined to be an audio noisy state; when any one or more of the number of sound sources does not reach the preset number or the sound decibels does not exceed the preset decibels, the first environment state is determined to be a non-audio noisy state.

[0054] In a feasible implementation manner, step S11 may further include steps C11 to C14: Step C11, performing decibel calculation based on the audio data collected by the audio collection device to determine the overall environmental decibel of the environment in which the wearable device is located.

[0055] It should be noted that the audio data collected by the audio acquisition device is preprocessed, including but not limited to removing background noise, enhancing voice clarity, etc., so as to obtain processed audio data. The processed audio data is converted into a sound pressure level, that is, a value expressed in decibels, which can be determined by calculating the average sound pressure value or the peak sound pressure value over a period of time, thereby obtaining a decibel value representing the overall environmental noise level of the environment in which the wearable device is located. In this embodiment, the overall environmental decibel refers to the decibel value of the overall environmental noise level.

[0056] Step C12: localize the sound source of the audio data to determine the sound source localization result of the audio data.

[0057] It should be noted that the time difference and phase difference of the sounds received by each microphone in the audio acquisition device are used to analyze the sound arrival angle, and beamforming technology is used to focus on the sound in a specific direction and suppress interference from other directions, so as to accurately locate the sound source and create a three-dimensional spatial audio map to mark the position of each detected sound source, thereby generating a sound source localization result containing the position information of all detected sound sources. When no sound source is detected, the sound source localization result indicates that there is no sound source position.

[0058] Step C13: performing sound source separation on the audio data according to the sound source localization result to determine the number of sound sources existing in the audio data.

[0059] It should be noted that, based on the sound source location information provided in the sound source localization result, features related to each sound source are extracted from the audio data, such as frequency range, audio mode, etc. Independent component analysis, non-negative matrix decomposition and other technologies are used to decompose the audio data into separate audio streams that may come from different objects, thereby obtaining the number of sound sources in the audio data and the audio features corresponding to each sound source.

[0060] Step C14: performing an environmental assessment according to the overall environmental decibels and the number of sound sources to determine a first environmental state of the environment in which the wearable device is located.

[0061] It should be noted that when the overall environment decibel exceeds the preset decibel and the number of sound sources reaches the preset number, the first environment state of the wearable device is determined to be an audio noisy state; when the number of sound sources does not reach the preset number or the overall environment decibel does not exceed the preset decibel, the first environment state is determined to be a non-audio noisy state. In this embodiment, the preset decibel is a sound decibel critical value set according to requirements; the preset number is a sound source number critical value set according to requirements.

[0062] Step S12: When the first environmental state is a first preset state, determining a second environmental state of the environment in which the wearable device is located according to the environmental image captured by the image acquisition device.

[0063] It should be noted that the second environmental state can clearly indicate whether the wearable device is in an environment with many objects that can produce sound, which objects do not include multimedia devices such as televisions, radios and other devices. The second environmental state includes but is not limited to an environmental noisy state and a non-environmental noisy state.

[0064] It can be understood that when the first environmental state is an audio noisy state, it means that the first environmental state is a first preset state. At this time, it is necessary to further determine whether the wearable device is in a noisy environment in combination with the environmental image captured by the image device. In this embodiment, the second environmental state can be determined in any of the following ways: 1. If the wearable device is indoors and there is only a multimedia device emitting audio in the surrounding area, the second environmental state is determined to be a non-environmental noisy state; if the wearable device is outdoors, the second environmental state is determined to be an environmental noisy state; if the wearable device is indoors and there are objects other than the multimedia device emitting audio in the surrounding environment, the second environmental state is determined to be an environmental noisy state. 2. If the wearable device is outdoors, the second environmental state is determined to be an environmental noisy state; if the wearable device is indoors and in the surrounding environment, the number of objects emitting audio other than the multimedia device does not exceed the set number, the second environmental state is determined to be a non-environmental noisy state; if the wearable device is indoors and in the surrounding environment, the number of objects emitting audio other than the multimedia device exceeds the set number, the second environmental state is determined to be an environmental noisy state. 3. If the wearable device is outdoors, the second environmental state is determined to be a noisy environmental state; if the wearable device is indoors, the second environmental state is determined to be a non-noisy environmental state.

[0065] In a feasible implementation manner, step S12 may further include steps D11 to D13: Step D11, analyzing the environment image captured by the image acquisition device to determine the objects existing in the environment image.

[0066] It should be noted that the environmental images captured by the image acquisition device are preprocessed, including but not limited to denoising, contrast adjustment and other operations, to obtain processed environmental images; key features are extracted from the processed environmental images, and objects such as people, vehicles, buildings, televisions and trees are detected in combination with deep learning models (such as convolutional neural networks) or other machine learning algorithms.

[0067] Step D12, matching the sound source in the audio data with the object in the environment image to determine a sound source matching result.

[0068] It should be noted that the sound sources existing in the audio data, the sound source positions corresponding to each sound source, and the audio features corresponding to each sound source are obtained, and the object positions of each existing object are determined through the environment image. The three-dimensional coordinates of the sound source positions corresponding to each sound source are converted to a space consistent with the image coordinate system, and a reasonable distance threshold is defined to determine whether the sound source is close enough to a certain existing object in the environment image. If the sound source is within this range, the sound source and the existing object are considered to be a potential matching pair.

[0069] It can be understood that for each potential matching pair, the audio features corresponding to each sound source and the object features of each existing object are analyzed to determine whether the features between the existing object and the sound source are similar. The specific judgment process of feature similarity can be carried out in the following way: deep learning is performed through the audio features of a large number of sound sources and the object features of their corresponding generated objects to obtain a deep learning model, and the audio features and object features of each potential matching pair are input into the trained deep learning model to obtain a matching score for each potential matching pair. The higher the score, the greater the possibility of a match.

[0070] In a specific implementation, for each potential matching pair, if its matching score exceeds a set score threshold, the potential matching pair is determined to be a valid matching pair, thereby obtaining a sound source matching result. In this embodiment, the sound source matching result includes a mapping relationship between each sound source in the audio data and a detection object in the detection image.

[0071] Step D13: When a preset result exists in the sound source matching result, determining that the second environmental state of the environment in which the wearable device is located is a second preset state.

[0072] It should be noted that, in the sound source matching result, if there is a matching pair other than the multimedia device-the multimedia device corresponding sound source, it means that there is a preset result in the sound source matching result, and at this time, the second environmental state of the wearable device is determined to be the second preset state. For example, in the sound source matching result, if there is a matching pair of vehicle-horn, or a matching pair of person-speech related audio, the second environmental state of the environment in which the wearable device is located is determined to be the second preset state.

[0073] Step S13: when the second environmental state is a second preset state, determining that the surrounding environmental state is a first target state.

[0074] It should be noted that when the second environmental state is a noisy state, it means that the second environmental state is a second preset state, that is, the environment in which the wearable device is located is relatively operated, and the surrounding environmental state is determined to be a noisy state. In this embodiment, the first target state refers to a noisy state. When the second environmental state is not the second preset state, the surrounding environmental state is determined to be the second target state.

[0075] This embodiment provides a method for cooling a wearable device. This embodiment determines the first environmental state of the environment in which the wearable device is located according to the audio data collected by the audio collection array; when the first environmental state is the first preset state, the second environmental state of the environment in which the wearable device is located is determined according to the environmental image collected by the image collection device; when the second environmental state is the second preset state, the surrounding environmental state is determined to be the first target state. In the above manner, the surrounding environmental state of the wearable device can be accurately identified, laying the foundation for the selection of subsequent cooling strategies.

[0076] Based on the first embodiment of the present application, in the third embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated in the following. Figure 3 , step S30, the cooling method of the wearable device further includes steps S31-S32: Step S31, when the cooling strategy is the first cooling strategy, determining the target control parameters of the cooling component according to the first cooling strategy, and controlling the cooling component to operate according to the target control parameters.

[0077] It should be noted that the first cooling strategy in this embodiment refers to adjusting the control parameters of the cooling component. When the detected temperature of the wearable device is greater than the cooling temperature threshold and the surrounding environment state of the wearable device is the first target state, the cooling strategy is determined to be the first cooling strategy.

[0078] It is understandable that when the cooling strategy is the first cooling strategy, the target control parameter of the cooling component can be determined. In this embodiment, a temperature-control parameter mapping table can be obtained, and the control parameter corresponding to the detected temperature can be found in the mapping table and used as the target control parameter. The target control parameter can also be determined by other methods, which is not limited in this embodiment.

[0079] In a specific implementation, in the temperature-control parameter mapping table, each temperature corresponds to multiple control parameters of the cooling component. For ease of understanding, Table 1 is used as an example. The values ​​in the table are only examples. The specific values ​​can be set according to needs, and the control parameters may include other relevant operating parameters.

[0080] Table 1

[0081] It should be noted that the cooling component is adjusted from the original closed state to the open state, and the cooling component is controlled to operate according to the target control parameters; or, the control parameters of the cooling component are adjusted to the target control parameters, for example, the speed of the cooling component is adjusted to the speed corresponding to the target control parameters, and the purpose of rapid cooling is achieved by increasing its speed.

[0082] It is understandable that when the detected temperature of the wearable device is less than or equal to the cooling temperature threshold and greater than the second temperature threshold, it means that the temperature has dropped. At this time, the target control parameter of the cooling component can be adjusted to the original parameter so that the cooling component operates according to the state before the rapid cooling. In this embodiment, the second temperature threshold is less than the cooling temperature threshold, and can be set according to needs.

[0083] Step S32, when the cooling strategy is the second cooling strategy, determining the target operating frequency according to the second cooling strategy, and adjusting the current operating frequency to the target operating frequency for cooling operation.

[0084] It should be noted that the second cooling strategy in this embodiment refers to lowering the operating frequency of the central processing unit. When the detected temperature of the wearable device is greater than the cooling temperature threshold and the surrounding environment state of the wearable device is the second target state, the cooling strategy is determined to be the second cooling strategy.

[0085] It is understandable that when the cooling strategy is the second cooling strategy, the target operating frequency of the CPU can be determined. In this embodiment, a temperature-operating frequency mapping table can be obtained, and the temperature-operating frequency mapping table contains the operating frequency of the CPU corresponding to each detected temperature. The operating frequency corresponding to the detected temperature is searched in the mapping table and used as the target operating frequency. The target operating frequency can also be determined by other methods, and this embodiment does not limit this.

[0086] In a specific implementation, the current operating frequency of the CPU is adjusted to the target operating frequency, and the purpose of rapid cooling is achieved by reducing its operating frequency. When the detected temperature of the wearable device is less than or equal to the cooling temperature threshold and greater than the second temperature threshold, it means that the temperature has dropped. At this time, the operating frequency of the CPU can be adjusted to the original operating frequency, so that the CPU operates in the state before the rapid cooling.

[0087] In this embodiment, when the cooling strategy is the second cooling strategy, in addition to reducing the operating frequency of the central processing unit as mentioned above, cooling can also be performed by adjusting the refresh rate of the display component, adjusting the display parameters of the display component (such as screen brightness, light source intensity), reducing the load of the graphics processing unit (such as reducing image rendering quality or resolution), etc. This embodiment does not impose any restrictions on this.

[0088] This embodiment provides a cooling method for a wearable device. When the cooling strategy is the first cooling strategy, the target control parameter of the cooling component is determined according to the first cooling strategy, and the cooling component is controlled to operate according to the target control parameter; when the cooling strategy is the second cooling strategy, the target operating frequency is determined according to the second cooling strategy, and the current operating frequency is adjusted to the target operating frequency for cooling operation. In the above manner, cooling is performed according to different cooling strategies, so that the effect of non-sensing cooling can be achieved, and the user experience can be improved.

[0089] For example, in order to help understand the implementation process of the cooling method of the wearable device obtained by combining the present embodiment with the above-mentioned embodiment 1 / 2, please refer to Figure 4 , Figure 4 A brief flow chart of a cooling method for a wearable device is provided. Specifically, when a user starts and uses an XR smart device product, the wearing detection module inside the product starts working. When it is detected that the user has passed the wearing recognition detection, the device starts normally and works normally according to the user's operation. When the user uses the XR prototype, the camera and screen of the whole machine are in working state, and applications with high power consumption are used. There are multiple NTCs (thermistors) in different positions inside the XR smart device to detect temperature changes at different positions, and the values ​​of the NTCs are given to the central processing unit in real time through the internal circuit. The central processing unit detects temperature changes at different positions. A temperature threshold is built into the software version. When the central processing unit detects that the temperature at a certain place exceeds the standard, it will make a logical judgment, detect the external environment through the microphone, and judge whether the environment is noisy at this time through the return value of the microphone. For example, on a quiet night, the microphone returns a small value. Since the external environment is relatively quiet at this time, if the fan speed is increased to cool down, the user will feel a lot of fan noise. At this time, conventional means such as reducing the frequency of the central processing unit or reducing the refresh rate of the screen can be used to cool down. If it is noisy outside, the microphone returns a large value. At this time, you can turn on the camera to check the external environment and confirm that you are in an outdoor environment. At this time, since the external environment is already noisy, you can increase the fan speed and blow the heat of the XR smart device to the outside of the machine through physical convection to achieve the purpose of cooling the machine. Since the central processing unit detects the internal temperature of the device in real time, after the fan has been working for a period of time, the temperatures inside the machine will drop. When the set threshold is reached, the fan speed can be reduced to save power.

[0090] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the cooling method of the wearable device of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0091] This application also provides a cooling device for a wearable device, please refer to Figure 5 , the cooling device of the wearable device comprises: The processing module 10 is used to determine the surrounding environment state of the wearable device according to at least one of the audio data collected by the audio collection device and the environment image collected by the image collection device when the detected temperature of the wearable device is greater than the cooling temperature threshold.

[0092] The processing module 10 is further configured to determine a cooling strategy for the wearable device according to the surrounding environment state.

[0093] The cooling module 20 is used to cool the wearable device according to the cooling strategy.

[0094] Optionally, the processing module 10 is further used for: Determine a first environmental state of the environment in which the wearable device is located based on audio data collected by an audio collection device; when the first environmental state is a first preset state, determine a second environmental state of the environment in which the wearable device is located based on an environmental image collected by the image collection device; when the second environmental state is a second preset state, determine the surrounding environmental state to be a first target state.

[0095] Optionally, the processing module 10 is further used for: Decibel calculation is performed based on the audio data collected by the audio collection device to determine the overall environmental decibel of the environment in which the wearable device is located; sound source positioning is performed on the audio data to determine the sound source positioning result of the audio data; sound source separation is performed on the audio data based on the sound source positioning result to determine the number of sound sources present in the audio data; and environmental assessment is performed based on the overall environmental decibel and the number of sound sources to determine a first environmental state of the environment in which the wearable device is located.

[0096] Optionally, the processing module 10 is further used for: The environmental image captured by the image acquisition device is analyzed to determine the objects existing in the environmental image; the sound source existing in the audio data is matched with the objects existing in the environmental image to determine the sound source matching result; when a preset result exists in the sound source matching result, it is determined that the second environmental state of the environment in which the wearable device is located is a second preset state.

[0097] Optionally, the processing module 10 is further used for: A first environmental state of the environment in which the wearable device is located is determined according to audio data collected by an audio collection device; when the first environmental state is not a first preset state, the surrounding environmental state is determined to be a second target state.

[0098] Optionally, the cooling module 20 is further used for: When the cooling strategy is the first cooling strategy, the target control parameters of the cooling component are determined according to the first cooling strategy, and the cooling component is controlled to operate according to the target control parameters; when the cooling strategy is the second cooling strategy, the target operating frequency is determined according to the second cooling strategy, and the current operating frequency is adjusted to the target operating frequency for cooling operation.

[0099] Optionally, the processing module 10 is further used for: The current temperatures corresponding to multiple detection positions in the wearable device are obtained in real time; when the current temperature corresponding to at least one detection position is greater than the cooling temperature threshold, the temperature average corresponding to the detection position within the target time period is determined; when the temperature average is greater than the cooling temperature threshold, it is determined that the detection temperature of the wearable device is greater than the cooling temperature threshold.

[0100] The cooling device for a wearable device provided in the present application adopts the cooling method for a wearable device in the above-mentioned embodiment, and can solve the technical problem of how to reduce interference to the user and improve the user experience while cooling the wearable device. Compared with the prior art, the beneficial effects of the cooling device for a wearable device provided in the present application are the same as the beneficial effects of the cooling method for a wearable device provided in the above-mentioned embodiment, and the other technical features of the cooling device for the wearable device are the same as the features disclosed in the above-mentioned embodiment method, which will not be described in detail here.

[0101] The present application provides a wearable device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the cooling method of the wearable device in the above-mentioned embodiment 1.

[0102] Reference below Figure 6 , which shows a schematic diagram of the structure of a wearable device suitable for implementing the embodiment of the present application. The wearable device in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions: tablet computers), PMPs (Portable Media Players: portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 6The wearable device shown is merely an example and should not impose any limitation on the functions and scope of use of the embodiments of the present application.

[0103] like Figure 6 As shown, the wearable device may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the wearable device are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the wearable device to communicate with other devices wirelessly or wired to exchange data. Although the figure shows a wearable device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or provided alternatively.

[0104] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0105] The wearable device provided by the present application adopts the cooling method of the wearable device in the above embodiment, which can solve the technical problem of how to reduce interference to the user and improve the user experience while cooling the wearable device. Compared with the prior art, the beneficial effects of the wearable device provided by the present application are the same as the beneficial effects of the cooling method of the wearable device provided by the above embodiment, and the other technical features in the wearable device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0106] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0107] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0108] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the cooling method of the wearable device in the above-mentioned embodiment.

[0109] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.

[0110] The computer-readable storage medium may be included in the wearable device; or may exist independently without being assembled into the wearable device.

[0111] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by the wearable device, the wearable device: determines the surrounding environment state of the environment in which the wearable device is located according to at least one of the audio data collected by the audio collection device and the environment image collected by the image collection device when the detected temperature of the wearable device is greater than the cooling temperature threshold; determines a cooling strategy for the wearable device according to the surrounding environment state; and cools the wearable device according to the cooling strategy.

[0112] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0113] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0114] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0115] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned cooling method for the wearable device, and can solve the technical problem of how to reduce interference to the user and improve the user experience while cooling the wearable device. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the cooling method for the wearable device provided by the above-mentioned embodiment, and will not be repeated here.

[0116] The present application also provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of the above-mentioned method for cooling a wearable device.

[0117] The computer program product provided by the present application can solve the technical problem of how to reduce interference to users and improve user experience while cooling down the wearable device. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as the beneficial effects of the cooling method of the wearable device provided by the above embodiment, which will not be elaborated here.

[0118] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A method for cooling a wearable device, characterized in that: The cooling method of the wearable device comprises: When the detected temperature of the wearable device is greater than the cooling temperature threshold, determining the surrounding environment state of the environment in which the wearable device is located according to at least one of the audio data collected by the audio collection device and the environment image collected by the image collection device; Determining a cooling strategy for the wearable device according to the surrounding environment state; The wearable device is cooled according to the cooling strategy.

2. The method according to claim 1, characterized in that The step of determining the surrounding environment state of the environment in which the wearable device is located according to at least one of the audio data collected by the audio collection device and the environment image collected by the image collection device comprises: Determining a first environmental state of the environment in which the wearable device is located according to audio data collected by an audio collection device; When the first environmental state is a first preset state, determining a second environmental state of the environment in which the wearable device is located according to the environmental image captured by the image acquisition device; When the second environmental state is a second preset state, the surrounding environmental state is determined to be a first target state.

3. The method according to claim 2, characterized in that The step of determining the first environmental state of the environment in which the wearable device is located according to the audio data collected by the audio collection device includes: Performing decibel calculation based on the audio data collected by the audio collection device to determine the overall environmental decibel of the environment in which the wearable device is located; Performing sound source localization on the audio data to determine a sound source localization result of the audio data; Performing sound source separation on the audio data according to the sound source localization result to determine the number of sound sources present in the audio data; An environmental assessment is performed according to the overall environmental decibels and the number of sound sources to determine a first environmental state of the environment in which the wearable device is located.

4. The method according to claim 2, characterized in that The step of determining the second environmental state of the environment in which the wearable device is located according to the environmental image acquired by the image acquisition device comprises: Analyzing the environment image captured by the image acquisition device to determine the objects existing in the environment image; Matching the sound source in the audio data with the object in the environment image to determine a sound source matching result; When there is a preset result in the sound source matching result, it is determined that the second environmental state of the environment in which the wearable device is located is a second preset state.

5. The method according to claim 1, characterized in that The step of determining the surrounding environment state of the environment in which the wearable device is located according to at least one of the audio data collected by the audio collection device and the environment image collected by the image collection device comprises: Determining a first environmental state of the environment in which the wearable device is located according to audio data collected by an audio collection device; When the first environmental state is not a first preset state, the surrounding environmental state is determined to be a second target state.

6. The method according to claim 1, characterized in that The step of cooling the wearable device according to the cooling strategy includes: When the cooling strategy is the first cooling strategy, determining a target control parameter of the cooling component according to the first cooling strategy, and controlling the cooling component to operate according to the target control parameter; When the cooling strategy is the second cooling strategy, the target operating frequency is determined according to the second cooling strategy, and the current operating frequency is adjusted to the target operating frequency for cooling operation.

7. The method according to any one of claims 1 to 6, characterized in that Before the step of determining the surrounding environment state of the environment in which the wearable device is located according to at least one of the audio data collected by the audio collection device and the environment image collected by the image collection device when the detected temperature of the wearable device is greater than the cooling temperature threshold, the method further includes: Obtain the current temperature corresponding to multiple detection locations in the wearable device in real time; When there is at least one detection location corresponding to a current temperature greater than a cooling temperature threshold, determining an average temperature corresponding to the detection location within a target time period; When the temperature average is greater than the cooling temperature threshold, it is determined that the detected temperature of the wearable device is greater than the cooling temperature threshold.

8. A cooling device for a wearable device, characterized in that: The cooling device of the wearable device comprises: a processing module, configured to determine, when the detected temperature of the wearable device is greater than a cooling temperature threshold, a surrounding environment state of the wearable device according to at least one of the audio data collected by the audio collection device and the environment image collected by the image collection device; The processing module is further used to determine a cooling strategy for the wearable device according to the surrounding environment state; A cooling module is used to cool the wearable device according to the cooling strategy.

9. A wearable device, characterized in that: The wearable device includes: a memory, a processor, and a cooling program of the wearable device stored in the memory and executable on the processor, wherein the cooling program of the wearable device is configured to implement a cooling method for the wearable device according to any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium stores a cooling program for the wearable device, and when the cooling program for the wearable device is executed by the processor, the cooling method for the wearable device according to any one of claims 1 to 7 is implemented.

Images