Method and device for reducing power consumption of augmented reality equipment and electronic equipment

Abstract

The embodiment of the invention discloses a method and a device for reducing power consumption of augmented reality equipment and electronic equipment. The method comprises the following steps: monitoring a visual angle range of the augmented reality XR equipment; judging whether a hot area and / or a gesture exists in the visual angle range or not; if no hot area and / or gesture exists in the visual angle range, reducing the collection frame rate of the XR equipment; and if the hot area exists in the visual angle range, reducing the acquisition frame rate of the XR equipment under the condition that the hot area meets a preset condition.

Description

Technical Field

[0001] The present invention relates to the field of XR technology, and in particular to a method, device and electronic device for reducing power consumption of an extended reality device. Background Art

[0002] XR (eXtended Reality) refers to a real-virtual, human-computer interactive environment created through computer technology and wearable devices. Extended reality includes AR (Augmented Reality), VR (Virtual Reality) and MR (Mixed Reality). Currently, there are many interactive algorithms on XR devices, such as gesture recognition and eye movement recognition algorithms. These algorithms can meet users' needs for instant interaction and provide users with a more intelligent and immersive experience.

[0003] However, the interactive algorithms on XR devices will cause the devices to consume higher power, which will severely shorten the device's battery life and make it difficult to meet the needs of wearing XR devices for a long time. Summary of the invention

[0004] The purpose of the embodiments of the present invention is to provide a method, an apparatus and an electronic device for reducing the power consumption of an extended reality device, so as to solve the problems in the prior art.

[0005] To solve the above technical problems, the embodiments of the present invention are implemented as follows: In a first aspect, an embodiment of the present invention provides a method for reducing power consumption of an extended reality device, including: Monitor the viewing angle of XR devices; Determine whether there is a hot spot and / or gesture within the viewing angle; If there is no hot spot and / or gesture within the viewing angle range, reducing the acquisition frame rate of the XR device; If there is a hot spot within the viewing angle range, the acquisition frame rate of the XR device is reduced if the hot spot meets a preset condition.

[0006] In a second aspect, an embodiment of the present invention provides a device for reducing power consumption of an extended reality device, including: A monitoring module, used to monitor the viewing angle range of an extended reality XR device; A recognition module, used to determine whether there is a hot spot and / or a gesture within the viewing angle; A processing module is used to reduce the acquisition frame rate of the XR device if there is no hot spot and / or gesture within the viewing angle range, and if there is a hot spot within the viewing angle range, reduce the acquisition frame rate of the XR device if the hot spot meets a preset condition.

[0007] In a third aspect, an embodiment of the present invention provides an electronic device, comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the above-mentioned method for reducing the power consumption of an extended reality device.

[0008] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned method for reducing the power consumption of an extended reality device are implemented.

[0009] In a fifth aspect, an embodiment of the present invention provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of the above-mentioned method for reducing the power consumption of an extended reality device.

[0010] It can be seen from the technical solutions provided by the above embodiments of the present invention that, in the embodiments of the present invention, the viewing angle range of the extended reality XR device is monitored to determine whether there are hot spots and / or gestures within the viewing angle range. If there are no hot spots and / or gestures within the viewing angle range, the acquisition frame rate of the XR device is reduced. If there are hot spots within the viewing angle range, the acquisition frame rate of the XR device is reduced when the hot spots meet preset conditions. Through the above process, the power consumption of the XR device can be reduced, the usage time of the XR device can be increased, the demand for wearing the XR device for a long time can be met, and adaptive adjustment of the acquisition frame rate of the XR device is achieved. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0012] Figure 1 A schematic flow chart of a method for reducing power consumption of an extended reality device provided by an embodiment of the present invention; Figure 2 A schematic flow chart of another method for reducing power consumption of an extended reality device provided by an embodiment of the present invention; Figure 3 A schematic flow chart of another method for reducing power consumption of an extended reality device provided by an embodiment of the present invention; Figure 4 A schematic diagram of a device structure for reducing power consumption of an extended reality device provided by an embodiment of the present invention; Figure 5 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0013] Embodiments of the present invention provide a method, an apparatus, and an electronic device for reducing power consumption of an extended reality device.

[0014] In order to enable those skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0015] The method and device for reducing the power consumption of an extended reality device provided by an embodiment of the present invention can be applied to an XR device. Specific application scenarios include, but are not limited to, scenarios in which a user wears an XR device for human-computer interaction. The content of human-computer interaction can be of various types, such as education or games, which are not specifically limited. Through the above method and device, the power consumption of the XR device can be reduced, the use time of the XR device can be increased, the need for wearing the XR device for a long time can be met, and adaptive adjustment of the acquisition frame rate of the XR device can be achieved.

[0016] like Figure 1 As shown, an embodiment of the present invention provides a method for reducing power consumption of an extended reality device, which may specifically include the following steps: S102: Monitor the viewing angle range of the extended reality XR device.

[0017] S104: Determine whether there is a hot spot and / or gesture within the viewing angle range. If there is no hot spot and / or gesture within the viewing angle range, execute step S106; if there is a hot spot within the viewing angle range, execute step S108.

[0018] In the embodiment of the present invention, it is possible to determine whether there is only a hot spot within the viewing angle, or only determine whether there is a gesture within the viewing angle, or determine whether there are both a hot spot and a gesture within the viewing angle. The specific method can be selected according to needs.

[0019] In the embodiment of the present invention, the above-mentioned determination of whether there is a hot spot within the viewing angle range may include: When there are multiple hot spots within the viewing angle range, it is determined whether there is an unobstructed hot spot within the viewing angle range.

[0020] That is to say, the blocked hotspot is not considered as the object of judgment and does not need to be considered. Only the unblocked hotspot is considered.

[0021] For example, there are three hot zones within the viewing angle range, among which hot zone 1 is not blocked and hot zone 3 is blocked by hot zone 2, then it is determined that hot zone 1 and hot zone 2 are included within the viewing angle range.

[0022] In the embodiment of the present invention, the hot zone may include: an interactive area of ​​a control in a virtual interface, and / or a 3D virtual avatar. The interactive area of ​​the control may involve a variety of interactive operations, including but not limited to: click, double-click, long press or drag, etc., without specific limitation.

[0023] In the embodiment of the present invention, in the above step S104, determining whether there is a hot spot and / or a gesture within the viewing angle range may specifically include: Determine whether there is a hot spot within the FOV (Field of view) of the current headset orientation; and / or, Determine whether there is a gesture within the viewing angle of the gesture recognition sensor.

[0024] Among them, judging whether there is a hot spot within the field of view FOV of the current head display can be achieved in a variety of ways, such as by scanning and identifying whether there is an interactive area of ​​the controls in the virtual interface within the FOV, etc., which is not specifically limited.

[0025] Among them, judging whether there is a gesture within the viewing angle of the gesture recognition sensor can be achieved in a variety of ways, such as identifying and tracking the user's gesture movements through sensors, cameras, or computer vision technologies, without specific limitation.

[0026] S106: Reduce the acquisition frame rate of the XR device, and the process ends.

[0027] In the embodiment of the present invention, the acquisition frame rate of the XR device includes the eye movement acquisition frame rate and the gesture acquisition frame rate.

[0028] In one implementation manner, the above step S106 may specifically include: If there is no hot spot within the viewing angle, reduce the eye movement acquisition frame rate of the XR device; If there is no gesture within the viewing angle, the gesture acquisition frame rate of the XR device is reduced; If there are neither hot spots nor gestures within the field of view, reduce the eye movement acquisition frame rate and gesture acquisition frame rate of the XR device.

[0029] S108: When the hot zone meets the preset conditions, the acquisition frame rate of the XR device is reduced, and the process ends.

[0030] In an embodiment of the present invention, the adjustment of the acquisition frame rate of the XR device is specifically performed by corresponding sensors, such as adjusting the gesture acquisition frame rate by a gesture sensor, adjusting the eye movement acquisition frame rate by an eye movement sensor, etc., which will not be further explained here.

[0031] In one implementation manner, the above step S108 may specifically include: Find the smallest hot spot; comparing the area of ​​the hot zone with a threshold value; When the area of ​​the hot zone is larger than the threshold, the eye movement acquisition frame rate of the XR device is reduced.

[0032] In one implementation, when the area of ​​the hot zone is greater than a threshold, reducing the eye movement acquisition frame rate of the XR device may include: When the area of ​​the hot zone is greater than the threshold, the area of ​​the hot zone is compared with a specified multiple of the eye movement accuracy; If the area of ​​the hotspot is larger than the specified multiple of the eye movement accuracy, the eye movement acquisition frame rate of the XR device is reduced.

[0033] In the embodiment of the present invention, after reducing the acquisition frame rate of the XR device, the following steps may also be included: When the eye movement acquisition frame rate is lowered, according to the correspondence between the eye movement accuracy and the eye movement acquisition frame rate, a new eye movement accuracy is determined for the XR device according to the lowered eye movement acquisition frame rate.

[0034] The above method provided by the embodiment of the present invention monitors the viewing angle range of the extended reality XR device to determine whether there are hot spots and / or gestures within the viewing angle range. If there are no hot spots and / or gestures within the viewing angle range, the acquisition frame rate of the XR device is reduced. If there are hot spots within the viewing angle range, the acquisition frame rate of the XR device is reduced when the hot spots meet preset conditions. This can reduce the power consumption of the XR device, increase the usage time of the XR device, meet the needs of wearing the XR device for a long time, and realize adaptive adjustment of the acquisition frame rate of the XR device.

[0035] like Figure 2 As shown, the embodiment of the present invention provides another method for reducing the power consumption of an extended reality device, which is described by taking gesture monitoring as an example. The method may specifically include the following steps: S202: Monitoring the viewing angle range of the gesture recognition sensor of the XR device.

[0036] S204: Determine whether there is a gesture within the viewing angle range, if yes, execute step S206, otherwise, execute step S208.

[0037] S206: The gesture acquisition frame rate of the XR device is kept unchanged, and the process ends.

[0038] In the embodiment of the present invention, the range of the gesture acquisition frame rate is determined by the XR device, such as 30 Hz to 90 Hz, etc., and is not specifically limited.

[0039] In this scenario, users use gestures to interact with the computer, and gesture acquisition needs to maintain a high frame rate. Therefore, the gesture acquisition frame rate of the XR device can be kept unchanged, such as keeping the gesture acquisition frame rate unchanged at 60Hz, to avoid reducing the user experience.

[0040] S208: Reduce the gesture acquisition frame rate of the XR device, and the process ends.

[0041] In this scenario, there is no need for gesture interaction, and the XR device does not need to maintain a high gesture acquisition frame rate. Therefore, the gesture acquisition frame rate of the XR device can be reduced, such as reducing the gesture acquisition frame rate from 80Hz to 30Hz, thereby reducing the power consumption of the XR device.

[0042] The above method provided by the embodiment of the present invention monitors the viewing angle range recognized by the gesture recognition sensor of the XR device to determine whether there is a gesture within the viewing angle range. If no gesture exists, the gesture acquisition frame rate of the XR device is reduced. Therefore, the power consumption of the XR device can be reduced, and the usage time of the XR device can be increased. It can meet the needs of wearing the XR device for a long time, and realizes adaptive adjustment of the gesture acquisition frame rate of the XR device.

[0043] like Figure 3 As shown, the embodiment of the present invention provides another method for reducing the power consumption of an extended reality device, which is described by taking monitoring of hot spots as an example. The method may specifically include the following steps: S302: Monitor the FOV range of the current head display orientation.

[0044] The current head display orientation refers to the orientation that the XR device can reach, including but not limited to: left, forward, and right. The angle range that each head display orientation can cover is determined by the hardware capabilities of the XR device, such as the screen display capabilities, and is generally within 90°~100°, so I will not explain it in detail here.

[0045] S304: Determine whether there is a hot spot within the FOV range. If there is no hot spot, execute step S306; if there is a hot spot, execute step S308.

[0046] In the embodiment of the present invention, there may be one or more hot zones within the FOV. If there are multiple hot zones within the FOV and some of the hot zones are blocked, it is specifically determined whether there is an unblocked hot zone within the FOV.

[0047] In the embodiment of the present invention, the above-mentioned hot zone may include: an interactive area of ​​a control in a virtual interface, and / or a 3D virtual avatar.

[0048] S306: Reduce the eye movement acquisition frame rate of the XR device, and the process ends.

[0049] In the embodiment of the present invention, the range of the eye movement acquisition frame rate is determined by the XR device, such as 30 Hz to 90 Hz, etc., but is not specifically limited.

[0050] In the scenario of step S306 above, there is no hot spot, and the XR device does not need to maintain a high eye movement acquisition frame rate. Therefore, the eye movement acquisition frame rate of the XR device can be reduced, such as reducing the eye movement acquisition frame rate from 70Hz to 35Hz, etc., thereby reducing the power consumption of the XR device.

[0051] In one implementation manner, after the above step S306, the following may also be included: According to the correspondence between eye movement accuracy and eye movement acquisition frame rate, a new eye movement accuracy is determined for the XR device according to the reduced eye movement acquisition frame rate.

[0052] Normally, a high eye movement acquisition frame rate leads to a high corresponding eye movement accuracy, and a low eye movement acquisition frame rate will inevitably lead to a low eye movement accuracy. The correspondence between eye movement accuracy and eye movement acquisition frame rate can be pre-set based on empirical values, or it can be adjusted at any time in actual applications. Based on this correspondence, the corresponding eye movement accuracy can be found using the eye movement acquisition frame rate as an index. Therefore, after the eye movement acquisition frame rate is determined, the corresponding eye movement accuracy can be found based on this correspondence, thereby adjusting the XR device to this eye movement accuracy.

[0053] S308: Find the hot zone with the smallest area among the hot zones within the FOV.

[0054] Among them, the FOV range may include one or more hot zones. If it includes one hot zone, then this hot zone is the hot zone with the smallest area; if it includes multiple hot zones, then find the hot zone with the smallest area among the multiple hot zones, that is, calculate the areas of all hot zones and then find the minimum area. It is worth mentioning that the above hot zones all refer to unobstructed hot zones, and include the interactive areas of controls in the virtual interface and / or 3D virtual avatars.

[0055] S310: Compare the area of ​​the hot zone with a threshold value. If the area of ​​the hot zone is greater than the threshold value, execute step S306; if the area of ​​the hot zone is less than or equal to the threshold value, execute step S312.

[0056] The above threshold is a preset value, and the specific value is not limited, for example, it can be set to 3°.

[0057] In the embodiment of the present invention, the area of ​​the hot zone can usually be represented by the field of view angle of the XR device corresponding to the height of the hot zone, and the area of ​​the hot zone generally ranges from 1° to 60°. Therefore, the area of ​​the hot zone can be compared with a preset angle threshold.

[0058] For example, if the field of view angle projected by the XR device corresponding to the height h of the hot zone 1 is b, then the area of ​​the hot zone 1 can be expressed as b. If the preset threshold is 3°, then a comparison is made to see whether b>3°.

[0059] In the scenario where the area of ​​the above hot zone is greater than the threshold, it indicates that the area of ​​the hot zone is large and there is no need to maintain a high eye movement acquisition frame rate. Therefore, the eye movement acquisition frame rate of the XR device can be appropriately reduced, thereby reducing the power consumption of the XR device.

[0060] In one implementation manner, if the area of ​​the hot zone is greater than the threshold in the above step S310, the following steps may also be performed: The area of ​​the hotspot is compared to a specified multiple of eye movement accuracy; If the area of ​​the hotspot is larger than the specified multiple of the eye movement accuracy, the eye movement acquisition frame rate of the XR device is reduced.

[0061] Among them, the above-mentioned specified multiple can be set as needed, such as 2 times or 3 times, etc., and the specific value is not limited. When the area of ​​the hot zone is greater than the specified multiple of the eye movement accuracy, it means that the area of ​​the hot zone is much greater than the eye movement accuracy. Therefore, the eye movement acquisition frame rate of the XR device can be reduced. Accordingly, after reducing the eye movement acquisition frame rate of the XR device, the new eye movement accuracy can be determined for the XR device according to the correspondence between the eye movement accuracy and the eye movement acquisition frame rate and the reduced eye movement acquisition frame rate.

[0062] For example, the initial eye movement acquisition frame rate of the XR device is x, the eye movement accuracy is a, the area of ​​the smallest hot spot is b, and the specified multiple is 2. Determine whether b>2*a. If so, it means that the area of ​​the smallest hot spot is much larger than the eye movement accuracy. Therefore, the eye movement acquisition frame rate of the XR device can be reduced to y, y<x. In addition, according to the correspondence between eye movement accuracy and eye movement acquisition frame rate, according to the reduced eye movement acquisition frame rate y, if the corresponding eye movement accuracy is b / 2, the eye movement accuracy of the XR device is adjusted to b / 2, that is, the eye movement accuracy is also reduced.

[0063] S312: The eye movement acquisition frame rate of the XR device is kept unchanged, and the process ends.

[0064] The above step S312 belongs to the scenario where the area of ​​the hot zone is less than or equal to the threshold, indicating that the area of ​​the hot zone is small and a higher eye movement acquisition frame rate needs to be maintained, otherwise it will affect the accuracy of the acquisition result. Therefore, the eye movement acquisition frame rate of the XR device can be maintained unchanged, thereby ensuring the performance of the XR device unchanged and avoiding affecting the user experience.

[0065] The above method provided by the embodiment of the present invention monitors the FOV range of the current head display orientation to determine whether there is a hot spot within the FOV range. If there is no hot spot, the eye movement acquisition frame rate of the XR device is reduced. If there is a hot spot, the hot spot with the smallest area is found among the hot spots within the FOV range, and the area of ​​the hot spot is compared with the threshold. If the area of ​​the hot spot is greater than the threshold, the eye movement acquisition frame rate of the XR device is reduced. Therefore, the power consumption of the XR device can be reduced, the usage time of the XR device can be increased, the demand for wearing the XR device for a long time can be met, and adaptive adjustment of the acquisition frame rate of the XR device is achieved.

[0066] The above is a method for reducing power consumption of an extended reality device provided by an embodiment of the present invention. Based on the same idea, an embodiment of the present invention also provides a device for reducing power consumption of an extended reality device, such as Figure 4 As shown, the device for reducing power consumption of an extended reality device includes: The monitoring module 401 is used to monitor the viewing angle range of the extended reality XR device.

[0067] The identification module 402 is used to determine whether there is a hot spot and / or a gesture within the viewing angle.

[0068] The processing module 403 is used to reduce the acquisition frame rate of the XR device if there is no hot spot and / or gesture within the viewing angle range, and if there is a hot spot within the viewing angle range, reduce the acquisition frame rate of the XR device when the hot spot meets the preset conditions.

[0069] In the embodiment of the present invention, the identification module 402 may be used to: Determine whether there is a hot spot within the field of view (FOV) of the current head display; and / or, Determine whether there is a gesture within the viewing angle of the gesture recognition sensor.

[0070] In the embodiment of the present invention, the processing module 403 may be used to: If there is no hot spot within the viewing angle, reduce the eye movement acquisition frame rate of the XR device; If there is no gesture within the viewing angle, the gesture acquisition frame rate of the XR device is reduced; If there are neither hot spots nor gestures within the field of view, reduce the eye movement acquisition frame rate and gesture acquisition frame rate of the XR device.

[0071] In the embodiment of the present invention, the processing module 403 may be used to: If there is a hot spot within the viewing angle, find the hot spot with the smallest area; comparing the area of ​​the hot zone with a threshold value; When the area of ​​the hot zone is larger than the threshold, the eye movement acquisition frame rate of the XR device is reduced.

[0072] In the embodiment of the present invention, when the area of ​​the hot zone is greater than the threshold, the processing module 403 reduces the eye movement acquisition frame rate of the XR device, which may specifically include: When the area of ​​the hot zone is greater than the threshold, the area of ​​the hot zone is compared with a specified multiple of the eye movement accuracy; If the area of ​​the hotspot is larger than the specified multiple of the eye movement accuracy, the eye movement acquisition frame rate of the XR device is reduced.

[0073] In the embodiment of the present invention, the processing module 403 may also be used for: After reducing the eye movement acquisition frame rate of the XR device, according to the correspondence between the eye movement accuracy and the eye movement acquisition frame rate, a new eye movement accuracy is determined for the XR device according to the reduced eye movement acquisition frame rate.

[0074] In the embodiment of the present invention, when determining whether there is a hot zone within the viewing angle range, the identification module 402 can be specifically used to: determine whether there is an unobstructed hot zone within the viewing angle range when there are multiple hot zones within the viewing angle range. In other words, the obstructed hot zone is not considered as a determination object and does not need to be considered, and only the unobstructed hot zone is considered.

[0075] In the embodiment of the present invention, the above-mentioned hot zone may include: an interactive area of ​​a control in a virtual interface, and / or a 3D virtual avatar.

[0076] The above-mentioned device provided by the embodiment of the present invention can execute the method provided by any of the above-mentioned method embodiments. For detailed processes, please refer to the description in the above-mentioned method embodiments, which will not be repeated here.

[0077] The above-mentioned device provided by the embodiment of the present invention monitors the viewing angle range of the extended reality XR device to determine whether there is a hot spot and / or gesture within the viewing angle range. If there is no target object within the viewing angle range, the acquisition frame rate of the XR device is reduced. If there is a hot spot within the viewing angle range, the acquisition frame rate of the XR device is reduced when the hot spot meets the preset conditions. This can reduce the power consumption of the XR device, increase the usage time of the XR device, meet the needs of wearing the XR device for a long time, and realize adaptive adjustment of the acquisition frame rate of the XR device.

[0078] Figure 5The hardware structure diagram of an electronic device for implementing various embodiments of the present invention is shown in FIG. The electronic device 500 includes but is not limited to: a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, a processor 510, and a power supply 55. Those skilled in the art will appreciate that Figure 5 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently. In the embodiments of the present invention, the electronic device includes but is not limited to a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted terminal, a wearable device, and a pedometer.

[0079] Among them, the processor 510 is used to monitor the viewing angle range of the extended reality XR device, determine whether there is a hot spot and / or gesture within the viewing angle range, and if there is no target object within the viewing angle range, reduce the acquisition frame rate of the XR device; if there is a hot spot within the viewing angle range, reduce the acquisition frame rate of the XR device when the hot spot meets the preset conditions.

[0080] In the embodiment of the present invention, the processor 510 may be used for: Determine whether there is a hot spot within the field of view (FOV) of the current head display; and / or, Determine whether there is a gesture within the viewing angle of the gesture recognition sensor.

[0081] In the embodiment of the present invention, the processor 510 may be used for: If there is no hot spot within the viewing angle, reduce the eye movement acquisition frame rate of the XR device; If there is no gesture within the viewing angle, the gesture acquisition frame rate of the XR device is reduced; If there are neither hot spots nor gestures within the field of view, reduce the eye movement acquisition frame rate and gesture acquisition frame rate of the XR device.

[0082] In the embodiment of the present invention, the processor 510 may be used for: If there is a hot spot within the viewing angle, find the hot spot with the smallest area; comparing the area of ​​the hot zone with a threshold value; When the area of ​​the hot zone is larger than the threshold, the eye movement acquisition frame rate of the XR device is reduced.

[0083] In the embodiment of the present invention, when the area of ​​the hot zone is greater than the threshold, the processor 510 reduces the eye movement acquisition frame rate of the XR device, which may specifically include: When the area of ​​the hot zone is greater than the threshold, the area of ​​the hot zone is compared with a specified multiple of the eye movement accuracy; If the area of ​​the hotspot is larger than the specified multiple of the eye movement accuracy, the eye movement acquisition frame rate of the XR device is reduced.

[0084] In the embodiment of the present invention, the processor 510 may also be used for: After reducing the eye movement acquisition frame rate of the XR device, according to the correspondence between the eye movement accuracy and the eye movement acquisition frame rate, a new eye movement accuracy is determined for the XR device according to the reduced eye movement acquisition frame rate.

[0085] In the embodiment of the present invention, when the processor 510 determines whether there is a hot zone within the viewing angle range, it can be specifically used to: when there are multiple hot zones within the viewing angle range, determine whether there is an unobstructed hot zone within the viewing angle range. In other words, the obstructed hot zone is not considered as a determination object and does not need to be considered, and only the unobstructed hot zone is considered.

[0086] In the embodiment of the present invention, the above-mentioned hot zone may include: an interactive area of ​​a control in a virtual interface, and / or a 3D virtual avatar.

[0087] An embodiment of the present invention provides an electronic device, which monitors the viewing angle range of an extended reality XR device to determine whether there are hot spots and / or gestures within the viewing angle range. If there are no hot spots and / or gestures within the viewing angle range, the acquisition frame rate of the XR device is reduced. If there are hot spots within the viewing angle range, the acquisition frame rate of the XR device is reduced when the hot spots meet preset conditions. This can reduce the power consumption of the XR device, increase the usage time of the XR device, meet the needs of wearing the XR device for a long time, and realize adaptive adjustment of the acquisition frame rate of the XR device.

[0088] It should be understood that in the embodiment of the present invention, the radio frequency unit 501 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving downlink data from the base station, it is sent to the processor 510 for processing; in addition, uplink data is sent to the base station. Generally, the radio frequency unit 501 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 501 can also communicate with the network and other electronic devices through a wireless communication system.

[0089] The electronic device provides users with wireless broadband Internet access through the network module 502, such as helping users to send and receive emails, browse web pages, and access streaming media.

[0090] The audio output unit 503 can convert the audio data received by the RF unit 501 or the network module 502 or stored in the memory 509 into an audio signal and output it as sound. Moreover, the audio output unit 503 can also provide audio output related to a specific function performed by the electronic device 500 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 503 includes a speaker, a buzzer, a receiver, etc.

[0091] The input unit 504 is used to receive audio or video signals. The input unit 504 may include a graphics processing unit (GPU) 5041 and a microphone 5042. The graphics processor 5041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 506. The image frame processed by the graphics processor 5041 can be stored in the memory 509 (or other storage medium) or sent via the radio frequency unit 501 or the network module 502. The microphone 5042 can receive sound and can process such sound into audio data. The processed audio data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 501 in the case of a telephone call mode.

[0092] The electronic device 500 also includes at least one sensor 505, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 5061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 5061 and / or the backlight when the electronic device 500 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary, which can be used to identify the posture of the electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; the sensor 505 can also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be repeated here.

[0093] The display unit 506 is used to display information input by the user or information provided to the user. The display unit 506 may include a display panel 5061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0094] The user input unit 507 can be used to receive input digital or character information, and generate key signal input related to user settings and function control of the electronic device. Specifically, the user input unit 507 includes a touch panel 5071 and other input devices 5072. The touch panel 5071, also known as a touch screen, can collect user touch operations on or near it (such as operations performed by users using fingers, styluses, or any other suitable objects or accessories on or near the touch panel 5071). The touch panel 5071 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact point coordinates, and then sends it to the processor 510, receives the command sent by the processor 510 and executes it. In addition, the touch panel 5071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 5071, the user input unit 507 may also include other input devices 5072. Specifically, other input devices 5072 may include but are not limited to a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail here.

[0095] Furthermore, the touch panel 5071 may be overlaid on the display panel 5061. When the touch panel 5071 detects a touch operation on or near it, it transmits the information to the processor 510 to determine the type of the touch event. Then, the processor 510 provides a corresponding visual output on the display panel 5061 according to the type of the touch event. Figure 5 In the figure, the touch panel 5071 and the display panel 5061 are used as two independent components to realize the input and output functions of the electronic device. However, in some embodiments, the touch panel 5071 and the display panel 5061 can be integrated to realize the input and output functions of the electronic device, which is not limited here.

[0096] The interface unit 508 is an interface for connecting an external device to the electronic device 500. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 508 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic device 500 or may be used to transmit data between the electronic device 500 and an external device.

[0097] The memory 509 can be used to store software programs and various data. The memory 509 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 509 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0098] The processor 510 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing software programs and / or modules stored in the memory 509 and calling data stored in the memory 509, it performs various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole. The processor 510 may include one or more processing units; preferably, the processor 510 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 510.

[0099] The electronic device 500 may also include a power source 55 (such as a battery) for supplying power to various components. Preferably, the power source 55 may be logically connected to the processor 510 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.

[0100] Preferably, an embodiment of the present invention further provides an electronic device, comprising a processor 510, a memory 509, and a computer program stored in the memory 509 and executable on the processor 510. When the computer program is executed by the processor 510, the various processes of the above-mentioned method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0101] An embodiment of the present invention further provides a computer program product, which includes a computer program. When the computer program is executed by a processor, it implements the various processes of the above-mentioned method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0102] The embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, each process of the above method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. The computer-readable storage medium is, for example, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0103] The above-mentioned computer-readable storage medium provided by the embodiment of the present invention monitors the viewing angle range of the extended reality XR device to determine whether there are hot spots and / or gestures within the viewing angle range. If there are no hot spots and / or gestures within the viewing angle range, the acquisition frame rate of the XR device is reduced. If there are hot spots within the viewing angle range, the acquisition frame rate of the XR device is reduced when the hot spots meet preset conditions. This can reduce the power consumption of the XR device, increase the usage time of the XR device, meet the needs of wearing the XR device for a long time, and realize adaptive adjustment of the acquisition frame rate of the XR device.

[0104] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0105] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0106] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0107] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0108] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0109] Memory may include non-permanent storage in a computer-readable medium, in the form of random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0110] Computer-readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. According to the definition in this article, computer-readable media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0111] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0112] The above description is only an embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent substitution, improvement, etc. made within the spirit and principle of the present invention should be included in the scope of the claims of the present invention.

Claims

1. A method for reducing power consumption of an extended reality device, characterized in that: The method comprises: Monitor the viewing angle of XR devices; Determine whether there is a hot spot and / or gesture within the viewing angle; If there is no hot spot and / or gesture within the viewing angle range, reducing the acquisition frame rate of the XR device; If there is a hot spot within the viewing angle range, the acquisition frame rate of the XR device is reduced if the hot spot meets a preset condition.

2. The method according to claim 1, characterized in that The determining whether there is a hot spot and / or a gesture within the viewing angle range includes: Determine whether there is a hot spot within the field of view (FOV) of the current head display; and / or, Determine whether there is a gesture within the viewing angle of the gesture recognition sensor.

3. The method according to claim 1, characterized in that If there is no hot spot and / or gesture within the viewing angle range, reducing the acquisition frame rate of the XR device includes: If there is no hot spot within the viewing angle range, reducing the eye movement acquisition frame rate of the XR device; If there is no gesture within the viewing angle, reducing the gesture acquisition frame rate of the XR device; If there is neither a hot spot nor a gesture within the viewing angle range, the eye movement acquisition frame rate and the gesture acquisition frame rate of the XR device are reduced.

4. The method according to claim 1, characterized in that: When the hot zone meets the preset condition, reducing the acquisition frame rate of the XR device includes: Find the smallest hot spot; comparing the area of ​​the hot zone with a threshold value; When the area of ​​the hot zone is greater than the threshold, the eye movement acquisition frame rate of the XR device is reduced.

5. The method according to claim 4, characterized in that When the area of ​​the hot zone is greater than the threshold, reducing the eye movement acquisition frame rate of the XR device includes: When the area of ​​the hot zone is greater than the threshold, comparing the area of ​​the hot zone with a specified multiple of the eye movement accuracy; If the area of ​​the hot zone is greater than a specified multiple of the eye movement accuracy, the eye movement acquisition frame rate of the XR device is reduced.

6. The method according to claim 1, characterized in that After reducing the acquisition frame rate of the XR device, the method further includes: When the eye movement acquisition frame rate is reduced, according to the correspondence between the eye movement accuracy and the eye movement acquisition frame rate, a new eye movement accuracy is determined for the XR device according to the reduced eye movement acquisition frame rate.

7. The method according to any one of claims 1 to 6, characterized in that The determining whether there is a hot spot within the viewing angle range includes: When there are multiple hot spots within the viewing angle range, it is determined whether there is an unobstructed hot spot within the viewing angle range.

8. The method according to any one of claims 1 to 6, characterized in that The hot zone includes: an interactive area of ​​a control in a virtual interface, and / or a 3D virtual avatar.

9. A device for reducing power consumption of an extended reality device, characterized in that: The device comprises: A monitoring module, used to monitor the viewing angle range of an extended reality XR device; A recognition module, used to determine whether there is a hot spot and / or a gesture within the viewing angle; A processing module is used to reduce the acquisition frame rate of the XR device if there is no hot spot and / or gesture within the viewing angle range, and if there is a hot spot within the viewing angle range, reduce the acquisition frame rate of the XR device if the hot spot meets a preset condition.

10. An electronic device, characterized in that: The method comprises a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, the steps of the method for reducing power consumption of an extended reality device described in any one of claims 1 to 8 are implemented.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method for reducing power consumption of an extended reality device according to any one of claims 1 to 8 are implemented.

12. A computer program product, characterized in that The method comprises a computer program, which, when executed by a processor, implements the steps of the method for reducing power consumption of an extended reality device according to any one of claims 1 to 8.

Images