Brightness adjustment method and device, electronic equipment and readable storage medium

Abstract

The invention discloses a brightness adjustment method and device, electronic equipment and a readable storage medium, and belongs to the technical field of augmented reality. The method comprises the following steps: in response to a first gesture, creating a first light source in an augmented reality space; in response to the second gesture, a light source parameter of the first light source is adjusted.

Description

Technical Field

[0001] The present application belongs to the field of extended reality technology, and specifically relates to a brightness adjustment method, device, electronic device and readable storage medium. Background Art

[0002] Light intensity has a significant impact on people's reading experience. In order to better assist users in browsing and reading the content displayed on the screen, electronic devices usually provide a dimming function to help users have a better browsing experience when using electronic devices.

[0003] At present, the dimming technology for electronic devices that perform two-dimensional flat displays is relatively mature. For example, dimming is achieved by providing a screen brightness adjustment function, or by identifying ambient light for intelligent dimming. However, in the extended reality space seen through certain virtual reality devices (e.g., AR glasses, VR glasses), since the space windows and containers are already rendered by ambient light by default, if the above dimming method is used for dimming, only uniform brightness adjustment of all contents in the extended reality space can be achieved. The extended reality space is a three-dimensional space, and uniform brightness adjustment will cause the light and shadow contrast of the extended reality space to be destroyed, and the sense of spatial depth and layering will be lost, resulting in poor brightness effect of the extended reality space. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a brightness adjustment method, device, electronic device and readable storage medium, which can perform customized lighting adjustment on the content of the extended reality space under the condition of existing natural light rendering, realize lighting compensation for the extended reality space, and improve the brightness effect of the extended reality space.

[0005] In a first aspect, an embodiment of the present application provides a brightness adjustment method, comprising:

[0006] In response to the first gesture, creating a first light source in the extended reality space;

[0007] In response to the second gesture, a light source parameter of the first light source is adjusted.

[0008] In a second aspect, an embodiment of the present application provides a brightness adjustment device, comprising:

[0009] A light source creation module, configured to create a first light source in the extended reality space in response to a first gesture;

[0010] The light source adjustment module is used to adjust the light source parameters of the first light source in response to the second gesture.

[0011] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0012] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0013] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0014] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0015] In an embodiment of the present application, in response to a first gesture, a first light source is created in the extended reality space; in response to a second gesture, the light source parameters of the first light source are adjusted to perform lighting compensation on the extended reality space through the first light source after parameter adjustment. According to an embodiment of the present application, dimming the extended reality space no longer adopts a planar brightness adjustment method, but based on the three-dimensional characteristics of the extended reality space and the device specificity of the electronic device, the first light source is conveniently created and adjusted through gestures, so that the content of the extended reality space can be customized with lighting adjustment in the case of existing natural light rendering, and lighting compensation for the extended reality space is achieved, so that the lighting effect of the extended reality space meets the user's expectations. Compared with traditional planar brightness adjustment, this embodiment is based on dimming of the light source, which can simulate natural lighting effects, achieve more realistic light and shadow interaction, make the extended reality space look more real, and improve the brightness effect of the extended reality space. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 is a flowchart of a brightness adjustment method provided in some embodiments of the present application;

[0017] Figure 2 (a) and Figure 2 (b) is a schematic diagram of a first gesture provided in some embodiments of the present application;

[0018] Figure 3 (a) and Figure 3 (b) is a schematic diagram of a first sub-gesture provided in some embodiments of the present application;

[0019] Figure 4 (a) and Figure 4 (b) is a schematic diagram of a second sub-gesture provided in some embodiments of the present application;

[0020] Figure 5 is a schematic diagram of a third sub-gesture provided in some embodiments of the present application;

[0021] Figure 6 (a) and Figure 6 (b) is a schematic diagram of a fourth sub-gesture provided in some embodiments of the present application;

[0022] Figure 7 is a schematic diagram of a fifth sub-gesture provided in some embodiments of the present application;

[0023] Figure 8 is a schematic diagram of a sixth sub-gesture provided in some embodiments of the present application;

[0024] Fig. 9 is a schematic diagram of a seventh sub-gesture provided in some embodiments of the present application;

[0025] Fig.10 is a schematic diagram of an eighth sub-gesture provided in some embodiments of the present application;

[0026] Fig.11 is a schematic diagram of a switching gesture provided in some embodiments of the present application;

[0027] Fig.12 is a schematic diagram of a fifth gesture provided in some embodiments of the present application;

[0028] Fig.13 (a)- Fig.13 (c) is a schematic diagram of a fourth gesture provided in some embodiments of the present application;

[0029] Fig.14 is a schematic diagram of the structure of a brightness adjustment device provided in some embodiments of the present application;

[0030] Fig.15 is a schematic diagram of the structure of an electronic device provided by some embodiments of the present application;

[0031] Fig.16 It is a schematic diagram of the structure of an electronic device provided in some embodiments of the present application. DETAILED DESCRIPTION

[0032] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0033] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0034] For ease of understanding, the terms involved in this application are explained as follows:

[0035] Extended reality space: includes three-dimensional space constructed through technologies such as virtual reality (VR), mixed reality (MR), and augmented reality (AR). Virtual reality is a virtual environment that is completely generated by computers. Users are completely immersed in this virtual world through devices such as head-mounted displays (HMDs), which are isolated from the real physical environment. For example, when a user wears a VR device to experience a flight simulation game, he sees a computer-generated virtual sky, clouds, mountains and other scenes. He seems to be in a virtual cockpit of an airplane. Everything around him is virtual, and there are no elements of the real world. Augmented reality mainly superimposes virtual information on the real world. Users are still in a real physical environment, and virtual elements serve as a supplement to enhance users' experience of the real world. For example, when observing city streets through AR glasses, users see real buildings, vehicles and pedestrians, and can also see virtual store signs, navigation arrows and other information superimposed on the real scene. Mixed reality is a technology between virtual reality and augmented reality. Mixed reality not only superimposes virtual information on the real world, but also allows virtual objects to interact with real objects. For example, in a mixed reality design scenario, designers can place virtual furniture models in a real room, and these virtual furniture can respond realistically to the physical environment of the real room, such as lighting and object occlusion, as if the virtual furniture and the real room were a whole.

[0036] The brightness adjustment method, device, equipment, medium and program product provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0037] The brightness adjustment method provided in this application can be applied to the dimming scene of the extended reality space. Figure 1-Figure 13The brightness adjustment method provided in the embodiment of the present application is described in detail. It should be noted that the brightness adjustment method provided in the embodiment of the present application can be executed by an electronic device that can create a virtual reality, augmented reality or mixed reality space. Exemplarily, the electronic device includes but is not limited to a head-mounted display, smart glasses, a smart phone, a tablet computer, etc. In the embodiment of the present application, the brightness adjustment method provided in the embodiment of the present application is described by taking the execution of the brightness adjustment method by an electronic device as an example.

[0038] See also Figure 1 , is a flow chart of a brightness adjustment method provided in an embodiment of the present application, such as Figure 1 As shown, the method includes the following steps 110 to 120, which are described in detail below.

[0039] Step 110. In response to the first gesture, create a first light source in the extended reality space.

[0040] In some embodiments of the present application, the electronic device can obtain the user's hand movements through sensors such as cameras, optical sensors, and inertial sensors, and can perform gesture recognition based on the obtained hand movements. Based on this, after the electronic device creates an extended reality space, the user can control the electronic device to perform actions related to the created extended reality space through gestures.

[0041] In some embodiments of the present application, the first gesture is a pre-set gesture for instructing the electronic device to create a light source in the extended reality space. By creating a light source in the extended reality space, the created light source can be used as compensation for the natural ambient light rendering in the extended reality space to simulate the lighting effect of the real world, thereby making the three-dimensional scene in the extended reality space more realistic. Based on this, when the user determines that the extended reality space needs to be compensated for the lighting, the user controls the electronic device to create the first light source in the extended reality space by executing the first gesture. During the user's execution of the first gesture, the electronic device obtains the user's hand movement through the sensor, performs gesture recognition based on the obtained hand movement, and performs an action associated with the first gesture when the user's gesture is recognized as the first gesture based on the user's hand movement, thereby creating the first light source in the extended reality space. Among them, the action associated with the first gesture is an action for creating a light source in the extended reality space.

[0042] In some embodiments of the present application, the type of the first light source includes but is not limited to a point light source, a spotlight, a single-sided light source, a parallel light source, a stereo light source, etc. Among them, a point light source can be imagined as a light point without size, which emits light evenly in all directions, just like a light bulb emitting light in space. The light of a spotlight is emitted in a cone shape, with a clear irradiation direction and range, just like a spotlight on a stage. A single-sided light source can be used to simulate directional light in the real world, such as sunlight, lights, etc. The light of a parallel light source is emitted in parallel, and is usually used to simulate distant light sources such as sunlight, and can simulate sunlight in an extended reality space. The stereo light source is intended to create a lighting effect with a sense of space and depth by providing light at different angles and directions. Creating a stereo light source can automatically and synchronously create multiple light sources in different directions. It can be seen from this that different types of light sources have different characteristics and can be used to fill light for different extended reality spaces. Based on this, before creating the first light source, the user can first select the type of the first light source to be created according to the characteristics of the extended reality space. In this way, when creating the first light source, a first light source with a light source type of the first light source type can be created. For example, before creating the first light source, the user selects a point light source as the first light source type according to the characteristics of the extended real space, then in the above step 110, in response to the user's first gesture, a point light source is created in the extended real space as the first light source. In this way, the flexibility and customization of light source creation can be improved.

[0043] In some embodiments of the present application, before creating the first light source, multiple light source type options can be displayed to the user in the form of a dial, etc., so that the user can select the first light source type from the multiple displayed light source type options through touch control, voice control, etc. according to actual needs.

[0044] Step 120: In response to the second gesture, adjust light source parameters of the first light source.

[0045] In some embodiments of the present application, the second gesture is a pre-set gesture for instructing the electronic device to adjust the light source parameters of the light source created in the extended real space. Here, adjusting the light source parameters refers to adjusting the parameter values ​​of the light source parameters, and the light source parameters include but are not limited to the attribute parameters, position parameters, etc. of the light source.

[0046] In some embodiments of the present application, in the above step 110, the electronic device creates a first light source based on the default values ​​of the light source parameters. Therefore, the parameter values ​​of the light source parameters of the first light source just created are pre-set default values. Since different extended reality spaces have different fill light requirements, the default values ​​of the light source parameters usually cannot meet the actual lighting compensation requirements of the current extended reality space. In view of this, in order to better perform lighting compensation for the extended reality space, after creating the first light source, the user can adjust the light source parameters of the first light source through a second gesture in combination with the three-dimensional characteristics of the current extended reality space and the device characteristics of the electronic device, so that the first light source after parameter adjustment can meet the actual lighting compensation requirements of the extended reality space. In this way, by performing lighting compensation for the extended reality space through the first light source after parameter adjustment, the lighting effect of the extended reality space can be improved.

[0047] In some embodiments of the present application, when the user determines that the light source parameters of the first light source need to be adjusted, the user performs a second gesture, and when the electronic device recognizes that the user performs the second gesture based on the sensor capturing the user's hand movement, the electronic device performs an action associated with the second gesture to adjust the light source parameters of the first light source. The action associated with the second gesture is an action for adjusting the parameter value of the light source parameter.

[0048] The brightness adjustment method provided in the embodiment of the present application creates a first light source in the extended reality space in response to a first gesture; and adjusts the light source parameters of the first light source in response to a second gesture, so as to perform lighting compensation on the extended reality space through the first light source after parameter adjustment. According to the embodiment of the present application, dimming the extended reality space no longer adopts the planar brightness adjustment method, but based on the three-dimensional characteristics of the extended reality space and the device specificity of the electronic device, the first light source is conveniently created and adjusted through gestures, so that the content of the extended reality space can be customized with lighting adjustment in the case of existing natural light rendering, and lighting compensation for the extended reality space is achieved, so that the lighting effect of the extended reality space meets the user's expectations. Compared with traditional planar brightness adjustment, this embodiment is based on dimming of the light source, which can simulate natural lighting effects, achieve more realistic light and shadow interaction, make the extended reality space look more real, and improve the brightness effect of the extended reality space.

[0049] In some embodiments, in the above step 110 , the first light source may be created through the following steps 1101 - 1102 .

[0050] Step 1101. In response to a first gesture, determine second posture information of a first light source based on the first posture information of the first gesture.

[0051] In some embodiments of the present application, the first position information of the first gesture refers to the position information of the gesture finger when the user performs the first gesture. The gesture finger is the hand used by the user to perform the gesture, and the gesture hand may include any one or both hands of the user, and different gestures may correspond to different gesture hands.

[0052] In some embodiments of the present application, when the user performs the first gesture, the electronic device collects the motion of the gesturing hand through a sensor, and determines the first position information of the first gesture based on the collected motion of the gesturing hand. The first position information includes at least one of the following: the position coordinates of the gesturing hand and the posture of the gesturing hand.

[0053] In some embodiments of the present application, the position coordinates of the gesture hand refer to the relative position coordinates of the gesture hand relative to the origin coordinates (0, 0, 0) of the electronic device. The origin coordinates of the electronic device are the zero point coordinates defined by the electronic device itself. The origin coordinates of different electronic devices may be different. This embodiment does not specifically limit the definition of the origin coordinates.

[0054] In some embodiments of the present application, the posture of the gesturing hand refers to various shapes and states presented by the gesturing hand, which can be formed by bending, stretching, rotating and coordinating the fingers and palms.

[0055] In some embodiments of the present application, the second posture information refers to the initial posture information of the first light source when it is created. The second posture information includes the initial position coordinates and / or initial posture of the first light source. Similar to the position coordinates of the gesture hand, the initial position coordinates in the second posture information refer to the relative position coordinates of the first light source relative to the origin coordinates (0, 0, 0) of the electronic device.

[0056] In some embodiments of the present application, according to actual needs, a first functional relationship between the first pose information and the second pose information is preset. Based on this, after the first pose information is determined, the second pose information is determined based on the first pose information and the preset first functional relationship. Among them, the first functional relationship is used to indicate the corresponding relationship between the first pose information and the second pose information, and the expression form of the first functional relationship includes but is not limited to mathematical expressions, graphs, tables, etc.

[0057] In some embodiments of the present application, the first gesture is a dynamic gesture in which the user's gesture hand is in a fist state and throws in the throwing direction, and after throwing, the fist opens into a palm. Dynamic gestures are relative to static gestures and refer to gestures that convey information, express intentions, or interact through changes in hand movements. For example, the first gesture is a user's gesture hand such as Figure 2 (a) shows the clenched fist state. Figure 2(b) shows a dynamic gesture of opening a fist into a palm after throwing in the direction B. Here, the user's gesture hand can be the user's left hand or right hand. Figure 2 (a) and Figure 2 (b) Only the user's gesture hand is taken as an example. Based on this, the electronic device determines that the user is performing the first gesture when it detects that the user's gesture hand is thrown in any direction in a fist state, and the fist is opened into a palm after throwing. After recognizing that the user is performing the first gesture, the position coordinates of the gesture hand at the first moment are determined, and the position coordinates of the gesture hand at the first moment are determined as the first position information of the gesture hand. Among them, the first moment is the moment when the gesture hand opens from a fist to a palm after throwing. After the gesture hand opens from a fist to a palm, the direction perpendicular to the palm is determined as the first direction, and the preset first function relationship is used to indicate the first distance between the position coordinates of the gesture hand at the first moment and the initial position coordinates of the first light source, wherein the first distance is a preset value set according to actual needs. Based on this, after determining the position coordinates of the gesture hand at the first moment, based on the first function relationship and the position coordinates of the gesture hand at the first moment, the initial position coordinates of the first light source can be calculated, and the initial position coordinates of the first light source are used as the second position information.

[0058] For example, see Figure 2 (b), the position coordinates of the gesture hand at the first moment are H 0 (a 0 ,b 0 ,c 0 ), the first distance is d, and the initial position coordinates of the first light source 201 are S 0 (x 0 ,y 0 ,z 0 ).

[0059] In some embodiments of the present application, the first functional relationship is shown in the following formula (1):

[0060]

[0061] In the above formula (1), d is a set value, and the value of d is preset according to actual needs.

[0062] Step 1102. Create a first light source in the extended reality space based on the second posture information.

[0063] In some embodiments of the present application, after obtaining the second posture information, the initial position coordinates and / or initial posture of the first light source in the extended reality space are determined based on the second posture information, and then the first light source is created in the extended reality space based on the initial position coordinates and / or initial posture.

[0064] In some embodiments of the present application, the second posture information includes the initial position coordinates of the first light source in the extended reality space, based on which the electronic device creates the first light source at the initial position coordinates in response to the first gesture.

[0065] In the above manner, the initial position information of the first light source is determined based on the user's first gesture, so that the user can freely specify the creation position and / or posture of the first light source in the extended state space through the first gesture according to the actual application scenario, thereby improving the flexibility of light source creation and meeting the user's personalized needs. Moreover, this interaction method can make the user more immersed in the extended reality environment, because when the user uses the first gesture to determine the position information of the first light source, he will feel that he has established a more direct connection with the extended reality space, as if his body movements can really affect this space.

[0066] In some embodiments, in the above step 120 , in response to the second gesture, adjusting the light source parameters of the first light source includes the following steps 1201 - 1202 .

[0067] Step 1201. In response to a second gesture, determine a first light source parameter to be adjusted and a parameter adjustment amount of the first light source parameter.

[0068] In some embodiments of the present application, the first light source parameter refers to the light source parameter of the first light source that needs to be adjusted this time. Exemplarily, the light source parameters of the first light source include but are not limited to attribute parameters such as light source radius, light intensity, light source scattering angle, light source color, and light source position. In order to achieve accurate parameter adjustment, when adjusting the light source parameters of the first light source based on the second gesture, first determine the first light source parameters that need to be adjusted this time.

[0069] In some embodiments of the present application, the second gesture may include multiple sub-gestures corresponding to different light source parameters, one sub-gesture corresponds to one light source parameter, and an association relationship between the light source parameter and the sub-gesture of the second gesture is pre-established. When the electronic device recognizes that the user performs any sub-gesture, it is determined that the user performs the second gesture. Among them, the postures of different sub-gestures are different. Based on this, in the above step 1201, the electronic device responds to the second gesture and determines the first light source parameter to be adjusted according to the fifth posture information of the second gesture. Here, the fifth posture information includes the posture information of the second gesture from the start time to the end time. Based on the fifth posture information, the sub-gesture performed by the user can be determined, so that the light source parameter associated with the sub-gesture performed by the user is determined as the first light source parameter to be adjusted. Among them, the starting time of the second gesture refers to the moment when the gesture action begins to occur, that is, the time point when the gesture hand starts to displace, change shape or perform other meaningful actions from a stationary state. The end time of the second gesture is the time point when the gesture action is completed.

[0070] In some embodiments of the present application, the light source parameters of the first light source include light source radius, light intensity, light source scattering angle and light source position, and the second gesture includes a first sub-gesture, a second sub-gesture, a third sub-gesture and a fourth sub-gesture. Among them, the first sub-gesture is associated with the light source radius, and is used to instruct the electronic device to adjust the light source radius, the second sub-gesture is associated with the light source intensity, and is used to instruct the electronic device to adjust the light source scattering angle, the third sub-gesture is associated with the light intensity, and is used to instruct the electronic device to adjust the light intensity, and the fourth sub-gesture is associated with the light source spatial position, and is used to instruct the electronic device to adjust the light source spatial position. Based on this, in the above step 1201, the first light source parameters can be determined in the following manner:

[0071] In response to the second gesture, when the second gesture is determined to be a first sub-gesture based on the fifth posture information of the second gesture, a light source radius associated with the first sub-gesture is determined as a first light source parameter;

[0072] In response to the second gesture, when the second gesture is determined to be a second sub-gesture based on the fifth posture information of the second gesture, a light source scattering angle associated with the second sub-gesture is determined as a first light source parameter;

[0073] In response to the second gesture, when the second gesture is determined to be a third sub-gesture based on the fifth posture information of the second gesture, determining the illumination intensity associated with the third sub-gesture as the first light source parameter;

[0074] and / or

[0075] In response to the second gesture, when the second gesture is determined to be a fourth sub-gesture based on the fifth posture information of the second gesture, the spatial position of the light source associated with the fourth sub-gesture is determined as the first light source parameter.

[0076] By using different sub-gestures to adjust different light source parameters, each sub-gesture has a clear corresponding light source parameter, and the required light source parameter can be quickly located and adjusted directly through the sub-gesture, reducing misoperation caused by similar or confused operations. In addition, because different light source parameters require different degrees of fine adjustment, by setting specific sub-gestures for each light source parameter, the corresponding adjustment method can be customized according to the characteristics of each light source parameter, thereby achieving more precise control.

[0077] In some embodiments of the present application, the extended reality space is a three-dimensional space, and the spatial position of the light source created in the extended reality space is a three-dimensional position coordinate including coordinate values ​​in three directions of the X-axis, the Y-axis, and the Z-axis. In order to realize a multi-granularity adjustment method for adjusting the spatial position of the light source from different directions, the second gesture may also include multiple sub-gestures for instructing the electronic device to adjust the spatial position of the light source in a single direction or in two directions, and different sub-gestures correspond to different position adjustment directions. For example, the second gesture may also include a fifth sub-gesture, a sixth sub-gesture, a seventh sub-gesture, an eighth sub-gesture, a ninth sub-gesture, and a tenth sub-gesture. Among them, the fifth sub-gesture is used to instruct the electronic device to adjust the position coordinates of the light source in the X-axis direction, and the light source parameter associated with the fifth sub-gesture is the position coordinates of the light source in the X-axis direction; the sixth sub-gesture is used to instruct the electronic device to adjust the position coordinates of the light source in the Y-axis direction, and the light source parameter associated with the sixth sub-gesture is the position coordinates of the light source in the Y-axis direction; the seventh sub-gesture is used to instruct the electronic device to adjust the position coordinates of the light source in the Z-axis direction, and the light source parameter associated with the seventh sub-gesture is the position coordinates of the light source in the Z-axis direction; the eighth sub-gesture is used to instruct the electronic device to adjust the position coordinates of the light source in the X-axis and Y-axis directions, and the light source parameter associated with the eighth sub-gesture is the position coordinates of the light source in the X-axis and Y-axis directions; the ninth sub-gesture is used to instruct the electronic device to adjust the position coordinates of the light source in the X-axis and Z-axis directions, and the light source parameter associated with the ninth sub-gesture is the position coordinates of the light source in the X-axis and Z-axis directions; the tenth sub-gesture is used to instruct the electronic device to adjust the position coordinates of the light source in the Y-axis and Z-axis directions, and the light source parameter associated with the tenth sub-gesture is the position coordinates of the light source in the Y-axis and Z-axis directions. Based on this, in the above step 1201, determining the first light source parameter may also include:

[0078] In response to the second gesture, when the second gesture is determined to be a fifth sub-gesture based on the fifth posture information of the second gesture, the position coordinates of the light source associated with the fifth sub-gesture in the X-axis direction are determined as the first light source parameters;

[0079] In response to the second gesture, when the second gesture is determined to be a sixth sub-gesture based on the fifth posture information of the second gesture, the position coordinates of the light source associated with the sixth sub-gesture in the Y-axis direction are determined as the first light source parameters;

[0080] In response to the second gesture, when the second gesture is determined to be a seventh sub-gesture based on the fifth posture information of the second gesture, the position coordinates of the light source associated with the seventh sub-gesture in the Z-axis direction are determined as the first light source parameters;

[0081] In response to the second gesture, when it is determined that the second gesture is the eighth sub-gesture based on the fifth pose information of the second gesture, the position coordinates of the light source associated with the eighth sub-gesture in the X-axis and Y-axis directions are determined as the first light source parameter;

[0082] In response to the second gesture, when it is determined that the second gesture is the ninth sub-gesture based on the fifth pose information of the second gesture, the position coordinates of the light source associated with the ninth sub-gesture in the X-axis and Z-axis directions are determined as the first light source parameter; and / or,

[0083] In response to the second gesture, when it is determined that the second gesture is the tenth sub-gesture based on the fifth pose information of the second gesture, the position coordinates of the light source associated with the tenth sub-gesture in the Y-axis and Z-axis directions are determined as the first light source parameter.

[0084] Through the above method, it is possible to adjust the spatial position of the first light source in one direction or multiple directions, realizing multi-granularity adjustment of the spatial position of the light source and improving the flexibility of position adjustment.

[0085] In some embodiments of the present application, the second gesture is a dynamic gesture, and different parameter adjustment amounts are represented by different poses of the gesture hand in the second gesture. Based on this, when adjusting the first light source parameter based on the second gesture, the pose information of the user's gesture hand in the second gesture can be determined, and the parameter adjustment amount of the first light source parameter can be determined based on the pose information of the gesture hand.

[0086] In some embodiments of the present application, when the user executes the second gesture, the electronic device collects the actions of the user's gesture hand through a sensor. Based on this, the electronic device can determine the pose information of the gesture hand based on the collected actions of the gesture hand.

[0087] In some embodiments of the present application, the parameter adjustment amount can be reflected by the degree of pose change of the gesture hand in the second gesture, or the parameter adjustment amount can be reflected by the pose information of the gesture hand at the end moment. Based on this, when determining the pose information of the gesture hand in the second gesture, the third pose information of the user's gesture hand at the start moment of the second gesture and / or the fourth pose information of the gesture hand at the end moment of the second gesture can be determined, and then the parameter adjustment amount of the first light source parameter is determined according to the third pose information and / or the fourth pose information.

[0088] In some embodiments of the present application, a second functional relationship between the posture information of the gesturing hand in the second gesture and the parameter adjustment amount of the first light source parameter is pre-established. Based on this, after the posture information of the gesturing hand is determined, the parameter adjustment amount of the first light source parameter can be determined based on the posture information and the second functional relationship. Among them, the second functional relationship is used to represent the corresponding relationship between the posture information of the gesturing hand in the second gesture and the parameter adjustment amount of the first light source parameter. The expression form of the second functional relationship includes but is not limited to tables, graphs, mathematical expressions, etc. In the second gesture, different sub-gestures correspond to different second functional relationships, and the second functional relationship corresponding to each sub-gesture can be set according to the sub-gesture and actual needs, which is not specifically limited in this embodiment.

[0089] The following is an example of how to determine the parameter adjustment amount of the first light source parameter in response to the second gesture. For example, the second gesture performed by the user is a first sub-gesture for adjusting the radius R of the light source. The first sub-gesture is when the user's two hands move from Figure 3 The palm closure state shown in (a) is switched to Figure 3 (b) is a dynamic gesture in a mutually parallel state as shown. The gesture hand of the user in the first sub-gesture includes the two hands of the user. Based on this, when the electronic device detects that the two hands of the user switch from the palm-closed state to the mutually parallel state, it determines that the first sub-gesture of the user is recognized. In response to the first sub-gesture, the electronic device determines the moment when the two hands of the user start to move apart from the palm-closed state in parallel as the starting moment of the first sub-gesture, and the moment when the two hands are pulled apart in parallel for a certain distance and the distance between the two hands no longer changes is determined as the termination moment of the first sub-gesture. Determine the fourth posture information of the two hands at the termination moment, wherein the fourth posture information is used to indicate the second distance m between the palms of the two hands. The fourth posture information is determined as the posture information of the first sub-gesture. The second functional relationship corresponding to the first sub-gesture includes the following formula (2):

[0090]

[0091] In the above formula (2), R n+1 Indicates the adjusted light source radius, R n Indicates the radius of the light source before this adjustment, T 1 represents the mapping multiple between the self-defined distance between the two palms and the increased diameter of the light source, and m represents the third posture information of the user's gesture hand in the first sub-gesture, that is, the second distance between the user's two palms at the end time, for example Figure 3 Based on this, after determining the position information of the first sub-gesture, the radius R of the light source after adjustment of the first light source 301 can be calculated by substituting m in the position information into the above formula (2). n+1, according to the light source radius R n+1 and R n The difference is used to determine the parameter adjustment amount for the light source radius.

[0092] For example, the second gesture performed by the user is a second sub-gesture for adjusting the light source scattering angle A. The second sub-gesture is a gesture of the user's two hands moving in a direction such as Figure 4 (a) shows that the fingertips are touching each other and the angle between the fingertips is 0°. The angle between the fingertips is changed by closing or opening the palms of the two hands. For example, the second sub-gesture is to change the angle between the fingertips from Figure 4 The initial angle shown in (a) is switched to Figure 4 (b) is a dynamic gesture at the angle shown in the figure. The gesture hand of the user in the second sub-gesture includes the two hands of the user. Based on this, when the electronic device detects that the angle between the fingertips of the two hands of the user changes by closing or opening the palms of the two hands when the fingertips are against each other and the angle between the fingertips is the initial angle, the electronic device determines that the second sub-gesture of the user is recognized. In response to the second sub-gesture, the electronic device determines the moment when the angle between the fingertips of the two hands of the user begins to change as the starting moment of the second sub-gesture, and determines the moment when the angle between the fingertips of the two hands of the user changes by closing or opening the palms and the angle no longer changes as the termination moment of the second sub-gesture, and determines the fourth position information of the two hands at the termination moment, wherein the fifth position information includes the angle θ between the fingertips of the two hands at the termination moment, and determines the fourth position information as the position information of the second sub-gesture. The second functional relationship corresponding to the second sub-gesture includes the following formula (3):

[0093] θ=2A (3)

[0094] In the above formula (3), θ represents the posture information of the user's gesture hand in the second sub-gesture, and A represents the vertex angle of the light source scattering after adjustment. The electronic device adjusts the light source scattering angle by changing the vertex angle of the light source scattering. Based on this, after obtaining the fourth posture information of the second sub-gesture, the θ in the fourth posture information is substituted into the above formula (3) to calculate the vertex angle A of the first light source 401 after adjustment, and by subtracting the vertex angle A from the vertex angle of the light source scattering before this adjustment, the adjustment amount of the light source scattering angle adjustment this time can be obtained.

[0095] For example, the second gesture performed by the user is a third sub-gesture for adjusting the light intensity. Figure 5 As shown, the user's gesture hand is a dynamic gesture of flapping upward or downward with the palm open and facing downward. Here, the gesture hand can be the user's left hand or right hand. Figure 5Take the gesture hand as the right hand as an example. Based on this, when the electronic device detects that the gesture hand of the user is flapping upward or downward with the palm open and the palm facing downward, it determines that the third sub-gesture of the user is recognized. In response to the third sub-gesture, the moment when the gesture hand of the user starts flapping upward or downward with the palm open and the palm facing downward is determined as the starting moment of the third sub-gesture, and the moment when the gesture hand of the user stops flapping upward or downward is determined as the termination moment of the third sub-gesture, and the fourth posture information of the gesture hand at the termination moment is determined, wherein the fifth posture information includes the palm orientation of the gesture hand at the termination moment, and the fourth posture information is determined as the posture information of the third sub-gesture. The second functional relationship corresponding to the third sub-gesture includes: when the posture information of the third sub-gesture indicates that the palm orientation of the gesture hand is the second direction at the termination moment, the first value is used as the light intensity adjustment amount of the light source, and when the posture information of the third sub-gesture indicates that the palm orientation of the gesture hand is the third direction at the termination moment, the second value is used as the light intensity adjustment amount of the light source. Among them, the second direction is the direction of the palm of the hand after the gesture hand is flapped upward, and the third direction is the direction of the palm of the hand after the gesture hand is flapped downward. The first value is a positive value, which is used to increase the light intensity, and the second value is a negative value, which is used to reduce the light intensity. The specific values ​​of the first value and the second value can be customized according to actual conditions, and this embodiment does not make specific restrictions on this. Based on this, the direction of the palm of the hand at the termination time is determined according to the posture information of the third sub-gesture, and then the first value or the second value is determined as the parameter adjustment amount for this light intensity adjustment.

[0096] For example, the second gesture performed by the user is a fourth sub-gesture for adjusting the spatial position of the light source. The fourth sub-gesture is a dynamic gesture in which the user moves in any direction while the gesture hand maintains a fist posture, for example, Figure 6 As shown, the fourth gesture is the gesture of the user's hand while maintaining a fist posture. Figure 6 Move to the position shown in (a) Figure 6 (b) Here, the gesture hand can be the user's left hand or right hand. Figure 6 (a) and Figure 6(b) Only take the gesture hand as the right hand as an example. Based on this, when the electronic device detects that the gesture hand of the user moves in any direction while maintaining a fist posture, it determines that the fourth sub-gesture of the user is recognized. In response to the fourth sub-gesture, the moment when the gesture hand of the user starts to move from a static state while maintaining a fist posture is determined as the starting moment of the fourth sub-gesture, and the moment when the gesture hand of the user moves a certain distance and no longer moves while maintaining a fist posture is determined as the ending moment of the fourth sub-gesture. The third posture information of the gesture hand at the starting moment and the fourth posture information at the ending moment are determined, wherein the third posture information includes the position coordinates of the gesture hand at the starting moment, and the fourth posture information includes the position coordinates of the gesture hand at the ending moment. The fourth posture information and the fifth posture information are jointly determined as the third posture information of the gesture hand of the user in the fourth sub-gesture. The second functional relationship corresponding to the fourth sub-gesture includes: based on the position coordinates of the gesture hand at the starting moment and the position coordinates of the gesture hand at the ending moment, respectively determine the moving distances of the gesture hand in the X-axis direction, the Y-axis direction and the Z-axis direction, use the moving distance of the gesture hand in the X-axis direction as the adjustment amount of the spatial position in the X-axis direction, use the moving distance of the gesture hand in the Y-axis direction as the adjustment amount of the spatial position in the Y-axis direction, and use the moving distance of the gesture hand in the Z-axis direction as the adjustment amount of the spatial position in the Z-axis direction. Based on this, according to the above second functional relationship and the posture information of the fourth sub-gesture, the position adjustment amounts of the first light source 601 in the X-axis direction, the Y-axis direction and the Z-axis direction can be determined, so that the first light source 601 is adjusted from Figure 6 (a) and adjust it to Figure 6 (b) The position shown.

[0097] For example, the second gesture performed by the user is a fifth sub-gesture for instructing the electronic device to adjust the position coordinates of the light source in the X-axis direction. The fifth sub-gesture is a gesture of the user's hand in the following manner: Figure 7 As shown, the thumb and index finger are pinched together and move in the X-axis direction. Here, the gesture hand can be the left hand or the right hand. Figure 7 Take the gesture hand as the right hand as an example. Based on this, the electronic device detects that the gesture hand of the user is kept as follows Figure 7 In the case where the user moves in the X-axis direction in the state shown, it is determined that the fifth sub-gesture of the user is recognized, and in response to the fifth sub-gesture, the user's gesture hand is moved while maintaining the gesture hand as shown in FIG. Figure 7 The moment when the user's gesture hand starts to move from being stationary in the state shown in FIG. 1 is determined as the starting moment of the fifth sub-gesture. Figure 7The moment when the hand gesture has moved a certain distance and then stops moving in the shown state is determined as the termination moment of the fifth sub-gesture. Determine the third pose information of the gesture hand at the starting moment and the fourth pose information at the termination moment. Among them, the third pose information includes the position coordinates of the gesture hand at the starting moment, and the fourth pose information includes the position coordinates of the user's gesture hand at the termination moment. The third pose information and the fourth pose information are jointly determined as the pose information of the fifth sub-gesture. The second functional relationship corresponding to the fifth sub-gesture includes: based on the position coordinates of the gesture hand at the starting moment and the position coordinates of the gesture hand at the termination moment, determine the moving distance of the gesture hand in the X-axis direction, and use the moving distance of the gesture hand in the X-axis direction as the adjustment amount of the spatial position in the X-axis direction. Based on this, based on the above second functional relationship and the pose information of the fifth sub-gesture, the position adjustment amount of the first light source in the X-axis direction can be determined.

[0098] Exemplarily, taking the second gesture executed by the user as the sixth sub-gesture for instructing the electronic device to adjust the position coordinates of the light source in the Y-axis direction as an example. Among them, the sixth sub-gesture is a dynamic gesture in which the user's gesture hand moves in the Y-axis direction in the state where the pulp of the thumb and the pulp of the middle finger are pinched and not released as shown in Figure 8 the figure. Here, the gesture hand can be the left hand or the right hand, Figure 8 and only taking the gesture hand as the right hand as an example. Based on this, when the electronic device detects that the user's gesture hand moves in the Y-axis direction while maintaining the state as shown in Figure 8 the figure, it is determined that the user's sixth sub-gesture is recognized. In response to the sixth sub-gesture, the moment when the user's gesture hand starts to move from a stationary state while maintaining the state as shown in Figure 8 the figure is determined as the starting moment of the sixth sub-gesture, and the moment when the user's gesture hand moves a certain distance and then stops moving while maintaining the state as shown in Figure 8 the figure is determined as the termination moment of the sixth sub-gesture. Determine the third pose information of the gesture hand at the starting moment and the fourth pose information at the termination moment. Among them, the third pose information includes the position coordinates of the gesture hand at the starting moment, and the fourth pose information includes the position coordinates of the user's gesture hand at the termination moment. The third pose information and the fourth pose information are jointly determined as the pose information of the sixth sub-gesture. The second functional relationship corresponding to the sixth sub-gesture includes: based on the position coordinates of the gesture hand at the starting moment and the position coordinates of the gesture hand at the termination moment, determine the moving distance of the gesture hand in the Y-axis direction, and use the moving distance of the gesture hand in the Y-axis direction as the adjustment amount of the spatial position of the first light source in the Y-axis direction. Based on this, according to the above second functional relationship and the pose information of the sixth sub-gesture, the adjustment amount of the spatial position of the first light source in the Y-axis direction can be determined.

[0099] For example, the second gesture performed by the user is the seventh sub-gesture for instructing the electronic device to adjust the position coordinates of the light source in the Z-axis direction. Fig. 9 As shown, the thumb and ring finger are pinched together and move in the Z-axis direction. Here, the gesture hand can be the left hand or the right hand. Fig. 9 Take the gesture hand as the right hand as an example. Based on this, the electronic device detects that the gesture hand of the user is kept as follows Fig. 9 In the case where the user moves in the Z-axis direction in the state shown in FIG. 1 , it is determined that the seventh sub-gesture of the user is recognized. In response to the seventh sub-gesture, the user's gesture hand is moved while maintaining the gesture hand as shown in FIG. Fig. 9 The moment when the user's gesture hand starts to move from rest in the state shown in FIG. 1 is determined as the starting moment of the seventh sub-gesture. Fig. 9 The moment when the gesture hand moves a certain distance and stops moving in the state shown is determined as the termination moment of the seventh sub-gesture, and the third posture information of the gesture hand at the starting moment and the fourth posture information at the termination moment are determined, wherein the third posture information includes the position coordinates of the gesture hand at the starting moment, and the fourth posture information includes the position coordinates of the gesture hand of the user at the termination moment, and the third posture information and the fourth posture information are jointly determined as the posture information of the seventh sub-gesture. The second functional relationship corresponding to the seventh sub-gesture includes: based on the position coordinates of the gesture hand at the starting moment and the position coordinates of the gesture hand at the termination moment, determining the moving distance of the gesture hand in the Z-axis direction, and using the moving distance of the gesture hand in the Z-axis direction as the adjustment amount of the spatial position of the first light source in the Z-axis direction. Based on this, according to the above-mentioned second functional relationship and the posture information of the seventh sub-gesture, the adjustment amount of the spatial position of the first light source in the Z-axis direction can be determined.

[0100] In some embodiments of the present application, if you want to adjust the spatial position of the light source in any two directions, you can use the method of pinching the thumb tip + the first finger tip + the second finger tip together without releasing them to adjust, where the first finger can be any finger other than the thumb, and the second finger can be any finger other than the thumb and the first finger.

[0101] For example, the second gesture performed by the user is an eighth sub-gesture for instructing the electronic device to adjust the position coordinates of the light source in the X-axis and Y-axis directions, wherein the eighth sub-gesture is a gesture of the user's hand in the following manner: Fig.10 As shown, the thumb, index finger and middle finger are pinched together and move in the X-axis and Y-axis directions. Here, the gesture hand can be the left hand or the right hand. Fig.10 Take the gesture hand as the right hand as an example. Based on this, the electronic device detects that the gesture hand of the user is kept as follows Fig.10In the state shown in FIG. 1 , when the user moves in both the X-axis and Z-axis directions, it is determined that the user's eighth sub-gesture is recognized. In response to the eighth sub-gesture, the user's gesture hand is moved while maintaining the gesture hand as shown in FIG. Fig.10 The moment when the user's gesture hand starts to move from being stationary in the state shown in FIG. 1 is determined as the starting moment of the eighth sub-gesture. Fig.10 The moment when the gesture hand moves a certain distance and stops moving in the state shown is determined as the termination moment of the eighth sub-gesture, and the third posture information of the gesture hand at the starting moment and the fourth posture information at the termination moment are determined, the third posture information includes the position coordinates of the gesture hand at the starting moment, and the fourth posture information includes the position coordinates of the gesture hand of the user at the termination moment, and the third posture information and the fourth posture information are jointly determined as the posture information of the eighth sub-gesture. The second functional relationship corresponding to the eighth sub-gesture includes: based on the position coordinates of the gesture hand at the starting moment and the position coordinates of the gesture hand at the termination moment, determining the moving distance of the gesture hand in the X-axis direction and the Y-axis direction, using the moving distance of the gesture hand in the X-axis direction as the adjustment amount of the spatial position in the X-axis direction, and using the moving distance of the gesture hand in the Y-axis direction as the adjustment amount of the spatial position of the first light source in the Y-axis direction. Based on this, according to the above second functional relationship and the posture information of the eighth sub-gesture, the adjustment amount of the spatial position of the first light source in the Y-axis direction can be determined.

[0102] The ninth and tenth sub-gestures are similar to the eighth sub-gesture, and are not described here one by one. Step 1202: Adjust the first light source parameter of the first light source based on the parameter adjustment amount.

[0103] In some embodiments of the present application, after determining the first light source parameters to be adjusted and the parameter adjustment amount of the first light source parameters, the electronic device can adjust the first light source parameters of the first light source based on the parameter adjustment amount, and the first light source with adjusted parameters can be obtained through the adjustment.

[0104] It should be noted that after the scattering angle of the first light source is adjusted, the light source type of the first light source remains unchanged, but the luminous range is adjusted. For example, when the created first light source is a point light source, after the scattering angle of the first light source is adjusted based on the second sub-gesture, the light source type of the first light source is still a point light source, but the luminous range is adjusted. For example, before adjustment, the vertex angle of the first light source is 0°, and when the posture information of the second sub-gesture is 90°, after the scattering angle of the first light source is adjusted based on the second sub-gesture, the first light source changes from a ray light in a single direction to a spotlight light source with a vertex angle of 45°. For another example, before adjustment, the vertex angle of the first light source is 0°, and when the posture information of the second sub-gesture is 360°, after the scattering angle of the first light source is adjusted based on the second sub-gesture, the first light source can be regarded as a light source that emits light in all directions in the extended reality space. When the first light source created is a surface light source, after the scattering angle of the first light source is adjusted based on the second sub-gesture, the light source type of the first light source is still a surface light source, but the angle of the light-emitting surface is adjusted, and the light is always perpendicular to the light-emitting surface and is adjusted accordingly. For example, before adjustment, the vertex angle of the first light source is 90°. When the position information of the second sub-gesture is θ, the center of the first light source is the unchanged vertex, and each radius is regarded as a cone mother line and follows the change until it becomes a conical surface with a vertex angle of θ / 2. At this time, the light is still perpendicular to the light-emitting surface.

[0105] Based on the above solutions of step 1201 and step 1202 , the user can conveniently adjust the light source parameters of the first light source through the second gesture.

[0106] In some embodiments, the state of the light source created in the extended reality space includes an editing state and a non-editing state. When the light source is in the editing state, the light source parameters of the light source can be adjusted, and when the light source is in the non-editing state, the light source parameters of the light source cannot be adjusted. The user can switch the state of the light source between the editing state and the non-editing state according to actual needs.

[0107] By distinguishing between the editing state and the non-editing state, it is helpful to reduce the misoperation of the light source parameters. When the light source is in the non-editing state, the user cannot adjust the light source parameters of the light source, which can prevent the user from accidentally modifying the light source parameters. In this state, the user can safely perform other interactive activities with the extended real space.

[0108] Accordingly, since the light source parameters can be adjusted only when the light source is in the editing state, before the above-mentioned step 120, the state of the first light source can be set to the editing state first, and then, when the electronic device determines that the state of the first light source is the editing state, it executes the step of adjusting the light source parameters of the first light source in response to the second gesture.

[0109] In some embodiments of the present application, the user may switch the state of the first light source to the editing state through a third gesture. Based on this, before the above step 120, the electronic device may further perform the following steps:

[0110] In response to the third gesture, the state of the first light source is switched to an editing state.

[0111] Here, the third gesture is a gesture for instructing the electronic device to turn on the light source editing mode. In the light source editing mode, the electronic device sets the state of the selected light source to the editing state.

[0112] In some embodiments of the present application, the third gesture is a dynamic gesture in which the gesture hand moves from away from the body to close to the body while the five fingertips are pinched together. The gesture hand can be the left hand or the right hand of the user, which is not specifically limited in this embodiment.

[0113] In some embodiments of the present application, the electronic device can set the only light source or a newly created light source in the extended reality space as the selected light source by default. In this way, when the first light source is just created, or there is only the first light source in the extended reality space, the electronic device can directly switch the state of the first light source to the editing state in response to the third gesture.

[0114] In some embodiments of the present application, the user can create multiple light sources in the extended reality space according to actual needs. When the extended reality space includes multiple light sources, and the multiple light sources include the first light source, the user can select the first light source from the multiple light sources as the selected light source, so that the electronic device switches the state of the selected first light source to the editing state in response to the third gesture.

[0115] In some embodiments of the present application, when the extended reality space includes multiple light sources, and the multiple light sources include a first light source, the electronic device may default to a light source that is closest to the user's hand in a straight line as the selected light source. At this time, if the light source that is closest to the user's hand in a straight line is the first light source, there is no need to switch the selected light source. If the light source that is closest to the user's hand in a straight line is not the first light source, the user may switch the selected light source through a switching gesture until the selected light source is switched to the first light source. The switching gesture is a gesture used to instruct the electronic device to switch the selected light source.

[0116] In some embodiments of the present application, the switching gesture is as follows Fig.11 The dynamic gestures shown in Figure 1 are as follows. Fig.11 As shown in FIG. 1 , the user instructs the electronic device to switch the selected light source by waving the palm of the gesture hand to the left or to the right, and switches one light source each time the palm is flapped. Here, the gesture hand is the user's left hand or right hand, such as Fig.11 Just take the gesture hand as the user's right hand as an example.

[0117] Through the above method, when there are multiple light sources in the extended reality space, the user can switch the light source that needs to be edited according to actual needs, thereby improving the flexibility of light source adjustment.

[0118] In some embodiments, after the first light source is created, the user can adjust the first light source multiple times according to the actual situation, and each adjustment is made on the basis of the previous adjustment. In this way, more refined effect adjustment can be achieved through superposition adjustment. Each time a small amount of superposition is made on the existing basis, the ideal effect can be gradually achieved, avoiding over-adjustment or effect deviation that may be caused by a one-time large-scale readjustment.

[0119] In some embodiments, a fifth gesture is pre-set for instructing the electronic device to exit editing the light source. Based on this, when the first light source meets the expected effect through adjustment, the user can instruct the electronic device to exit editing the first light source through the fifth gesture, and the electronic device responds to the user's fifth gesture and switches the first light source from a selected light source to an unselected light source, thereby setting the first light source to a non-editing state, thereby exiting editing the first light source.

[0120] In some embodiments of the present application, the fifth gesture is as follows Fig.12 The dynamic gestures shown, such as Fig.12 As shown, the user can exit the editing of the first light source by touching the back of the middle finger and the pulp of the thumb of the gesture hand, and then ejecting the middle finger outward. Here, the gesture hand can be the left hand or the right hand. Fig.12 Just take the right hand as an example.

[0121] Through the above technical solution, the user can exit the editing of the light source at any time through gestures according to the actual situation, which improves flexibility and convenience. After completing the adjustment of the first light source, by exiting the editing of the first light source, it is convenient to perform other gesture interaction activities with the extended real space.

[0122] In some embodiments, a fourth gesture is pre-set to instruct the electronic device to delete the light source from the extended real space. Based on this, when the first light source is in the editing state, the electronic device may further perform the following steps:

[0123] In response to the fourth gesture, the first light source is removed from the extended reality space.

[0124] In some embodiments of the present application, the fourth gesture is as follows Fig.13 The dynamic gestures shown in Figure 1 are as follows. Fig.13 As shown, when clearing the first light source 1301, the user can first move the gesture hand from Fig.13 The palm shown in (a) changes into Fig.13 (b) to hold the first light source 1301, and after holding the first light source 1301, Fig.13 As shown in (b), press your wrist until your fist is pointing vertically downward, then Fig.13 (c) shows the fist being unclenched, thereby controlling the electronic device to remove the first light source 1301 in the editing state from the extended reality space.

[0125] Through the above solution, users can delete light sources in the extended reality space according to actual needs, which improves the flexibility of dimming and can adapt to different needs in different scenes. Moreover, the creatability and deletability of light sources provide a broad space for creative exploration. Users can boldly try different lighting combinations and discover new visual effects by constantly creating new light sources, adjusting their parameters, and then deleting inappropriate light sources. This process of repeated trials can inspire users' inspiration, break through the limitations of traditional lighting concepts, and create a unique visual experience.

[0126] The brightness adjustment method provided in the embodiment of the present application can be executed by a brightness adjustment device. In the embodiment of the present application, the brightness adjustment device provided in the embodiment of the present application is described by taking the brightness adjustment device executing the brightness adjustment method as an example.

[0127] See also Fig.14 , is a schematic diagram of a brightness adjustment device provided in an embodiment of the present application, such as Fig.14 As shown, the device 1400 includes the following modules:

[0128] A light source creation module 1401, configured to create a first light source in an extended reality space in response to a first gesture;

[0129] The light source adjustment module 1402 is configured to adjust light source parameters of the first light source in response to the second gesture.

[0130] In an embodiment of the present application, in response to a first gesture, a first light source is created in the extended reality space; in response to a second gesture, the light source parameters of the first light source are adjusted to perform lighting compensation on the extended reality space through the first light source after parameter adjustment. According to an embodiment of the present application, dimming the extended reality space no longer adopts a planar brightness adjustment method, but based on the three-dimensional characteristics of the extended reality space and the device specificity of the electronic device, the first light source is conveniently created and adjusted through gestures, so that the content of the extended reality space can be customized with lighting adjustment in the case of existing natural light rendering, and lighting compensation for the extended reality space is achieved, so that the lighting effect of the extended reality space meets the user's expectations. Compared with traditional planar brightness adjustment, this embodiment is based on dimming of the light source, which can simulate natural lighting effects, achieve more realistic light and shadow interaction, make the extended reality space look more real, and improve the brightness effect of the extended reality space.

[0131] In some embodiments, the light source creation module 1401 is specifically configured to:

[0132] In response to the first gesture, determining second posture information of the first light source based on the first posture information of the first gesture;

[0133] Based on the second pose information, a first light source is created in the extended reality space.

[0134] In some embodiments, the light source adjustment module 1402 is specifically configured to:

[0135] In response to the second gesture, determining a first light source parameter to be adjusted and a parameter adjustment amount of the first light source parameter;

[0136] Based on the parameter adjustment amount, a first light source parameter of the first light source is adjusted.

[0137] In some embodiments, the second gesture is a dynamic gesture, and the light source adjustment module 1402 is specifically configured to:

[0138] Determine third position information of the second gesture at a starting time and / or determine fourth position information of the second gesture at an ending time;

[0139] Based on the third posture information and / or the fourth posture information, a parameter adjustment amount of the first light source parameter is determined.

[0140] In some embodiments, the light source adjustment module 1402 is specifically configured to:

[0141] In response to the second gesture, a first light source parameter to be adjusted is determined according to fifth posture information of the second gesture.

[0142] In some embodiments, the apparatus 1400 further includes: an editing start module, configured to:

[0143] Before adjusting the light source parameters of the first light source in response to the second gesture, switching the state of the first light source to an editing state in response to a third gesture;

[0144] The light source adjustment module is specifically used for:

[0145] When the first light source is in the editing state, in response to the second gesture, a light source parameter of the first light source is adjusted.

[0146] In some embodiments, the apparatus 1400 further includes: a light source removal module, configured to:

[0147] When the first light source is in the editing state, in response to a fourth gesture, the first light source is removed from the extended real space.

[0148] The brightness adjustment device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0149] The brightness adjustment device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0150] The brightness adjustment device provided in the embodiment of the present application can achieve Figures 1 to 13 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0151] Alternatively, if Fig.15As shown, an embodiment of the present application further provides an electronic device 1500, including a processor 1501 and a memory 1502, wherein the memory 1502 stores programs or instructions that can be executed on the processor 1501, and when the program or instructions are executed by the processor 1501, the various steps of the above-mentioned brightness adjustment method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0152] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0153] Fig.16 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0154] The electronic device 1600 includes but is not limited to: a radio frequency unit 1601, a network module 1602, an audio output unit 1603, an input unit 1604, a sensor 1605, a display unit 1606, a user input unit 1607, an interface unit 1608, a memory 1609, and a processor 1610 and other components.

[0155] Those skilled in the art will appreciate that the electronic device 1600 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1610 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.16 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0156] The processor 1610 is configured to create a first light source in the extended reality space in response to the first gesture;

[0157] The processor 1610 is further configured to adjust light source parameters of the first light source in response to the second gesture.

[0158] In an embodiment of the present application, in response to a first gesture, a first light source is created in the extended reality space; in response to a second gesture, the light source parameters of the first light source are adjusted to perform lighting compensation on the extended reality space through the first light source after parameter adjustment. According to an embodiment of the present application, dimming the extended reality space no longer adopts a planar brightness adjustment method, but based on the three-dimensional characteristics of the extended reality space and the device specificity of the electronic device, the first light source is conveniently created and adjusted through gestures, so that the content of the extended reality space can be customized with lighting adjustment in the case of existing natural light rendering, and lighting compensation for the extended reality space is achieved, so that the lighting effect of the extended reality space meets the user's expectations. Compared with traditional planar brightness adjustment, this embodiment is based on dimming of the light source, which can simulate natural lighting effects, achieve more realistic light and shadow interaction, make the extended reality space look more real, and improve the brightness effect of the extended reality space.

[0159] In some embodiments, the processor 1610 is specifically configured to:

[0160] In response to the first gesture, determining second posture information of the first light source based on the first posture information of the first gesture;

[0161] Based on the second pose information, a first light source is created in the extended reality space.

[0162] In some embodiments, the processor 1610 is specifically configured to:

[0163] In response to the second gesture, determining a first light source parameter to be adjusted and a parameter adjustment amount of the first light source parameter;

[0164] Based on the parameter adjustment amount, a first light source parameter of the first light source is adjusted.

[0165] In some embodiments, the second gesture is a dynamic gesture; the processor 1610 is specifically configured to:

[0166] Determine third position information of the second gesture at a starting time and / or fourth position information of the second gesture at an ending time;

[0167] According to the third posture information and / or the fourth posture information, a parameter adjustment amount of the first light source parameter is determined.

[0168] In some embodiments, the processor 1610 is specifically configured to:

[0169] In response to the second gesture, a first light source parameter to be adjusted is determined according to fifth posture information of the second gesture.

[0170] In some embodiments, the processor 1610 is further configured to:

[0171] Before adjusting the light source parameter of the first light source in response to the second gesture, setting the state of the first light source to an edit state in response to a third gesture;

[0172] The processor 1610 is specifically configured to:

[0173] When the first light source is in the editing state, in response to the second gesture, a light source parameter of the first light source is adjusted.

[0174] In some embodiments, the processor 1610 is further configured to:

[0175] When the first light source is in the editing state, in response to a fourth gesture, the first light source is removed from the extended real space.

[0176] It should be understood that in the embodiment of the present application, the input unit 1604 may include a graphics processor (Graphics Processing Unit, GPU) 16041 and a microphone 16042, and the graphics processor 16041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1606 may include a display panel 16061, and the display panel 16061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1607 includes a touch panel 16071 and at least one of other input devices 16072. The touch panel 16071 is also called a touch screen. The touch panel 16071 may include two parts: a touch detection device and a touch controller. Other input devices 16072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0177] The memory 1609 can be used to store software programs and various data. The memory 1609 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1609 may include a volatile memory or a non-volatile memory, or the memory x09 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1609 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0178] The processor 1610 may include one or more processing units; optionally, the processor 1610 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1610.

[0179] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned brightness adjustment method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0180] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0181] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned brightness adjustment method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0182] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0183] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned brightness adjustment method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0184] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0185] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0186] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A brightness adjustment method, characterized in that: include: In response to the first gesture, creating a first light source in the extended reality space; In response to a second gesture, a light source parameter of the first light source is adjusted.

2. The method according to claim 1, characterized in that In response to the first gesture, creating a first light source in the extended reality space includes: In response to a first gesture, determining second posture information of the first light source based on the first posture information of the first gesture; Based on the second pose information, the first light source is created in the extended reality space.

3. The method according to claim 1, characterized in that The adjusting, in response to the second gesture, a light source parameter of the first light source comprises: In response to a second gesture, determining a first light source parameter to be adjusted and a parameter adjustment amount of the first light source parameter; Based on the parameter adjustment amount, the first light source parameter of the first light source is adjusted.

4. The method according to claim 3, characterized in that The second gesture is a dynamic gesture; In response to the second gesture, determining a parameter adjustment amount of the first light source parameter includes: Determine third position information of the second gesture at a starting time and / or fourth position information of the second gesture at an ending time; Determine a parameter adjustment amount of the first light source parameter according to the third posture information and / or the fourth posture information.

5. The method according to claim 3, characterized in that: In response to the second gesture, determining a first light source parameter to be adjusted includes: In response to the second gesture, a first light source parameter to be adjusted is determined according to fifth posture information of the second gesture.

6. The method according to any one of claims 1 to 5, characterized in that: Before adjusting the light source parameters of the first light source in response to the second gesture, the method further includes: In response to a third gesture, switching the state of the first light source to an editing state; The adjusting, in response to the second gesture, a light source parameter of the first light source comprises: When the first light source is in an editing state, in response to the second gesture, a light source parameter of the first light source is adjusted.

7. The method according to claim 6, characterized in that The method further comprises: When the first light source is in an editing state, in response to a fourth gesture, the first light source is removed from the extended reality space.

8. A brightness adjustment device, characterized in that: include: A light source creation module, configured to create a first light source in the extended reality space in response to a first gesture; The light source adjustment module is used to adjust the light source parameters of the first light source in response to a second gesture.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the brightness adjustment method according to any one of claims 1 to 7 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the brightness adjustment method according to any one of claims 1 to 7 are implemented.

Images