Spatial range control interaction method, image presentation method, device, and storage medium

Abstract

The present application provides a spatial range control interaction method, an image presentation method, a device, and a storage medium. The spatial range control interaction method comprises: displaying a first fence interactive interface, wherein the first fence interactive interface comprises an environment view and a fence view corresponding to the environment view, the environment view comprises a current environment image and a spatial boundary region mark, the current environment image being used for reflecting spatial distribution of a target object in a current real environment, and the spatial boundary region mark being used for marking, in the current environment image, a region belonging to an available spatial range, and the fence view comprises a current spatial background image and a spatial boundary graphic mark, the current spatial background image being obtained on the basis of three-dimensional reconstruction of a space in the current environment image, and the spatial boundary graphic mark being used for marking the available spatial range in the current spatial background image; receiving a range adjustment operation acting on the first fence interactive interface; and in the first fence interactive interface, updating the spatial boundary graphic mark and the spatial boundary region mark.

Description

Spatial range control interaction methods, image rendering methods, devices and storage media Technical Field

[0001] This application relates to the field of display interaction, and more particularly to spatial range control interaction methods, image rendering methods, devices, and storage media. Background Technology

[0002] Meeting scenarios are becoming increasingly complex, and people have higher and higher requirements for audio and video quality. People not only want audio and video equipment to capture and present clear images, but also want to be able to choose specific areas of view. In other words, they want audio and video equipment to present the images they want to see, so as to avoid capturing irrelevant people in the frame when the camera picks up the image. For example, they want to avoid capturing people walking around outside the meeting area in an open space, or to avoid capturing the reflection of people on the glass in a glass meeting space, and so on.

[0003] Therefore, it is urgent to implement the function of local spatial selection. Summary of the Invention

[0004] This application provides a spatial range control interaction method, an image rendering method, a device, and a storage medium, which aim to realize the local spatial selection function.

[0005] Firstly, a spatial range control interaction method is provided, including:

[0006] The first fence interaction interface is displayed, which includes an environment view and a fence view corresponding to the environment view. The environment view includes a current environment image and spatial boundary region markers. The current environment image reflects the spatial distribution of the target object in the current real environment. The target object is an object affected by the available space range, and the available space range is a set effective space range. The spatial boundary region markers are used to mark the area belonging to the available space range in the current environment image. The fence view includes a current spatial background image and spatial boundary graphic markers. The current spatial background image is obtained based on three-dimensional reconstruction of the space in the current environment image, and the spatial boundary graphic markers are used to mark the available space range in the current spatial background image.

[0007] Receive a range adjustment operation applied to the first fence interaction interface, the range adjustment operation being used to adjust the available space range;

[0008] In the first fence interaction interface, the spatial boundary graphic marker and the spatial boundary area marker are updated. The updated spatial boundary area marker is used to mark the area belonging to the first available space range in the current environment image. The first available space range is the available space range set based on the range adjustment operation. The updated spatial boundary graphic marker is used to mark the first available space range in the current space background image.

[0009] In this technical solution, a first fence interaction interface is displayed, which includes an environment view and a fence view corresponding to the environment view. Then, a range adjustment operation is received on the first fence interaction interface. This range adjustment operation is used to adjust the available space range. In the first fence interaction interface, the spatial boundary graphic markers in the fence view and the spatial boundary region markers in the environment view are updated. Users can select and set local spaces by performing range adjustment operations in the fence interaction interface. Since the environment view includes the current environment image and spatial boundary region markers, the current environment image reflects the spatial distribution of the target object in the current real environment. The target object is the object affected by the available space range. The spatial region markers are used to indicate that the target object belongs to the available space in the current environment image. The fenced-off view includes the current spatial background image and spatial boundary graphic markers. The current background image is obtained by 3D reconstruction of the space in the current environment image, and the spatial boundary graphic markers are used to mark the available space range in the current spatial background image. By displaying the current background image and spatial boundary graphic markers obtained by 3D reconstruction of the space in the current environment image in the fenced-off view, users have a clear understanding of the range covered by the selected local space, which helps them to select the local space accurately. Furthermore, by displaying the current environment image and spatial boundary area markers in the environment view, the environment view forms a comparison view with the fenced-off view, enhancing users' understanding of the range covered by the selected local space in the real environment, making it easier for users to select the local space more accurately.

[0010] In conjunction with the first aspect, in one possible implementation, the environment view further includes object markers used to identify target objects in the current environment image. The display style of a first object marker in the current environment image differs from that of a second object marker in the current environment image. The first object marker is used to identify target objects located within the available space range in the current environment image, while the second object marker is used to identify target objects located outside the available space range in the current environment image. After receiving the range adjustment operation applied to the first fence interaction interface, the method further includes updating the display style of each object marker in the current environment image within the first fence interaction interface.

[0011] By displaying object markers in the environment view to indicate target objects in the current environment image, and showing object markers for target objects outside the available space differently from those for target objects within the available space, users can confirm whether the selected local space is the desired local space based on the object markers, which helps users select local spaces more accurately.

[0012] In conjunction with the first aspect, in one possible implementation, the first fence interaction interface further includes a size marker, which is used to indicate the size of the available space range on the horizontal plane; after receiving the range adjustment operation applied to the first fence interaction interface, the interface further includes: updating the size marker in the first fence interaction interface, wherein the size indicated by the updated size marker is the size of the first available space range on the horizontal plane.

[0013] By displaying dimension markers on the horizontal plane to indicate the available space extent in the fence interface, users can easily understand the specific dimensions of the area covered by a local space.

[0014] In conjunction with the first aspect, in one possible implementation, the fence view further includes object location markers, which are used to mark target objects in the current spatial background image. The display style of a first object location marker in the current spatial background image differs from the display style of a second object location marker in the current spatial background image. The first object location marker is used to mark target objects located within the available space range in the current spatial background image, and the second object location marker is used to mark target objects located outside the available space range in the current spatial background image. After receiving the range adjustment operation applied to the first fence interaction interface, the method further includes: updating the display style of each object location marker in the current spatial background image within the first fence interaction interface.

[0015] By displaying object location markers in the fence view to indicate the target object in the current space background image, and by showing object location markers for target objects outside the available space differently from those for target objects within the available space, users can confirm whether the selected local space is reasonable based on the object location markers, which helps users to accurately select local space.

[0016] In conjunction with the first aspect, in one possible implementation, the object location marker is obtained by adding a three-dimensional object model to a three-dimensional spatial model based on the spatial coordinates of the target object. The three-dimensional object model is used to represent the target object, and the three-dimensional spatial model is a model obtained by three-dimensional reconstruction of the space in the current environment image.

[0017] Object location marking is obtained by adding a 3D object model representing the target object to a 3D spatial model based on the target object's spatial coordinates, which helps users perceive space.

[0018] In conjunction with the first aspect, in one possible implementation, the available spatial range is the framing range, the current environmental image is a real-time video image, and the target object is a person; and / or,

[0019] The available space range is the sound processing range, the current environment image is a real-time audio image, and the target object is a person and / or a sound sensing component.

[0020] In conjunction with the first aspect, in one possible implementation, the method further includes: receiving a view adjustment operation applied to the fence view, the view adjustment operation being used to adjust the viewing angle of the fence view; updating the fence view in the first fence interaction interface, wherein the spatial boundary graphic markers in the updated fence view are obtained by adjusting the spatial boundary graphic markers in the previous fence view according to the target viewing angle corresponding to the view adjustment operation.

[0021] When a view adjustment operation is received that affects the fence view, the fence view is updated in the fence interaction interface, which allows users to observe the environment from different angles and thus make better selections of local spaces.

[0022] In conjunction with the first aspect, in one possible implementation, receiving the range adjustment operation applied to the first fence interaction interface includes: receiving the movement operation applied to the lines or control points of the spatial boundary graphic marker, wherein the control points include the vertices of the spatial boundary graphic marker.

[0023] The available space range can be adjusted by moving lines or control points, allowing users to easily adjust the available space range.

[0024] In conjunction with the first aspect, in one possible implementation, receiving the range adjustment operation applied to the first fence interaction interface further includes: receiving the control point adjustment operation applied to the spatial boundary graphic marker, the control point adjustment operation being used to adjust the number of control points of the spatial boundary graphic marker; and updating the number of control points of the spatial boundary graphic marker in the first fence interaction interface.

[0025] The number of control points for the spatial boundary graphic markers can be adjusted, which can improve the convenience for users to adjust the available space range.

[0026] In conjunction with the first aspect, in one possible implementation, receiving the range adjustment operation applied to the first fence interaction interface includes: receiving a first selection operation applied to the current environment image, wherein the first selection operation is used to select the target object in the current environment image.

[0027] The available space range can be adjusted by selecting a target object in the environment image, allowing users to freely select the target object.

[0028] In conjunction with the first aspect, in one possible implementation, the fence view further includes an object location marker, which is used to mark a target object in the current spatial background image; the receiving of the range adjustment operation applied to the first fence interaction interface includes: receiving a second selection operation applied to the current spatial background image, which is used to select the object location marker in the current spatial background image.

[0029] The available space range can be adjusted by selecting the object location marker in the spatial background image, allowing users to freely select the target object.

[0030] In conjunction with the first aspect, in one possible implementation, the first fence interaction interface further includes a fence control, which is used to control the available space range; the receiving of the range adjustment operation applied to the first fence interaction interface includes: receiving a third selection operation applied to the fence control, which is used to select the fence control.

[0031] The available space range can be adjusted by triggering the fence control, allowing users to quickly adjust the space range.

[0032] In conjunction with the first aspect, in one possible implementation, displaying the first fence interaction interface includes: acquiring the current environment image and the current spatial background image; adding a spatial boundary region marker to the current environment image to indicate the initial available space range, thereby obtaining the environment view; and adding a spatial boundary graphic marker to the current spatial background image to indicate the initial available space range, thereby obtaining the fence view; and displaying the environment view and the fence view to obtain the first fence interaction interface.

[0033] An environment view is obtained by adding spatial boundary area markers representing the initial available space range to the current environment image, and a fence view is obtained by adding spatial boundary graphic markers representing the initial available space range to the current space background image, thus completing the display of the fence interactive interface.

[0034] In conjunction with the first aspect, in one possible implementation, displaying the first fence interaction interface includes: displaying the first interaction interface, which includes a current environment image and the current spatial background image; receiving a range selection operation applied to the first interaction interface, the range selection operation being used to select an available space range; adding a spatial boundary region marker for indicating a second available space range to the current environment image, and adding a spatial boundary graphic marker for indicating the second available space range to the current spatial background image, thereby obtaining the first fence interaction interface, wherein the second available space range is the available space range set based on the range selection operation.

[0035] By adding spatial boundary region markers corresponding to the range selection operation to the current environment image, and adding spatial boundary graphic markers corresponding to the range selection operation to the current spatial background image, the fence interaction interface can be displayed.

[0036] Secondly, a range control interaction method is provided, including:

[0037] The first interactive interface is displayed, which includes a current environment image and a current spatial background image. The current environment image is used to reflect the spatial distribution of the target object in the current real environment. The target object is an object affected by the available space range, and the available space range is a set effective space range. The current spatial background image is obtained by three-dimensional reconstruction of the space in the current environment image.

[0038] Receive a range selection operation applied to the first interactive interface, the range selection operation being used to select an available space range;

[0039] The first fence interaction interface is displayed, which includes an environment view and a fence view corresponding to the environment view. The environment view includes the current environment image and a spatial boundary area marker. The spatial boundary area marker is used to mark the area belonging to the second available space range in the current environment image. The second available space range is the available space range set based on the range selection operation. The fence view includes the current space background image and a spatial boundary graphic marker. The spatial boundary graphic marker is used to mark the second available space range in the current space background image.

[0040] In this technical solution, a first interactive interface is displayed, which includes a current environment image and a current spatial background image. Then, a range selection operation is received on the first interactive interface to select an available space range. Finally, a first fence interactive interface is displayed, which includes an environment view and a fence view corresponding to the environment view. Users can select and set local spaces by performing range selection operations within the interactive interface. Since the environment view includes a current environment image and spatial boundary region markers, the current environment image reflects the spatial distribution of the target object in the current real environment. The target object is the object affected by the available space range. The spatial boundary region markers indicate areas belonging to the available space range. The fence view... The image includes a current spatial background image and spatial boundary graphic markers. The current background image is obtained by 3D reconstruction of the space in the current environment image, and the spatial boundary graphic markers are used to mark the available space range in the current spatial background image. By displaying the current background image and spatial boundary graphic markers obtained by 3D reconstruction of the space in the current environment image in the fence view, users have a clear understanding of the range covered by the selected local space, which helps them to select the local space accurately. Furthermore, by displaying the current environment image and spatial boundary area markers in the environment view, the environment view forms a comparison view with the fence view, enhancing users' understanding of the range covered by the selected local space in the real environment, making it easier for users to select the local space more accurately.

[0041] In conjunction with the second aspect, in one possible implementation, the environment view further includes object markers for identifying target objects in the current environment image. The display style of a first object marker in the current environment image differs from that of a second object marker in the current environment image. The first object marker is used to identify target objects located within the available space range in the current environment image, while the second object marker is used to identify target objects located outside the available space range in the current environment image.

[0042] By displaying object markers in the environment view to indicate target objects in the current environment image, and showing object markers for target objects outside the available space differently from those for target objects within the available space, users can confirm whether the selected local space is the desired local space based on the object markers, which helps users select local spaces more accurately.

[0043] In conjunction with the second aspect, in one possible implementation, the first fence interaction interface further includes size markers for indicating the dimensions of the available space on the horizontal plane.

[0044] By displaying dimension markers on the horizontal plane to indicate the available space extent in the fence interface, users can easily understand the specific dimensions of the area covered by a local space.

[0045] In conjunction with the second aspect, in one possible implementation, the fence view further includes object location markers for marking target objects in the current spatial background image. The display style of a first object location marker in the current spatial background image differs from that of a second object location marker in the current spatial background image. The first object location marker is used to mark target objects located within the available space range in the current spatial background image, while the second object location marker is used to mark target objects located outside the available space range in the current spatial background image.

[0046] By displaying object location markers in the fence view to indicate the target object in the current space background image, and by showing object location markers for target objects outside the available space differently from those for target objects within the available space, users can confirm whether the selected local space is reasonable based on the object location markers, which helps users to accurately select local space.

[0047] In conjunction with the second aspect, in one possible implementation, the object location marker is obtained by adding a three-dimensional object model to a three-dimensional spatial model based on the spatial coordinates of the target object. The three-dimensional object model is used to represent the target object, and the three-dimensional spatial model is a model obtained by three-dimensional reconstruction of the space in the current environment image.

[0048] Object location marking is obtained by adding a 3D object model representing the target object to a 3D spatial model based on the target object's spatial coordinates, which helps users perceive space.

[0049] In conjunction with the second aspect, in one possible implementation, the available spatial range is the framing range, the current environmental image is a real-time video image, and the target object is a person; and / or, the available spatial range is the sound processing range, the current environmental image is a real-time audio image, and the target object is a person and / or a sound sensing component.

[0050] In conjunction with the second aspect, in one possible implementation, the method further includes: receiving a view adjustment operation applied to the fence view, the view adjustment operation being used to adjust the viewing angle of the fence view; updating the fence view in the first fence interaction interface, wherein the spatial boundary graphic markers in the updated fence view are obtained by adjusting the spatial boundary graphic markers in the previous fence view according to the target viewing angle corresponding to the view adjustment operation.

[0051] When a view adjustment operation is received that affects the fence view, the fence view is updated in the fence interaction interface, which allows users to observe the environment from different angles and thus make better selections of local spaces.

[0052] In conjunction with the second aspect, in one possible implementation, receiving a range selection operation applied to the first interactive interface includes: receiving a first selection operation applied to the current environment image, wherein the first selection operation is used to select the target object in the current environment image.

[0053] The selection of available space is triggered by selecting a target object in the environment image, allowing users to freely choose the target object.

[0054] In conjunction with the second aspect, in one possible implementation, the first interactive interface further includes an object location marker, which is used to mark a target object in the current spatial background image; the receiving of a range selection operation applied to the first interactive interface includes: receiving a second selection operation applied to the current spatial background image, which is used to select the object location marker in the current spatial background image.

[0055] The selection of available space is triggered by choosing an object location marker in the spatial background image, allowing users to freely select the target object.

[0056] In conjunction with the second aspect, in one possible implementation, the first interactive interface further includes a fence control, which is used to control the available space range; the receiving of the range selection operation applied to the first interactive interface includes receiving a third selection operation applied to the fence control.

[0057] The fence control triggers the selection of available space, allowing users to quickly select a space.

[0058] In conjunction with the second aspect, in one possible implementation, after displaying the first fence interaction interface, the method further includes: receiving a range adjustment operation applied to the first fence interaction interface, the range adjustment operation being used to adjust the available space range; in the first fence interaction interface, updating the spatial boundary graphic marker and the spatial boundary region marker, wherein the updated spatial boundary region marker is used to mark the region belonging to the first available space range in the current environment image, the first available space range being the available space range set based on the range adjustment operation, and the updated spatial boundary graphic marker is used to mark the first available space range in the current spatial background image.

[0059] After receiving a range adjustment operation applied to the first fence interaction interface, the range adjustment operation is used to adjust the available space range. In the first fence interaction interface, the spatial boundary graphic marker in the fence view and the spatial boundary area marker in the environment view are updated. This enables the fence view and the environment view to be displayed in a linked manner, making it easier for users to perceive and associate the set spatial range with the actual spatial range, thereby selecting the spatial range more accurately.

[0060] Thirdly, a spatial range control interaction method is provided, including:

[0061] The second interactive interface is displayed. The second interactive interface includes a current spatial background image. The current spatial background image is obtained by three-dimensional reconstruction of the space in the current environment image. The current environment image is used to reflect the spatial distribution of the target object in the current real environment. The target object is an object affected by the available space range. The available space range is a set effective space range.

[0062] Receive a range setting operation applied to the second interactive interface, the range setting operation being used to set the available space range;

[0063] The second fence interaction interface is displayed. The second fence interaction interface includes a fence view, which includes the current space background image, space boundary graphic markers, and object location markers. The space boundary graphic markers are used to mark a third available space range in the current space background image. The third available space range is an available space range set based on the range setting operation. The object location markers are used to mark target objects in the current space background image. The display style of the first object location marker in the current space background image is different from the display style of the second object location marker in the current space background image. The first object location marker is used to mark target objects located within the available space range in the current space background image, and the second object location marker is used to mark target objects located outside the available space range in the current space background image.

[0064] In this technical solution, a second interactive interface is displayed, which includes a current spatial background image. Then, a range setting operation is received on the second interactive interface to set the available space range. Finally, a second fence interactive interface is displayed, which includes a fence view. Users can select and set a local space by performing range setting operations within the interactive interface. Since the fence view includes a current spatial background image, spatial boundary graphic markers, and object location markers, and the current background image is obtained through 3D reconstruction of the space in the current environment image, and the spatial boundary graphic markers are used to indicate the available space range in the current spatial background image, displaying the current background image and spatial boundary graphic markers based on 3D reconstruction of the space in the current environment image in the fence view allows users to clearly understand the range covered by the selected local space, facilitating accurate selection. Furthermore, by displaying object location markers in the current spatial background image to indicate target objects, and because the display style of object location markers for target objects outside the available space range differs from that for target objects within the available space range, users can confirm the rationality of the selected local space based on the object location markers, further facilitating accurate selection.

[0065] In conjunction with the third aspect, in one possible implementation, the object location marker is obtained by adding a three-dimensional object model to a three-dimensional spatial model based on the spatial coordinates of the target object. The three-dimensional object model is used to represent the target object, and the three-dimensional spatial model is a model obtained by three-dimensional reconstruction of the space in the current environment image.

[0066] Object location marking is obtained by adding a 3D object model representing the target object to a 3D spatial model based on the target object's spatial coordinates, which helps users perceive space.

[0067] In conjunction with the third aspect, in one possible implementation, the available spatial range is the framing range, the current environmental image is a real-time video image, and the target object is a person; and / or, the available spatial range is the sound processing range, the current environmental image is a real-time audio image, and the target object is a person and / or a sound sensing component.

[0068] In conjunction with the third aspect, in one possible implementation, the method further includes: receiving a view adjustment operation applied to the fence view, the view adjustment operation being used to adjust the viewing angle of the fence view; updating the fence view in the second fence interaction interface, wherein the spatial boundary graphic markers in the updated fence view are obtained by adjusting the spatial boundary graphic markers in the previous fence view according to the target viewing angle corresponding to the view adjustment operation.

[0069] When a view adjustment operation is received that affects the fence view, the fence view is updated in the fence interaction interface, which allows users to observe the environment from different angles and thus make better selections of local spaces.

[0070] In conjunction with the third aspect, in one possible implementation, the second interactive interface includes the object location marker; the receiving of the range setting operation applied to the second interactive interface includes: receiving a second selection operation applied to the current spatial background image, the second selection operation being used to select the object location marker in the current spatial background image.

[0071] The available space range can be set by selecting an object location marker in the spatial background image, allowing users to freely set the target object.

[0072] In conjunction with the third aspect, in one possible implementation, the second interactive interface includes the spatial boundary graphic marker; the receiving of the range setting operation applied to the second interactive interface includes: receiving a movement operation applied to a line or control point of the spatial boundary graphic marker, wherein the control point includes the vertex of the spatial boundary graphic marker.

[0073] The available space range can be set by moving lines or control points, which makes it convenient for users to set the available space range.

[0074] In conjunction with the third aspect, in one possible implementation, receiving the range setting operation applied to the second interactive interface further includes: receiving the control point adjustment operation applied to the spatial boundary graphic marker, the control point adjustment operation being used to adjust the number of control points of the spatial boundary graphic marker; and updating the number of control points of the spatial boundary graphic marker in the second interactive interface.

[0075] The number of control points for the spatial boundary graphic markers can be adjusted, which can improve the convenience for users to adjust the available space range.

[0076] In conjunction with the third aspect, in one possible implementation, the second interactive interface further includes a fence control for controlling the available space range; the receiving of the range setting operation applied to the second interactive interface includes receiving a third selection operation applied to the fence control, the third selection being used to select the fence control.

[0077] The fence control allows users to quickly set the available space range.

[0078] Fourthly, an image rendering method is provided, including:

[0079] Acquire a current environment image, which reflects the spatial distribution of the target object in the current real environment. The target object is an object affected by the available space range, and the available space range is a set effective space range.

[0080] In the current environment image, the image region corresponding to the target available space range is obtained as the output environment screen. The target available space range is obtained based on the fence interaction interface. The fence interaction interface includes a fence view, which includes a current space background image and a space boundary graphic marker. The current space background image is obtained based on the three-dimensional reconstruction of the space in the current environment image. The space boundary graphic marker is used to mark the target available space range in the current space background image.

[0081] In this technical solution, by acquiring the current environment image, which reflects the spatial distribution of the target object in the current real environment, the target object is the object affected by the available space range, and the available space range is the set effective space range. In the current environment image, the image area corresponding to the target available space range is acquired as the output environment screen, realizing the output of the environment image within the local space. The fence interaction interface includes a fence view, which includes the current space background image and space boundary graphic markers. The current background image is obtained based on the three-dimensional reconstruction of the space in the current environment image. The space boundary graphic markers are used to mark the available space range in the current space background image. By setting the local space range through the fence interaction interface, the user has a clear understanding of the range covered by the selected local space, which helps the user to accurately select the local space, thereby outputting a more accurate local environment screen.

[0082] In conjunction with the fourth aspect, in one possible implementation, before obtaining the image region corresponding to the target available space range in the current environment image and using it as the output environment screen, the method further includes: displaying the fence interaction interface; and determining the target available space range based on the fence interaction interface.

[0083] The user can set the available space range of the target area through the fence interaction interface, making it easier for users to perceive the local space range.

[0084] In conjunction with the fourth aspect, in one possible implementation, displaying the fence interaction interface includes: performing three-dimensional reconstruction of the space in the current environment image to obtain a three-dimensional space model; generating a current space background image based on the view of the three-dimensional space model from the target's viewing perspective; adding the space boundary graphic marker to the current space background image to obtain the fence view; and displaying the fence view in the display interface.

[0085] In conjunction with the fourth aspect, in one possible implementation, the fence view further includes object location markers, which are used to mark target objects in the current spatial background image. The display style of a first object location marker in the current spatial background image differs from that of a second object location marker in the current spatial background image. The first object location marker is used to mark target objects located within the available space range in the current spatial background image, and the second object location marker is used to mark target objects located outside the available space range in the current spatial background image. Displaying the fence interaction interface further includes: identifying the spatial coordinates of the target objects in the current environment image; and adding the first object location marker and the second object location marker with different display styles to the current spatial background image based on the spatial coordinates and the spatial boundary graphic marker.

[0086] By adding object location markers to the current spatial background image to indicate the target object, and by displaying the object location markers of target objects outside the available space differently from those of target objects within the available space, users can confirm whether the selected local space is reasonable based on the object location markers, which helps users to accurately select the local space.

[0087] In conjunction with the fourth aspect, in one possible implementation, the fence interaction interface further includes an environment view, which includes the current environment image and spatial boundary region markers. The spatial boundary region markers are used to mark areas belonging to the target available space range in the current environment image. Displaying the fence interaction interface further includes: determining the spatial boundary region markers based on the spatial boundary graphic markers; adding the spatial boundary region markers to the current environment image to obtain the environment view; and displaying the environment view in the display interface.

[0088] The fence interface includes an environment view, which includes a current environment image and spatial boundary area markers. The current environment image reflects the spatial distribution of the target object in the current real environment. The environment view forms a comparison view with the fence view, enhancing the user's understanding of the range of the selected local space in the real environment and making it easier for the user to select the local space more accurately.

[0089] In conjunction with the fourth aspect, in one possible implementation, the environment view further includes object markers used to mark target objects in the current environment image. The display style of a first object marker in the current environment image differs from that of a second object marker in the current environment image. The first object marker is used to mark target objects located within the available space range in the current environment image, and the second object marker is used to mark target objects located outside the available space range in the current environment image. Displaying the fence interaction interface further includes: identifying the position coordinates of the target objects in the current environment image; and adding the first object marker and the second object marker with different display styles to the current environment image based on the position coordinates and the spatial boundary graphic marker.

[0090] By adding object markers to the current environment image to identify target objects, and displaying the object markers of target objects outside the available space differently from those within the available space, users can confirm whether the selected local space is the desired local space based on the object markers, which helps users select local spaces more accurately.

[0091] In conjunction with the fourth aspect, in one possible implementation, determining the target available space range based on the fence interaction interface includes: receiving a range setting operation applied to the fence interaction interface, the range setting operation being used to set the available space range; and determining the target available space range according to the range setting operation.

[0092] The target space is determined by the selection operation performed on the fence interaction interface, allowing users to freely select a local space range.

[0093] Fifthly, a terminal device is provided, including a memory and a processor, the memory being connected to the processor, the processor being configured to execute one or more computer programs stored in the memory, wherein when the processor executes the one or more computer programs, the terminal device enables the spatial range control interaction method of the first aspect, the second aspect, or the third aspect described above, or the image presentation method of the fourth aspect described above.

[0094] In a sixth aspect, a computer-readable storage medium is provided, the computer-readable storage medium storing a computer program, the computer program including program instructions, which, when executed by a processor, cause the processor to perform the spatial range control interaction method of the first aspect, the second aspect, or the third aspect, or the image presentation method of the fourth aspect. Attached Figure Description

[0095] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments of this application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0096] Figure 1 is a flowchart illustrating a spatial range control interaction method provided in an embodiment of this application;

[0097] Figures 2A-2M are schematic diagrams of control interaction provided in the embodiments of this application;

[0098] Figure 3 is a flowchart illustrating another spatial range control interaction method provided in an embodiment of this application;

[0099] Figures 4A-4C are schematic diagrams of control interaction provided in the embodiments of this application;

[0100] Figure 5 is a flowchart illustrating an image presentation method provided in an embodiment of this application;

[0101] Figures 6A-6E are schematic diagrams of control interaction provided in the embodiments of this application;

[0102] Figure 7 is a flowchart illustrating an image presentation method provided in an embodiment of this application;

[0103] Figure 8 is a schematic diagram of the structure of a terminal device provided in an embodiment of this application. Detailed Implementation

[0104] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of this application. All other embodiments obtained by those skilled in the art based on the embodiments in this application without inventive effort are within the scope of protection of this application.

[0105] It should be noted that, unless there is a conflict, the various features in the embodiments of this application can be combined with each other, all of which are within the protection scope of this application. Furthermore, although functional modules are divided in the device schematic diagram and a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than the module division in the device or the order in the flowchart. Moreover, the terms "first," "second," and "third" used in this application do not limit the data or execution order, but only distinguish identical or similar items with essentially the same function and effect.

[0106] Spatial fencing is a concept proposed to meet some special needs in meeting scenarios. Through spatial fencing, users can set a local spatial range for audio and video devices, restricting the processing range of audio and video devices to the local spatial range set by the user, so that the audio and video devices only collect and / or output audio and video within the local spatial range set by the user.

[0107] Spatial fencing can include video fencing, which refers to capturing and / or outputting video footage within a user-defined local spatial range, ensuring that the user sees only the video footage within that local spatial range. Spatial fencing can also include audio fencing, which refers to capturing and / or outputting sound within a user-defined local spatial range, ensuring that only sound within that range is captured (i.e., sound is picked up only within the user-defined local spatial range), and / or that only sound within the user-defined local spatial range is amplified (i.e., sound is amplified only within the user-defined local spatial range).

[0108] How to implement the spatial fencing function has become a technical problem that urgently needs to be solved.

[0109] To achieve the spatial fencing function, this application proposes a control interaction scheme and a presentation scheme for spatial fencing. By displaying a fencing interaction interface, which includes a fencing view, the fencing view includes a current spatial background image and spatial boundary graphic markers. The current background image is obtained through 3D reconstruction of the space in the current environmental image, and the spatial boundary graphic markers are used to indicate the available space range in the current spatial background image. By displaying the current background image and spatial boundary graphic markers obtained through 3D reconstruction of the space in the current environmental image in the fencing view, the user has a clear understanding of the range covered by the selected local space, which is beneficial for the user to accurately select the local space. Furthermore, the fencing interaction interface also includes an environment view, which includes the current environmental... The system includes an environmental image and spatial boundary area markers. The current environmental image reflects the spatial distribution of the target object in the current real environment. The target object is an object affected by the available space range. The spatial boundary area markers are used to indicate the areas belonging to the available space range. By displaying the current environmental image and spatial boundary area markers in the environmental view, the environmental view forms a comparison view with the fence view, enhancing the user's understanding of the range covered by the selected local space in the real environment and facilitating more accurate selection of local spaces. In addition, this application also outputs the image area corresponding to the target available space range in the environmental image as the output environmental screen based on the target available space range set by the user in the fence interaction interface. This can restrict the environmental image to a local space range and realize the spatial fence function.

[0110] The technical solution of this application is described in detail below.

[0111] Referring to Figure 1, which is a flowchart illustrating a spatial range control interaction method provided in an embodiment of this application, the method includes the following steps:

[0112] S101, displays the first fence interaction interface.

[0113] Here, the first fence interaction interface is an interactive interface provided to users to set the local space range.

[0114] The first fence interaction interface includes an environment view and a fence view corresponding to the environment view. The environment view is used to display the current real environment, and the fence view is used to recreate and display the space contained in the current real environment. For example, the first fence interaction interface is shown as J1 in Figure 2A.

[0115] The environment view includes a current environment image and spatial boundary region markers. The current environment image reflects the spatial distribution of the target object in the current real environment. The target object is an object affected by the available space range, which is a defined effective space range. In this application, the available space range can be understood as the local space range expected by the user. For example, the environment view is shown as J11 in J1 of Figure 2A, and the current environment image is shown as P1 in J1 of Figure 2A.

[0116] Depending on the application scenario, the meanings of the current environment image, available space range, and target object may vary.

[0117] In some embodiments, the available spatial range is the framing range, which is used to define the video frame captured and / or output by the camera, the current environmental image is a real-time video image, and the target object is a person in the real environment.

[0118] In other embodiments, the available spatial range is the sound processing range, which includes a pickup range and / or an amplification range. The pickup range is used to define the sound acquisition range, and the amplification range is used to define the range where the sound needs to be amplified. The current environmental image is a real-time audio image, which is an image showing the distribution of people and / or sounds. The target object is a person and / or sound sensing component in the real environment. The sound sensing component in the real environment includes a speaker, microphone, and other sensing components related to sound acquisition and output in the real environment.

[0119] In some other embodiments, the available spatial range includes the framing range and sound processing range described above, and the current environmental image includes the real-time video image and real-time audio image described above. This application does not impose any limitations on this.

[0120] Spatial boundary region markers are used to indicate areas belonging to the available space range in the current environment image. Spatial boundary region markers can be presented in various ways; they can be presented as perspective planes belonging to the available space range in the current environment image, as perspective geometry belonging to the available space range in the current environment image, or as other forms that can indicate areas belonging to the available space range. This application does not impose any limitations on this. For example, as shown in qj1 of J1 in Figure 2A, the spatial boundary region marker is presented as a perspective plane belonging to the available space range.

[0121] Optionally, the environment view also includes object markers. These object markers are used to identify target objects in the current environment image. The display style of the first object marker in the current environment image differs from that of the second object marker. The first object marker is used to identify target objects located within the available space in the current environment image, while the second object marker is used to identify target objects located outside the available space. For example, the object markers are shown as dj1 (the black rectangle) and dj2 (the light gray rectangle) in J1 of Figure 2A, presented as rectangles. These rectangles are used to identify people in Figure 2A. dj1 is the first object marker, and dj2 is the second object marker; dj1 and dj2 are different colors. It is understood that object location markers are not limited to the form shown in Figure 2A; they can also be presented in other forms, such as image location points, solid geometric models, etc. Besides using color to distinguish the first object marker and the second object marker, other display methods can also be used to distinguish them; for example, the first object marker can be presented as a solid-line rectangle, and the second object marker can be presented as a dashed-line rectangle, thereby distinguishing the first object marker and the second object marker. This application does not impose any limitations on this.

[0122] By displaying object markers in the environment view to indicate target objects in the current environment image, and showing object markers for target objects outside the available space differently from those for target objects within the available space, users can confirm whether the selected local space is the desired local space based on the object markers, which helps users select local spaces more accurately.

[0123] The fence view includes a current spatial background image and spatial boundary graphic markers. The current spatial background image is obtained by 3D reconstruction of the space in the current environment image. The current spatial background image includes a view of the 3D spatial model from the target viewing angle (hereinafter referred to as the 3D viewing view). The 3D spatial model is a model obtained by 3D reconstruction of the space in the current environment image. For example, the fence view is shown as J12 in J1 of Figure 2A, and the current spatial background image is shown as P2 in J1 of Figure 2A. P2 shows a top-down view of the 3D spatial model obtained by 3D reconstruction of the space in P1. The target viewing angle refers to a pre-set viewing angle for observing the 3D spatial model, such as a top-down angle, a bottom-up angle, or a side-up angle. The target viewing angle can be pre-set or set by the user. It is understood that the target viewing angle can be any angle other than a top-down angle; P2 in Figure 2A does not limit this application.

[0124] In addition to the 3D viewing view, the current spatial background image may also include a background view set around the 3D viewing view.

[0125] Spatial boundary graphic markers are used to indicate the available spatial extent in the current spatial background image. These markers are presented as graphics in the current spatial background image, and include lines and control points, with the control points being the vertices of the spatial boundary graphic markers. For example, as shown in tj1 of Figure 2A, the spatial boundary graphic marker is presented as a polygon.

[0126] Optionally, the fence view also includes object location markers. These markers are used to indicate target objects in the current spatial background image. The display style of the first object location marker in the current spatial background image differs from that of the second object location marker. The first object location marker indicates target objects located within the available space in the current spatial background image, while the second object location marker indicates target objects located outside the available space. For example, object location markers are shown as lj1 (i.e., a solid black circle) and lj2 (i.e., a solid light gray circle) in Figure 2A. lj1 and lj2 are used to indicate people in Figure 2A. lj1 is the first object location marker, and lj2 is the second object location marker. The colors of lj1 and lj2 are different. It is understood that object location markers are not limited to the style shown in Figure 2A; they can also be presented in other forms, such as location points, location boxes, human-shaped markers, etc. Besides using color to distinguish the first object location marker and the second object location marker, other display methods can also be used to distinguish them; for example, the first object location marker can be presented as a solid rectangle, and the second object location marker can be presented as a hollow rectangle, thereby distinguishing the first object location marker and the second object location marker. This application does not impose any limitations on this.

[0127] By displaying object location markers in the fence view to indicate the target object in the current space background image, and by showing object location markers for target objects outside the available space differently from those for target objects within the available space, users can confirm whether the selected local space is reasonable based on the object location markers, which helps users to accurately select local space.

[0128] In some possible cases, object location marking is obtained by adding a 3D object model to a 3D spatial model based on the spatial coordinates of the target object. The 3D object model is used to represent the target object. Taking a person in a real environment as an example, after reconstructing the space in the current environment image to obtain a 3D spatial model, a 3D model representing the person is added to the 3D spatial model based on the spatial coordinates of the person in the current environment image, resulting in a 3D spatial model containing the person, which is also a 3D spatial model containing the target object.

[0129] Object location marking is obtained by adding a 3D object model representing the target object to a 3D spatial model based on the target object's spatial coordinates, which helps users perceive space.

[0130] Optionally, the first fence interaction interface also includes size markers, which are used to indicate the dimensions of the available space on the horizontal plane. Specifically, the size markers can indicate the width and / or depth of the available space on the horizontal plane. For example, as shown in cj1 of J1 in Figure 2A, the size marker indicates a depth of 4 meters and a width of 3.2 meters on the horizontal plane.

[0131] By displaying dimension markers on the horizontal plane to indicate the available space extent in the fence interface, users can easily understand the specific dimensions of the area covered by a local space.

[0132] The specific implementation of the first fence interaction interface will be introduced later, and will not be described in detail here.

[0133] S102, receive the range adjustment operation applied to the first fence interaction interface.

[0134] Here, the range adjustment operation is used to adjust the available space range.

[0135] There are various ways to interact with the range adjustment operation. The specific interaction methods for receiving range adjustment operations will be introduced later and will not be described in detail here.

[0136] S103, in the first fence interaction interface, update the spatial boundary graphic markers in the fence view and the spatial boundary area markers in the environment view.

[0137] The updated spatial boundary region marker is used to indicate the area belonging to the first available space range in the current environment image of the first fence interaction interface, and the updated spatial boundary graphic marker is used to indicate the first available space range in the current spatial background image of the first fence interaction interface.

[0138] The first available space range is the available space range set based on the range adjustment operation, that is, the available space range determined according to the range adjustment operation performed on the first fence interaction interface. Different range adjustment operations performed on the first fence interaction interface will result in different first available space ranges.

[0139] For example, referring to Figure 2A, when a range adjustment operation is received on the first fence interface shown in J1, the spatial boundary graphic marker in the fence view and the spatial boundary region marker in the environment view are updated in the first fence interaction interface as shown in J2 in Figure 2A. The updated spatial boundary graphic marker is shown as tj2 in J2 in Figure 2A. The spatial boundary graphic marker shown in tj2 is updated from the spatial boundary graphic marker shown in tj1 and is used to represent the first available space range. The updated spatial region graphic marker is shown as qj2 in J2 in Figure 2A. The spatial region graphic marker shown in qj2 is updated from the spatial boundary graphic marker shown in qj1 and is used to represent the region belonging to the first available space range.

[0140] When the environment view in the first fence interaction interface includes object markers, after receiving a range adjustment operation applied to the first fence interaction interface, in addition to updating the spatial boundary graphic markers in the fence view and the spatial boundary area markers in the environment view, the display style of each object marker in the current environment image is also updated in the first fence interaction interface. This makes the updated display style of the first object marker in the current environment image different from the updated display style of the second object location marker in the current environment image. The updated first object marker is used to mark target objects located within the first available space range in the current environment image, and the updated second object marker is used to mark target objects located outside the first available space range in the current environment image.

[0141] For example, referring to J2 in Figure 2A, the updated object markers are shown as dj3 (i.e., black rectangle) and dj4 (i.e., light gray rectangle) in J2 of Figure 2A. dj3 in J2 represents the updated first object marker, and dj4 in J2 represents the updated second object marker.

[0142] When the fence view in the first fence interaction interface includes object location markers, after receiving a range adjustment operation applied to the first fence interaction interface, in addition to updating the spatial boundary graphic markers in the fence view and the spatial boundary area markers in the environment view, the display style of each object location marker in the current spatial background image is also updated. This makes the display style of the updated first object location marker in the current spatial background image different from the display style of the updated second object location marker in the current spatial background image. The updated first object location marker is used to mark target objects located within the first available space range in the current spatial background image, and the updated second object location marker is used to mark target objects located outside the first available space range in the current spatial background image.

[0143] For example, referring to J2 in Figure 2A, the updated object markers are shown as lj3 (i.e., black solid circle) and lj2 (i.e., light gray solid circle) in J2 of Figure 2A. lj3 in J2 represents the updated first object position marker, and lj4 in J2 represents the updated second object position marker.

[0144] When the first fence interaction interface includes size markers, after receiving a range adjustment operation applied to the first fence interaction interface, in addition to updating the spatial boundary graphic markers in the fence view and the spatial boundary area markers in the environment view, the size markers in the first fence interaction interface are also updated. The updated size markers indicate the size of the first available space range on the horizontal plane.

[0145] For example, referring to J2 in Figure 2A, the updated dimension marking is shown as cj2 in J2 in Figure 2A, which indicates that the depth of the first available space range in the horizontal plane is 3 meters and the width is 3.2 meters.

[0146] In the technical solution corresponding to Figure 1 above, a first fence interaction interface is displayed, which includes an environment view and a fence view corresponding to the environment view. Then, a range adjustment operation is received on the first fence interaction interface. This range adjustment operation is used to adjust the available space range. In the first fence interaction interface, the spatial boundary graphic markers in the fence view and the spatial boundary region markers in the environment view are updated. Users can select and set local spaces by performing range adjustment operations in the fence interaction interface. Since the environment view includes the current environment image and spatial boundary region markers, the current environment image reflects the spatial distribution of the target object in the current real environment. The target object is the object affected by the available space range. The spatial region markers are used to indicate that the target object belongs to the available space range in the current environment image. The fence view, which displays the current spatial background image and spatial boundary graphic markers, is based on a 3D reconstruction of the space in the current environment image. The spatial boundary graphic markers are used to indicate the available spatial range in the current spatial background image. By displaying the current background image and spatial boundary graphic markers in the fence view, users have a clear understanding of the range covered by the selected local space, which helps them to select the local space accurately. Furthermore, by displaying the current environment image and spatial boundary area markers in the environment view, the environment view forms a comparison view with the fence view, enhancing users' understanding of the range covered by the selected local space in the real environment, making it easier for users to select the local space more accurately.

[0147] The following section describes how the interactive interface for displaying the first fence is implemented.

[0148] In one embodiment, displaying the first fence interaction interface includes the following steps A1-A3:

[0149] A1. Obtain the current environment image and the current spatial background image.

[0150] The definitions of the current environment image and the current spatial background image can be found in the description of step S101 above, and will not be repeated here.

[0151] After acquiring the current environment image, a 3D reconstruction of the space within the image can be performed to obtain a 3D spatial model. A view of this model from the target's perspective is then generated, resulting in a 3D observation view. Based on this view, a background image of the current space is generated. For example, the 3D observation view can be a top-down view of the 3D spatial model.

[0152] This involves using any 3D reconstruction algorithm to reconstruct the space within the current environmental image, resulting in a 3D spatial model. These 3D reconstruction algorithms include, but are not limited to, stereo matching-based 3D reconstruction algorithms and deep learning-based 3D reconstruction methods.

[0153] After obtaining the 3D observation view, use the 3D observation view as the current spatial background image; or, add a background view around the 3D observation view to obtain the current spatial background image.

[0154] A2. Add spatial boundary area markers to the current environment image to indicate the initial available space range, thus obtaining the environment view. Add spatial boundary graphic markers to the current space background image to indicate the initial available space range, thus obtaining the fence view corresponding to the environment view.

[0155] Here, the initial available space range is the default space range, which is, for example, the maximum space range obtained from the 3D reconstruction.

[0156] When the environment view in the first fence interaction interface includes object markers, the position coordinates of the target object in the current environment image (hereinafter referred to as the first position coordinates) can also be identified. Based on the first position coordinates and the spatial boundary graphic markers, first object markers and second object markers with different display styles are added to the current environment image to obtain the environment view. It is understood that the first object marker here is used to mark target objects located within the initial available space range in the current environment image, and the second object marker here is used to mark target objects located outside the initial available space range in the current environment image. The first position coordinates can be identified using any object detection method. Object detection algorithms include, but are not limited to, region-based convolutional neural networks (RCNN), YOLO (you only look once) algorithm, or single-shot multibox detector (SSD) algorithm.

[0157] In one feasible implementation, spatial boundary graphic markers can be mapped from the current spatial background image to a three-dimensional spatial model based on the coordinate transformation relationship corresponding to the target's viewing angle. Then, based on the coordinate transformation relationship determined during 3D reconstruction, the spatial boundary graphic markers are mapped from the three-dimensional spatial model to the current environmental image, obtaining the image region (hereinafter referred to as the spatial image region) corresponding to the spatial boundary graphic markers in the current environmental image. A first object marker is added at a first position coordinate located within the spatial image region in the current environmental image, and a second object marker is added at a first position coordinate located outside the spatial image region in the current environmental image, thereby adding first and second object markers with different display styles to the current environmental image. This application does not limit the specific method of adding first and second object markers with different display styles to the current environmental image based on the first position coordinates and the spatial boundary graphic markers.

[0158] When the fence view in the first fence interaction interface includes object location markers, it can also identify the spatial coordinates of the target object in the current environment image. Spatial coordinates refer to coordinates in three-dimensional space. Based on the spatial coordinates of the target object and the spatial boundary graphic markers in the current environment image, first and second object location markers with different display styles are added to the current spatial background image to obtain the fence view corresponding to the environment view. Here, the first object location marker is used to mark target objects located within the initial available space range in the current spatial background image, and the second object location marker is used to mark target objects located outside the initial available space range in the current spatial background image. Specifically, based on the coordinate transformation relationship determined during 3D reconstruction, the first location coordinates are converted into spatial coordinates in the 3D spatial model, thereby identifying the spatial coordinates of the target object in the current environment image.

[0159] In one feasible implementation, the position coordinates (hereinafter referred to as the second position coordinates) of the target object in the current spatial background image can be determined based on the spatial coordinates of the target object. A first object position marker is added at the second position coordinates located within the spatial boundary graphic marker in the current spatial background image, and a second object position marker is added at the second position coordinates located outside the spatial boundary graphic marker in the current spatial background image. This results in the addition of first and second object position markers with different display styles in the current spatial background image. Specifically, the spatial coordinates of the target object are transformed to the image coordinate system corresponding to the current spatial background image based on the coordinate transformation relationship corresponding to the target viewing angle, thereby obtaining the second position coordinates.

[0160] In another feasible implementation, when the object location marker is obtained from the aforementioned three-dimensional object model, three-dimensional object models with different display styles can be added to the three-dimensional spatial model based on the spatial coordinates of the target object to distinguish target objects located within the available space and target objects located outside the available space. Then, a three-dimensional viewing view is regenerated, and a current spatial background image is generated based on the three-dimensional viewing view. In this way, a first object location marker and a second object location marker with different display styles are added to the current spatial background image. This application does not limit the specific method by which first and second object location markers with different display styles are added to the current spatial background image based on the spatial coordinates and spatial boundary graphic markers of the target object in the current environment image.

[0161] A3. Display the environment view and the corresponding fence view to obtain the first fence interaction interface.

[0162] If the first fence interaction interface includes size markers, initial size markers can also be added in the environment view or the fence view corresponding to the environment view. The initial size markers are used to indicate the size of the initial available range on the horizontal plane, thus obtaining the first fence interaction interface.

[0163] In steps A1-A3 above, an environment view is obtained by adding spatial boundary area markers representing the initial available space range to the current environment image, and a fence view is obtained by adding spatial boundary graphic markers representing the initial available space range to the current space background image, thus completing the display of the fence interactive interface.

[0164] Understandably, steps A1-A3 above describe the implementation method of initially displaying the first fence interaction interface after enabling the "spatial fence" function. During the process of displaying and interacting with the first fence interaction interface, the corresponding markers in the first fence interaction interface are updated directly according to the adjustment operation applied to the area of ​​the first fence interaction interface, thereby displaying the first fence interaction interface. These corresponding markers include the aforementioned spatial boundary graphic markers and spatial boundary area markers; optionally, these corresponding markers also include one or more of the aforementioned object markers, object position markers, and size markers.

[0165] In one embodiment, displaying the first fence interaction interface includes the following steps B1-B3:

[0166] B1. Display the first interactive interface.

[0167] Here, the first interactive interface includes the current environment image and the current spatial background image. The definitions of the current environment image and the current spatial background image can be found in the description of step S101 above, and will not be repeated here.

[0168] Displaying the first interactive interface includes: acquiring the current environment image and the current spatial background image, and displaying the current environment image and the current spatial background image in the display interface. For details regarding acquiring the current environment image and the current spatial background image, please refer to the relevant description in step A1 above; it will not be repeated here.

[0169] Optionally, the first interactive interface also includes object markers. The meaning of the object markers can be found in the description of step S101 above, and will not be repeated here. Displaying the first interactive interface further includes: identifying first position coordinates, wherein the first position coordinates can be determined with reference to the description of step A2 above; adding object markers at the first position coordinates in the current environment image, wherein all added object markers are object markers with the same display style, such as all added object markers being first object markers or all added object markers being second object markers; and displaying the current environment image in the display interface, including: displaying the current environment image after adding the object markers in the display interface.

[0170] Optionally, the first interactive interface also includes object location markers. The meaning of the object location markers can be referred to the relevant description in step S101 above, and will not be repeated here. Displaying the first interactive interface further includes: identifying the spatial coordinates of the target object in the current environment image; determining the second location coordinates based on the spatial coordinates of the target object, wherein the determination of the second location coordinates can be referred to the relevant description in step A2 above; adding object location markers at the second location coordinates in the current spatial background image, wherein all added object location markers are object location markers with the same display style, such as all added object location markers being first object location markers or all added object location markers being second object location markers; displaying the current spatial background image in the display interface, including: displaying the current spatial background image after adding the object location markers in the display interface.

[0171] For example, the first interactive interface can be displayed as shown in J3 of Figure 2B.

[0172] B2. Receive the range selection operation applied to the first interactive interface.

[0173] Here, the range selection operation is used to select the available space range.

[0174] There are various ways to interact with the range selection operation. The specific interaction methods for receiving the range selection operation will be introduced later and will not be described in detail here.

[0175] B3. Add a spatial boundary graphic marker to the current environment image of the first interactive interface to indicate the second available space range, and add a spatial boundary area marker to the current space background image of the first interactive interface to indicate the second available space range, thus obtaining the first fence interactive interface.

[0176] Here, the second available space range is the available space range set based on the range selection operation.

[0177] For example, referring to Figure 2B, the first interactive interface is shown as J3 in Figure 2B. When a range selection operation is received on the first interactive interface shown as J3, a spatial boundary graphic mark for marking the second available space range is added to the current environment image, and a spatial boundary area mark for marking the second available space range is added to the current space background image, thus obtaining the first fence interactive interface, as shown as J1 in Figure 2B.

[0178] If the first interactive interface does not contain the aforementioned object markers and / or object location markers, object markers may be added to the current environment image of the first interactive interface, and / or object location markers may be added to the current spatial background image of the first interactive interface. For the specific implementation principles of adding object markers to the current environment image and / or adding object location markers to the current spatial background image, please refer to the relevant description in step A2 above, which will not be repeated here.

[0179] In steps B1-B3 above, the display of the fence interaction interface can be completed by adding spatial boundary area markers corresponding to the range selection operation to the current environment image and adding spatial boundary graphic markers corresponding to the range selection operation to the current spatial background image.

[0180] The following section introduces some specific interaction methods for adjusting the range of the first fence interaction interface.

[0181] In one embodiment, receiving a range adjustment operation applied to a first fence interactive interface includes: receiving a movement operation applied to a line or control point of a spatial boundary graphic marker in the first fence interactive interface, wherein the spatial boundary graphic marker control point includes the vertex of the spatial boundary graphic marker.

[0182] For example, referring to Figure 2C, assuming the first fence interaction interface is shown as J1 in Figure 2C, when the user drags the lines of the spatial boundary graphic markers in J1, the user receives a range adjustment operation on the first fence interaction interface, updates the various markers in the first fence interaction interface, and displays the updated first fence interaction interface as shown as J5 in Figure 2C.

[0183] For example, referring to Figure 2D, assuming the first fence interaction interface is shown as J5 in Figure 2D, when the user drags the control point of the spatial boundary graphic marker in J5, the user receives a range adjustment operation on the first fence interaction interface, updates the various markers in the first fence interaction interface, and displays the updated first fence interaction interface as shown as J6 in Figure 2D.

[0184] When the available space includes the framing range, in the first fence interaction interface, during the process of updating the spatial boundary graphic marker, it is also possible to detect whether the movement position of the control point movement operation acting on the spatial boundary graphic marker exceeds the maximum framing range. The maximum framing range refers to the complete field of view that the camera can cover. If the movement position exceeds the maximum framing range, the control point acting on the movement operation is restricted to the boundary corresponding to the maximum framing range in the first fence interaction interface, so that the available space indicated by the spatial boundary graphic marker is less than or equal to the maximum framing range.

[0185] For example, referring to Figure 2E, when the control point cd1 in Figure 2E is dragged outside the maximum framing range, the control point cd1 stays on the boundary corresponding to the maximum framing range.

[0186] In the first fence interaction interface, during the process of updating the spatial boundary graphic markers, it is also possible to detect whether the movement position of the line or control point movement operation acting on the spatial boundary graphic markers exceeds the horizontal boundary in the three-dimensional observation view. The horizontal boundary is used to represent the horizontal plane of the space in the current environment image in the current spatial background image. If the movement position exceeds the horizontal boundary in the three-dimensional observation view, a space exceedance prompt is displayed in the first fence interaction interface. The space exceedance prompt is used to indicate that the available space range corresponding to the spatial boundary graphic marker exceeds the space in the current environment image.

[0187] For example, referring to Figure 2F, when the control point cd2 in Figure 2F is dragged to the background view outside the horizontal boundary in the three-dimensional observation view, a space exceeding the limit prompt tt is displayed in the first fence interaction interface.

[0188] During the process of updating the spatial boundary graphic markers in the first fence interaction interface, it is also possible to detect whether the movement position of the control point movement operation applied to the spatial boundary graphic markers exceeds the current spatial background image. If the movement position exceeds the current spatial background image, the control point applied to by the movement operation is restricted to the boundary of the current spatial background image, so that the spatial boundary graphic markers are only displayed in the current spatial background image.

[0189] For example, referring to Figure 2G, when the control point cd3 in Figure 2G is dragged outside the current spatial background image, the control point cd3 stays on the boundary of the current spatial background image.

[0190] During the process of updating the spatial boundary graphic marker in the first fence interactive interface, the distance between the two ends of the line affected by the movement operation of the line acting on the spatial boundary graphic marker and the horizontal boundary in the three-dimensional observation view can also be detected. If the distance between the two ends of the line affected by the movement operation and the horizontal boundary in the three-dimensional observation view is less than the first preset distance, the line affected by the movement operation will be snapped to the horizontal boundary in the three-dimensional observation view in the first fence interactive interface.

[0191] For example, referring to Figure 2H, when the line s1 in Figure 2H is dragged so that the distance between the line s1 and the horizontal boundary in the three-dimensional view is less than or equal to 0.2 cm, the line s1 will automatically snap to the horizontal boundary in the three-dimensional view.

[0192] During the process of updating the spatial boundary graphic markers in the first fence interactive interface, the distance between the control point affected by the movement operation of the control point of the spatial boundary graphic marker and the horizontal boundary in the three-dimensional observation view can also be detected. If the distance between the control point affected by the movement operation and the horizontal boundary in the three-dimensional observation view is less than the second preset distance, the control point affected by the movement operation will be snapped to the horizontal boundary in the three-dimensional observation view in the first fence interactive interface.

[0193] For example, referring to Figure 2I, when the control point cd4 in Figure 2I is dragged so that the distance between the control point cd4 and the boundary of the spatial region q3 is less than or equal to 0.2cm, the control point cd4 automatically snaps to the horizontal boundary in the three-dimensional observation view.

[0194] In some possible cases, receiving a range adjustment operation applied to the first fence interactive interface may further include: receiving a control point adjustment operation applied to the spatial boundary graphic markers in the first fence interactive interface, wherein the control point adjustment operation is used to adjust the number of control points of the spatial boundary graphic markers; and updating the number of control points of the spatial boundary graphic markers in the first fence interactive interface.

[0195] For example, referring to Figure 2J, when a user long-presses the line of the spatial boundary graphic marker, a control point adjustment operation is received on the spatial boundary graphic marker in the first fence interaction interface. A control point cd5 is added on the line that the user long-presses, thereby updating the number of control points of the spatial boundary graphic marker.

[0196] The available space range can be adjusted by moving lines or control points, allowing users to easily adjust the available space range.

[0197] In one embodiment, receiving a range adjustment operation applied to a first fence interaction interface includes: receiving a first selection operation applied to a current environment image in the first fence interaction interface, the first selection operation being used to select a target object in the current environment image.

[0198] For example, referring to Figure 2K, assuming the first fence interaction interface is shown as J5 in Figure 2K, when the user selects the current environment image in J5, a range adjustment operation is received on the first fence interaction interface, updating various markers in the first fence interaction interface, and displaying the updated first fence interaction interface as shown in J2 in Figure 2K.

[0199] The available space range can be adjusted by selecting the object location marker in the spatial background image, allowing users to freely select the target object.

[0200] In one embodiment, when the fence view includes object location markers, receiving a range adjustment operation applied to a first fence interaction interface includes: receiving a second selection operation applied to a current spatial background image in the first fence interaction interface, the second selection operation being used to select an object location marker in the current spatial background image.

[0201] For example, referring to Figure 2L, assuming that the first fence interaction interface is currently as shown in J5 in Figure 2L, when the user selects or clicks on the object position markers in the current spatial background image in J5, a range adjustment operation is received on the first fence interaction interface, updating various markers in the first fence interaction interface and displaying the updated first fence interaction interface as shown in J2 in Figure 2L.

[0202] The available space range can be adjusted by selecting the object location marker in the spatial background image, allowing users to freely select the target object.

[0203] In one embodiment, the first fence interaction interface further includes a fence control for controlling the available space range, and the number of fence controls in the first fence interaction interface is not limited to one; receiving a range adjustment operation applied to the first fence interaction interface includes: receiving a third selection operation applied to the fence control in the first fence interaction interface, the third selection operation being used to select the fence control.

[0204] For example, referring to Figure 2M, assume that the first fence interaction interface is currently as shown in J6 of Figure 2M. The first fence interaction interface displays a "One-click Exclude Wall" button, which is a fence control. When the user clicks the "One-click Exclude Wall" button, a range adjustment operation is received on the first fence interaction interface, updating various markers in the first fence interaction interface and displaying the updated first fence interaction interface as shown in J7 of Figure 2M.

[0205] The available space range can be adjusted by triggering the fence control, allowing users to quickly adjust the space range.

[0206] It is understood that the scope adjustment operation is not limited to the various forms of operation listed above, and there may be other forms of operation, which this application does not limit.

[0207] Referring to Figure 3, which is a flowchart illustrating another spatial range control interaction method provided in an embodiment of this application, the method includes the following steps:

[0208] S201, displaying the first interactive interface.

[0209] For details regarding the display of the first interactive interface, please refer to the description in step B1 above; it will not be repeated here.

[0210] S202, receive a range selection operation applied to the first interactive interface.

[0211] Here, the range selection operation is used to select the available space range.

[0212] There are various ways to interact with the range selection operation. The specific interaction methods for receiving the range selection operation will be introduced later and will not be described in detail here.

[0213] S203, displaying the first fence interaction interface.

[0214] The definition of the first fence interaction interface can be found in the description of step S101 above, and will not be repeated here.

[0215] Specifically, a spatial boundary graphic marker for indicating the second available space range is added to the current environment image of the first interactive interface, and a spatial boundary region marker for indicating the second available space range is added to the current space background image of the first interactive interface, so as to display the first fence interactive interface. The specific implementation of adding the spatial boundary graphic marker for indicating the second available space range to the current environment image of the first interactive interface and adding the spatial boundary region marker for indicating the second available space range to the current space background image of the first interactive interface to display the first fence interactive interface can be referred to the relevant description in step B3 above, and will not be repeated here.

[0216] Optionally, after displaying the first fence interaction interface, the following steps S204-S205 are also included:

[0217] S204, Receive range adjustment operation applied to the first fence interaction interface.

[0218] S205, in the first fence interaction interface, update the spatial boundary graphic markers and spatial boundary area markers.

[0219] The specific implementation of steps S204 to S205 can be found in the descriptions of steps S102 to S103 above, and will not be repeated here.

[0220] In the technical solution corresponding to Figure 3 above, a first interactive interface is displayed, which includes a current environment image and a current spatial background image. Then, a range selection operation is received on the first interactive interface to select an available space range. Finally, a first fence interactive interface is displayed, which includes an environment view and a fence view corresponding to the environment view. Users can select and set local spaces by performing range selection operations within the interactive interface. Since the environment view includes a current environment image and spatial boundary region markers, the current environment image reflects the spatial distribution of the target object in the current real environment, the target object is the object affected by the available space range, and the spatial boundary region markers indicate areas belonging to the available space range. The fence view includes a current spatial background image and spatial boundary graphic markers. The current background image is obtained by 3D reconstruction of the space in the current environment image, and the spatial boundary graphic markers are used to mark the available space range in the current spatial background image. By displaying the current background image and spatial boundary graphic markers obtained by 3D reconstruction of the space in the current environment image in the fence view, users have a clear understanding of the range covered by the selected local space, which helps them to accurately select the local space. Furthermore, by displaying the current environment image and spatial boundary area markers in the environment view, the environment view forms a comparison view with the fence view, enhancing users' understanding of the range covered by the selected local space in the real environment, making it easier for users to select the local space more accurately.

[0221] The following section introduces some specific interaction methods for setting the scope of the first interactive interface.

[0222] In one embodiment, receiving a range setting operation applied to a first interactive interface includes: receiving a first selection operation applied to a current environment image in the first interactive interface, the first selection operation being used to select a target object in the current environment image.

[0223] For example, referring to Figure 4A, assuming the first interactive interface is shown as J3 in Figure 4A, when the user selects the current environment image in J3, the user receives a range setting operation on the first interactive interface and displays the first fence interactive interface as shown as J2 in Figure 4A.

[0224] The selection of available space is triggered by selecting a target object in the environment image, allowing users to freely choose the target object.

[0225] In one embodiment, when the first interactive interface includes an object location marker, receiving a range setting operation applied to the first interactive interface includes: receiving a second selection operation applied to a current spatial background image in the first interactive interface, the second selection operation being used to select an object location marker in the current spatial background image.

[0226] For example, referring to Figure 4B, assuming the first interactive interface is shown as J3 in Figure 4B, when the user selects or clicks on the object location marker in the current space background image in J3, a range setting operation is received on the first interactive interface, and the first fence interactive interface is displayed as shown as J2 in Figure 4B.

[0227] The selection of available space is triggered by choosing an object location marker in the spatial background image, allowing users to freely select the target object.

[0228] In one embodiment, the first interactive interface further includes a fence control for controlling the available space range, and the number of fence controls in the first fence interactive interface is not limited to one; receiving a range selection operation applied to the first interactive interface includes: receiving a third selection operation applied to the fence control in the first interactive interface, the third selection operation being used to select the fence control.

[0229] For example, referring to Figure 4C, assume that the first interactive interface is shown as J8 in Figure 4C. The first interactive interface displays a "One-click Exclude Walls" button, which is a fence control. When the user clicks the "One-click Exclude Walls" button, a range adjustment operation is received on the first interactive interface, and the first fence interactive interface is displayed as J7 in Figure 4C.

[0230] The fence control triggers the selection of available space, allowing users to quickly select a space.

[0231] It is understood that the range setting operation is not limited to the various forms of operation listed above, and there may be other forms of operation, which this application does not limit.

[0232] In some possible cases, the spatial range control interaction method shown in Figure 1 or Figure 3 above further includes: receiving a view adjustment operation applied to the fence view in the first fence interaction interface, the view adjustment operation being used to adjust the viewing angle of the fence view in the first fence interaction interface; updating the fence view in the first fence interaction interface, wherein the spatial boundary graphic markers in the updated fence view are obtained by adjusting the spatial boundary graphic markers in the previous fence view according to the target viewing angle corresponding to the view adjustment operation.

[0233] When a view adjustment operation is received that affects the fence view, the fence view is updated in the fence interaction interface, which allows users to observe the environment from different angles and thus make better selections of local spaces.

[0234] Referring to Figure 5, which is a flowchart illustrating an image presentation method provided in an embodiment of this application, the method includes the following steps:

[0235] S301, displaying the second interactive interface.

[0236] Here, the second interactive interface includes the current spatial background image. For a description of the current spatial background image, please refer to the relevant description in step S101 above; it will not be repeated here. Displaying the second interactive interface includes: acquiring the current spatial background image and displaying the current spatial background image in the display interface. For the specific implementation of acquiring the current spatial background image, please refer to the relevant description in step A1 above; it will not be repeated here.

[0237] Optionally, the second interactive interface also includes an object location marker. The meaning of the object location marker can be found in the description of step S101 above, and will not be repeated here. Displaying the second interactive interface further includes: identifying the spatial coordinates of the target object in the current environment image; the specific implementation of identifying the spatial coordinates of the target object in the current environment image can be found in the description of step A2 above; determining the second location coordinates based on the spatial coordinates of the target object; the specific implementation of determining the second location coordinates based on the spatial coordinates of the target object can be found in the description of step A2 above; adding the object location marker at the second location coordinates in the current spatial background image; and displaying the current spatial background image in the display interface, including: displaying the current spatial background image after adding the object location marker in the display interface.

[0238] For example, the second interactive interface can be shown as J9 in Figure 6A.

[0239] S302, receive the range setting operation applied to the second interactive interface.

[0240] Here, the range setting operation is used to set the range of available space.

[0241] There are various ways to interact with the range setting operation. The specific interaction methods for receiving range setting operations will be introduced later and will not be described in detail here.

[0242] S303 displays the second fence interaction interface.

[0243] Here, the second fence interaction interface includes a fence view, which includes a current spatial background image, spatial boundary graphic markers, and object location markers. The spatial boundary graphic markers in the second fence interaction interface are used to indicate a third available space range in the current spatial background image. The third available space range is the available space range set based on the range setting operation. The meaning of the object location markers can be found in the description of step S101 above, and will not be repeated here.

[0244] For example, the second fence interaction interface can be shown as J10 in Figure 6A.

[0245] In the technical solution corresponding to Figure 5 above, a second interactive interface is displayed, which includes the current spatial background image. Then, a range setting operation is received on the second interactive interface to set the available space range. Finally, a second fence interactive interface is displayed, which includes a fence view. Users can select and set a local space by performing range setting operations within the interactive interface. Since the fence view includes the current spatial background image, spatial boundary graphic markers, and object location markers, and the current background image is obtained through three-dimensional reconstruction of the space in the current environment image, and the spatial boundary graphic markers are used to indicate the available space range in the current spatial background image, displaying the current background image and spatial boundary graphic markers obtained through three-dimensional reconstruction of the space in the current environment image in the fence view allows users to clearly understand the range covered by the selected local space, facilitating accurate selection of the local space. Furthermore, displaying object location markers in the fence view to indicate the target object in the current spatial background image, and showing a different display style for the object location markers of target objects outside the available space range compared to those within the available space range, allows users to confirm the rationality of the selected local space based on the object location markers, further facilitating accurate selection of the local space.

[0246] In some possible cases, the spatial range control interaction method shown in Figure 5 above further includes: receiving a view adjustment operation applied to the fence view in the second fence interaction interface, the view adjustment operation being used to adjust the viewing angle of the fence view in the second fence interaction interface; updating the fence view in the second fence interaction interface, wherein the spatial boundary graphic markers in the updated fence view are obtained by adjusting the spatial boundary graphic markers in the previous fence view according to the target viewing angle corresponding to the view adjustment operation.

[0247] When a view adjustment operation is received that affects the fence view, the fence view is updated in the fence interaction interface, which allows users to observe the environment from different angles and thus make better selections of local spaces.

[0248] The following section introduces some specific interaction methods for setting the scope of the second interactive interface.

[0249] In one embodiment, when the second interactive interface includes an object location marker, receiving a range setting operation applied to the second interactive interface includes: receiving a second selection operation applied to the current spatial background image in the second interactive interface, the second selection operation being used to select an object location marker in the current spatial background image.

[0250] For example, referring to Figure 6B, assuming the second interactive interface is shown as J9 in Figure 6B, when the user circles or clicks on the object location marker in the current spatial background image in J9, a range setting operation is received on the second interactive interface, and the second fence interactive interface can be displayed as shown as J11 in Figure 6B.

[0251] The available space range can be set by selecting an object location marker in the spatial background image, allowing users to freely set the target object.

[0252] In one embodiment, the second interactive interface further includes a fence control, and the number of fence controls in the second interactive interface is not limited to one; receiving a range setting operation applied to the second interactive interface includes: receiving a third selection operation applied to the fence control in the second interactive interface, the third selection being used to select the fence control.

[0253] For example, referring to Figure 6C, assume that the second interactive interface is shown as J12 in Figure 6C. The second interactive interface displays a "One-click Exclude Walls" button, which is a fence control. When the user clicks the "One-click Exclude Walls" button, a range setting operation is received on the second interactive interface, and the second fence interactive interface shown as J13 in Figure 6C is displayed.

[0254] The fence control allows users to quickly set the available space range.

[0255] In one embodiment, the second interactive interface includes spatial boundary graphic markers. For example, the second interactive interface is shown as J14 in FIG6D or J15 in FIG6E. Receiving a range setting operation applied to the second interactive interface includes receiving a movement operation of a line or control point applied to the spatial boundary graphic marker in the second interactive interface.

[0256] For example, referring to Figure 6D, assuming the second interactive interface is shown as J14 in Figure 6D, when the user drags the line of the spatial boundary graphic marker in J14, the user receives a range setting operation on the second interactive interface and displays the second fence interactive interface as shown as J15 in Figure 6D.

[0257] For example, referring to Figure 6E, assuming the second interactive interface is shown as J15 in Figure 6E, when the user drags the control point of the spatial boundary graphic mark in J15, the user receives the range setting operation applied to the second interactive interface and displays the second fence interactive interface as shown as J16 in Figure 6E.

[0258] When the second interactive interface includes spatial boundary graphic markers, during the display of the second fence interactive interface, the lines or control points of the spatial boundary graphic markers can be adjusted or restricted, referring to the descriptions corresponding to Figures 2E-2I above. The specific principles can be referred to the relevant descriptions corresponding to Figures 2E-2I above, which will not be repeated here.

[0259] In some possible cases, receiving a range setting operation applied to the second interactive interface may also include: receiving a control point adjustment operation applied to the spatial boundary graphic markers in the second interactive interface; and updating the number of control points of the spatial boundary graphic markers in the second interactive interface.

[0260] The available space range can be set by moving lines or control points, which makes it convenient for users to set the available space range.

[0261] Referring to Figure 7, which is a flowchart illustrating an image presentation method provided in an embodiment of this application, the method includes the following steps:

[0262] S401, Obtain the current environment image.

[0263] For an introduction to the current environment image, please refer to the relevant description in step S101 above, which will not be repeated here.

[0264] S402, in the current environment image, obtain the image area corresponding to the available space range of the target, and use it as the output environment image.

[0265] Here, the available space range of the target is obtained based on the fence interaction interface, which can be either the first fence interaction interface mentioned above or the second fence interaction interface mentioned above. For an introduction to the fence interaction interface, please refer to the previous description; it will not be repeated here.

[0266] The available space range of the target is obtained by converting the spatial boundary graphic markers in the fence interaction interface, and the image area corresponding to the available space range of the target is obtained by converting the available space range of the target.

[0267] In one feasible implementation, the spatial boundary graphic marker can be mapped from the current spatial background image to the three-dimensional spatial model according to the coordinate transformation relationship corresponding to the target observation perspective, so as to obtain the target's usable spatial range; then, according to the coordinate transformation relationship determined during three-dimensional reconstruction, the target's usable spatial range is transformed to obtain the image region corresponding to the target's usable spatial range in the current environmental image.

[0268] In the technical solution corresponding to Figure 7 above, by acquiring the current environment image, which reflects the spatial distribution of the target object in the current real environment, the target object is the object affected by the available space range, and the available space range is the set effective space range. In the current environment image, the image area corresponding to the target available space range is acquired as the output environment screen, realizing the output of the environment image within the local space. The fence interaction interface includes a fence view, which includes the current space background image and space boundary graphic markers. The current background image is obtained based on the three-dimensional reconstruction of the space in the current environment image. The space boundary graphic markers are used to mark the available space range in the current space background image. By setting the local space range through the fence interaction interface, the user has a clear understanding of the range covered by the selected local space, which is conducive to the user accurately selecting the local space, thereby outputting a more accurate local environment screen.

[0269] In some embodiments, before obtaining the image region corresponding to the available spatial range of the target in the current environmental image and using it as the output image, the following steps C1-C2 are further included:

[0270] C1. Display the fence interaction interface.

[0271] The fence interaction interface can be displayed through the following steps a1-a3:

[0272] a1. Generate the current spatial background image based on the view of the 3D spatial model from the target's perspective.

[0273] For details on how to generate the current spatial background image, please refer to the description in step A1 above; it will not be repeated here.

[0274] a2. Add spatial boundary graphic markers to the current spatial background image to obtain the fence view.

[0275] For details on how to implement step a2, please refer to the descriptions of steps A2 and B3 above. They will not be repeated here.

[0276] a3. Display the fence view in the display interface.

[0277] Optionally, the fence view in the fence interaction interface also includes object location markers. The meaning of the object location markers can be found in the description of step S101 above, and will not be repeated here. Displaying the fence interaction interface also includes the following steps b1-b2:

[0278] b1. Identify the spatial coordinates of the target object in the current environment image.

[0279] The specific implementation of step b1 can be found in the description of step A2 above, and will not be repeated here.

[0280] b2. Based on the spatial coordinates and spatial boundary graphic markers of the target object in the current environment image, add a first object position marker and a second object position marker with different display styles in the current spatial background image.

[0281] The meanings of the first object location marker and the second location marker can be found in the description of step S101 above, and will not be repeated here.

[0282] For details on how to implement step b2, please refer to the description of step A2 above, which will not be repeated here.

[0283] By adding object location markers to the current spatial background image to indicate the target object, and by displaying the object location markers of target objects outside the available space differently from those of target objects within the available space, users can confirm whether the selected local space is reasonable based on the object location markers, which helps users to accurately select the local space.

[0284] Optionally, the fence interaction interface also includes an environment view. The meaning of the environment view can be found in the description of step S101 above, and will not be repeated here. Displaying the fence interaction interface also includes the following steps c1-c3:

[0285] c1. Determine the spatial boundary region markings based on the spatial boundary graphic markings.

[0286] In one feasible implementation, the spatial boundary graphic marker can be mapped from the current spatial background image to the three-dimensional spatial model according to the coordinate transformation relationship corresponding to the target observation perspective, so as to obtain the target's usable spatial range; the area belonging to the target's usable spatial range in the current environmental image is determined to determine the spatial boundary area marker.

[0287] c2. Add spatial boundary region markers to the current environment image to obtain the environment view.

[0288] c3. In the display interface, display the environment view.

[0289] The fence interface includes an environment view, which includes a current environment image and spatial boundary area markers. The current environment image reflects the spatial distribution of the target object in the current real environment. The environment view forms a comparison view with the fence view, enhancing the user's understanding of the range of the selected local space in the real environment and making it easier for the user to select the local space more accurately.

[0290] Optionally, the environment view also includes object markers. For the meaning of the object markers, please refer to the relevant description in step S101 above; it will not be repeated here. Displaying the fence interaction interface also includes the following steps d1-d2:

[0291] d1. Identify the position coordinates of the target object in the current environment image.

[0292] The specific implementation of step d1 can be found in the description of step A2 above, and will not be repeated here.

[0293] d2. Based on the position coordinates and spatial boundary graphic markers of the target object in the current environment image, add a first object marker and a second object marker with different display styles in the current environment image.

[0294] The meanings of the first object marker and the second object marker can be found in the description of step S101 above, and will not be repeated here.

[0295] For details on how to implement step d2, please refer to the description of step A2 above, which will not be repeated here.

[0296] By adding object markers to the current environment image to identify target objects, and displaying the object markers of target objects outside the available space differently from those within the available space, users can confirm whether the selected local space is the desired local space based on the object markers, which helps users select local spaces more accurately.

[0297] C2. Determine the available space range of the target area based on the fence interaction interface.

[0298] This includes receiving range setting operations applied to the fence interaction interface; and determining the target available space range based on the range setting operations applied to the fence interaction interface. Specifically, based on the range setting operations applied to the fence interaction interface, spatial boundary graphic markers can be determined in the fence interaction interface, and the target range can be determined based on the spatial boundary graphic markers.

[0299] In steps C1-C2 above, the available space range of the target is set through the fence interaction interface, which makes it easier for users to perceive the local space range.

[0300] The method of this application has been described above; the apparatus of this application will be described below.

[0301] Referring to Figure 8, which is a schematic diagram of the structure of a terminal device provided in an embodiment of this application, the terminal device 50 includes a processor 501 and a memory 502. The memory 502 is connected to the processor 501, for example, via a bus.

[0302] Processor 501 is configured to support the terminal device 50 in performing the corresponding functions in the methods described in the above method embodiments. Processor 501 may be a central processing unit (CPU), a network processor (NP), a hardware chip, or any combination thereof. The aforementioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The aforementioned PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof.

[0303] Memory 502 is used to store program code, etc. Memory 502 may include volatile memory (VM), such as random access memory (RAM); memory 502 may also include non-volatile memory (NVM), such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid-state drive (SSD); memory 502 may also include combinations of the above types of memory.

[0304] The memory 502 is used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the program instructions / modules corresponding to the spatial range control interaction method and / or image rendering method in the embodiments of this application. The processor executes the various functional applications and data processing of the spatial range control interaction method and / or image rendering method by running the non-volatile software programs, instructions, and modules stored in the memory, thereby realizing the functions of the spatial range control interaction method and / or image rendering method provided in the above method embodiments.

[0305] Memory 502 may include a program storage area and a data storage area, wherein the program storage area may store the operating system and applications required for at least one function. In some embodiments, the memory may include memory remotely located relative to the processor, and such remote memory may be connected to the processor via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0306] The one or more modules are stored in the memory. When executed by the one or more processors, they perform the spatial range control interaction method and / or image rendering method in any of the above method embodiments, for example, the method steps described in the above method embodiments.

[0307] This application also provides a computer-readable storage medium storing a computer program, the computer program including program instructions, which, when executed by a computer, cause the computer to perform the method described in the foregoing embodiments.

[0308] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0309] The above-disclosed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application shall still fall within the scope of this application.

Images