Multi-room calibration method, device, equipment, medium and program product

Abstract

The embodiment of the invention provides a multi-room calibration method and device, equipment, a medium and a program product, and the method comprises the steps: displaying a room calibration interface according to a room calibration triggering instruction, the room calibration interface comprises the information of an uncalibrated room of a target space, and an environment map of the target space can be associated with anchor points of a plurality of calibrated rooms in the target space; calibrating a target room selected by the user according to a multi-room calibration strategy; and updating environment data of the environment map according to the calibration result of the target room, and associating the anchor point of the target room to the environment map. According to the method, an environment map is created for a target space, the environment map is continuously increased along with calibration of rooms in the target space, the environment map can be associated with anchor points of a plurality of calibrated rooms in the target space, when a user moves among different rooms, the environment map does not need to be positioned again, and the user experience is improved. And only the anchor points of the room need to be switched, so that the user experience is improved.

Description

Technical Field

[0001] Embodiments of the present application relate to the field of virtual reality, and in particular to a multi-room calibration method, device, equipment, medium, and program product. Background Art

[0002] Extended Reality (XR) refers to the combination of reality and virtuality through computers to create a virtual environment for human-computer interaction. XR is also a general term for multiple technologies such as Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR). By integrating the visual interaction technologies of the three, it brings the experiencer an "immersive feeling" of seamless transition between the virtual world and the real world.

[0003] In the MR scene, the room capture method is used to calibrate the positions of objects such as the floor, walls, ceiling, and furniture in the room in turn. Based on the calibration technology, some gameplay can be derived in the MR space, for example, using a virtual sphere to slingshot into the real space and collide back. In the existing solution, in a multi-room scene, an environment map needs to be created for each room, and multiple rooms correspond to multiple environment maps. During the operation of the MR application, when the user moves from one room to another, the environment map of the new room needs to be used again for positioning.

[0004] It takes a certain amount of time to locate the environment map. During the location process of the environment map, users cannot use MR applications normally, resulting in a poor user experience. Summary of the invention

[0005] The embodiments of the present application provide a multi-room calibration method, apparatus, device, medium and program product, which can calibrate multiple rooms on an environment map. During the use of MR applications, the environment map only needs to be positioned once. When the user moves between different rooms, there is no need to re-position the environment map, and only the anchor point of the room needs to be switched. In addition, based on the multi-room calibration results, richer functions or gameplay can be provided for MR applications, thereby improving the user experience.

[0006] In a first aspect, an embodiment of the present application provides a multi-room calibration method, comprising:

[0007] In response to a room calibration trigger instruction, displaying a room calibration interface, wherein the room calibration interface includes information of uncalibrated rooms of a target space, and an environment map of the target space may be associated with anchor points of a plurality of calibrated rooms in the target space;

[0008] In response to a user selecting an uncalibrated target room in the room calibration interface, calibrating the target room according to a multi-room calibration strategy;

[0009] The environmental data of the environmental map is updated according to the calibration result of the target room, and the anchor point of the target room is associated with the environmental map.

[0010] In some embodiments, the multi-room calibration strategy includes: closed spaces of any two calibrated rooms in the environment map do not overlap.

[0011] In some embodiments, the multi-room calibration strategy further includes: the calibration frame of the furniture in the room cannot exceed the closed space of the room.

[0012] In some embodiments, calibrating the target room according to a multi-room calibration strategy includes:

[0013] Acquire an image corresponding to the target room, and calibrate the target room in the order of ground, wall, ceiling, and furniture according to the image corresponding to the target room, wherein the closed space of the target room is formed by connecting the calibration lines of the ground, wall, and ceiling of the target room;

[0014] When calibrating the closed space of the target room, when it is detected that the target calibration line of the closed space of the target room overlaps with the closed space of the calibrated room of the environmental map, a first prompt information is output, and the first prompt information is used to prompt that the position of the target calibration line is wrong, and / or, prompt to adjust the position of the target calibration line to a correct position.

[0015] In some embodiments, calibrating the target room according to a multi-room calibration strategy includes:

[0016] Acquire an image corresponding to the target room, and calibrate the target room in the order of ground, wall, ceiling, and furniture according to the image corresponding to the target room, wherein the closed space of the target room is formed by connecting the calibration lines of the ground, wall, and ceiling of the target room;

[0017] When it is detected that the calibration frame of the target furniture in the target room exceeds the closed space of the target room, a second prompt information is output, wherein the second prompt information is used to prompt that the calibration of the target furniture is wrong and / or to prompt to adjust the calibration frame of the target furniture.

[0018] In some embodiments, acquiring an image corresponding to the target room, and calibrating the target room in the order of ground, wall, ceiling, and furniture according to the image corresponding to the target room, includes:

[0019] Determining a perspective image corresponding to the target room according to the image corresponding to the target room;

[0020] Displaying the perspective image corresponding to the target room and the ground closed area or closed space of the marked room in the target space;

[0021] The target room is calibrated in the order of ground, wall, ceiling and furniture.

[0022] In some embodiments, the calibrating the target room in the order of ground, wall, ceiling and furniture includes:

[0023] When calibrating the calibration object in the target room, a semi-transparent mask is displayed on the calibration surface synchronously with the formation of the calibration surface of the calibration object being calibrated, wherein the semi-transparent mask is displayed on the calibration surface of the calibrated object in the target room.

[0024] In some embodiments, associating the anchor point of the target room to the environment map comprises:

[0025] Generate anchor point information of the target room, and store the anchor point information of the target room using the identifier of the target room as an index;

[0026] An association relationship between the identifier of the target room and the identifier of the environment map is established.

[0027] In some embodiments, it also includes:

[0028] In response to receiving the first instruction, positioning the environment map according to the environment data of the environment map;

[0029] When the environment map is successfully positioned, the identifiers of a plurality of marked rooms associated with the environment map are determined according to the identifier of the environment map;

[0030] Acquire, according to the identifiers of the multiple calibrated rooms associated with the environment map, anchor point information of all or part of the multiple calibrated rooms associated with the environment map;

[0031] According to the obtained anchor point information of the calibrated room, the obtained content of the calibrated room is displayed.

[0032] In some embodiments, acquiring anchor point information of all or part of the multiple calibrated rooms associated with the environment map according to the identifiers of the multiple calibrated rooms associated with the environment map includes:

[0033] Determining, according to the loading rule, an identifier of a second calibrated room to be loaded from identifiers of a plurality of calibrated rooms associated with the environment map;

[0034] According to the identifier of the second calibrated room, the anchor point information of the second calibrated room is loaded into the memory.

[0035] In some embodiments, displaying the acquired content of the calibrated room according to the acquired anchor point information of the calibrated room includes:

[0036] Determining, according to the display rule, an identifier of a first marked room to be displayed;

[0037] Determining, from the memory, an anchor point of the calibrated room to be displayed according to the identifier of the first calibrated room;

[0038] The content of the first calibrated room is displayed according to the anchor point information of the first calibrated room.

[0039] In some embodiments, it also includes:

[0040] When detecting that the user moves from the third calibrated room to the fourth calibrated room, acquiring the anchor point information of the fourth calibrated room according to the identifier of the fourth calibrated room;

[0041] The content of the fourth calibrated room is displayed according to the anchor point information of the fourth calibrated room.

[0042] In some embodiments, when it is detected that the user moves from the third calibrated room to the fourth calibrated room, the method further includes: closing the content of the third calibrated room.

[0043] In some embodiments, displaying the content of the fourth calibrated room according to the anchor point information of the fourth calibrated room includes:

[0044] According to the anchor point information of the fourth calibrated room, the content of the fourth calibrated room is displayed and the calibrated surface of the calibrated object in the fourth calibrated room is displayed with a semi-transparent mask.

[0045] In some embodiments, when detecting that the user moves from the third calibrated room to the fourth calibrated room, the method further includes:

[0046] The content of the third calibrated room is closed, or the content of the third calibrated room is displayed and the mask of the third calibrated room is closed.

[0047] In some embodiments, the method further comprises:

[0048] In response to the second instruction, a first management interface is displayed in the extended reality space, wherein the first management interface includes a space list of the user's calibrated space, a room list of calibrated rooms of the calibrated space, and a 2D view of the spatial layout of the first calibrated space, wherein the first calibrated space belongs to the space of the user's calibrated space.

[0049] In some embodiments, the method further comprises:

[0050] In response to a third instruction, a 3D view of the spatial layout of the first calibrated space is displayed in the extended reality space.

[0051] In some embodiments, the first calibrated space is the space where the user is currently located, and the 2D view of the spatial layout of the first calibrated space also displays an identifier of the user's current location;

[0052] The step of displaying, in response to the third instruction, a 3D view of the spatial layout of the first calibrated space comprises:

[0053] In response to detecting that a user moves from a first room to a second room in the first calibrated space, a 3D view of the spatial layout of the first calibrated space is displayed in the first management interface.

[0054] In some embodiments, the method further comprises:

[0055] In response to a 3D model invoking instruction, a 3D model of a first room in the first calibrated space is displayed in the extended reality space.

[0056] In some embodiments, displaying the 3D model of the first room in the first calibrated space in the extended reality space includes:

[0057] The first management interface is hidden in the extended reality space, and the 3D model of the first room is displayed.

[0058] In some embodiments, the method further comprises:

[0059] When a first operation is detected, the 3D model of the first room is controlled to enter an editing state, and after the 3D model of the first room enters the editing state, the 3D model of the first room is displayed with a preset special effect;

[0060] When the second operation is detected, the 3D model of the first room is controlled to rotate.

[0061] In some embodiments, the first calibrated space is the space where the user is currently located, the first room is the room where the user is currently located, and the method further includes:

[0062] When it is detected that the rotation angle of the head mounted device is greater than a preset angle or the 3D model of the first room is beyond the user's field of view, the 3D model of the first room is controlled to move to a preset position within the user's field of view according to the user's current position.

[0063] In some embodiments, the method further comprises:

[0064] In response to the fourth instruction, displaying a second management interface in the extended reality space, the second management interface including a space list of spaces calibrated by the user, a room list of calibrated rooms in the calibrated space, and management controls for the calibrated rooms in the calibrated space;

[0065] In response to the user's second operation on the management control of the fifth calibrated room of the calibrated space, the following operations are performed on the fifth calibrated room: modify the room, delete the room, and the room modification includes one or more of the following modification operations: modify the name of the room, reset the spatial calibration results of the room, add furniture in the room, delete the furniture in the room, and modify the anchor points in the room.

[0066] In some embodiments, the second management interface further includes a room adding control, and the method further includes: in response to a third operation of the user on the room adding control, adding a calibratable room to the target space.

[0067] In a second aspect, an embodiment of the present application provides a multi-room calibration device, the device comprising:

[0068] A display module, configured to display a room calibration interface in response to a room calibration trigger instruction, wherein the room calibration interface includes information of uncalibrated rooms of a target space, and an environment map of the target space may be associated with anchor points of multiple calibrated rooms in the target space;

[0069] A calibration module, configured to calibrate an uncalibrated target room in the room calibration interface in response to a user's selection operation on the target room, according to a multi-room calibration strategy;

[0070] An updating module is used to update the environmental data of the environmental map according to the calibration result of the target room, and associate the anchor point of the target room with the environmental map.

[0071] In a third aspect, an embodiment of the present application provides an XR device, comprising: a processor and a memory, the memory being used to store a computer program, the processor being used to call and run the computer program stored in the memory to execute a method as described in any one of the first aspects above.

[0072] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program, and the computer program enables a computer to execute the method as described in any one of the first aspects above.

[0073] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the method described in any one of the first aspects above.

[0074] The multi-room calibration method, device, equipment, medium and program product provided by the embodiment of the present application include: in response to a room calibration trigger instruction, displaying a room calibration interface, the room calibration interface includes information of uncalibrated rooms in the target space, and the environment map of the target space can be associated with the anchor points of multiple calibrated rooms in the target space; calibrating the target room selected by the user according to the multi-room calibration strategy; updating the environment data of the environment map according to the calibration result of the target room, and associating the anchor point of the target room to the environment map. The method creates an environment map for multiple rooms in the target space, and as the rooms in the target space are calibrated, the environment map continues to increase, and the environment map can be associated with the anchor points of multiple calibrated rooms in the target space. During the use of MR applications, the environment map only needs to be positioned once. When the user moves between different rooms, there is no need to re-position the environment map, and only the anchor points of the room need to be switched, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0075] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0076] Figure 1 is a flow chart of the multi-room calibration method provided in Example 1 of the present application;

[0077] Figure 2 This is a UI diagram after the user opens the room calibration function for the first time;

[0078] Figure 3 A schematic diagram of a calibrated room of the target space;

[0079] Figure 4 A schematic diagram of the positional relationship between the closed ground area of ​​the calibrated room in the target space and the wall of the target room;

[0080] Figure 5 A schematic diagram of the masking of the marked wall in the target room;

[0081] Figure 6 This is a schematic diagram of the UI changes during the room calibration process;

[0082] Figure 7 A flowchart of a multi-room calibration method provided in Embodiment 2 of the present application;

[0083] Figure 8 A flowchart of a multi-room calibration method provided in Embodiment 3 of the present application;

[0084] Fig. 9 This is a schematic diagram of the UI involved in the management process of the marked room;

[0085] Fig.10 A flowchart of a multi-room calibration method provided in Embodiment 4 of the present application;

[0086] Fig.11 is a schematic diagram of a first management interface;

[0087] Fig.12 is another schematic diagram of the first management interface;

[0088] Fig.13 A schematic diagram showing a 3D view of a spatial layout of a first marked space in a first management interface;

[0089] Fig.14 Another schematic diagram of a 3D view showing a spatial layout of a first marked space in a first management interface;

[0090] Fig.15 A display diagram of a 3D model of a room;

[0091] Fig.16 A schematic diagram of the structure of a multi-room calibration device provided in Example 5 of the present application;

[0092] Fig.17 A structural schematic diagram of the XR device provided in Example 6 of the present application. DETAILED DESCRIPTION

[0093] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0094] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.

[0095] In order to facilitate understanding of the embodiments of the present application, before describing each embodiment of the present application, some concepts involved in all embodiments of the present application are first appropriately explained, as follows:

[0096] The multi-room calibration method provided in the embodiment of the present application can be applied to XR devices, including but not limited to VR devices, AR devices and MR devices.

[0097] VR: Technology for creating and experiencing a virtual world. It generates a virtual environment by computation. It is a multi-source information (the virtual reality mentioned in this article includes at least visual perception, and can also include auditory perception, tactile perception, motion perception, and even taste perception, olfactory perception, etc.). It realizes the simulation of the fusion and interactive three-dimensional dynamic vision and entity behavior of the virtual environment, immersing users in a simulated virtual reality environment, and realizing applications in various virtual environments such as maps, games, videos, education, medical care, simulation, collaborative training, sales, assisted manufacturing, maintenance and repair.

[0098] AR: AR scenery refers to a simulated scenery in which at least one virtual object is superimposed on a physical scenery or a representation thereof. For example, an electronic system may have an opaque display and at least one imaging sensor for capturing images or videos of a physical scenery, which are representations of the physical scenery. The system combines the image or video with the virtual object and displays the combination on the opaque display. An individual uses the system to indirectly view the physical scenery via an image or video of the physical scenery and observes the virtual object superimposed on the physical scenery. When the system uses one or more image sensors to capture images of the physical scenery and uses those images to present the AR scenery on an opaque display, the displayed image is referred to as video transmission. Alternatively, an electronic system for displaying an AR scenery may have a transparent or translucent display through which an individual can directly view the physical scenery. The system may display virtual objects on a transparent or translucent display so that an individual uses the system to observe virtual objects superimposed on the physical scenery. As another example, the system may include a projection system that projects virtual objects into a physical scenery. Virtual objects can be projected, for example, on a physical surface or as a hologram, so that individuals using the system observe virtual objects superimposed on a physical setting. Specifically, a technology that calculates the camera's posture parameters in the real world (or three-dimensional world, real world) in real time during the process of the camera capturing images, and adds virtual elements to the images captured by the camera based on the camera posture parameters. Virtual elements include, but are not limited to: images, videos, and three-dimensional models. The goal of AR technology is to integrate the virtual world into the real world on the screen for interaction.

[0099] MR: By presenting virtual scene information in the real scene, an interactive feedback information loop is established between the real world, the virtual world and the user to enhance the realism of the user experience. For example, computer-created sensory input (e.g., virtual objects) is integrated with sensory input from the physical scene or its representation in the simulated scene. In some MR scenes, the computer-created sensory input can adapt to changes in sensory input from the physical scene. In addition, some electronic systems used to present MR scenes can monitor the orientation and / or position relative to the physical scene so that virtual objects can interact with real objects (i.e., physical elements from the physical scene or their representations). For example, the system can monitor movement so that virtual plants appear stationary relative to physical buildings.

[0100] Virtual reality devices refer to terminals that achieve virtual reality effects, which can usually be provided in the form of glasses, helmet-mounted displays (Head Mount Display, abbreviated as HMD), and contact lenses to achieve visual perception and other forms of perception. Of course, the form of virtual reality devices is not limited to this, and can be further miniaturized or enlarged according to actual needs.

[0101] Optionally, the virtual reality device (ie, XR device) described in the embodiments of the present application may include but is not limited to the following types:

[0102] 1) Mobile virtual reality devices support the configuration of mobile terminals (such as smart phones) in various ways (such as head-mounted displays with dedicated card slots). Through wired or wireless connection with the mobile terminal, the mobile terminal performs relevant calculations of virtual reality functions and outputs data to the mobile virtual reality device, such as watching virtual reality videos through the mobile terminal's APP.

[0103] 2) All-in-one virtual reality devices have a processor for performing relevant calculations of virtual functions, and thus have independent virtual reality input and output functions. They do not need to be connected to a PC or mobile terminal and have a high degree of freedom in use.

[0104] 3) Computer-based virtual reality (PCVR) devices use the PC to perform relevant calculations and data output for virtual reality functions. External computer-based virtual reality devices use the data output by the PC to achieve virtual reality effects.

[0105] The multi-room calibration method provided in this embodiment can be applied in MR scenarios. MR applications (applications, apps) use calibration (room capture) to assign physical properties (including but not limited to occlusion and collision) to the floor, walls, ceilings, and furniture in the space, and use spatial anchors technology to set anchors in the environment map corresponding to the real environment. The MR application calls the calibration results of the space to display the content of the MR application to the user.

[0106] In the MR scene, the XR device performs VST processing on the image of the real environment to obtain the perspective image corresponding to the real environment. The perspective image corresponding to the real environment is a 3D image, which is displayed on the display of the XR device. The user can directly see the real environment through the display. For head-mounted XR devices, users can accurately see the external real environment without removing the head-mounted XR device, which is convenient for users to interact with the external real environment.

[0107] MR applications use VST technology to perform spatial calibration, and the environment map obtained through spatial calibration is also called a virtual map or virtual scene.

[0108] In the prior art, in a multi-room scenario, for example, a user uses an XR device at home, and there are multiple rooms in the home. An environment map needs to be created for each room, and multiple rooms correspond to multiple environment maps. When a user enters room 1 from room 2, it is necessary to switch from the environment map corresponding to room 1 to the environment map corresponding to room 2, that is, it is necessary to reposition the environment map to the environment map corresponding to room 2. The positioning of the environment map takes a certain amount of time, and the user cannot use the MR application normally during the positioning process of the environment map. Among them, the positioning of the environment map is also called the recognition of the environment map or the retrieval of the environment map or the spatial recognition.

[0109] In order to solve the problems of the prior art, the embodiment of the application provides a multi-room calibration method, which creates an environment map for multiple rooms in the target space. As the rooms in the target space are calibrated, the environment map continues to grow. The environment map can be associated with multiple calibrated rooms in the target space. During the use of MR applications, the environment map only needs to be positioned once. When the user moves between different rooms, there is no need to re-position the environment map.

[0110] Figure 1 1 is a flow chart of a multi-room calibration method provided in Embodiment 1 of the present application, which is applied to an XR device. Figure 1 As shown, the method provided in this embodiment includes the following steps.

[0111] S101. In response to a space calibration trigger instruction, a room calibration interface is displayed, where the room calibration interface includes information of uncalibrated rooms of a target space, and an environment map of the target space can be associated with anchor points of multiple calibrated rooms in the target space.

[0112] The user wears a head-mounted device and turns on the calibration function of the MR application. For an all-in-one XR device, the XR device is a head-mounted device. For a split XR device (such as the mobile virtual reality device or PCVR device mentioned above), the XR device includes a head-mounted device and other external devices.

[0113] After the user turns on the calibration function of the MR application, a calibration option is displayed on the UI interface corresponding to the calibration function. The user can click, double-click, long press, and other operations on the calibration option. The XR device detects that the user clicks, double-clicks, long presses, and other operations on the calibration option and generates a spatial calibration trigger instruction. According to the spatial calibration trigger instruction, the spatial calibration interface is displayed.

[0114] The space calibration interface includes information of uncalibrated rooms of a target space, and the target space includes a plurality of calibrable rooms.

[0115] In one implementation, the number of calibrable rooms may be a fixed number, such as 6. After the number of calibrated rooms reaches the fixed number, the user cannot add any more rooms.

[0116] In another implementation, there is no upper limit to the number of calibrable rooms, and the user can continuously add rooms according to their needs. Optionally, the room calibration interface also includes a room addition option; in response to the user's selection operation of the room addition option, a calibrable room is added to the target space, and the user can modify the name of the newly added calibrable room.

[0117] When the user first opens the calibration function, all calibrable rooms in the target space are uncalibrated. At this time, the uncalibrated rooms of the target space include all calibrable rooms in the target space. After the user completes the calibration of some rooms, the uncalibrated rooms of the target space are the remaining uncalibrated rooms.

[0118] The information of the uncalibrated room includes the name or number of the uncalibrated room, and optionally, may also include at least one of an operation item of the uncalibrated room and an icon of the uncalibrated room, and the icons of different types of rooms are different.

[0119] The room name or number is used by the user to distinguish different rooms. The room name usually has semantics. For example, if the target space is "my home", the names of the rooms in the target space can be "living room", "master bedroom", "guest bedroom", "study", "kitchen", "game room", etc.

[0120] The operation item of the uncalibrated room may be an operation area of ​​the uncalibrated room, or may be an operation control of the uncalibrated room.

[0121] Figure 2 This is a UI diagram after the user opens the room calibration function for the first time. Figure 2 As shown, when the user opens the room calibration for the first time, the user interface on the left is displayed. After the user clicks the "Calibrate New Space" control, the room calibration interface shown on the right is opened. The room calibration interface includes information of four uncalibrated rooms, and the user selects one of the uncalibrated rooms for calibration.

[0122] When the user turns on the time calibration function for the first time, it will be displayed Figure 2 The user interface on the left may be optional. When the user does not open the room calibration function for the first time, the user interface on the left may not be displayed. Instead, the room calibration interface may be directly displayed for the user to select the room to be calibrated.

[0123] Optionally, the room calibration interface may also include information about calibrated rooms. When the information about uncalibrated rooms and calibrated rooms is displayed simultaneously in the space calibration interface, the information about uncalibrated rooms and calibrated rooms are displayed separately, so that users can easily distinguish which rooms have been calibrated and which rooms have not been calibrated. For example, the information about calibrated rooms is highlighted, and the information about uncalibrated rooms is displayed normally; or, the information about calibrated rooms includes a calibrated mark, and the information about uncalibrated rooms does not include a calibrated mark or includes an uncalibrated mark, and the calibrated mark and the uncalibrated mark are different, and the calibrated mark and the uncalibrated mark include but are not limited to text, patterns, or icons.

[0124] In this embodiment, an environment map is created for the target space. The environment map of the target space is the virtual space or virtual environment corresponding to the real environment where the target space is located. The environment map is obtained by calibration according to the VST function of the XR device. The environment map has a unique identifier, called map ID. The XR device creates the environment map when calibrating the first room of the target space, and can also create the environment map when creating the target space.

[0125] The environment map can be considered empty when it is just created. As the rooms in the target space are calibrated, the environment map is continuously updated according to the calibration results of the rooms, that is, the environment map is continuously expanded. The method of this embodiment requires that the environment map has an expansion function, or the environment map is an incremental map.

[0126] The association of the environmental map with the anchor points of multiple calibrated rooms can be understood as: establishing an association relationship, a corresponding relationship, or a binding relationship between the environmental map and the anchor points of multiple calibrated rooms. The association of the environmental map with the anchor points of multiple calibrated rooms can also be described as binding the environmental map with the anchor points of multiple calibrated rooms. Each room has an identifier that can uniquely distinguish a room inside the device. The room identifier can be the same as or different from the name or number of the above-mentioned room. When the room identifier is different from the name or number of the above-mentioned room, the room identifier has a corresponding relationship with the name or number of the above-mentioned room. The room identifier is used to distinguish the room inside the device, and the room name or number is used by the user to distinguish the room.

[0127] For any calibrated room, the identifier of the calibrated room is used as the index of the anchor point of the calibrated room. According to the identifier of the calibrated room, the anchor point information of the calibrated room can be obtained.

[0128] When an XR device displays an environment map, it needs to display it based on the environment data and anchor point information of the environment map. The environment data of the environment map includes environment feature points, key points and key frames. The environment feature points are also called point cloud data of the environment.

[0129] The anchor point has a position and a direction (which can be understood as a posture), which is called the information of the anchor point. The anchor point is located in the environment map and is associated with the environment map, that is, the position of the anchor point and the feature point in the environment map is fixed. MR technology can associate one or more virtual objects with each anchor point in the environment map. When the user's posture changes, the virtual object associated with the anchor point in the environment map corresponding to the user's current posture is called according to the user's posture. For example, the association of the anchor point with the virtual object includes displaying the virtual object at the position of the anchor point. The posture of the virtual object is the information of the anchor point. When the user's posture changes, the associated virtual object is displayed according to the posture of the anchor point.

[0130] In this embodiment, the environment map is associated with anchor points of multiple calibrated rooms in the target space, which is equivalent to dividing all anchor points of the environment map according to regions. One region is a room. When calling the anchor points of the environment map, the anchor points are called according to the room granularity.

[0131] S102: In response to a user selecting an uncalibrated target room in the room calibration interface, calibrate the target room according to a multi-room calibration strategy.

[0132] The selection operation may be a click operation, a double click operation, a long press operation, or a hover operation of the target room information by the user, and this embodiment is not limited to this. Figure 2 , the user selects “Living Room” as the target room.

[0133] Exemplarily, the multi-room calibration strategy includes: the closed spaces of any two calibrated rooms in the environment map do not overlap. Multiple calibration surfaces in the room form a closed space, multiple calibration lines in the room are connected to form multiple calibration surfaces, and the calibration surfaces are connected to form a closed space. For example, taking a wall as an example, four calibration lines of the wall are usually connected to form a calibration surface of the wall, and the calibration surfaces of each wall in the space are connected to form a closed space.

[0134] Figure 3 A schematic diagram of a calibrated room in the target space, Figure 3 is a top view of the closed space of the marked room, such as Figure 3 As shown, there are 5 rooms in the target space, and the closed spaces of the 5 rooms do not overlap with each other.

[0135] When calibrating the first room in the target space, there is no calibrated room, so it is not restricted by the above calibration strategy. When calibrating other rooms in the target space (i.e., not the first calibrated room), since there are calibrated rooms, the calibration of other rooms is restricted by the above calibration strategy.

[0136] When calibrating the target room, you can use fully automatic, semi-automatic, or fully manual calibration methods. The fully automatic calibration method does not require any user operation, the semi-automatic calibration method requires manual user assistance for some calibration objects, and the fully manual method requires manual calibration of all calibration objects.

[0137] In one implementation, an image corresponding to a target room is acquired, and the target room is calibrated in the order of ground, wall, ceiling, and furniture according to the image corresponding to the target room, wherein the closed space of the target room is formed by connecting the calibration lines of the ground, wall, and ceiling of the target room. When calibrating the closed space of the target room, when it is detected that the target calibration line of the closed space of the target room overlaps with the closed space of the calibrated room of the environment map, a first prompt information is output, and the first prompt information is used to prompt that the position of the target calibration line is wrong, and / or prompt to adjust the position of the target calibration line to a correct position.

[0138] The user can adjust the position of the target calibration line according to the first prompt information. If the target calibration line still overlaps with the closed space of the calibrated room of the environment map after multiple adjustments, it will be prompted that the calibration has failed.

[0139] In this embodiment, the anchor points of the environment map are called with the room as the granularity. Therefore, it is necessary to accurately calibrate and identify the range of the room, so the closed spaces of any two calibrated rooms of the environment map are restricted to not overlap, so as to avoid the inability to accurately load the anchor points of the room during the use of the environment map.

[0140] Assuming that the closed spaces of two calibrated rooms overlap, when the user is in the overlapping area, the XR device cannot determine which room the user is currently in, and therefore cannot load the anchor points of the room, or the XR device cannot accurately determine which room the user is currently in. For example, when the user moves from room 1 to room 2, the user expects to load the anchor points of room 2, but the XR device misjudges that the user is still in room 1. By restricting the closed spaces of any two calibrated rooms in the environment map to not overlap, the problems mentioned here can be avoided and the room the user is currently in can be accurately identified.

[0141] In order to improve the calibration efficiency, optionally, when calibrating the target room, in addition to displaying the perspective image corresponding to the target room, the ground closed area or closed space of the calibrated room in the target space can also be displayed. The ground closed area is a part of the closed space, that is, the area of ​​the closed space located on the ground.

[0142] When the user calibrates the target room in the order of floor, wall, ceiling and furniture, the user can determine the position of the calibration ray emitted by the handle based on the closed floor area or closed space of the calibrated room in the displayed target space as a reference, so as to avoid the intersection of the calibration line of the target room with the closed floor area or closed space of the calibrated room in the target space, thereby improving the calibration efficiency.

[0143] Figure 4 It is a schematic diagram of the positional relationship between the closed ground area of ​​the calibrated room in the target space and the wall of the target room, such as Figure 4 As shown, 4a is a schematic diagram of the ground closed area of ​​two calibrated spaces in the target space before the target room is calibrated, and 4b is a situation where a wall of the target room being calibrated does not intersect with the ground closed area of ​​the two calibrated spaces. Figure 4 c is the case where the wall of the target room intersects with the closed ground area of ​​one of the calibrated spaces.

[0144] When calibrating the calibration objects in the target room, a semi-transparent mask is displayed on the calibration surface of the calibrated objects in the target room. For the calibration objects being calibrated, a semi-transparent mask is displayed on the calibration surface synchronously according to the formation of the calibration surface of the calibration objects being calibrated. Among them, the calibration objects are the ground, walls, ceilings and furniture. The uncalibrated calibration objects in the target space are displayed normally, and the calibrated objects are displayed semi-transparently. The mask is equivalent to a semi-transparent mask on the outer surface of the calibrated objects, making the changed objects seen by the user appear vaguely.

[0145] By displaying a semi-transparent mask on the calibrated objects, users can easily distinguish which objects have been calibrated and which have not been calibrated. For the objects being calibrated, the mask is formed synchronously during the process of forming the calibration surface, that is, the mask and the calibration surface are formed synchronously, which makes it easier for users to understand the formation process and position of the calibration surface in real time, bringing users a better experience.

[0146] Figure 5 is a schematic diagram of the masking of the marked wall in the target room, such as Figure 5 As shown, the user is calibrating the wall. For the calibrated wall, a mask is displayed on its calibrated surface. For the uncalibrated furniture, ceiling, etc. in the target room, there is no mask on its outer surface.

[0147] Optionally, in some implementations, the closed spaces of two calibrated rooms may overlap, and no anchor point is set in the intersection area or the overlap area; or, an anchor point is set in the intersection area or the overlap area, but the anchor point set in the intersection area or the overlap area is not loaded; or, when the user is within the overlap area, the user is prompted to move so that the user moves out of the overlap area.

[0148] Optionally, the multi-room calibration strategy also includes: the calibration frame of the furniture in the room cannot exceed the closed space of the room. The purpose of this calibration strategy is still to prevent the XR device from being unable to accurately identify the scope of the room. When the calibration frame of the furniture in the room exceeds the closed space of the room, it is impossible to determine which room the furniture belongs to. Therefore, when loading the anchor points of the room, it may cause the anchor points of the room to be loaded incorrectly, for example, the anchor points on the furniture that exceed the closed space of the room are not loaded.

[0149] In one implementation, an image corresponding to a target room is acquired, and the target room is calibrated in the order of floor, wall, ceiling and furniture according to the image corresponding to the target room, wherein a closed space of the target room is formed by connecting calibration lines of the floor, wall and ceiling of the target room; when it is detected that a calibration frame of target furniture in the target room exceeds the closed space of the target room, a second prompt message is output, and the second prompt message is used to prompt that the calibration of the target furniture is wrong, and / or prompt to adjust the calibration frame of the target furniture.

[0150] The user can adjust the calibration frame of the target furniture according to the second prompt information. If the target furniture still exceeds the closed space of the room after multiple adjustments, it will be prompted that the calibration has failed.

[0151] S103: Update the environmental data of the environmental map according to the calibration result of the target room, and associate the anchor point of the target room with the environmental map.

[0152] The calibration result of the target room may include the location information of the floor, walls, ceiling, and furniture in the room, and the location information may be the 3D coordinates of the floor, walls, ceiling, and furniture. The environmental data of the environment map is updated according to the calibration result of the target room. When the data of the environment map changes, the environment map displayed to the user will also change.

[0153] The environmental data of the environment map is updated according to the calibration result of the target room, including generating the environmental data of the target room according to the calibration result of the target room, adding the environmental data of the target room to the environmental data of the environment map, thereby expanding the environment map, and the updated environment map includes the target room. In one optional manner, the calibration result of the target room is the environmental data of the target room, and in another optional manner, the calibration result of the target room is processed to obtain the environmental data of the target room.

[0154] Exemplarily, the anchor point of the target room is associated with the environment map in the following manner: generating anchor point information of the target room, storing the anchor point information of the target room with the identifier of the target room as an index; and establishing an association relationship between the identifier of the target room and the identifier of the environment map.

[0155] The environmental data of the environmental map and the anchor point information of the calibrated room can be stored in the disk of the XR device or in the cloud. When storing the anchor point information of the calibrated room, the anchor point information of the calibrated room is stored with the identifier of the calibrated room as the index, and the anchor point information of the calibrated room can be queried later based on the identifier of the calibrated room.

[0156] Different from the prior art, in this embodiment, it is also necessary to store the association relationship between the identification of the environmental map and the identification of the calibrated rooms. The identification of the environmental map is associated with the identification of multiple calibrated rooms, and the association relationship between the identification of the target room and the identification of the environmental map is established. The identification of the target room can be added on the basis of the existing association relationship between the identification of the environmental map and the identification of multiple calibrated rooms.

[0157] Figure 6 This is a schematic diagram of the UI changes during the room calibration process. Figure 6 As shown, after the user turns on the room calibration function and chooses to calibrate the room, UIa, i.e., the room calibration interface, is displayed. Then the room to be calibrated is selected, and then the floor, wall, ceiling, and furniture are calibrated in sequence. The partial UIs displayed during the calibration of the floor, wall, ceiling, and furniture are: UIb, UIc, UId, and UIe. After the furniture calibration is completed, the room calibration process ends. After the user clicks the completion control in UIe, UIf is displayed. If the user selects the exit control in UIf, the calibration process ends and the room calibration function is exited. If the user selects the control in UIf to calibrate other rooms, the room calibration interface is displayed, and the calibration of the next room continues according to the above process.

[0158] After associating the anchor point of the target room with the environment map, the calibration of the target room is completed. The MR application can perform MR content based on the environment map and the anchor points of multiple rooms associated with the environment map. Some new MR functions can also be developed. For example, users can see different content when entering different rooms.

[0159] The method of this embodiment, in response to a room calibration trigger instruction, displays a room calibration interface, the room calibration interface includes information of uncalibrated rooms of the target space, and the environment map of the target space can be associated with anchor points of multiple calibrated rooms in the target space; calibrates the target room selected by the user according to the multi-room calibration strategy; updates the environment data of the environment map according to the calibration result of the target room, and associates the anchor point of the target room to the environment map. The method creates an environment map for multiple rooms in the target space, and as the rooms in the target space are calibrated, the environment map continues to grow, and the environment map can be associated with anchor points of multiple calibrated rooms in the target space. During the use of MR applications, the environment map only needs to be positioned once. When the user moves between different rooms, there is no need to re-position the environment map, and only the anchor point of the room needs to be switched. In addition, according to the multi-room calibration results, richer functions or gameplay can be provided for MR applications, thereby improving the user experience.

[0160] Based on the first embodiment, the second embodiment of the present application provides a multi-room calibration method, which mainly describes the application of the multi-room calibration results. Figure 7 This is a flow chart of the multi-room calibration method provided in Example 2 of the present application, such as Figure 7 As shown, the method provided in this embodiment includes the following steps.

[0161] S201. In response to a room calibration trigger instruction, display a room calibration interface, wherein the room calibration interface includes information of uncalibrated rooms in a target space, and an environment map of the target space may be associated with anchor points of multiple calibrated rooms in the target space.

[0162] S202: In response to a user selecting an uncalibrated target room in the room calibration interface, calibrate the target room according to a multi-room calibration strategy.

[0163] S203: Update the environmental data of the environmental map according to the calibration result of the target room, and associate the anchor point of the target room with the environmental map.

[0164] The specific implementation of steps S201-S203 refers to the first embodiment and will not be described in detail here.

[0165] S204: In response to receiving the first instruction, positioning the environment map according to the environment data of the environment map.

[0166] The first instruction includes but is not limited to an opening instruction of the MR application, and the first instruction is used to trigger the positioning of the environment map. The XR device locates the environment map based on the feature points of the current real environment captured by the camera and the environment data of the environment map of the target space. If the feature points of the current real environment match the environment data of the environment map, the positioning of the environment map is successful. If the feature points of the current real environment do not match the environment data of the environment map, the positioning of the environment map fails. The XR device may include multiple environment maps, and different environment maps have different identifiers. According to the identifier of each environment map, the map data of each environment map is loaded from the disk to the memory in turn, and then each environment map is located until the positioning is successful.

[0167] S205. When the environment map is positioned successfully, the identifiers of multiple calibrated rooms associated with the environment map are determined according to the identifier of the environment map, and the anchor point information of all or part of the multiple calibrated rooms associated with the environment map is obtained according to the identifiers of the multiple calibrated rooms associated with the environment map.

[0168] After retrieving the environment map, it is necessary to load the anchor point information corresponding to the environment map into the memory. In this embodiment, according to the identifier of the successfully located environment map and the association relationship between the identifier of the saved environment map and the identifier of the calibrated room, the identifier of the calibrated room associated with the environment map is determined, and according to the identifier of the calibrated room associated with the environment map, the anchor point information of the calibrated room is loaded into the memory. Among them, loading the anchor point information of the calibrated room into the memory means loading it from the disk, hard disk or other storage device of the XR device into the memory.

[0169] In this embodiment, anchor point information of all or part of the multiple calibrated rooms can be loaded according to the needs of the MR application. In some applications, only the anchor point of the room where the user is currently located can be loaded, that is, the anchor point loading depends on the user's positioning. In other applications, the anchor point information of all rooms can be loaded, and the anchor point loading no longer depends on the user's positioning.

[0170] Exemplarily, the identifier of the second calibrated room to be loaded is determined according to the loading rule, and the anchor point information of the second calibrated room is loaded into the memory according to the identifier of the second calibrated room. The loading rule is configured in the XR device, for example, the loading rule is configured to load the anchor points of all rooms, or the loading rule is configured to load the anchor points of 3 rooms.

[0171] S206. Display the obtained content of the calibrated room according to the obtained anchor point information of the calibrated room.

[0172] The contents of all rooms or part of the rooms loaded in the memory can be displayed. For example, the identifier of the first calibrated room to be displayed is determined according to the display rule; the anchor point of the calibrated room to be displayed is determined from the memory according to the identifier of the first calibrated room; the contents of the first calibrated room are displayed according to the anchor point information of the first calibrated room. Alternatively, all rooms in the memory are displayed by default, or the room where the user is currently located is displayed by default.

[0173] S207: When it is detected that the user moves from the third calibrated room to the fourth calibrated room, the anchor point information of the fourth calibrated room is obtained according to the identifier of the fourth calibrated room.

[0174] The method of this embodiment can locate the room where the user is currently located and detect the room switching. When the user moves from the third calibrated room to the fourth calibrated room, the user's movement can be detected, and the room where the user is currently located is located as the fourth calibrated room, and the identifier of the fourth calibrated room is obtained. Here, the third and fourth are only used to distinguish the rooms before and after the movement.

[0175] When it is detected that the user moves from the third calibrated room to the fourth calibrated room, the anchor point information of the fourth calibrated room is obtained according to the identifier of the fourth calibrated room. Specifically, it is determined whether the anchor point information of the fourth calibrated room exists in the memory according to the fourth calibrated room. If the anchor point information of the fourth calibrated room is not loaded in the memory, the anchor point information of the fourth calibrated room is loaded from the disk to the memory. If the anchor point information of the fourth calibrated room has been loaded in the memory, the anchor point of the calibrated room to be displayed is determined from the memory according to the identifier of the fourth calibrated room.

[0176] S208. Display the content of the fourth calibrated room according to the anchor point information of the fourth calibrated room.

[0177] Optionally, when it is detected that the user moves from the third calibrated room to the fourth calibrated room, the content of the third calibrated room can be closed first, and then the content of the fourth calibrated room can be displayed to complete the switching from the content of the third calibrated room to the content of the fourth calibrated room.

[0178] When the user moves from the third calibrated room to the fourth calibrated room, no map positioning is required. The environmental map of the target space is still used. It only needs to switch from the anchor point of the third calibrated room to the anchor point of the fourth calibrated room to achieve seamless switching between rooms.

[0179] Based on the multi-room calibration results, richer functions or gameplay can be provided for MR applications. For example, different decorations or themes can be set for different rooms. When users move to different rooms, they can see different decorations or experience different themes.

[0180] For another example, the auxiliary MR application manages the mounted applications, and different applications can be mounted in different rooms. For example, a video application can be mounted on the wall of room 1, and a game application can be mounted on the TV of room 2. When the user moves to room 1, the video application is opened, and when the user moves from room 1 to room 2, the game application in room 2 is opened. Optionally, the video application in room 1 can be closed first, and then the game application in room 2 can be opened.

[0181] For another example, regardless of the user's location, the content of any one or more of the marked rooms associated with the environment map is displayed to the user.

[0182] It is understandable that more functions can be developed based on multi-room calibration. This is just an example and does not constitute a limitation.

[0183] It should be noted that steps S207 and S208 are optional steps. During the use of the MR application, the user may move to different rooms or may not move. When the user does not move between rooms, steps S207 and S208 are not executed.

[0184] Optionally, when displaying the content of the fourth calibrated room according to the anchor point information of the fourth calibrated room, a semi-transparent mask is displayed on the calibration surface of the calibrated objects in the fourth calibrated room. The user can understand whether the current room has been calibrated, and which items in the current room have been calibrated and which have not been calibrated according to the mask. If some calibrated objects are not accurately calibrated, they can be deleted and recalibrated, or, for uncalibrated objects, the calibration mode can be turned on to recalibrate.

[0185] When the user moves from the third marked room to the fourth marked room, the content of the third marked room can be closed, and when the content of the third marked room is closed, the mask of the third marked room is closed at the same time. Alternatively, the content of the third marked room continues to be displayed, and the mask of the third marked room is closed, so that the mask of the room to which the user moves is opened.

[0186] In this embodiment, after the MR application is opened, the environment map is positioned according to the environment data of the environment map. When the environment map is positioned successfully, the anchor point information of all or part of the multiple calibrated rooms associated with the environment map is loaded into the memory according to the identifiers of the multiple calibrated rooms associated with the environment map; according to the anchor point information of the calibrated rooms loaded in the memory, the content of the calibrated rooms loaded in the memory is displayed. The anchor point of the room can be called according to the identifier of the room, so that different functions can be set for different rooms, so that the user can experience different content when entering different rooms. When the user switches between different rooms, there is no need to re-position the environment map, only the anchor points of different rooms need to be switched, which improves the user experience.

[0187] Based on the first and second embodiments, the third embodiment of the present application further provides a multi-room calibration method for managing calibrated rooms in a target space. Figure 8 This is a flow chart of the multi-room calibration method provided in Example 3 of the present application, such as Figure 8 As shown, the method provided in this embodiment includes the following steps.

[0188] S301. In response to the fourth instruction, display a second management interface in the extended reality space, wherein the second management interface includes a space list of spaces calibrated by the user, a room list of calibrated rooms of the calibrated space, and management controls for calibrated rooms of the calibrated space.

[0189] The user can open the second management interface through the space management entrance of the MR application. A user can have multiple calibrated spaces, and each calibrated space can have one or more calibrated rooms. Among them, the room list of calibrated rooms in the calibrated space can be displayed in the form of a secondary menu. For example, after the user opens the second management interface, only the space list of the user's calibrated space is displayed. The user clicks on any calibrated space in the space list of the calibrated space, and the room list of calibrated rooms of the selected calibrated space and the management controls of the calibrated rooms of the calibrated space are displayed. Similarly, the management controls of the calibrated rooms of the calibrated space can be displayed in the form of a three-level menu, which will not be repeated here.

[0190] The user can open the second management page in any scenario after opening the MR application, for example, before calibrating the target space, during the calibration of the target space, or after the calibration of the target space is completed. The extended reality space is a virtual space provided by the XR device, which is a 3D space, and the second management interface is usually a 2D display panel. When the user opens the second management interface before calibrating the target space, the extended reality space can be a 3D desktop environment. When the user opens the second management interface during the calibration of the target space, the extended reality space can be a perspective image of the room being calibrated. When the user opens the second management interface after the calibration of the target space is completed, the extended reality space can be a perspective image of the room where the user is currently located.

[0191] S302: In response to the user's second operation on the management option of the management control of the fifth calibrated room of the calibrated space, perform the following operations on the fifth calibrated room: modify the room, delete the room.

[0192] Optionally, the management control of the calibrated room includes a delete control and a modify control of the calibrated room. The user can select the delete control or the modify control of the fifth calibrated room through the second operation. When the user selects the delete control, the calibration result of the fifth calibrated room is deleted. After deleting the fifth calibrated room, the environmental data of the fifth calibrated room in the environmental data of the environmental map is also deleted. When the user selects the modify control, the calibration result of the fifth calibrated room is modified.

[0193] Exemplarily, modifying a room includes one or more of the following modification operations: modifying the name of the room, resetting the spatial calibration result of the room, adding furniture in the room, deleting furniture in the room, and modifying anchor points in the room. Resetting the spatial calibration result of the room means resetting or recalibrating the calibration results of the floor, wall, and ceiling of the room. Modifying anchor points in the room includes adding new anchor points, deleting anchor points, modifying the positions of anchor points, etc.

[0194] Fig. 9 This is a schematic diagram of the UI involved in the management process of the marked room, such as Fig. 9 As shown, when the user opens the multi-room calibration function for the first time, UI1 is displayed. After the user selects the "New Room" control, the room calibration interface is displayed. After the user selects the "Room Management" control, UI2, the second management interface, is displayed. If the user chooses to modify a room, UI3 is displayed. If the user chooses to delete a room, UI4 is displayed. In UI3, if the user chooses to reset the room (i.e., reset the spatial calibration result of the room), UI5 is displayed. If the user chooses to add or delete furniture, UI6 is displayed. After completing the room modification, the user can open UI2 and continue to delete or modify other rooms.

[0195] Optionally, the second management interface also includes a room adding control. When a third operation of the user on the room adding control is detected, a calibratable room is added to the target space. The newly added calibratable room is calibrated according to the process of the above embodiment, thereby being able to flexibly add rooms to the target space.

[0196] The method of this embodiment displays a second management interface according to the fourth instruction, and the second management interface includes a space list of the user's calibrated space, a room list of the calibrated rooms of the calibrated space, and a management control of the calibrated rooms of the calibrated space. According to the second operation of the user on the management option of the management control of the fifth calibrated room of the calibrated space, the following operations are performed on the fifth calibrated room: modify the room, delete the room. By providing a room management function, the calibrated room can be flexibly deleted or modified, and the deletion of a room in the target space will not affect the use of other rooms.

[0197] Based on the first and second embodiments, the fourth embodiment of the present application further provides a multi-room calibration method for managing calibrated rooms in a target space. Fig.10 This is a flowchart of a multi-room calibration method provided in Example 4 of the present application, such as Fig.10 As shown, the method provided in this embodiment includes the following steps.

[0198] S401. In response to the second instruction, display a first management interface in the extended reality space, wherein the first management interface includes a space list of the user's calibrated spaces, a room list of calibrated rooms of the calibrated spaces, and a 2D view of the spatial layout of the first calibrated space, wherein the first calibrated space belongs to the space of the user's calibrated space.

[0199] The user can open the first management page in any scenario after opening the MR application, for example, before calibrating the target space, during the calibration of the target space, or after the calibration of the target space is completed. The extended reality space is a virtual space provided by the XR device, which is a 3D space, and the first management interface is usually a 2D display panel. When the user opens the first management interface before calibrating the target space, the extended reality space can be a 3D desktop environment. When the user opens the first management interface during the calibration of the target space, the extended reality space can be a perspective image of the room being calibrated. When the user opens the first management interface after the calibration of the target space is completed, the extended reality space can be a perspective image of the room where the user is currently located.

[0200] Fig.11 is a schematic diagram of the first management interface, such as Fig.11As shown, the first management interface adopts a left-right structure. The space list of the user's calibrated space (hereinafter referred to as the space list) and the room list of calibrated rooms of the calibrated space (hereinafter referred to as the room list) are displayed on the left side of the first management interface, and the 2D view of the spatial layout of the first calibrated space is displayed on the right side of the first management interface.

[0201] Fig.12 is another schematic diagram of the first management interface, such as Fig.12 As shown, the first management interface adopts a top-bottom structure, the space list and the room list are displayed at the bottom of the first management interface, and the 2D view of the spatial layout of the first calibrated space is displayed above the space list and the room list.

[0202] The first calibrated space is any space among the user's calibrated spaces. The first calibrated space may be the user's current space or may not be the user's current space. The user may select a calibrated space from multiple calibrated spaces.

[0203] The 2D view of the spatial layout of the first calibrated space may be a top view of a part of the space, through which the user may clearly understand the room layout within the first calibrated space, including the positional relationship of the rooms, the size relationship of the rooms, and the like.

[0204] When the first marked space is the space where the user is currently located, the 2D view also displays an identifier of the user's current location, for example, Fig.11 and Fig.12 The “My Bedroom 01” shown is the user's current location, and the circle in “My Bedroom 01” is the identifier of the current location. It can be understood that the identifier of the current location can also be represented by other icons and / or texts.

[0205] S402: In response to a third instruction, display a 3D view of the spatial layout of the first calibrated space.

[0206] The 3D view of the spatial layout of the first calibrated space can be displayed on the first management interface, and can also be displayed through a separate third interface. The third interface and the first management interface are both 2D panels and are displayed in the extended reality space provided by the XR device.

[0207] When the 3D view is displayed on the first management interface, the 3D view can be displayed at any position above, below, left or right of the 2D view of the spatial layout of the first calibrated space, or the 2D view can be hidden and only the 3D view can be displayed.

[0208] Fig.13 is a schematic diagram showing a 3D view of a spatial layout of a first marked space in a first management interface, Fig.13 Depend on Fig.11The interface shown is transformed. Fig.14 is another schematic diagram of a 3D view showing the spatial layout of a first calibrated space in a first management interface, Fig.14 Depend on Fig.12 The interface shown is transformed.

[0209] exist Fig.13 and Fig.14 The first management interface shown also displays a zoom-in control and a zoom-out control, and the user zooms in on the 3D view through the zoom-in control and zooms out on the 3D view through the zoom-out control.

[0210] For example, a 3D view opening control is displayed at the position of each room on the 2D view, and when a preset operation of the user on the opening control of the 3D view is detected, the 3D view is displayed on the first management interface, so that the user can view the 3D view of each room conveniently. Alternatively, the user double-clicks, clicks, hovers, etc. at any position in the 2D view to open the 3D view.

[0211] or in Fig.12 and Fig.14 The interface shown also displays 2D controls and 3D controls, through which flexible switching between the 2D view and the 3D view of the spatial layout of the first calibrated space can be achieved.

[0212] Optionally, in one implementation, when the user initially opens the first management interface, a 2D view of the spatial layout of the first calibrated space is displayed on the first management interface; when it is detected that the user moves from a first room to a second room in the first calibrated space, a 3D view of the spatial layout of the first calibrated space is displayed in the first management interface.

[0213] When a user moves among multiple rooms in a calibrated space, the first management interface can follow the user and always remain within the user's perspective. For example, the user opens the first management interface in the first room, and when the user moves to the second room, the first management interface follows the user to the second room.

[0214] Reference Fig.13 and Fig.14 There are three controls in the upper right corner of the first management interface, which are respectively for resetting the room, deleting the room, and modifying the furniture. The reset room control is used to reset the spatial calibration result of the room, and the delete room control is used to delete the entire room. By modifying the furniture control, a sub-interface can be opened to add or delete furniture in the room.

[0215] Fig.13The upper left corner of the first management interface shows a name modification control, and the user can modify the name of the first marked space currently displayed through the name modification control. Fig.14 The name modification control is not shown in the figure, but it can be understood that the name modification control can also be set on the first management interface as needed.

[0216] S403: In response to the 3D model invoking instruction, display the 3D model of the first room in the first calibrated space in the extended reality space.

[0217] The 3D model of the first room can be understood as a sandbox model of the first room, which is a model obtained according to the actual proportion based on the layout of the first room.

[0218] In order to provide users with an immersive experience, you can hide the first management interface first and then display the model of the first room.

[0219] Optionally, a 3D model evoke control is displayed on the 3D view of the spatial layout of the first calibrated space or the first management interface, referring to Fig.13 and Fig.14 As shown, when a preset operation of invoking the control on the 3D model is detected, a 3D model of the first room in the first calibrated space is displayed in the extended reality space. The first room can be a room selected by the user or a room where the user is currently located.

[0220] When the first calibrated space is the user's current space and the first room is the user's current room, the extended reality space is the perspective image corresponding to the first room. In response to the invocation instruction, not only the first management interface is hidden, but also the mask of the first room is turned on, so that the user can immersively experience the 3D model of the first room.

[0221] Fig.15 A schematic diagram showing a 3D model of a room, such as Fig.15 As shown, a 3D model of the first room is displayed in the perspective image of the first room.

[0222] When the first operation is detected, the 3D model of the first room is controlled to enter an editing state. After the 3D model of the first room enters the editing state, the 3D model of the first room is displayed with preset special effects; when the second operation is detected, the 3D model of the first room is controlled to rotate.

[0223] The first operation is, for example, a hover operation on the area where the 3D model is located. The preset special effect is, for example, highlighting the bottom of the 3D model, or displaying an aperture special effect at the bottom of the 3D model. Fig.15 Effects shown.

[0224] After the 3D model enters the editing state, the user can rotate the 3D model through a second operation, which can be a pressing operation on the trigger key of the handle navigation or a pressing operation on the direction key of the handle. Through the second operation, the 3D model of the first room can be controlled to rotate horizontally, or rotate 360 ​​degrees in the extended reality space. By controlling the rotation of the 3D model, it is convenient for the user to view and understand the layout of the first room.

[0225] Optionally, after the 3D model enters the editing state, a furniture add and delete control and a return control are also displayed in the extended control. The return control is used to exit the display of the 3D model, and the furniture add and delete space is used to add or delete furniture in the first room.

[0226] When the first calibrated space is the space the user is currently in and the first room is the room the user is currently in, when it is detected that the rotation angle of the head mounted device is greater than the preset angle or the 3D model of the first room is beyond the user's field of view, the 3D model of the first room is controlled to move to the preset position within the user's field of view according to the user's current position.

[0227] The preset angle is, for example, 30 degrees. When the user wears the head mounted device to move or rotate, when the rotation angle of the head mounted device is greater than 30 degrees, the 3D model of the first room is no longer located directly in front of the user's field of view, and may move out or be located at the edge of the user's field of view. At this time, the 3D model of the first room is controlled to move to a preset position within the user's field of view, which may be directly in front of the field of view, thereby facilitating the user to view the 3D model.

[0228] In order to facilitate better implementation of the multi-room calibration method of the embodiment of the present application, the embodiment of the present application also provides a multi-room calibration device. Fig.16 This is a schematic diagram of the structure of the multi-room calibration device provided in Example 5 of the present application, such as Fig.16 As shown, the multi-room calibration device 100 may include:

[0229] A display module 11 is used to display a room calibration interface in response to a room calibration trigger instruction, wherein the room calibration interface includes information of uncalibrated rooms of a target space, and an environment map of the target space can be associated with anchor points of multiple calibrated rooms in the target space;

[0230] A calibration module 12, configured to calibrate the target room according to a multi-room calibration strategy in response to a user's selection operation of an uncalibrated target room in the room calibration interface;

[0231] The updating module 13 is used to update the environmental data of the environmental map according to the calibration result of the target room, and associate the anchor point of the target room with the environmental map.

[0232] In some embodiments, the multi-room calibration strategy includes: closed spaces of any two calibrated rooms in the environment map do not overlap.

[0233] In some embodiments, the multi-room calibration strategy further includes: the calibration frame of the furniture in the room cannot exceed the closed space of the room.

[0234] In some embodiments, the calibration module 12 is specifically used for:

[0235] Acquire an image corresponding to the target room, and calibrate the target room in the order of ground, wall, ceiling, and furniture according to the image corresponding to the target room, wherein the closed space of the target room is formed by connecting the calibration lines of the ground, wall, and ceiling of the target room;

[0236] When calibrating the closed space of the target room, when it is detected that the target calibration line of the closed space of the target room overlaps with the closed space of the calibrated room of the environmental map, a first prompt information is output, and the first prompt information is used to prompt that the position of the target calibration line is wrong, and / or, prompt to adjust the position of the target calibration line to a correct position.

[0237] In some embodiments, the calibration module 12 is specifically used for:

[0238] Determining a perspective image corresponding to the target room according to the image corresponding to the target room;

[0239] Displaying the perspective image corresponding to the target room and the ground closed area or closed space of the marked room in the target space;

[0240] The target room is calibrated in the order of ground, wall, ceiling and furniture.

[0241] In some embodiments, the calibration module 12 is specifically used for:

[0242] When calibrating the calibration object in the target room, a semi-transparent mask is displayed on the calibration surface synchronously with the formation of the calibration surface of the calibration object being calibrated, wherein the semi-transparent mask is displayed on the calibration surface of the calibrated object in the target room.

[0243] In some embodiments, the calibration module 12 is specifically used for:

[0244] Acquire an image corresponding to the target room, and calibrate the target room in the order of ground, wall, ceiling, and furniture according to the image corresponding to the target room, wherein the closed space of the target room is formed by connecting the calibration lines of the ground, wall, and ceiling of the target room;

[0245] When it is detected that the calibration frame of the target furniture in the target room exceeds the closed space of the target room, a second prompt information is output, wherein the second prompt information is used to prompt that the calibration of the target furniture is wrong and / or to prompt to adjust the calibration frame of the target furniture.

[0246] In some embodiments, the updating module 13 is specifically used for:

[0247] Generate anchor point information of the target room, and store the anchor point information of the target room using the identifier of the target room as an index;

[0248] An association relationship between the identifier of the target room and the identifier of the environment map is established.

[0249] In some embodiments, a calling module is further included for:

[0250] In response to receiving the first instruction, positioning the environment map according to the environment data of the environment map;

[0251] When the environment map is successfully positioned, the identifiers of a plurality of marked rooms associated with the environment map are determined according to the identifier of the environment map;

[0252] Acquire, according to the identifiers of the multiple calibrated rooms associated with the environment map, anchor point information of all or part of the multiple calibrated rooms associated with the environment map;

[0253] According to the obtained anchor point information of the calibrated room, the obtained content of the calibrated room is displayed.

[0254] In some embodiments, the calling module is specifically used to:

[0255] Determining, according to the loading rule, an identifier of a second calibrated room to be loaded from identifiers of a plurality of calibrated rooms associated with the environment map;

[0256] According to the identifier of the second calibrated room, the anchor point information of the second calibrated room is loaded into the memory.

[0257] In some embodiments, the calling module is specifically used to:

[0258] Determining, according to the display rule, an identifier of a first marked room to be displayed;

[0259] Determining, from the memory, an anchor point of the calibrated room to be displayed according to the identifier of the first calibrated room;

[0260] The content of the first calibrated room is displayed according to the anchor point information of the first calibrated room.

[0261] In some embodiments, the calling module is further used to:

[0262] When detecting that the user moves from the third calibrated room to the fourth calibrated room, acquiring the anchor point information of the fourth calibrated room according to the identifier of the fourth calibrated room;

[0263] The content of the fourth calibrated room is displayed according to the anchor point information of the fourth calibrated room.

[0264] In some embodiments, the calling module is further used to: when detecting that the user moves from the third calibrated room to the fourth calibrated room, close the content of the third calibrated room.

[0265] In some embodiments, the calling module is specifically used to:

[0266] According to the anchor point information of the fourth calibrated room, the content of the fourth calibrated room is displayed and the calibrated surface of the calibrated object in the fourth calibrated room is displayed with a semi-transparent mask.

[0267] In some embodiments, the calling module is specifically used to:

[0268] The content of the third calibrated room is closed, or the content of the third calibrated room is displayed and the mask of the third calibrated room is closed.

[0269] In some embodiments, a management module is further included for:

[0270] In response to the second instruction, a first management interface is displayed in the extended reality space, wherein the first management interface includes a space list of the user's calibrated space, a room list of calibrated rooms of the calibrated space, and a 2D view of the spatial layout of the first calibrated space, wherein the first calibrated space belongs to the space of the user's calibrated space.

[0271] In some embodiments, the management module is further configured to:

[0272] In response to a third instruction, a 3D view of the spatial layout of the first calibrated space is displayed in the extended reality space.

[0273] In some embodiments, the first calibrated space is the space where the user is currently located, and the 2D view of the spatial layout of the first calibrated space also displays an identifier of the user's current location; the management module is specifically used to:

[0274] In response to detecting that a user moves from a first room to a second room in the first calibrated space, a 3D view of the spatial layout of the first calibrated space is displayed in the first management interface.

[0275] In some embodiments, the management module is further configured to:

[0276] In response to a 3D model invoking instruction, a 3D model of a first room in the first calibrated space is displayed in the extended reality space.

[0277] In some embodiments, the management module is specifically used to:

[0278] The first management interface is hidden in the extended reality space, and the 3D model of the first room is displayed.

[0279] In some embodiments, the management module is further configured to:

[0280] When a first operation is detected, the 3D model of the first room is controlled to enter an editing state, and after the 3D model of the first room enters the editing state, the 3D model of the first room is displayed with a preset special effect;

[0281] When the second operation is detected, the 3D model of the first room is controlled to rotate.

[0282] In some embodiments, the first marked space is the space where the user is currently located, the first room is the room where the user is currently located, and the management module is further used to:

[0283] When it is detected that the rotation angle of the head mounted device is greater than a preset angle or the 3D model of the first room is beyond the user's field of view, the 3D model of the first room is controlled to move to a preset position within the user's field of view according to the user's current position.

[0284] Alternatively, in some embodiments, the management module is used to:

[0285] In response to the fourth instruction, displaying a second management interface in the extended reality space, the second management interface including a space list of spaces calibrated by the user, a room list of calibrated rooms in the calibrated space, and management controls for the calibrated rooms in the calibrated space;

[0286] In response to the user's second operation on the management control of the fifth calibrated room of the calibrated space, the following operations are performed on the fifth calibrated room: modify the room, delete the room, and the room modification includes one or more of the following modification operations: modify the name of the room, reset the spatial calibration results of the room, add furniture in the room, delete the furniture in the room, and modify the anchor points in the room.

[0287] In some embodiments, the second management interface further includes a room adding control, and the method further includes: in response to a third operation of the user on the room adding control, adding a calibratable room to the target space.

[0288] It should be understood that the device embodiment and the method embodiment may correspond to each other, and similar descriptions may refer to the method embodiment. To avoid repetition, they will not be described here.

[0289] The above describes the device 100 of the embodiment of the present application from the perspective of the functional module in conjunction with the accompanying drawings. It should be understood that the functional module can be implemented in hardware form, can be implemented by instructions in software form, and can also be implemented by a combination of hardware and software modules. Specifically, the steps of the method embodiment in the embodiment of the present application can be completed by the hardware integrated logic circuit and / or software form instructions in the processor, and the steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to perform, or a combination of hardware and software modules in the decoding processor to perform. Optionally, the software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory, and completes the steps in the above method embodiment in conjunction with its hardware.

[0290] The embodiment of the present application also provides an XR device. Fig.17 A structural diagram of an XR device provided in Example 6 of the present application, such as Fig.17 As shown, the XR device 200 may include:

[0291] The memory 21 and the processor 22, the memory 21 is used to store the computer program and transmit the program code to the processor 22. In other words, the processor 22 can call and run the computer program from the memory 21 to implement the method in the embodiment of the present application.

[0292] For example, the processor 22 may be configured to execute the above method embodiments according to instructions in the computer program.

[0293] In some embodiments of the present application, the processor 22 may include but is not limited to:

[0294] General-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc.

[0295] In some embodiments of the present application, the memory 21 includes but is not limited to:

[0296] Volatile memory and / or non-volatile memory. Among them, the non-volatile memory can be read-only memory (ROM), programmable ROM (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM) or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus random access memory (DR RAM).

[0297] In some embodiments of the present application, the computer program may be divided into one or more modules, which are stored in the memory 21 and executed by the processor 22 to complete the method provided by the present application. The one or more modules may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the XR device.

[0298] like Fig.17 As shown, the XR device may further include: a transceiver 23 , which may be connected to the processor 22 or the memory 21 .

[0299] The processor 22 may control the transceiver 23 to communicate with other devices, specifically, to send information or data to other devices, or to receive information or data sent by other devices. The transceiver 23 may include a transmitter and a receiver. The transceiver 23 may further include an antenna, and the number of antennas may be one or more.

[0300] Understandable, although Fig.17 Not shown, the XR device 200 may also include a camera module, a wireless fidelity WIFI module, a positioning module, a Bluetooth module, a display, a controller, etc., which will not be repeated here.

[0301] It should be understood that the various components in the XR device are connected via a bus system, wherein the bus system includes, in addition to a data bus, a power bus, a control bus, and a status signal bus.

[0302] The present application also provides a computer storage medium on which a computer program is stored, and when the computer program is executed by a computer, the computer can perform the method of the above method embodiment. In other words, the present application embodiment also provides a computer program product containing instructions, and when the instructions are executed by a computer, the computer can perform the method of the above method embodiment.

[0303] The present application also provides a computer program product, which includes a computer program, which is stored in a computer-readable storage medium. The processor of the XR device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the XR device executes the corresponding process in the method for controlling the user position in the virtual scene in the embodiment of the present application, which will not be described in detail for the sake of brevity.

[0304] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the module is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0305] The modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. For example, each functional module in each embodiment of the present application may be integrated into a processing module, or each module may exist physically separately, or two or more modules may be integrated into one module.

[0306] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A multi-room calibration method, characterized in that: include: In response to a room calibration trigger instruction, displaying a room calibration interface, wherein the room calibration interface includes information of uncalibrated rooms of a target space, and an environment map of the target space may be associated with anchor points of a plurality of calibrated rooms in the target space; In response to a user selecting an uncalibrated target room in the room calibration interface, calibrating the target room according to a multi-room calibration strategy; The environmental data of the environmental map is updated according to the calibration result of the target room, and the anchor point of the target room is associated with the environmental map.

2. The method according to claim 1, characterized in that: The multi-room calibration strategy includes: closed spaces of any two calibrated rooms in the environment map do not overlap.

3. The method according to claim 2, characterized in that The multi-room calibration strategy also includes: the calibration frame of the furniture in the room cannot exceed the closed space of the room.

4. The method according to claim 2, characterized in that: The calibrating the target room according to the multi-room calibration strategy includes: Acquire an image corresponding to the target room, and calibrate the target room in the order of ground, wall, ceiling, and furniture according to the image corresponding to the target room, wherein the closed space of the target room is formed by connecting the calibration lines of the ground, wall, and ceiling of the target room; When calibrating the closed space of the target room, when it is detected that the target calibration line of the closed space of the target room overlaps with the closed space of the calibrated room of the environmental map, a first prompt information is output, and the first prompt information is used to prompt that the position of the target calibration line is wrong, and / or, prompt to adjust the position of the target calibration line to a correct position.

5. The method according to claim 3, characterized in that: The calibrating the target room according to the multi-room calibration strategy includes: Acquire an image corresponding to the target room, and calibrate the target room in the order of ground, wall, ceiling, and furniture according to the image corresponding to the target room, wherein the closed space of the target room is formed by connecting the calibration lines of the ground, wall, and ceiling of the target room; When it is detected that the calibration frame of the target furniture in the target room exceeds the closed space of the target room, a second prompt information is output, wherein the second prompt information is used to prompt that the calibration of the target furniture is wrong and / or to prompt to adjust the calibration frame of the target furniture.

6. The method according to claim 5, characterized in that Acquire an image corresponding to the target room, and calibrate the target room in the order of ground, wall, ceiling, and furniture according to the image corresponding to the target room, including: Determining a perspective image corresponding to the target room according to the image corresponding to the target room; Displaying the perspective image corresponding to the target room and the ground closed area or closed space of the marked room in the target space; The target room is calibrated in the order of ground, wall, ceiling and furniture.

7. The method according to claim 6, characterized in that The calibrating the target room in the order of the ground, the wall, the ceiling and the furniture includes: When calibrating the calibration object in the target room, a semi-transparent mask is displayed on the calibration surface synchronously with the formation of the calibration surface of the calibration object being calibrated, wherein the semi-transparent mask is displayed on the calibration surface of the calibrated object in the target room.

8. The method according to any one of claims 1 to 7, characterized in that: The associating the anchor point of the target room to the environment map comprises: Generate anchor point information of the target room, and store the anchor point information of the target room using the identifier of the target room as an index; An association relationship between the identifier of the target room and the identifier of the environment map is established.

9. The method according to any one of claims 1 to 7, characterized in that: Also includes: In response to receiving the first instruction, positioning the environment map according to the environment data of the environment map; When the environment map is successfully positioned, the identifiers of a plurality of marked rooms associated with the environment map are determined according to the identifier of the environment map; Acquire, according to the identifiers of the multiple calibrated rooms associated with the environment map, anchor point information of all or part of the multiple calibrated rooms associated with the environment map; According to the obtained anchor point information of the calibrated room, the obtained content of the calibrated room is displayed.

10. The method according to claim 9, characterized in that The acquiring, according to the identifiers of the multiple calibrated rooms associated with the environment map, anchor point information of all or part of the multiple calibrated rooms associated with the environment map comprises: Determining, according to the loading rule, an identifier of a second calibrated room to be loaded from identifiers of a plurality of calibrated rooms associated with the environment map; According to the identifier of the second calibrated room, the anchor point information of the second calibrated room is loaded into the memory.

11. The method according to claim 10, characterized in that The method of displaying the content of the calibrated room obtained according to the obtained anchor point information of the calibrated room includes: Determining, according to the display rule, an identifier of a first marked room to be displayed; Determining, from the memory, an anchor point of the calibrated room to be displayed according to the identifier of the first calibrated room; The content of the first calibrated room is displayed according to the anchor point information of the first calibrated room.

12. The method according to claim 9, characterized in that Also includes: When detecting that the user moves from the third calibrated room to the fourth calibrated room, acquiring the anchor point information of the fourth calibrated room according to the identifier of the fourth calibrated room; The content of the fourth calibrated room is displayed according to the anchor point information of the fourth calibrated room.

13. The method according to claim 12, characterized in that When it is detected that the user moves from the third calibrated room to the fourth calibrated room, the method further includes: Close the contents of the third marked room.

14. The method according to claim 12, characterized in that The displaying the content of the fourth calibrated room according to the anchor point information of the fourth calibrated room includes: According to the anchor point information of the fourth calibrated room, the content of the fourth calibrated room is displayed and the calibrated surface of the calibrated object in the fourth calibrated room is displayed with a semi-transparent mask.

15. The method according to claim 14, characterized in that When it is detected that the user moves from the third calibrated room to the fourth calibrated room, the method further includes: The content of the third calibrated room is closed, or the content of the third calibrated room is displayed and the mask of the third calibrated room is closed.

16. The method according to any one of claims 1 to 7, characterized in that: Also includes: In response to the second instruction, a first management interface is displayed in the extended reality space, wherein the first management interface includes a space list of the user's calibrated space, a room list of calibrated rooms of the calibrated space, and a 2D view of the spatial layout of the first calibrated space, wherein the first calibrated space belongs to the space of the user's calibrated space.

17. The method according to claim 16, characterized in that The method further comprises: In response to a third instruction, a 3D view of the spatial layout of the first calibrated space is displayed in the extended reality space.

18. The method according to claim 17, characterized in that The first calibrated space is the space where the user is currently located, and the 2D view of the spatial layout of the first calibrated space also displays an identifier of the user's current location; The step of displaying, in response to the third instruction, a 3D view of the spatial layout of the first calibrated space comprises: In response to detecting that a user moves from a first room to a second room in the first calibrated space, a 3D view of the spatial layout of the first calibrated space is displayed in the first management interface.

19. The method according to claim 17, characterized in that Also includes: In response to a 3D model invoking instruction, a 3D model of a first room in the first calibrated space is displayed in the extended reality space.

20. The method according to claim 18, characterized in that The displaying, in the extended reality space, a 3D model of the first room in the first calibrated space includes: The first management interface is hidden in the extended reality space, and the 3D model of the first room is displayed.

21. The method according to claim 19, characterized in that Also includes: When a first operation is detected, the 3D model of the first room is controlled to enter an editing state, and after the 3D model of the first room enters the editing state, the 3D model of the first room is displayed with a preset special effect; When the second operation is detected, the 3D model of the first room is controlled to rotate.

22. The method according to claim 19, characterized in that The first marked space is the space where the user is currently located, the first room is the room where the user is currently located, and further includes: When it is detected that the rotation angle of the head mounted device is greater than a preset angle or the 3D model of the first room is beyond the user's field of view, the 3D model of the first room is controlled to move to a preset position within the user's field of view according to the user's current position.

23. The method according to any one of claims 1 to 7, characterized in that: Also includes: In response to the fourth instruction, displaying a second management interface in the extended reality space, the second management interface including a space list of spaces calibrated by the user, a room list of calibrated rooms in the calibrated space, and management controls for the calibrated rooms in the calibrated space; In response to the user's second operation on the management control of the fifth calibrated room of the calibrated space, the following operations are performed on the fifth calibrated room: modify the room, delete the room, and the room modification includes one or more of the following modification operations: modify the name of the room, reset the spatial calibration results of the room, add furniture in the room, delete the furniture in the room, and modify the anchor points in the room.

24. The method according to claim 23, characterized in that The second management interface also includes a room adding control, and the method further includes: in response to a third operation of the user on the room adding control, adding a calibratable room to the target space.

25. A multi-room calibration device, characterized in that: The device comprises: A display module, configured to display a room calibration interface in response to a room calibration trigger instruction, wherein the room calibration interface includes information of uncalibrated rooms of a target space, and an environment map of the target space may be associated with anchor points of multiple calibrated rooms in the target space; A calibration module, configured to calibrate an uncalibrated target room in the room calibration interface in response to a user's selection operation on the target room, according to a multi-room calibration strategy; An updating module is used to update the environmental data of the environmental map according to the calibration result of the target room, and associate the anchor point of the target room with the environmental map.

26. An extended reality device, characterized in that: include: A processor and a memory, the memory being used to store a computer program, and the processor being used to call and run the computer program stored in the memory to execute the method according to any one of claims 1 to 24.

27. A computer-readable storage medium, characterized in that: Used to store a computer program, the computer program causing a computer to execute the method according to any one of claims 1 to 24.

28. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 24 is implemented.

Images