AR-based interior design method, AR glasses and storage medium

Through AR glasses, the information acquisition and communication between designers can be achieved, and the location of design elements can be adjusted in real time, which solves the problem of position conflicts in interior design and improves design efficiency.

CN118410555BActive Publication Date: 2024-11-12SHANGHAI NEW RUI INTERIOR DESIGN CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410843917.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-06-27
Publication Date
2024-11-12
Estimated Expiration
2044-06-27

AI Technical Summary

Technical Problem

During the interior design process, designers from different professional directions cannot display the location of each other's design elements in real time, resulting in position conflicts and inefficient design.

Method used

Through AR glasses, information acquisition and communication between designers can be achieved, and the location of design elements can be displayed and adjusted in real time to ensure that the design elements of collaborative designers are consistent with the location of users' design elements.

Benefits of technology

Avoid location conflicts in design elements, reduce communication and modification costs, and improve design efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118410555B_ABST
    Figure CN118410555B_ABST
Patent Text Reader

Abstract

The present application belongs to the field of communications, and more particularly to an AR-based interior design method, AR glasses, and storage media, wherein the method includes being able to display a first design element selected by a user, and after the AR glasses of a collaborative designer select a second design element, the second design element can also be displayed in the user's field of view, and the entire process of the collaborative designer adjusting and displacing the second design element can be displayed, thereby achieving collaborative design between users and collaborative designers, repeatedly avoiding conflicts between their respective design elements and each other's design elements, reducing the communication and modification costs of interior design, and improving design efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of communications, and in particular to an AR-based interior design method, AR glasses, and a storage medium. Background Art

[0002] Interior design is the process in which designers consider multiple factors such as spatial layout, functionality, aesthetics and practicality to create an indoor environment that meets the needs and vision of residents or users;

[0003] In order to better present the design effect, the existing technology combines AR technology with interior design, that is, combining virtual design elements with physical interior space, so that designers can intuitively judge the actual effect of their design. However, interior design often involves multiple professional directions, such as wall design, furniture planning and design, circuit laying design, pipeline planning and design, etc., and designers from different professional directions often design independently, that is, each designer can only see the position of the design elements called by him / her through AR glasses, but cannot display the position of the design elements of other designers in real time. Therefore, the design elements of different designers are prone to position conflicts, which will lead to multiple reworks and seriously affect the design efficiency. Summary of the invention

[0004] In view of this, the embodiments of the present application provide an AR-based interior design method, AR glasses and storage medium that can solve the above technical problems.

[0005] A first aspect of an embodiment of the present application provides an AR-based interior design method, which is applied to a user's AR glasses. The AR-based interior design method includes:

[0006] S1: Obtain information of each designer to determine a co-designer from the designers, and then determine the AR glasses of the co-designer;

[0007] S2: Establishing communication between the user's AR glasses and the co-designer's AR glasses;

[0008] S3: taking the area to be designed in the field of view of the user's AR glasses as the current design area;

[0009] S4: displaying a collection of design elements corresponding to the professional direction preset by the user in the field of view of the AR glasses of the user, so that the user can select a first design element for the current design area from the collection of design elements;

[0010] S5: displaying the selected first design element in the field of view of the user's AR glasses, and monitoring whether the AR glasses of the collaborative designer select a second design element for the current design area, wherein the second design element is a design element selected by the collaborative designer from a collection of design elements of a corresponding professional direction;

[0011] S6: when the AR glasses of the co-designer select the second design element for the current design area, the second design element is obtained, the second design element is displayed in the field of view of the AR glasses of the user, and the position information of the second design element is obtained from the AR glasses of the co-designer in real time, so as to adjust the position of the second design element in the field of view of the AR glasses of the user according to the position information, so that the user can adjust the position of the first design element in the field of view of the AR glasses of the user according to the position of the second design element;

[0012] S7: when a position determination signal of the second design element sent by the AR glasses of the collaborative designer is received and the user determines the position of the first design element in the field of view of the AR glasses of the user, the design of the current design area is completed;

[0013] S8: After the user completes the movement, execute steps S3 to S8 until the design of all the areas to be designed is completed.

[0014] A second aspect of an embodiment of the present application provides an AR glasses, comprising a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the AR-based interior design method.

[0015] A third aspect of an embodiment of the present application provides a storage medium having a computer program stored thereon. When the computer program is executed by a processor, the processor executes the steps of the AR-based interior design method.

[0016] Compared with the prior art, the embodiments of the present application have the following beneficial effects: the method provided by the present invention includes obtaining information of each designer to determine a co-designer from the designers, and then determining the AR glasses of the co-designer; establishing communication with the AR glasses of the co-designer; taking the area to be designed in the field of view as the current design area; displaying a collection of design elements corresponding to the professional direction preset by the user in the field of view, so that the user can select a first design element for the current design area from the collection of design elements; displaying the selected first set element in the field of view, and monitoring whether the AR glasses of the co-designer select the second design element for the current design area; when the AR glasses of the co-designer select the second design element for the current design area, obtaining the second design element, displaying the second design element in the field of view, and obtaining the position information of the second design element from the AR glasses of the co-designer in real time, so as to obtain the position information of the second design element based on the professional direction preset by the user. The position information adjusts the position of the second design element in the field of view, so that the user can adjust the position of the first design element in the field of view according to the position of the second design element in the field of view; when the position determination signal of the second design element sent by the AR glasses of the collaborative designer is received and the user determines the position of the first design element in the field of view, the design of the current design area is completed; after the user completes the movement, the above steps are repeated until the design of all areas to be designed is completed; in the present application, the online display of the user's AR glasses and the AR glasses of the collaborative designer is realized, and then the position changes of the first design element called by the user and the second design element called by the collaborative designer are displayed simultaneously during the whole design process, thereby realizing the collaborative design of the user and the collaborative designer, and can repeatedly avoid conflicts between their respective design elements and each other's design elements, reduce the communication and modification costs of interior design, and improve design efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0018] Figure 1 It is a schematic diagram of the implementation process of the AR-based interior design method provided in the embodiment of the present application;

[0019] Figure 2 is an application environment diagram of the AR-based interior design method provided in an embodiment of the present application;

[0020] Figure 3 is a schematic diagram of the relationship between AR glasses and computer equipment in the AR-based interior design method provided in an embodiment of the present application;

[0021] Figure 4 It is a schematic diagram of the AR glasses provided in an embodiment of the present application. DETAILED DESCRIPTION

[0022] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0023] In order to illustrate the technical solution described in this application, a specific embodiment is provided below for illustration.

[0024] Figure 1 An AR-based interior design method provided in Embodiment 1 of the present application is shown, which is applied to a user's AR glasses. The AR-based interior design method includes:

[0025] S1: Obtain information of each designer to determine a co-designer from the designers, and then determine the AR glasses of the co-designer;

[0026] S2: Establishing communication between the user's AR glasses and the co-designer's AR glasses;

[0027] S3: taking the area to be designed in the field of view of the user's AR glasses as the current design area;

[0028] S4: displaying a collection of design elements corresponding to the professional direction preset by the user in the field of view of the AR glasses of the user, so that the user can select a first design element for the current design area from the collection of design elements;

[0029] S5: displaying the selected first design element in the field of view of the user's AR glasses, and monitoring whether the AR glasses of the collaborative designer select a second design element for the current design area, wherein the second design element is a design element selected by the collaborative designer from a collection of design elements of a corresponding professional direction;

[0030] S6: when the AR glasses of the co-designer select the second design element for the current design area, the second design element is obtained, the second design element is displayed in the field of view of the AR glasses of the user, and the position information of the second design element is obtained from the AR glasses of the co-designer in real time, so as to adjust the position of the second design element in the field of view of the AR glasses of the user according to the position information, so that the user can adjust the position of the first design element in the field of view of the AR glasses of the user according to the position of the second design element;

[0031] S7: when a position determination signal of the second design element sent by the AR glasses of the collaborative designer is received and the user determines the position of the first design element in the field of view of the AR glasses of the user, the design of the current design area is completed;

[0032] S8: After the user completes the movement, execute steps S3 to S8 until the design of all the areas to be designed is completed.

[0033] In this embodiment, the method is executed in AR glasses. AR glasses are smart glasses that integrate augmented reality technology, such as Microsoft HoloLens and Google Glass. AR glasses can overlay virtual information on the real world, allowing users to see the augmented reality effect. When performing interior design, designers from various professional directions are in the interior space to be designed. Each designer wears an AR glasses, and each AR glasses can cooperate with other AR glasses to execute the method.

[0034] In this embodiment, the information of each designer is the information of other designers except the user; one professional direction is often only coordinated with the professional directions of other parts (for example, circuit planning and design are coordinated with electrical planning and design), and is not related to other professional directions. In order to exclude the influence of irrelevant design elements, such as Figure 2 As shown, the user's AR glasses first screen out the co-designers from the designers, and then establish communication with the AR glasses of the co-designers, so as to realize the collaborative design by the user and the co-designers; in addition, the number of co-designers can be one or more, mainly depending on whether their corresponding professional directions are related, and is not limited here;

[0035] In this embodiment, if Figure 3As shown, each AR glasses communicates with a computer device, and the computer device can be an independent physical server or terminal, or a server cluster composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud servers, cloud databases, cloud storage and CDN; the staff can divide the indoor space into several areas to be designed in advance in the computer device, and send the divided indoor space information to each AR glasses, so that the AR glasses can identify different areas to be designed and their boundaries in the field of view; the user and the collaborative designer can move together to an area to be designed, and the two can collaboratively design the area through this method; after completing the design of one design area, the user and the collaborative designer start to move, and when moving to another area to be designed, the user completes the movement (the user can use gestures or voice instructions to make the AR glasses recognize and confirm that the user has completed the movement), and then collaboratively design another area to be designed until the design of all areas to be designed is completed;

[0036] In this embodiment, the design elements of interior design refer to the basic components that constitute the visual and functional experience of the space, such as various types of furniture, decorations, pipelines, etc. Different professional directions correspond to different collections of design elements; each design element collection includes all design elements corresponding to the user's professional direction; the user can select the first design element by making a corresponding gesture, and then the three-dimensional virtual model of the first design element is displayed in the field of view. The user can adjust the size and direction of the three-dimensional virtual model through gestures, and finally place the model at a certain position to complete the design; at the same time, after the collaborative designer's AR glasses select the second design element, the second design element can also be displayed in the user's field of view, and the collaborative designer can display the entire process of adjusting and displacing the second design element. Correspondingly, the collaborative designer can also see the entire process of adjusting and displacing the first design element through his AR glasses, thereby realizing collaborative design between users and collaborative designers, and can repeatedly avoid conflicts between their respective design elements and each other's design elements, reducing the communication and modification costs of interior design, and improving design efficiency.

[0037] As a preferred embodiment, the information of each designer includes the name, professional field and AR glasses ID of the designer; the obtaining the information of each designer to determine the co-designer from the designers, and then determining the AR glasses of the co-designer includes:

[0038] Determine the associated professional direction associated with the user's professional direction according to the user's professional direction and a preset professional direction association table, wherein the professional direction association table includes each professional direction of interior design and the associated professional directions of the professional direction;

[0039] Determine from among all designers the designers whose corresponding professional direction is consistent with the related professional direction as collaborative designers;

[0040] Determine the AR glasses ID of the co-designer;

[0041] Establishing communication with the co-designer’s AR glasses involves:

[0042] The AR glasses of the co-designer are screened out from various AR glasses according to the AR glasses ID of the co-designer;

[0043] Establish communication with the selected AR glasses.

[0044] In this embodiment, the AR glasses ID is a unique serial number for each AR glasses. Before designing the interior space, the information of each designer is stored in the computer device. Before the user comes to the designed space, the computer center will send the information of all designers of this design to each AR glasses; the association between each professional direction in the professional direction association table is determined by the staff based on historical data. For example, if the historical conflict frequency of design elements of two professional directions exceeds a certain set value, it can be determined that the two are associated; after obtaining the AR glasses ID of the co-designer, the ID of each AR glasses can be queried first, and the queried ID can be compared with the obtained ID to determine the AR glasses of the co-designer and then establish communication with them.

[0045] As a preferred embodiment, a spatial coordinate system is preset in the field of view of each AR glasses, and the position information is the coordinates of each pixel point constituting the second design element in the spatial coordinate system of the AR glasses of the co-designer; the spatial coordinate system in the field of view of the user's AR glasses is used as the first coordinate system, and the spatial coordinate system in the field of view of the AR glasses of the co-designer is used as the second coordinate system, wherein the coordinates in the first coordinate system are the first coordinates, and the coordinates in the second coordinate system are the second coordinates;

[0046] Acquiring the position information of the second design element from the AR glasses of the collaborative designer in real time, and adjusting the position of the second design element in the field of view of the AR glasses of the user according to the position information includes:

[0047] S61: aligning the first coordinate system with the second coordinate system;

[0048] S62: Obtain the second coordinates of each pixel constituting the second design element at the current moment;

[0049] S63: adjusting the position of the second design element in the field of view of the user's AR glasses according to each acquired second coordinate, so that the first coordinate of each pixel point of the second design element in the field of view of the user's AR glasses is the same as the corresponding second coordinate;

[0050] S64: Repeat steps S62 to S63 until a position determination signal of the second design element sent by the AR glasses of the collaborative designer is received.

[0051] In this embodiment, by aligning the origins of the first coordinate system and the second coordinate system, the reference systems of the user's field of view and the collaborative designer's field of view are unified. Through the unified reference system, the position adjustment of the second design element in the field of view can be synchronized and consistent with the position adjustment of the second design element in the AR glasses of the collaborative designer. In addition, by executing steps S62 to S63 at every moment, the position adjustment of the second design element in the field of view can be synchronized with the position adjustment of the second design element in the AR glasses of the collaborative designer at every moment until the design is completed, thereby ensuring the coordination of the entire design process.

[0052] As a preferred embodiment, aligning the first coordinate system with the second coordinate system includes:

[0053] Get a screenshot of the co-designer's AR glasses' field of view;

[0054] Identifying the origin of the second coordinate system in the acquired visual field screenshot;

[0055] Identify at least two reference objects in the visual field screenshot;

[0056] Identifying the relative position of each reference object relative to the origin of the second coordinate system in the visual field screenshot;

[0057] Identify each reference object in the user's AR glasses' field of view, and then determine the target origin position based on the position of each reference object and the corresponding relative position;

[0058] The origin of the first coordinate system is moved to the target origin position, and the first coordinate system is rotated around the origin to adjust the directions of the coordinate axes of the first coordinate system until the first coordinate of the pixel point of the reference object is consistent with the second coordinate.

[0059] Determining the target origin position based on the position of each reference object and the corresponding relative position includes:

[0060] S611: Take a reference object, and determine a first position according to the position of the reference object and the corresponding relative position, and repeat this step until the first position corresponding to each reference object is obtained;

[0061] S612: Determine whether each first position is the same position. If so, determine the first position as the target origin position. If not, re-determine at least two reference objects in the field of view screenshot, and identify the relative position of each reference object relative to the origin of the second coordinate system in the field of view screenshot, and execute steps S611 to S612 until the target origin position is obtained.

[0062] In this embodiment, after determining the reference object, a reference point can be further determined on each reference object. The relative position of the reference object to the origin of the second coordinate system is the relative position of the reference point to the origin of the second coordinate system, and the relative position includes the direction and distance of the reference point at the origin. After moving the origin of the first coordinate system to the target origin position, the first coordinate system is rotated around the origin to adjust the directions of the coordinate axes of the first coordinate system so that the directions of the coordinate axes of the first coordinate system are consistent with those of the coordinate axes of the second coordinate system, so that the first coordinate and the second coordinate corresponding to the same pixel point are consistent. In addition, the target origin position is determined based on multiple reference objects, which ensures its accuracy, thereby ensuring accurate alignment of the first coordinate system with the second coordinate system.

[0063] As a preferred embodiment, before completing the design of the current design area, the method further includes:

[0064] Identify whether the first design element and the second design element in the field of view of the user's AR glasses conflict with each other in position;

[0065] If the first design element and the second design element conflict in position, a first adjustment direction relative to the first design element and a second adjustment direction relative to the second design element are displayed, so that the user can fine-tune the position of the first design element according to the first adjustment direction, wherein the first adjustment direction and the second adjustment direction are adjustment directions for separating the first design element and the second design element that conflict in position;

[0066] The second adjustment direction is sent to the AR glasses of the collaborative designer, so that the collaborative designer fine-tunes the position of the second design element according to the second adjustment direction.

[0067] Identifying whether the first design element and the second design element have a position conflict includes:

[0068] Identify all pixels of the first design element;

[0069] Identify all pixels of the second design element;

[0070] It is determined whether a pixel point of the first design element overlaps with a pixel point of the second design element. If so, the first design element and the second design element have a position conflict. Otherwise, the first design element and the second design element have no position conflict.

[0071] In this embodiment, due to operational deviations and subjective judgment deviations of designers, position conflicts may still occur after they collaboratively complete the adjustment and movement of the design elements. This embodiment implements position verification of the first design element and the second design element to ensure that there is no position conflict; and when a position conflict occurs, the movement of the first design element and the second design element can be simulated to determine in which direction the two elements move so that the overlapping area can gradually decrease until it disappears, and then the user is prompted accordingly to improve the user's adjustment efficiency.

[0072] A second aspect of an embodiment of the present application provides an AR glasses, including a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the AR-based interior design method, specifically including:

[0073] S1: Obtain information of each designer to determine a co-designer from the designers, and then determine the AR glasses of the co-designer;

[0074] S2: Establish communication with the AR glasses of the co-designer;

[0075] S3: taking the area to be designed in the field of view as the current design area;

[0076] S4: displaying a collection of design elements corresponding to a professional direction preset by the user in the field of view, so that the user can select a first design element for a current design area from the collection of design elements;

[0077] S5: Displaying the selected first setting element in the field of view, and monitoring whether the AR glasses of the collaborative designer select a second design element for the current design area, wherein the second design element is a design element selected by the collaborative designer from a collection of design elements of a corresponding professional direction;

[0078] S6: when the AR glasses of the collaborative designer select the second design element for the current design area, the second design element is obtained, the second design element is displayed in the field of view, and the position information of the second design element is obtained from the AR glasses of the collaborative designer in real time, so as to adjust the position of the second design element in the field of view according to the position information, so that the user can adjust the position of the first design element in the field of view according to the position of the second design element in the field of view;

[0079] S7: when a position determination signal of the second design element sent by the AR glasses of the collaborative designer is received and the user determines the position of the first design element in the field of view, the design of the current design area is completed;

[0080] S8: After the user completes the movement, execute steps S3 to S8 until the design of all the areas to be designed is completed.

[0081] A third aspect of an embodiment of the present application provides a storage medium, on which a computer program is stored. When the computer program is executed by a processor, the processor executes the steps of the AR-based interior design method, specifically including:

[0082] S1: Obtain information of each designer to determine a co-designer from the designers, and then determine the AR glasses of the co-designer;

[0083] S2: Establish communication with the AR glasses of the co-designer;

[0084] S3: taking the area to be designed in the field of view as the current design area;

[0085] S4: displaying a collection of design elements corresponding to a professional direction preset by the user in the field of view, so that the user can select a first design element for a current design area from the collection of design elements;

[0086] S5: Displaying the selected first setting element in the field of view, and monitoring whether the AR glasses of the collaborative designer select a second design element for the current design area, wherein the second design element is a design element selected by the collaborative designer from a collection of design elements of a corresponding professional direction;

[0087] S6: when the AR glasses of the collaborative designer select the second design element for the current design area, the second design element is obtained, the second design element is displayed in the field of view, and the position information of the second design element is obtained from the AR glasses of the collaborative designer in real time, so as to adjust the position of the second design element in the field of view according to the position information, so that the user can adjust the position of the first design element in the field of view according to the position of the second design element in the field of view;

[0088] S7: when a position determination signal of the second design element sent by the AR glasses of the collaborative designer is received and the user determines the position of the first design element in the field of view, the design of the current design area is completed;

[0089] S8: After the user completes the movement, execute steps S3 to S8 until the design of all the areas to be designed is completed.

[0090] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0091] It should be understood that when used in the present application specification, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0092] It should also be understood that the term “and / or” used in the specification of the present application refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0093] As used in the present specification, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting" depending on the context. Similarly, the phrase "if it is determined" or "if [the described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [the described condition or event] is detected" or "in response to detecting [the described condition or event]" depending on the context.

[0094] In addition, in the description of the present specification, the terms "first", "second", "third", etc. are only used to distinguish descriptions, and cannot be understood as indicating or implying relative importance. It should also be understood that although the terms "first", "second", etc. are used to describe various elements in some embodiments of the present application in the text, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, the first table can be named as the second table, and similarly, the second table can be named as the first table, without departing from the scope of the various described embodiments. The first table and the second table are both tables, but they are not the same table.

[0095] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0096] Figure 4 Schematic diagram of the structure of AR glasses provided by an embodiment of the present application. Figure 4As shown, the AR glasses of this embodiment include: at least one processor and a memory, wherein the memory stores a computer program that can be run on the processor. When the processor executes the computer program, the steps in the above-mentioned various AR-based interior design method embodiments are implemented, for example Figure 1 Steps S1 to S8 are shown.

[0097] The AR glasses may include, but are not limited to, a processor and a memory. Those skilled in the art will appreciate that Figure 4 These are merely examples of AR glasses and do not constitute a limitation of AR glasses. The AR glasses may include more or fewer components than those shown in the figure, or a combination of certain components, or different components. For example, the AR glasses may also include an input sending device, a network access device, a bus, etc.

[0098] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0099] In some embodiments, the memory may be an internal storage unit of the AR glasses, such as a hard disk or memory of the AR glasses. The memory may also be an external storage device of the AR glasses, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the AR glasses. Furthermore, the memory may also include both an internal storage unit of the AR glasses and an external storage device. The memory is used to store operating systems, applications, boot loaders (BootLoader), data and other programs, such as program codes of the computer programs, etc. The memory may also be used to temporarily store data that has been sent or is to be sent.

[0100] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0101] An embodiment of the present application provides a computer program product. When the computer program product runs on AR glasses, the AR glasses can implement the steps in the above-mentioned method embodiments when executing.

[0102] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device that can carry the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium, etc.

[0103] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0104] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0105] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0106] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. An AR-based interior design method, applied to a user's AR glasses, characterized in that: The AR-based interior design method includes: S1: Obtain information of each designer to determine a co-designer from the designers, and then determine the AR glasses of the co-designer; S2: Establishing communication between the user's AR glasses and the co-designer's AR glasses; S3: taking the area to be designed in the field of view of the user's AR glasses as the current design area; S4: displaying a collection of design elements corresponding to the professional direction preset by the user in the field of view of the AR glasses of the user, so that the user can select a first design element for the current design area from the collection of design elements; S5: displaying the selected first design element in the field of view of the user's AR glasses, and monitoring whether the AR glasses of the collaborative designer select a second design element for the current design area, wherein the second design element is a design element selected by the collaborative designer from a collection of design elements of a corresponding professional direction; S6: when the AR glasses of the co-designer select the second design element for the current design area, the second design element is obtained, the second design element is displayed in the field of view of the AR glasses of the user, and the position information of the second design element is obtained from the AR glasses of the co-designer in real time, so as to adjust the position of the second design element in the field of view of the AR glasses of the user according to the position information, so that the user can adjust the position of the first design element in the field of view of the AR glasses of the user according to the position of the second design element; S7: when a position determination signal of the second design element sent by the AR glasses of the collaborative designer is received and the user determines the position of the first design element in the field of view of the AR glasses of the user, the design of the current design area is completed; S8: After the user completes the movement, execute steps S3 to S8 until the design of all the areas to be designed is completed.

2. The method according to claim 1, characterized in that The information of each designer includes the designer’s name, professional field, and AR glasses ID; The obtaining of information of each designer to determine a co-designer from the designers, and further determining the AR glasses of the co-designer includes: Determine the associated professional direction associated with the user's professional direction according to the user's professional direction and a preset professional direction association table, wherein the professional direction association table includes each professional direction of interior design and the associated professional directions of the professional direction; Determine from among all designers the designers whose corresponding professional direction is consistent with the related professional direction as collaborative designers; Determine the AR glasses ID of the co-designer; Establishing communication with the co-designer’s AR glasses involves: The AR glasses of the co-designer are screened out from various AR glasses according to the AR glasses ID of the co-designer; Establish communication with the selected AR glasses.

3. The method according to claim 1, characterized in that A spatial coordinate system is preset in the field of view of each AR glasses, and the position information is the coordinates of each pixel point constituting the second design element in the spatial coordinate system of the AR glasses of the collaborative designer; the spatial coordinate system in the field of view of the user's AR glasses is used as the first coordinate system, and the spatial coordinate system in the field of view of the AR glasses of the collaborative designer is used as the second coordinate system, wherein the coordinates in the first coordinate system are the first coordinates, and the coordinates in the second coordinate system are the second coordinates; Acquiring the position information of the second design element from the AR glasses of the collaborative designer in real time, and adjusting the position of the second design element in the field of view of the AR glasses of the user according to the position information includes: S61: aligning the first coordinate system with the second coordinate system; S62: Obtain the second coordinates of each pixel constituting the second design element at the current moment; S63: adjusting the position of the second design element in the field of view of the user's AR glasses according to each acquired second coordinate, so that the first coordinate of each pixel point of the second design element in the field of view of the user's AR glasses is the same as the corresponding second coordinate; S64: Repeat steps S62 to S63 until a position determination signal of the second design element sent by the AR glasses of the collaborative designer is received.

4. The method according to claim 3, characterized in that Aligning the first coordinate system with the second coordinate system involves: Get a screenshot of the co-designer's AR glasses' field of view; Identifying the origin of the second coordinate system in the acquired visual field screenshot; Identify at least two reference objects in the visual field screenshot; Identifying the relative position of each reference object relative to the origin of the second coordinate system in the visual field screenshot; Identify each reference object in the user's AR glasses' field of view, and then determine the target origin position based on the position of each reference object and the corresponding relative position; The origin of the first coordinate system is moved to the target origin position, and the first coordinate system is rotated around the origin to adjust the directions of the coordinate axes of the first coordinate system until the first coordinate of the pixel point of the reference object is consistent with the second coordinate.

5. The method according to claim 4, characterized in that Determining the target origin position based on the position of each reference object and the corresponding relative position includes: S611: Take a reference object, and determine a first position according to the position of the reference object and the corresponding relative position, and repeat this step until the first position corresponding to each reference object is obtained; S612: Determine whether each first position is the same position. If so, determine the first position as the target origin position. If not, re-determine at least two reference objects in the field of view screenshot, and identify the relative position of each reference object relative to the origin of the second coordinate system in the field of view screenshot, and execute steps S611 to S612 until the target origin position is obtained.

6. The method according to claim 3, characterized in that Before completing the design of the current design area, it also includes: Identify whether the first design element and the second design element in the field of view of the user's AR glasses conflict with each other in position; If the first design element and the second design element conflict in position, a first adjustment direction relative to the first design element and a second adjustment direction relative to the second design element are displayed, so that the user can fine-tune the position of the first design element according to the first adjustment direction, wherein the first adjustment direction and the second adjustment direction are adjustment directions for separating the first design element and the second design element that conflict in position; The second adjustment direction is sent to the AR glasses of the collaborative designer, so that the collaborative designer fine-tunes the position of the second design element according to the second adjustment direction.

7. The method according to claim 6, characterized in that Identifying whether the first design element and the second design element have a position conflict includes: Identify all pixels of the first design element; Identify all pixels of the second design element; It is determined whether a pixel point of the first design element overlaps with a pixel point of the second design element. If so, the first design element and the second design element have a position conflict. Otherwise, the first design element and the second design element have no position conflict.

8. An AR glasses, characterized in that: The invention comprises a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the AR-based interior design method as claimed in any one of claims 1 to 7.

9. A storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes the steps of the AR-based interior design method as described in any one of claims 1 to 7.