Parts installation method, device, storage medium and AR glasses
By using AR glasses to identify and display part information and output installation prompts, the problem of low installation efficiency using paper manuals is solved, and an efficient and accurate part installation process is achieved.
Patent Information
- Application Number
- CN202010897794.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-08-31
- Publication Date
- 2025-09-23
- Estimated Expiration
- 2040-08-31
AI Technical Summary
In the prior art, paper instructions are difficult to clearly and intuitively guide users in installing objects such as furniture and electrical appliances, resulting in low installation efficiency and prone to errors.
AR glasses are used for part identification and installation guidance. Part information is displayed through the lens display screen, and installation prompt information is output according to user selection, using preset model installation information for guidance.
The installation efficiency and accuracy are improved. Users do not need to read paper instructions. They can intuitively see the installation process of parts through the lens display and follow the guidance of AR glasses to install them correctly.
Smart Images

Figure CN114202707B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of AR technology, and in particular to a parts installation method, device, storage medium and AR glasses. Background Art
[0002] Currently, users generally need to pay additional installation fees for furniture, electrical appliances and other items they purchase. Alternatively, users can install them themselves according to the instructions. However, paper instructions usually cannot clearly and intuitively tell users how to install them. Users need to spend more time learning to install long instructions, and the written instructions are even more difficult to understand for the installation of complex items. If one step is installed incorrectly, the user may need to start over from the beginning, which is time-consuming and labor-intensive, and has low installation efficiency. Summary of the Invention
[0003] The embodiments of the present application provide a parts installation method, device, storage medium, and AR glasses, which can solve the problem of low object installation efficiency caused by the above-mentioned paper instructions. The technical solution is as follows:
[0004] In a first aspect, an embodiment of the present application provides a parts installation method, which is applied to AR glasses and includes:
[0005] Identifying each part on the scanned object to be installed and displaying each part;
[0006] A selection instruction for a first part among the parts is received, and installation prompt information for the first part is output.
[0007] In a second aspect, an embodiment of the present application provides a parts mounting device, which is applied to AR glasses and includes:
[0008] A parts display module, used to identify each part on the scanned object to be installed and display each of the parts;
[0009] The prompt information output module is used to receive a selection instruction for a first part among the parts and output installation prompt information for the first part.
[0010] In a third aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which implements the steps of any of the above methods when executed by a processor.
[0011] In a fourth aspect, an embodiment of the present application provides an AR glasses, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any one of the above methods when executing the program.
[0012] The beneficial effects of the technical solutions provided in the embodiments of the present application include at least:
[0013] The parts installation method provided in the embodiment of the present application is applied to AR glasses, which identifies the various parts on the scanned object to be installed and displays the various parts; receives a selection instruction for the first part among the various parts, and outputs installation prompt information for the first part. The AR glasses worn by the user are pre-installed with the model installation information of the object to be installed. The AR glasses scan and identify the various parts within the visual range and display the various parts on the lens display screen. When the user selects the first part from the various parts, the AR glasses output installation prompt information for the first part based on the model installation information. With the help of AR glasses, users do not have to flip through paper instructions to view a large amount of text and installation drawings. They can see the installation process of the parts intuitively and three-dimensionally only through the lens display screen, and users can correctly install the parts by following the guidance of the AR glasses, with high installation efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0015] Figure 1 This is a flow chart of a parts installation method provided in an embodiment of the present application;
[0016] Figure 2 This is a flow chart of a parts installation method provided in an embodiment of the present application;
[0017] Figure 3 This is a structural diagram of a parts installation device provided in an embodiment of the present application;
[0018] Figure 4 This is a structural diagram of a parts installation device provided in an embodiment of the present application;
[0019] Figure 5 This is a structural block diagram of AR glasses provided in an embodiment of the present application. DETAILED DESCRIPTION
[0020] In order to make the objectives, technical solutions and advantages of the present application clearer, the embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
[0021] When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Instead, they are merely examples of devices and methods consistent with certain aspects of the present application, as detailed in the appended claims.
[0022] In the description of this application, it should be understood that the terms "first", "second", etc. are used for descriptive purposes only and should not be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood according to specific circumstances. In addition, in the description of this application, unless otherwise specified, "multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship.
[0023] The following will be combined with the Figure 1 -Attached Figure 2 , the parts installation method provided in the embodiment of the present application is introduced in detail.
[0024] See Figure 1 , which is a flow chart of a parts installation method provided in an embodiment of the present application.
[0025] like Figure 1 As shown, the method of the embodiment of the present application may include the following steps:
[0026] S101 , identifying each part on the scanned object to be installed, and displaying each of the parts.
[0027] AR (Augmented Reality) technology cleverly integrates virtual information with the real world. This application addresses the current low installation efficiency of various objects by using AR glasses. The AR glasses are pre-loaded with model installation information of the object to be installed. Based on this model installation information, the AR glasses can intuitively guide the user to install the various components of the physical object, improving installation efficiency.
[0028] Specifically, the user wears AR glasses, which scan and identify each part that appears within the visual range, and display the identification results on the mirror display screen of the AR glasses.
[0029] The parts are all on the same object to be installed. If a single scan fails to capture all the parts, the viewing angle can be adjusted to bring the remaining parts into the visual range of the AR glasses. The object to be installed can be a bookcase, table, chair, cabinet, or even some household appliances.
[0030] Each scanned part is identified and displayed one by one on the mirror display screen of the AR glasses. The content displayed on the mirror display screen includes, for example, an image of each part. Based on the identification results of each part, the object to be installed corresponding to each part is determined, and the model installation information of the object to be installed, which is pre-installed in the AR glasses, is obtained.
[0031] An object, modeled to a certain scale, is a replica of a real object. A model shares the same structural structure as the real object. For an object assembled from parts, the model also shares the same parts and assembly process. The model's pre-installed assembly information for AR glasses includes the order, location, and method of assembly for each part.
[0032] In an optional embodiment, the user may also manually input information about the object to be installed before scanning and identifying each part. Based on this information, the AR glasses may directly obtain the pre-installed model installation information of the object to be installed.
[0033] S102, receiving a selection instruction for a first part among the parts, and outputting installation prompt information for the first part.
[0034] Based on the user's selection, installation prompt information for the corresponding part is output. Receiving a selection instruction for the first part among the parts includes the following methods: first, the user touches and picks up a part, and the AR glasses identify the part picked up by the user through the image and select it as the first part; second, the user uses some buttons on the AR glasses to select a part from the part image displayed on the mirror display screen, and selects the part as the first part.
[0035] The first part may be a part that needs to be installed in the first step of the object to be installed, or may be any one of the parts.
[0036] Based on the obtained model installation information of the object to be installed and the first part selected by the user, the AR glasses output installation prompt information of the first part through the mirror display screen. Based on the installation prompt information, the user can complete the installation efficiently and smoothly.
[0037] The installation prompt information includes the location of the first part (installation location), which parts the first part should be installed with, how to install the first part, etc. The installation prompt information can be presented in the form of a video explanation or in the form of a dynamic image.
[0038] AR glasses can intuitively and three-dimensionally guide users to install each part of the object to be installed one by one, eliminating the need for users to read instructions, speeding up the installation of parts, and following the guidance of AR glasses, users can install parts correctly, improving installation accuracy.
[0039] In other embodiments, the parts scanned by the AR glasses may also be on multiple objects to be installed. In this case, the operation steps after the AR glasses display the parts include:
[0040] receiving a selection instruction for a first part among the parts, and obtaining a target object to be installed corresponding to the first part when determining that there are multiple objects to be installed;
[0041] Based on the model installation information of the target object to be installed, installation prompt information for the first part is output.
[0042] AR glasses can be pre-installed with model installation information of multiple objects to be installed. When the recognition results show that each part belongs to multiple objects to be installed, the first part selected by the user is first determined, and then the object to be installed corresponding to the first part is determined based on the first part. The object to be installed corresponding to the first part is called the target object to be installed.
[0043] The model installation information of the target object to be installed is obtained from the pre-placed model installation information of multiple objects to be installed. Based on the model installation information of the target object to be installed and the first part, the AR glasses output installation prompt information of the first part through the mirror display screen.
[0044] The parts installation method provided in the embodiment of the present application is applied to AR glasses, which identifies the various parts on the scanned object to be installed and displays the various parts; receives a selection instruction for the first part among the various parts, and outputs installation prompt information for the first part. The AR glasses worn by the user are pre-installed with the model installation information of the object to be installed. The AR glasses scan and identify the various parts within the visual range and display the various parts on the lens display screen. When the user selects the first part from the various parts, the AR glasses output installation prompt information for the first part based on the model installation information. With the help of AR glasses, users do not have to flip through paper instructions to view a large amount of text and installation drawings. They can see the installation process of the parts intuitively and three-dimensionally only through the lens display screen, and users can correctly install the parts by following the guidance of the AR glasses, with high installation efficiency.
[0045] See Figure 2 , which is a flow chart of a parts installation method provided in an embodiment of the present application.
[0046] like Figure 2 As shown, the method of the embodiment of the present application may include the following steps:
[0047] S201 , identifying each part on the scanned object to be installed, and performing part identification processing on each part, so that each part corresponds to the part identification one by one.
[0048] The user wears AR glasses, which scan and identify at least one part within their visual range. These parts are all part of the same object to be assembled. If a single scan fails to capture all parts, the user can adjust the viewing angle to bring the remaining parts within the AR glasses' visual range. The object to be assembled can be Lego blocks, educational building toys, or similar.
[0049] In order to improve the efficiency of parts installation, this embodiment also performs part identification processing on each part after scanning and identifying each part. The identification processing can help users find the guided parts quickly and accurately.
[0050] Identify the identified parts, for example by coding or naming them. The part identifiers for each part should be unique, i.e., each part should have a one-to-one correspondence with the part identifiers. This ensures that the user does not mistakenly pick up the wrong part when the AR glasses are guiding the user through installation.
[0051] When coding the parts, the coding of each part may be a group of numbers or a group of letters. In other embodiments, a combination of numbers and letters may also be used.
[0052] When naming each part, the professional terminology in the field can be used to name the parts according to their characteristics. In other embodiments, the parts can also be named randomly.
[0053] S202, displaying the part image and part identification of each part on the lens display screen.
[0054] After identification processing, the AR glasses display the image and identification of each part on the mirror display screen. Based on the identification results of each part, the AR glasses determine the object to be installed corresponding to each part and obtain the model installation information of the object to be installed from the pre-installed model installation information. The pre-installed model installation information of the AR glasses contains information such as the installation order, installation location, and installation method of each part of the object to be installed.
[0055] In an optional embodiment, the user can manually input information about the object to be installed before scanning and identifying each part. Based on this information, the AR glasses can directly obtain the pre-installed model installation information for the object to be installed. Manually inputting the object information eliminates the step of determining the object to be installed based on the recognition results, reducing computation and improving the efficiency of the AR glasses in obtaining model installation information.
[0056] S203: receiving a selection instruction for a first part among the parts, and outputting installation prompt information for the first part.
[0057] For some objects to be installed, they must be installed strictly in order to assemble the objects, while for other objects to be installed, the assembly of the objects can be completed no matter which part is picked up. Therefore, the AR glasses in this embodiment guide the user in two ways: one is that the AR glasses highlight a part on the mirror display screen and guide the user to pick up the part. The highlighted part is used as the first part, and the AR glasses output installation prompt information for the first part based on the obtained model installation information of the object to be installed.
[0058] The second is that the user touches and picks up a part with his hand, and the AR glasses determine the part picked up by the user through the image and use the part as the first part, or the user uses some buttons on the AR glasses to select a part from the part image displayed on the mirror display screen and use the part as the first part; according to the model installation information of the object to be installed, the AR glasses output the installation prompt information of the first part through the mirror display screen, and based on the installation prompt information, the user completes the installation of the first part.
[0059] In the above two methods, the user can either pick up a specific part according to the prompt of the AR glasses, or randomly pick up a part from among the parts according to their wishes, and the AR glasses will provide installation guidance based on the part picked up by the user. In other words, the first part can be the part that needs to be installed in the first step of the object to be installed, or it can be any part among the parts mentioned above.
[0060] The installation prompt information includes the location of the first part (installation location), which parts the first part should be installed with, how to install the first part, etc. The installation prompt information can be a three-dimensional animation.
[0061] S204: Determine a second part connected to the first part.
[0062] S205: Displaying the part identification of the second part and the installation method between the first part and the second part on the lens display screen.
[0063] The second part is determined based on the installation prompt information of the first part, and the part identification of the second part and the installation method between the first part and the second part are displayed through the lens display screen. In an optional embodiment, in addition to the part identification and installation method, the image of the second part and its position information among the parts can also be highlighted.
[0064] The user takes the second part according to the instructions and installs the first part and the second part together according to the prompts. The AR glasses then output installation prompt information for the second part, namely: which parts the second part should be installed with, how the second part should be installed with them, etc.
[0065] The installation methods between parts include but are not limited to gear connection, threaded connection, hinge connection, etc.
[0066] In some embodiments, if there are multiple second parts connected to the first part, the lens display screen displays the part identifications of the multiple second parts, as well as the installation order and installation method between the first part and the multiple second parts.
[0067] When the first part needs to be connected to multiple parts, that is, when there are multiple second parts, the AR glasses need to clearly display the connection order and method between the first part and each second part. For the installation of parts with complex structures, if the installation order is wrong, the subsequent parts will not be able to be installed. Therefore, the multiple second parts connected to the first part must be installed one by one in strict accordance with the installation order.
[0068] AR glasses can intuitively and three-dimensionally guide users to install each part of the object to be installed one by one, eliminating the need for users to read instructions, speeding up the installation of parts, and following the guidance of AR glasses, users can install parts correctly, improving installation accuracy.
[0069] The parts installation method provided in this embodiment identifies each part on the scanned object to be installed and displays each of the parts; receives a selection instruction for the first part among the parts, and outputs installation prompt information for the first part. The AR glasses worn by the user are pre-installed with the model installation information of the object to be installed. The AR glasses scan and identify each part within the visual range and display the parts on the lens display screen. When the user selects the first part from the parts, the AR glasses output installation prompt information for the first part based on the model installation information. With the help of AR glasses, users do not have to flip through paper instructions to view a large amount of text and installation drawings. They can see the installation process of the parts intuitively and three-dimensionally only through the lens display screen, and users can correctly install the parts by following the guidance of the AR glasses, with high installation efficiency.
[0070] The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.
[0071] See Figure 3 , is a schematic diagram of the structure of a parts installation device provided by an exemplary embodiment of the present application. The parts installation device can be implemented as all or part of the AR glasses through software, hardware, or a combination of both, and can also be integrated into a server as an independent module. The parts installation device 1 in the embodiment of the present application is applied to AR glasses, and the device 1 includes a parts display module 11 and a prompt information output module 12, wherein:
[0072] A parts display module 11 is used to identify each part on the scanned object to be installed and display each of the parts;
[0073] The prompt information output module 12 is used to receive a selection instruction for a first part among the parts and output installation prompt information for the first part.
[0074] In other embodiments, the prompt information output module 12 is specifically used to:
[0075] receiving a selection instruction for a first part among the parts, and obtaining a target object to be installed corresponding to the first part when determining that there are multiple objects to be installed;
[0076] Based on the model installation information of the target object to be installed, installation prompt information for the first part is output.
[0077] See Figure 4 , which is a structural schematic diagram of a part installation device provided by an exemplary embodiment of the present application.
[0078] like Figure 4 As shown, the part display module 11 in the part installation device 1 provided in the embodiment of the present application includes:
[0079] A parts identification unit 111 is used to identify each part on the scanned object to be installed;
[0080] An identification processing unit 112 is used to perform part identification processing on each of the parts, so that each part has a one-to-one correspondence with the part identification;
[0081] The part display unit 113 is used to display the part image and part identification of each part through the lens display screen.
[0082] The prompt information output module 12 in the device 1 includes:
[0083] An instruction receiving unit 121 is configured to receive a selection instruction for a first part among the parts, and output installation prompt information for the first part;
[0084] a connected part determining unit 122, configured to determine a second part connected to the first part;
[0085] The information display unit 123 is used to display the part identification of the second part and the installation method between the first part and the second part through the lens display screen.
[0086] In other embodiments, the information display unit 123 is specifically used to:
[0087] If there are multiple second parts connected to the first part, the lens display screen displays the part identifications of the multiple second parts, as well as the installation sequence and installation method between the first part and the multiple second parts.
[0088] It should be noted that the parts installation device provided in the above embodiment, when executing the parts installation method, is merely illustrated by the division of the above-mentioned functional modules. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the parts installation device provided in the above embodiment and the parts installation method embodiment are based on the same concept. The implementation process is detailed in the method embodiment and will not be repeated here.
[0089] The serial numbers of the above embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0090] The parts installation device provided in the embodiment of the present application identifies each part on the scanned object to be installed and displays each of the parts; receives a selection instruction for the first part among the parts, and outputs installation prompt information for the first part. The AR glasses worn by the user are pre-installed with the model installation information of the object to be installed. The AR glasses scan and identify each part within the visible range and display the parts on the lens display screen. When the user selects the first part from the parts, the AR glasses output installation prompt information for the first part based on the model installation information. With the help of AR glasses, users do not have to flip through paper instructions to view a large amount of text and installation drawings. They can see the installation process of the parts intuitively and three-dimensionally only through the lens display screen, and users can correctly install the parts by following the guidance of the AR glasses, with high installation efficiency.
[0091] The present application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of any of the aforementioned methods. The computer-readable storage medium may include, but is not limited to, any type of disk, including a floppy disk, an optical disk, a DVD, a CD-ROM, a microdrive, a magneto-optical disk, a ROM, a RAM, an EPROM, an EEPROM, a DRAM, a VRAM, a flash memory device, a magnetic card or an optical card, a nanosystem (including a molecular memory IC), or any type of medium or device suitable for storing instructions and / or data.
[0092] An embodiment of the present application also provides AR glasses, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the steps of any of the above-mentioned embodiments are implemented.
[0093] See Figure 5 , which is a structural block diagram of AR glasses provided in an embodiment of the present application.
[0094] like Figure 5 As shown, the AR glasses 100 include: a processor 501 and a memory 502.
[0095] In the embodiment of the present application, the processor 501 is the control center of the computer system, which can be the processor of a physical machine or the processor of a virtual machine. The processor 501 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 501 can be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), or PLA (Programmable Logic Array). The processor 501 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state.
[0096] In the embodiment of the present application, the processor 501 is specifically configured to:
[0097] Identifying each part on the scanned object to be installed and displaying each part;
[0098] A selection instruction for a first part among the parts is received, and installation prompt information for the first part is output.
[0099] Furthermore, the display of each of the parts includes:
[0100] The part image and part identification of each of the parts are displayed through the lens display screen.
[0101] Furthermore, after identifying the parts on the scanned object to be installed, the method further includes:
[0102] Part identification processing is performed on each of the parts, and each of the parts corresponds to the part identification one by one.
[0103] Furthermore, after receiving the selection instruction for the first part among the parts and outputting installation prompt information for the first part, the method further includes:
[0104] determining a second part connected to the first part;
[0105] The part identification of the second part and the installation method between the first part and the second part are displayed through the lens display screen.
[0106] Furthermore, if there are multiple second parts connected to the first part, the display of the part identification of the second part and the installation method between the first part and the second part on the lens display screen includes:
[0107] The lens display screen displays the part identifications of the plurality of second parts, as well as the installation sequence and method between the first part and the plurality of second parts.
[0108] Furthermore, the receiving of a selection instruction for a first part among the parts and outputting installation prompt information for the first part includes:
[0109] receiving a selection instruction for a first part among the parts, and obtaining a target object to be installed corresponding to the first part when determining that there are multiple objects to be installed;
[0110] Based on the model installation information of the target object to be installed, installation prompt information for the first part is output.
[0111] The memory 502 may include one or more computer-readable storage media, which may be non-transitory. The memory 502 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash memory storage devices. In some embodiments of the present application, the non-transitory computer-readable storage medium in the memory 502 is used to store at least one instruction, which is used to be executed by the processor 501 to implement the method in the embodiment of the present application.
[0112] In some embodiments, the AR glasses 100 further include a peripheral device interface 503 and at least one peripheral device. The processor 501, memory 502, and peripheral device interface 503 may be connected via a bus or signal lines. Each peripheral device may be connected to the peripheral device interface 503 via a bus, signal lines, or circuit boards. Specifically, the peripheral device includes at least one of a display screen 504, a camera 505, and an audio circuit 506.
[0113] The peripheral device interface 503 can be used to connect at least one I / O (Input / Output)-related peripheral device to the processor 501 and the memory 502. In some embodiments of the present application, the processor 501, the memory 502, and the peripheral device interface 503 are integrated on the same chip or circuit board; in some other embodiments of the present application, any one or two of the processor 501, the memory 502, and the peripheral device interface 503 can be implemented on separate chips or circuit boards. This embodiment of the present application is not specifically limited to this.
[0114] The display screen 504 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, or any combination thereof. When the display screen 504 is a touch screen display, it is also capable of collecting touch signals on or above the surface of the display screen 504. The touch signals may be input as control signals to the processor 501 for processing. In this case, the display screen 504 may also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments of the present application, there may be one display screen 504, provided on the front panel of the AR glasses 100. In other embodiments of the present application, there may be at least two display screens 504, provided on different surfaces of the AR glasses 100 or in a foldable design. In still other embodiments of the present application, the display screen 504 may be a flexible display, provided on a curved or foldable surface of the AR glasses 100. Furthermore, the display screen 504 may be configured as a non-rectangular irregular shape, i.e., a special-shaped screen. The display screen 504 may be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).
[0115] The camera 505 is used to capture images or videos. Optionally, the camera 505 includes a front camera and a rear camera. Typically, the front camera is set on the front panel of the AR glasses, and the rear camera is set on the back of the AR glasses. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments of the present application, the camera 505 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.
[0116] The audio circuit 506 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals for input to the processor 501 for processing. For the purpose of stereo sound collection or noise reduction, there may be multiple microphones, each located in different parts of the AR glasses 100. The microphone may also be an array microphone or an omnidirectional collection microphone.
[0117] The power supply 507 is used to power the various components of the AR glasses 100. The power supply 507 can be AC power, DC power, a disposable battery, or a rechargeable battery. When the power supply 507 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged via a wired line, while a wireless rechargeable battery is a battery that is charged via a wireless coil. The rechargeable battery can also be used to support fast charging technology.
[0118] The AR glasses structural block diagram shown in the embodiment of the present application does not constitute a limitation on the AR glasses 100. The AR glasses 100 may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component arrangement.
[0119] In this application, the terms "first," "second," etc. are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or order; the term "plurality" refers to two or more, unless expressly limited otherwise. Terms such as "installed," "connected," "connected," and "fixed" should be understood in a broad sense. For example, "connected" can mean a fixed connection, a detachable connection, or an integral connection; "connected" can mean a direct connection or an indirect connection through an intermediary. Those skilled in the art will understand the specific meanings of the above terms in this application based on the specific circumstances.
[0120] In the description of this application, it should be understood that the terms "upper" and "lower" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing this application and simplifying the description, rather than indicating or implying that the device or unit referred to must have a specific direction, be constructed and operated in a specific orientation. Therefore, they should not be understood as limitations on this application.
[0121] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any modifications or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present application should be included in the scope of protection of the present application. Therefore, equivalent modifications made according to the claims of the present application are still within the scope of protection of the present application.
Claims
1. A parts installation method, characterized in that: Applied to AR glasses, the method includes: Identifying each part on the scanned object to be installed and displaying each of the parts, wherein the object to be installed is an object with no restrictions on the installation order; The display of each of the parts includes: Displaying a part image and a part identification of each part on a lens display screen, wherein the part identification is used to encode or name the part; The method further comprises: Performing part identification processing on each of the parts, respectively, so that each of the parts corresponds to the part identification one by one; receiving a selection instruction for a first part among the parts, and outputting installation prompt information for the first part, the installation prompt information including a part identifier of each part and an installation method and an installation sequence between the first part and each part, the first part being any one of the parts; After receiving the selection instruction for the first part among the parts and outputting installation prompt information for the first part, the method further includes: determining a second part connected to the first part; Displaying the part identification of the second part, as well as the installation method and installation order between the first part and the second part on the lens display screen, and highlighting the image of the second part and its position information among the parts; The displaying of the part identification of the second part and the installation method between the first part and the second part on the lens display screen includes: If there are multiple second parts connected to the first part, the lens display screen displays the part identifications of the multiple second parts, as well as the installation sequence and installation method between the first part and the multiple second parts.
2. The method according to claim 1, characterized in that The receiving a selection instruction for a first part among the parts and outputting installation prompt information for the first part includes: receiving a selection instruction for a first part among the parts, and obtaining a target object to be installed corresponding to the first part when determining that there are multiple objects to be installed; Based on the model installation information of the target object to be installed, installation prompt information for the first part is output.
3. A parts installation device, characterized in that: The device comprises: A parts display module is used to identify and display each part on the scanned object to be installed. The object to be installed is an object with no restrictions on the installation order. The part image and part identification of each part are displayed on the lens display screen. The part identification is used to encode or name the part. Each part is individually identified, and each part has a one-to-one correspondence with the part identification. A prompt information output module is used to receive a selection instruction for a first part among the parts, and output installation prompt information for the first part, wherein the installation prompt information includes a part identification of each part and an installation method and an installation sequence between the first part and each part, wherein the first part is any one of the parts; determine a second part connected to the first part; display the part identification of the second part, and the installation method and installation sequence between the first part and the second part through the lens display screen, and highlight the image of the second part and its position information in each part; if there are multiple second parts connected to the first part, display the part identification of the multiple second parts, and the installation sequence and installation method between the first part and the multiple second parts through the lens display screen.
4. The device according to claim 3, characterized in that The parts display module includes: A parts recognition unit, used to identify each part on the scanned object to be installed; The part display unit is used to display the part image and part identification of each part through the lens display screen.
5. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 2 are implemented.
6. AR glasses, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the steps of the method according to any one of claims 1 to 2 are implemented.
Citation Information
Patent Citations
AR-aid-based method and system for product assembling or equipment maintenance
CN107422710A
Tutorial demonstration method and apparatus based on augmented reality
CN109427102A