An operation method, device, medium and equipment based on AR device
By obtaining and executing user operation instructions in virtual reality scenarios, the problem that AR devices cannot operate is solved, and users' interaction and operability to virtual reality scenarios are realized, and user experience is enhanced.
Patent Information
- Application Number
- CN202210529050.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-05-16
- Publication Date
- 2025-01-10
- Estimated Expiration
- 2042-05-16
AI Technical Summary
Existing AR devices can only be used by users to view virtual reality scenarios and cannot perform corresponding operations.
By obtaining the virtual reality scene displayed by the current electronic device, obtaining the user's operation instructions in the virtual reality scene, and performing corresponding operations, the operation and control of the virtual reality scene is realized, such as entering, rotating, and moving on a panoramic three-dimensional model Wait for operations.
It realizes that users can perform actual operations and control through AR devices, and enhances the interaction and operability of users with virtual reality scenarios.
Smart Images

Figure CN114791766B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of operating methods of AR devices, and in particular to an operating method, apparatus, medium and equipment based on AR devices. Background Art
[0002] At present, with the advancement and development of technology, intelligent devices have gradually entered every household. Nowadays, my country has developed augmented reality technology (AR, Augmented Reality, a technology that cleverly integrates virtual information with the real world) and corresponding AR devices, through which users can experience various real scenes in person. However, even if AR devices are developed, users can only watch but cannot perform corresponding operations. Summary of the invention
[0003] In order to solve the above technical problems, the present application is proposed. The embodiments of the present application provide an operation method, apparatus, medium and device based on an AR device, which solves the problem that a user cannot perform corresponding operations through an AR device.
[0004] According to one aspect of the present application, an operation method based on an AR device is provided, including: obtaining a virtual reality scene displayed by a current electronic device; wherein the virtual reality scene is displayed on a graphic of a door; obtaining an operation instruction of a user in the virtual reality scene; and executing an operation corresponding to the operation instruction and displaying the operation result on the current electronic device.
[0005] In one embodiment, obtaining the virtual reality scene currently displayed by the electronic device includes: obtaining the virtual reality scene currently displayed by the electronic device; wherein the virtual reality scene includes a panoramic stereo model.
[0006] In one embodiment, the operation corresponding to executing the operation instruction includes: if it is obtained that the continuous operation time at a position of the current electronic device is greater than a first preset time, entering the inside of the panoramic stereo model from the outside.
[0007] In one embodiment, the operation corresponding to executing the operation instruction includes: if it is obtained that the simultaneous operation time of the first position and the second position on the current electronic device is less than a second preset time and the first position moves toward the first target position in the target direction, and the second position moves toward the second target position in the target direction, then the panoramic stereo model is controlled to rotate in the target direction; wherein the first target position is different from the second target position.
[0008] In one embodiment, obtaining the virtual reality scene currently displayed by the electronic device includes: obtaining the virtual reality scene currently displayed by the electronic device; wherein the virtual reality scene includes three-dimensional models of multiple preset commodities.
[0009] In one embodiment, the operation corresponding to executing the operation instruction includes: if an operation instruction is obtained on the current electronic device to move the target model stored in the three-dimensional model of the multiple preset commodities from the current position to the third target position, then controlling the target model to move from the current position to the third target position.
[0010] In one embodiment, obtaining the virtual reality scene currently displayed by the electronic device includes: obtaining the virtual reality scene currently displayed by the electronic device; wherein the virtual reality scene includes an image of a real scene and placing three-dimensional models of the plurality of preset commodities in the image of the real scene.
[0011] According to one aspect of the present application, an operating device based on an AR device is provided, characterized in that it includes: a scene acquisition module, used to acquire a virtual reality scene displayed by a current electronic device; wherein the virtual reality scene is displayed on a graphic of a door; an instruction acquisition module, used to acquire an operating instruction of a user in the virtual reality scene; and an execution module, used to execute an operation corresponding to the operating instruction and display the operation result on the current electronic device.
[0012] According to another aspect of the present application, a computer-readable storage medium is provided, wherein the storage medium stores a computer program, and the computer program is used to execute any of the above-mentioned operating methods based on an AR device.
[0013] According to another aspect of the present application, an electronic device is provided, comprising: a processor; a memory for storing instructions executable by the processor; and the processor for executing any of the above-mentioned operating methods based on an AR device.
[0014] The present application provides an operation method, device, medium and device based on an AR device, the method comprising: obtaining a virtual reality scene displayed by a current electronic device, wherein the virtual reality scene is displayed on a door graphic, obtaining an operation instruction of a user in the virtual reality scene, and performing an operation corresponding to the operation instruction and displaying the operation result on the current electronic device. By obtaining the virtual reality scene displayed by the current electronic device and the operation instruction of the user in the virtual reality scene, the corresponding operation result is obtained according to the operation instruction, so that the user can perform the corresponding operation based on the AR device. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] By describing the embodiments of the present application in more detail in conjunction with the accompanying drawings, the above and other purposes, features and advantages of the present application will become more apparent. The accompanying drawings are used to provide a further understanding of the embodiments of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the present application and do not constitute a limitation of the present application. In the accompanying drawings, the same reference numerals generally represent the same components or steps.
[0016] Figure 1 It is a flowchart of an operation method based on an AR device provided by an exemplary embodiment of the present application.
[0017] Figure 2 It is a flowchart of an operation method based on an AR device provided by another exemplary embodiment of the present application.
[0018] Figure 3 It is a flowchart of an operation method based on an AR device provided by another exemplary embodiment of the present application.
[0019] Figure 4 It is a flowchart of an operation method based on an AR device provided by another exemplary embodiment of the present application.
[0020] Figure 5 It is a flowchart of an operation method based on an AR device provided by another exemplary embodiment of the present application.
[0021] Figure 6 It is a flowchart of an operation method based on an AR device provided by another exemplary embodiment of the present application.
[0022] Figure 7 It is a flowchart of an operation method based on an AR device provided by another exemplary embodiment of the present application.
[0023] Figure 8 It is a structural schematic diagram of an operating device based on an AR device provided by an exemplary embodiment of the present application.
[0024] Fig. 9 It is a structural schematic diagram of an operating device based on an AR device provided by another exemplary embodiment of the present application.
[0025] Fig.10 It is a structural diagram of an electronic device provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION
[0026] Below, the exemplary embodiments according to the present application will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited to the exemplary embodiments described here.
[0027] Figure 1 FIG. 1 is a flow chart of an operation method based on an AR device provided by an exemplary embodiment of the present application. Figure 1 As shown, the operation method based on the AR device includes:
[0028] Step 110: Acquire the virtual reality scene currently displayed by the electronic device, wherein the virtual reality scene is displayed on the graphic of the door.
[0029] Get the virtual reality scene currently displayed by the electronic device. The virtual reality scene is obtained by taking an image taken by the electronic device, and then performing image processing on the image to obtain multiple feature points. If the figure formed by the multiple feature points matches the preset figure, the advertisement corresponding to the preset figure is obtained and an opening instruction is sent to the access controller, and then the advertisement is covered on the figure. The advertisement carries a virtual reality scene identifier. After the advertisement is obtained, the corresponding virtual reality scene will be generated and displayed on the door figure.
[0030] Step 120: Obtain the user's operation instructions in the virtual reality scene.
[0031] The user can operate in a virtual reality scene on an electronic device or while wearing a VR device, and then obtain the operation instructions generated when the user operates on the electronic device.
[0032] Step 130: Execute the operation corresponding to the operation instruction and display the operation result on the current electronic device.
[0033] The operation corresponding to the operation instruction is executed, and then the operation result is displayed on the current electronic device, so that the user can view the corresponding action during the operation.
[0034] The present application provides an operation method, device, medium and device based on an AR device, the method comprising: obtaining a virtual reality scene displayed by a current electronic device, wherein the virtual reality scene is displayed on a door graphic, obtaining an operation instruction of a user in the virtual reality scene, and performing an operation corresponding to the operation instruction and displaying the operation result on the current electronic device. By obtaining the virtual reality scene displayed by the current electronic device and the operation instruction of the user in the virtual reality scene, the corresponding operation result is obtained according to the operation instruction, so that the user can perform the corresponding operation based on the AR device.
[0035] Figure 2 FIG. 1 is a flowchart of an operation method based on an AR device provided by another exemplary embodiment of the present application. Figure 2 As shown, step 110 may include:
[0036] Step 111: Acquire a virtual reality scene currently displayed by the electronic device, wherein the virtual reality scene includes a panoramic stereo model.
[0037] The panoramic stereo model is displayed at an empty space position in the image of the real scene.
[0038] Figure 3 FIG. 1 is a flowchart of an operation method based on an AR device provided by another exemplary embodiment of the present application. Figure 3 As shown, step 130 may include:
[0039] Step 131: if it is obtained that the continuous operation time at a position of the current electronic device is greater than a first preset time, then enter the inside of the panoramic stereo model from the outside.
[0040] If the user long presses a position on the electronic device and the continuous operation time is greater than the first preset time, then the user can enter the interior of the panoramic stereo model from the outside. For example, if the panoramic stereo model is a car and the first preset time is 3 seconds, long press the car window for 3 seconds, then the user can enter the interior of the car and view the scenery from inside the car to outside the car. Or if the current electronic device displays a simulated object, and the user's continuous operation time at the position of the simulated object is greater than the third preset time and the simulated object is moved from the current position to another position, the simulated object can be moved. The third preset time can be 1 second. However, if the user's operation instruction is not received during the movement, the simulated object will stop moving directly.
[0041] Or if it is obtained that the number of touches at a position of the current electronic device is greater than or equal to a preset number threshold, then the inside of the panoramic stereo model is entered from the outside.
[0042] If the number of times the user touches a position on the current electronic device is greater than or equal to a preset number threshold, which may be 2 times, the user enters the inside of the panoramic stereo model from the outside. For example, the panoramic stereo model may be a simulated car. If the user touches a position on the current electronic device twice, the user enters the inside of the simulated car from the outside.
[0043] When entering the interior of the panoramic stereo model and obtaining the duration of the operation on the target object of the current electronic device is greater than or equal to the fourth preset duration threshold, the fourth preset duration threshold can be 1 second, then the target object is selected and the target object can be controlled to move, and when it is obtained that there is no operation on the target object of the current electronic device, the movement is stopped. In addition, if it is obtained that the continuous operation time of the first sub-position on the current electronic device is greater than the fifth preset time and the first sub-position moves toward the first sub-target position in the target direction, the current viewing angle of the electronic device is controlled to rotate in the target direction. And if it is obtained that the third sub-position on the current electronic device approaches the fourth sub-position in the third direction and the fifth sub-position approaches the sixth sub-position in the fourth direction, the viewing angle of the current electronic device is enlarged, wherein the third direction is the opposite direction to the fourth direction. If in the enlarged viewing angle, if it is obtained that the continuous operation time of the second sub-position on the current electronic device is less than the sixth preset time and the second sub-position moves toward the second sub-target position in the target direction, then move in the target direction in the enlarged image. When the number of times the target object is touched on the current electronic device is greater than the preset number threshold, the preset number threshold can be 2 times, then enter the interior of the target object.
[0044] If the user's continuous operation time at two positions of the current electronic device is greater than a fourth preset time, the user returns from the inside to the outside of the panoramic stereoscopic model.
[0045] If the user continues to operate at two positions of the current electronic device for longer than a fifth preset time, which may be 3 seconds, the user returns from the interior of the panoramic stereo model to the exterior. For example, the panoramic stereo model is a simulated car, that is, if the user presses two fingers for 3 seconds, the interior scene of the panoramic stereo model is exited.
[0046] Figure 4 FIG. 1 is a flowchart of an operation method based on an AR device provided by another exemplary embodiment of the present application. Figure 4 As shown, step 130 may include:
[0047] Step 132: If it is obtained that the continuous operation time of the first position and the second position on the current electronic device is less than the second preset time and the first position moves toward the first target position in the target direction, and the second position moves toward the second target position in the target direction, then the panoramic stereo model is controlled to rotate in the target direction, wherein the first target position is different from the second target position.
[0048] If it is obtained that the continuous operation time of the first position and the second position on the current electronic device is greater than the second preset time, and the first position moves toward the first target position in the target direction, and the second position moves toward the second target position in the target direction, the panoramic stereo model can be rotated to the left or right, that is, it can be rotated clockwise or counterclockwise. It can be understood that when there is a panoramic stereo model (AR object), the user presses the object with two fingers and slides left and right to realize the clockwise or counterclockwise rotation of the panoramic stereo model. When there are multiple panoramic stereo models and an operation instruction to touch the target panoramic stereo model is obtained, the target panoramic stereo model is selected. For example, there are panoramic stereo models A and B. When an operation instruction to touch the A panoramic stereo model is obtained, the A panoramic stereo model is selected, wherein the first position and the second position can be the upper direction, the lower direction, the left direction, the right direction or any other direction or any other angle.
[0049] In one embodiment, if it is obtained that the third position on the current electronic device approaches the fourth position in the first direction and the fifth position approaches the sixth position in the second direction, the panoramic stereo model is enlarged, wherein the first direction and the second direction are opposite directions.
[0050] If it is obtained that the third position on the current electronic device is approaching the fourth position in the first direction and the fifth position is approaching the sixth position in the second direction, that is, the user's two fingers are expanding outward, the panoramic stereo model can be enlarged, where the operation can be adapted to the operation of one or more panoramic stereo models.
[0051] In one embodiment, if a click simulation operation button is received, the screen of the current electronic device is controlled to switch to full screen.
[0052] When the user clicks the simulated operation button, the screen of the electronic device is displayed in full screen, and the user can start the simulated operation on it. During the simulated operation, the cloud can render in real time and send down the data stream.
[0053] Figure 5 FIG. 1 is a flowchart of an operation method based on an AR device provided by another exemplary embodiment of the present application. Figure 5 As shown, step 110 may include:
[0054] Step 112: Acquire a virtual reality scene currently displayed by the electronic device, wherein the virtual reality scene includes three-dimensional models of a plurality of preset commodities.
[0055] The virtual reality scene includes a plurality of stereoscopic models of preset commodities, which are stored in the form of a list. The user can click on the commodity to cache the commodity. When wearing the AR device, the user can view the stored stereoscopic model of the commodity through the AR device.
[0056] Figure 6 FIG. 1 is a flowchart of an operation method based on an AR device provided by another exemplary embodiment of the present application. Figure 6 As shown, step 130 may include:
[0057] Step 133: If an operation instruction is obtained to move a target model stored in the three-dimensional models of multiple preset commodities on the current electronic device from the current position to the third target position, the target model is controlled to move from the current position to the third target position.
[0058] When an operation instruction to move the target model from the current position to the third target position is obtained, the target model is controlled to move from the current position to the third target position. For example, the user touches the current position of the electronic device with one or two fingers, and the target model moves along the user's moving route, and the movement instruction controls the target model to move from the current position to the third target position.
[0059] In one embodiment, if it is obtained that the user clicks the camera icon button, a photo of the real scene image in the current lens is taken.
[0060] Figure 7 FIG. 1 is a flowchart of an operation method based on an AR device provided by another exemplary embodiment of the present application. Figure 7 As shown, step 110 may include:
[0061] Step 113: Acquire a virtual reality scene currently displayed by the electronic device, wherein the virtual reality scene includes an image of a real scene and three-dimensional models of a plurality of preset commodities are placed in the image of the real scene.
[0062] A virtual reality scene currently displayed by the electronic device is obtained, where the virtual reality scene includes an image of a real scene and three-dimensional models of a plurality of preset commodities are placed in the image of the real scene.
[0063] In one embodiment, if the AR device displays an image of a display scene and places a plurality of stereoscopic models of preset commodities in the image of the real scene, the operation process is obtained from the cloud database and displayed on the display screen of the AR device.
[0064] In one embodiment, before step 110, the operation method based on the AR device can be specifically implemented as follows: if the current electronic device displays a video, the video is overlaid on the door graphic.
[0065] In one embodiment, before step 130, the operation method based on the AR device can be specifically implemented as follows: receiving an instruction for the electronic device to move in a target direction and controlling the video to move along with the graphic of the door.
[0066] Figure 8 1 is a schematic diagram of the structure of an operating device based on an AR device provided by an exemplary embodiment of the present application. Figure 8 As shown, the operating device 20 based on the AR device includes: a scene acquisition module 201, used to acquire the virtual reality scene displayed by the current electronic device, wherein the virtual reality scene is displayed on the graphic of the door, an instruction acquisition module 202, used to acquire the user's operation instructions in the virtual reality scene, and an execution module 203, used to execute the operation corresponding to the operation instruction and display the operation result on the current electronic device.
[0067] The present application provides an operation device based on an AR device, including: obtaining a virtual reality scene displayed by a current electronic device through a scene acquisition module 201, wherein the virtual reality scene is displayed on a door graphic, an instruction acquisition module 202 obtains an operation instruction of a user in the virtual reality scene, and an execution module 203 executes an operation corresponding to the operation instruction and displays the operation result on the current electronic device. By obtaining the virtual reality scene displayed by the current electronic device and the operation instruction of the user in the virtual reality scene, a corresponding operation result is obtained according to the operation instruction, so that the user can perform corresponding operations based on the AR device.
[0068] Fig. 9 FIG. 1 is a schematic diagram of a structure of an operating device based on an AR device provided by another exemplary embodiment of the present application. Fig. 9 As shown, the scene acquisition module 201 may include: a first scene acquisition subunit 2011, used to acquire the virtual reality scene currently displayed by the electronic device, wherein the virtual reality scene includes a panoramic stereo model.
[0069] In one embodiment, if Fig. 9 As shown, the execution module 203 may include: a first execution subunit 2031, configured to enter the interior of the panoramic stereo model from the exterior if it is obtained that the continuous operation time at a position of the current electronic device is greater than a first preset time.
[0070] In one embodiment, if Fig. 9 As shown, the execution module 203 may include: a second execution sub-unit 2032, which is used to control the panoramic stereo model to rotate in the target direction if it is obtained that the simultaneous continuous operation time of the first position and the second position on the current electronic device is less than a second preset time and the first position moves toward the first target position in the target direction, and the second position moves toward the second target position in the target direction, wherein the first target position is different from the second target position.
[0071] In one embodiment, if Fig. 9As shown, the scene acquisition module 201 may include: a second scene acquisition subunit 2012, which acquires the virtual reality scene currently displayed by the electronic device, wherein the virtual reality scene includes three-dimensional models of multiple preset commodities.
[0072] In one embodiment, if Fig. 9 As shown, the execution module 203 may include: a third execution sub-unit 2033, which is used to control the target model to move from the current position to the third target position if an operation instruction is obtained on the current electronic device to move the target model stored in the three-dimensional model of the multiple preset commodities from the current position to the third target position.
[0073] In one embodiment, if Fig. 9 As shown, the scene acquisition module 201 may include: a third scene acquisition subunit 2013, used to acquire the virtual reality scene displayed by the current electronic device, wherein the virtual reality scene includes an image of a real scene and three-dimensional models of the multiple preset commodities are placed in the image of the real scene.
[0074] Fig.10 A block diagram of an electronic device according to an embodiment of the present application is illustrated.
[0075] like Fig.10 As shown, the electronic device 10 includes one or more processors 11 and a memory 12 .
[0076] The processor 11 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 10 to perform desired functions.
[0077] The memory 12 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory (cache), etc. The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 11 may run the program instructions to implement the operating methods based on the AR device and / or other desired functions of the various embodiments of the present application described above. Various contents such as input signals, signal components, noise components, etc. may also be stored in the computer-readable storage medium.
[0078] In one example, the electronic device 10 may further include: an input device 13 and an output device 14, and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).
[0079] When the electronic device is a stand-alone device, the input device 13 may be a communication network connector, which is used to receive the collected input signals from the first device and the second device.
[0080] In addition, the input device 13 may also include, for example, a keyboard, a mouse, and the like.
[0081] The output device 14 can output various information to the outside, including the determined distance information, direction information, etc. The output device 14 can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, and the like.
[0082] Of course, to simplify, Fig.10 Only some of the components related to the present application in the electronic device 10 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device 10 may also include any other appropriate components.
[0083] The computer program product may be written in any combination of one or more programming languages to write program codes for performing the operations of the embodiments of the present application, including object-oriented programming languages, such as Java, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as an independent software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.
[0084] The computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0085] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present application to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.
Claims
1. An operation method based on an AR device, characterized in that: include: Acquire a virtual reality scene currently displayed by the electronic device; wherein the virtual reality scene is displayed on a graphic of a door; Obtaining operation instructions from the user in the virtual reality scene; and Execute the operation corresponding to the operation instruction and display the operation result on the current electronic device; The process of obtaining a virtual reality scene currently displayed by the electronic device and displaying the virtual reality scene on the door graphic includes: The virtual reality scene is an image captured by an electronic device, and then the captured image is processed to obtain multiple feature points. If a graphic composed of multiple feature points matches a preset graphic, an advertisement corresponding to the preset graphic is obtained and an opening instruction is sent to the access control controller, and then the advertisement is overlaid on the graphic. The advertisement carries a virtual reality scene logo. After the advertisement is obtained, a corresponding virtual reality scene is generated and displayed on the door graphic.
2. The operation method based on AR device according to claim 1, characterized in that: The obtaining of the virtual reality scene currently displayed by the electronic device comprises: Acquire a virtual reality scene currently displayed by the electronic device; wherein the virtual reality scene includes a panoramic stereo model.
3. The operation method based on AR device according to claim 2, characterized in that: The operations corresponding to executing the operation instructions include: If it is obtained that the continuous operation time at one position of the current electronic device is greater than a first preset time, then entering the interior of the panoramic stereo model from the outside.
4. The operation method based on AR device according to claim 2, characterized in that: The operations corresponding to executing the operation instructions include: If it is obtained that the simultaneous continuous operation time of the first position and the second position on the current electronic device is less than a second preset time and the first position moves toward the first target position in a target direction and the second position moves toward the second target position in the target direction, the panoramic stereo model is controlled to rotate in the target direction; wherein the first target position is different from the second target position.
5. The operation method based on AR device according to claim 1, characterized in that: The obtaining of the virtual reality scene currently displayed by the electronic device comprises: A virtual reality scene currently displayed by the electronic device is obtained; wherein the virtual reality scene includes three-dimensional models of a plurality of preset commodities.
6. The operation method based on AR device according to claim 5, characterized in that: The operations corresponding to executing the operation instructions include: If an operation instruction is obtained on the current electronic device to move a target model stored in the three-dimensional models of the plurality of preset commodities from a current position to a third target position, the target model is controlled to move from the current position to the third target position.
7. The operation method based on AR device according to claim 5, characterized in that: The obtaining of the virtual reality scene currently displayed by the electronic device comprises: Acquire a virtual reality scene currently displayed by the electronic device; wherein the virtual reality scene includes an image of a real scene and three-dimensional models of the plurality of preset commodities are placed in the image of the real scene.
8. An operating device based on an AR device, characterized in that: include: A scene acquisition module, used to acquire a virtual reality scene currently displayed by the electronic device; wherein the virtual reality scene is displayed on a graphic of a door; An instruction acquisition module, used to acquire operation instructions of the user in the virtual reality scene; and An execution module, used to execute the operation corresponding to the operation instruction and display the operation result on the current electronic device; The process of obtaining a virtual reality scene currently displayed by the electronic device and displaying the virtual reality scene on the door graphic includes: The virtual reality scene is an image captured by an electronic device, and then the captured image is processed to obtain multiple feature points. If a graphic composed of multiple feature points matches a preset graphic, an advertisement corresponding to the preset graphic is obtained and an opening instruction is sent to the access control controller, and then the advertisement is overlaid on the graphic. The advertisement carries a virtual reality scene logo. After the advertisement is obtained, a corresponding virtual reality scene is generated and displayed on the door graphic.
9. A computer-readable storage medium, wherein the storage medium stores a computer program, wherein the computer program is used to execute the operation method based on an AR device as described in any one of claims 1 to 7.
10. An electronic device, comprising: processor; a memory for storing instructions executable by the processor; The processor is used to execute the operation method based on the AR device as described in any one of claims 1 to 7.
Citation Information
Patent Citations
Product comparison method and apparatus based on augmented reality and storage medium
CN107767211A
A data processing method and system for intelligent vehicle watching
CN109949121A
Display method and device based on augmented reality, storage medium and program product
CN112884908A