Augmented reality data processing method and system and computer readable storage medium
Patent Information
- Application Number
- HK42026127495
- Authority / Receiving Office
- HK · HK
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2026-08-13
- Publication Date
- 2026-10-09
- Estimated Expiration
- 2044-10-15
Smart Images
Figure 00000000_0000_ABST
Abstract
Description
(19) State Intellectual Property Office (12) Invention Patent Application (10) Application Publication Number (43) Application Publication Date (21) Application Number 202411446407.7 (22) Application Date 2024.10.16 (71) Applicant Beijing Damai Culture Media Development Co., Ltd. Address 701, 7th Floor, Building 32, Dongzhong Street, Dongcheng District, Beijing 100010 (72) Inventor Wang Dong (74) Patent Agency Beijing Brui Intellectual Property Agency Co., Ltd. 11505 Patent Attorney Yuan Yuan (51) Int.Cl. H04N 21 / 262 (2011.01) H04N 21 / 266 (2011.01) H04N 21 / 25 (2011.01) H04B 10 / 116 (2013.01) (54) Invention Title: Augmented Reality Data Processing Method, System, and Computer-Readable Storage Medium (57) Abstract: This application discloses an augmented reality data processing method, system, and computer-readable storage medium. The specific solution is as follows: acquiring a visible light signal emitted by a second device; decoding the visible light signal to obtain target information carried by the visible light signal, the target information being related to the target real-world scene; sending the target information to a server so that the server determines the target AR material based on the target information and returns the target AR material; superimposing the target AR material onto the real-world scene view of the target real-world scene to obtain an AR view and displaying the AR view. In this application, target information is acquired based on visible light communication, and AR materials adapted to the real-world scene are determined based on the target information, thereby solving the problem of augmented reality display for different real-world scenes. Claims 3 pages, Description 14 pages, Drawings 5 pages, CN 121888017 A 2026.04.17 CN 1 21 88 80 17 A 1. An augmented reality data processing method, characterized in that it includes: acquiring a visible light signal emitted by a second device; decoding the visible light signal to acquire target information carried by the visible light signal, the target information being related to a target real-world scene; sending the target information to a server so that the server determines target augmented reality AR material based on the target information and returns the target AR material; superimposing the target AR material onto a real-world scene view of the target real-world scene to obtain an AR view, and displaying the AR view. 2. The method according to claim 1, characterized in that, after displaying the AR view, the method further includes: in response to detecting an operation behavior performed by a user based on the AR view, sending behavior data of the operation behavior to a server. 3. The method according to claim 1 or 2, characterized in that, acquiring the visible light signal emitted by the second device includes:In response to receiving interactive prompt information, an interactive prompt interface is generated and displayed based on the interactive prompt information. The interactive prompt interface includes a visible light signal acquisition control. The interactive prompt information is triggered and sent in response to the first device being located within the associated area of the target real scene. In response to detecting a user's trigger operation on the visible light signal acquisition control, the visible light signal acquisition module of the first device is invoked to acquire the visible light signal. 4. The method according to claim 3, wherein the associated area is a geofence area created based on a geofence service, and the interactive prompt information is sent to the first device by the geofence system in response to detecting that the first device is located within the geofence area of the target real scene. 5. An augmented reality data processing method, comprising: receiving target information sent by a first device, wherein the target information is obtained by the first device through decoding a visible light signal emitted by a second device, and the target information is related to a target real scene; determining target AR material based on the target information; returning the target AR material to the first device, so that the first device overlays the target AR material onto the real scene view of the target real scene to obtain an AR view, and displays the AR view. 6. The method according to claim 5, wherein determining the target AR material based on the target information includes: determining the target AR material corresponding to the target information based on a first preset correspondence between the target information and the target AR material; or, determining the candidate AR material corresponding to the target information based on a second preset correspondence between the target information and candidate AR materials; and selecting the target AR material from the candidate AR materials based on user-related information of the user of the first device. 7. The method according to claim 6, wherein selecting the target AR material from the candidate AR materials based on user-related information of the user of the first device includes at least one of the following: determining the type of the target AR material based on the user's historical operation behavior, and selecting AR materials of the determined type from the candidate AR materials as the target AR material; or, determining the AR materials already used by the user based on the user's historical operation behavior, and selecting the target AR material from the candidate AR materials other than the already used AR materials. 8. The method according to any one of claims 5-7, characterized in that, after the first device displays the AR view, the method further comprises: in response to receiving behavioral data of a preset operation behavior, determining a recommended scene associated with the target real-world scene.In a real-world scenario, the behavioral data is sent by the first device in response to detecting a user performing a preset operation based on the AR view; guidance information is generated and sent to the first device, the guidance information being used to guide the user to move to an associated area of the real-world scene to be recommended. 9. An augmented reality data processing system, characterized in that it includes a first device, a second device, and a server; the second device is used to generate and emit a visible light signal carrying target information; the first device is used to acquire the visible light signal emitted by the second device, decode the visible light signal, acquire the target information carried by the visible light signal, and send the target information to the server, the target information being related to a target real-world scene; the server is used to determine target AR material based on the target information and return the target AR material to the first device; the first device is further used to overlay the target AR material onto a real-world scene view of the target real-world scene to obtain an AR view, and display the AR view. 10. The system according to claim 9, wherein when the server determines the target AR material based on the target information, it is specifically configured to: determine the target AR material corresponding to the target information based on a first preset correspondence between the target information and the target AR material; or, determine the candidate AR material corresponding to the target information based on a second preset correspondence between the target information and candidate AR materials; and filter the target AR material from the candidate AR materials based on user-related information of the user of the first device. 11. The system according to claim 9 or 10, wherein when the first device acquires the visible light signal emitted by the second device, it is specifically configured to: generate and display an interactive prompt interface based on the interactive prompt information in response to receiving interactive prompt information, the interactive prompt interface including a visible light signal acquisition control, the interactive prompt information being triggered and sent in response to the first device being located within an associated area of the target real-world scene; and call the visible light signal acquisition module of the first device to acquire the visible light signal in response to detecting a user's trigger operation on the visible light signal acquisition control. 12. A computer-readable storage medium having a computer program stored thereon, characterized in that, when executed by a processor, the program performs the steps of the method according to any one of claims 1-8. 13. An electronic device, characterized in that it comprises: one or more processors; and a memory associated with said one or more processors, said memory for storing program instructions, said program instructions, when read and executed by said one or more processors, performing the steps of the method according to any one of claims 1-8. 14. A computer program product comprising a computer program, characterized in that the computer program is executed by a processor. (See claims 2 / 3)CN 121888017 A The steps of implementing the method described in any one of claims 1-8. Claims 3 / 3 Page 4 CN 121888017 A Augmented Reality Data Processing Method, System and Computer-Readable Storage Medium Technical Field
[0001] This application relates to the technical fields of visible optical communication, augmented reality, etc., and in particular to an augmented reality data processing method, system and computer-readable storage medium. Background Art
[0002] Augmented Reality (AR) refers to the technology of superimposing virtual information onto real-world scenes. AR technology can provide users with a richer interactive experience.
[0003] Currently, AR technology is increasingly being applied to various places. Various places contain many different real-world scenes. How to perform augmented reality display on different real-world scenes has become an important technical problem. Summary of the Invention
[0004] This application provides an augmented reality data processing method, system and computer-readable storage medium.
[0005] This application provides the following solution:
[0006] According to a first aspect, an augmented reality data processing method is provided, comprising:
[0007] acquiring a visible light signal emitted by a second device;
[0008] decoding the visible light signal to acquire target information carried by the visible light signal, wherein the target information is related to a target real-world scene;
[0009] sending the target information to a server so that the server determines the target AR material based on the target information and returns the target AR material;
[0010] overlaying the target AR material onto a real-world scene view of the target real-world scene to obtain an AR view and displaying the AR view.
[0011] According to a second aspect, another augmented reality data processing method is provided, comprising:
[0012] receiving target information sent by a first device, wherein the target information is obtained by the first device through decoding a visible light signal emitted by a second device, and the target information is related to a target real-world scene;
[0013] determining target AR material based on the target information;
[0014] returning the target AR material to the first device, so that the first device overlays the target AR material onto a real-world scene view of the target real-world scene to obtain an AR view, and displays the AR view.
[0015] According to a third aspect, another augmented reality data processing system is provided, including a first device, a second device, and a server;
[0016] The second device is used to generate and emit a visible light signal carrying target information;
[0017] The first device is used to acquire the visible light signal emitted by the second device, decode the visible light signal, acquire the target information carried by the visible light signal, and send the target information to the server, wherein the target information is related to the target real-world scene;
[0018] The server is used to determine the target AR material based on the target information and return the target AR material to the first device;
[0019] The first device is also used to overlay the target AR material onto a real scene view of the target real scene to obtain an AR view, and to display the AR view.
[0020] According to a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the steps of the method of any one of the first aspects above. Specification 1 / 14 pages 5 CN 121888017 A
[0021] According to a fifth aspect, an electronic device is provided, comprising:
[0022] one or more processors; and
[0023] a memory associated with one or more processors, the memory being used to store program instructions, which, when read and executed by one or more processors, perform the steps of the method of any one of the first aspects above.
[0024] According to specific embodiments provided in this application, the following technical effects are disclosed in this application:
[0025] In this application, a visible light signal carrying target information is emitted by a second device, enabling the first device to decode the visible light signal, thereby obtaining the target information. The target information is related to the target real-world scene, enabling the determination of target AR materials that are compatible with the target real-world scene based on the target information, thereby solving the problem of augmented reality display for different real-world scenes.
[0026] In addition, compared with the method of additionally deploying signal enhancement equipment in related technologies, the second device in this application can be implemented using the lighting equipment already deployed in the scene, which is an effective use of existing infrastructure, without the need for additional equipment deployment, greatly reducing deployment costs. Brief Description of the Drawings
[0027] In order to more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0028] Figure 1 is a system architecture diagram applicable to the embodiments of this application;
[0029] Figure 2 is a flowchart of an augmented reality data processing method provided by an embodiment of this application;
[0030] Figure 3 is a flowchart of another augmented reality data processing method provided by an embodiment of this application;
[0031] Figure 4 is a flowchart of a specific implementation of an augmented reality data processing method provided by an embodiment of this application;
[0032] Figure 5 is a structural schematic diagram of an augmented reality data processing device provided by an embodiment of this application;
[0033] Figure 6 is a structural schematic diagram of another augmented reality data processing device provided by an embodiment of this application;
[0034] Figure 7 is a schematic block diagram of an electronic device provided by an embodiment of this application. Detailed Embodiments
[0035] The technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.The embodiments described herein are obviously only a part of the embodiments of this application, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.
[0036] The terminology used in the embodiments of this invention is for the purpose of describing particular embodiments only, and is not intended to limit the invention. The singular forms “a,” “the,” and “the” used in the embodiments of this invention and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise.
[0037] It should be understood that the term “and / or” used herein is merely a description of the relationship between related objects, indicating that three relationships may exist, for example, A and / or B, which can mean: A alone, A and B simultaneously, and B alone. In addition, the character “ / ” in this document generally indicates that the related objects before and after are in an “or” relationship.
[0038] Depending on the context, the word “if” as used herein can be interpreted as “when” or “when” or “in response to determination” or “in response to detection.” Similarly, depending on the context, the phrases "if determined" or "if detected (the stated condition or event)" can be interpreted as "when determined" or "in response to determined" or "when detected (the stated condition or event)" or "in response to detected (the stated condition or event)".
[0039] Augmented Reality (AR) refers to the technology of overlaying virtual information onto real-world scenes.
[0040] Currently, AR technology is increasingly being applied to various venues to provide users with a better on-site interactive experience.
[0041] For example, AR technology can be applied to various exhibition venues. Exhibition venues generally have many different real-world scenes. How to perform augmented reality display for these real-world scenes has become an important technical problem.
[0042] It is understood that when performing augmented reality display on real-world scenes, the AR materials used to be overlaid onto the real-world scene view need to have a certain degree of compatibility with the real-world scene view in order to achieve a better augmented reality effect. Therefore, it is necessary to provide AR materials that are compatible with different real-world scenarios, and to overlay and display the compatible AR materials when the user device displays the real-world scene view, thereby realizing the augmented reality display of the real-world scene.
[0043] In related technologies, the augmented reality display of real-world scenes relies on the location information of the user device. Based on the location information of the user device, the real-world scene in which the user is located is determined, and then AR materials that are compatible with the real-world scene in which the user is located are pushed to the user device for augmented reality display. However, since the actual situation of real-world scenes is often quite complex, for example...In indoor scenarios such as exhibition halls, the positioning information of user devices is mostly obtained based on Global Positioning System (GPS) signals. Numerous obstructions in indoor environments can cause significant attenuation of positioning signals (such as GPS signals), and when there is a high density of people indoors, multiple positioning signals can interfere with each other, resulting in the inability to accurately obtain the positioning information of user devices and effectively display the real-world scene in augmented reality.
[0044] To solve the problem of ineffective positioning of user devices in indoor environments, related technologies often require the deployment of dedicated positioning signal enhancement devices (such as signal amplifiers or additional positioning base stations) in indoor environments, which incurs additional deployment costs.
[0045] In view of this, this application provides a new approach. To facilitate understanding of this application, the system architecture on which this application is based is first described. Figure 1 shows an augmented reality data processing system that can be applied to embodiments of this application. The augmented reality data processing system includes a server, a first device, and a second device.
[0046] The first device is used to display the target real-world scene in augmented reality. The first device is a device that supports augmented reality, which may include, but is not limited to, mobile phones, tablets, smart wearable devices, smart car terminals, etc., wherein smart wearable devices may include smartwatches, smart glasses, smart bracelets, smart watches, smart glasses, etc. In this embodiment, the first device usually has an information display function, such as a display screen. In addition, it may also have an operation command input function, such as inputting operation commands through touch screen, keyboard, voice, etc.
[0047] The second device is a visible light signal emitting device, which may include, but is not limited to, light-emitting diode (LED) lighting.
[0048] The server can be an independent server, or it can be implemented by a server group, or it can be a cloud server. A cloud server is also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of high management difficulty and weak service scalability in traditional physical hosts and virtual private servers (VPS).
[0049] The server is mainly used to determine the target AR material and send the target AR material to the first device, so that the first device can perform augmented reality display on the target real scene based on the target AR material.
[0050] The first device and the server can interact via a network. The network can be wired or wireless, as described on page 3 / 14 of the specification (CN 121888017 A). The first device and the second device can interact via Visible Light Communication (VLC).
[0051] VLC is a communication technology that uses light waves as a medium to transmit data. This technology utilizes the characteristics of visible light for information transmission, achieving communication by modulating the brightness, frequency, or phase of light, hiding data information within the optical signal, and then transmitting the data through the transmission of visible light signals.
[0052] It should be understood that the number of servers, first devices, and second devices in Figure 1 is merely illustrative. Depending on implementation needs, any number of servers, first devices, and second devices can be used.
[0053] Figure 2 is a flowchart of an augmented reality data processing method provided in an embodiment of this application. This method can be executed by the first device in the system shown in Figure 1. As shown in Figure 2, the method may include the following steps:
[0054] Step S210: Acquire the visible light signal emitted by the second device;
[0055] Step S220: Decode the visible light signal to obtain the target information carried by the visible light signal, the target information being related to the target real-world scene;
[0056] Step S230: Send the target information to the server so that the server can determine the target AR material based on the target information and return the target AR material;
[0057] Step S240: Overlay the target AR material onto the real-world scene view of the target real-world scene to obtain an AR view and display the AR view.
[0058] When performing augmented reality display on different real-world scenes, the difficulty lies in how to provide AR materials that are compatible with the real-world scene. As can be seen from the above process, in this application, the second device emits a visible light signal carrying target information, enabling the first device to decode the visible light signal and thereby obtain the target information. The target information is related to the target real scene, so that based on the target information, the target AR material that is compatible with the target real scene can be determined, thereby solving the problem of augmented reality display for different real scenes.
[0059] In addition, compared with the method of additionally deploying signal enhancement equipment in related technologies, the second device in this application can be implemented using the lighting equipment already deployed in the scene, which is an effective use of existing infrastructure, without the need for additional equipment deployment, greatly reducing deployment costs.
[0060] The following describes in detail each step in the above process and the effects that can be further produced in conjunction with the embodiments.
[0061] First, the above step S210, namely "acquiring the visible light signal emitted by the second device", will be described in detail in conjunction with the embodiments.
[0062] The second device may include a visible light signal emitting module, which is used to encode and send visible light signals.
[0063] The first device has a visible light signal acquisition module, which acquires the visible light signal emitted by the second device.
[0064] As an implementable method, in this step, the first device can respond to receiving interactive prompt information, based onAn interactive prompt interface is generated and displayed. The interactive prompt interface includes a visible light signal acquisition control. The interactive prompt information is triggered and sent in response to the first device being located in the associated area of the target real scene. In response to detecting the user's trigger operation on the visible light signal acquisition control, the visible light signal acquisition module of the first device is invoked to acquire visible light signals.
[0065] The associated area of the target real scene can be understood as an area within a certain range around the target real scene. When the user is in this area, the visible light signal acquisition module of the first device can be used to acquire visible light signals, and the real scene view of the target real scene can be acquired, thereby supporting the subsequent augmented reality display of the target real scene.
[0066] In this embodiment of the application, when the user moves the first device to the associated area of the target real scene, the transmission of interactive prompt information can be automatically triggered. After the interactive prompt information is sent to the first device, the first device can generate and display an interactive prompt interface based on the interactive prompt information. The interactive prompt interface is used to guide the user to interact based on augmented reality technology. Specifically, the interactive prompt interface includes a visible light signal acquisition control. After the interactive prompt interface guides the user to trigger the visible light signal acquisition control, the first device will acquire the visible light signal and perform augmented reality display based on the visible light signal, thereby realizing interaction with the user.
[0067] As an achievable method, the associated area is a geofence area created based on the geofence service. The interactive prompt information is sent to the first device by the geofence system in response to detecting that the first device is located within the geofence area of the target real scene.
[0068] Wherein, the geofence area of the target real scene can be defined based on the geofence service and used as the aforementioned associated area. When the first device touches the geofence area of the target real scene, the geofence system automatically sends interactive prompt information to the first device.
[0069] The following describes in detail step S220, namely "decoding the visible light signal to obtain the target information carried by the visible light signal, the target information being related to the target real scene", in conjunction with the embodiment.
[0070] The visible light signal is essentially obtained by encoding the target information using the visible light signal transmitting module of the second device, and then carrying the encoded information in visible light, i.e., using VLC (Visible Light Communication) technology.
[0071] After acquiring the visible light signal, the first device can decode the visible light signal based on a preset visible light signal decoding algorithm to obtain the target information.
[0072] The target real-world scene is the scene where the user of the first device is currently located, i.e., the scene where augmented reality display is currently required.The target information is related to the target real scene, enabling the target information to characterize some relevant information of the target real scene, and enabling the target AR material adapted to the target real scene to be determined based on the target information.
[0073] As an example, the target information may include, but is not limited to, the identification information of the second device, the location information of the target real scene, and the scene identification of the target real scene.
[0074] The second device may be a device associated with the target real scene, enabling the target AR material adapted to the target real scene to be determined based on the identification information of the second device.
[0075] As an example, the second device may be an LED light near the target real scene, which can provide illumination for the target real scene and also emit visible light signals to the adjacent area of the target real scene.
[0076] The above step S230, namely "sending the target information to the server so that the server can determine the target AR material based on the target information and return the target AR material", will be described in detail below with reference to the embodiments.
[0077] After the first device decodes the target information, it can send the target information to the server, and the server determines the target AR material based on the target information.
[0078] Specifically, when the target information includes the identification information of the second device, since the second device is associated with the target real-world scene, the target real-world scene that needs to be displayed in augmented reality can be determined based on the identification information of the second device, thereby determining the target AR material that is compatible with the target real-world scene.
[0079] When the target information includes the location information of the target real-world scene, the location information can characterize the location of the target real-world scene, so that the target real-world scene that needs to be displayed in augmented reality can be determined based on the location information, and the target AR material that is compatible with the target real-world scene can be determined from page 5 / 14 of the specification, 9 CN 121888017 A.
[0080] When the target information includes the scene identifier of the target real-world scene, the scene identifier can serve as a unique identifier for the target real-world scene, so that the target real-world scene that needs to be displayed in augmented reality can be determined based on the scene identifier, thereby determining the target AR material that is compatible with the target real-world scene.
[0081] The target AR material may include, but is not limited to, 3D models, animations, videos, etc. For example, in games such as grabbing red envelopes, the target AR material is an animation of red envelopes falling.
[0082] The server can pre-set an AR material library and determine the target AR material from the AR material library based on the target information.
[0083] The following describes in detail the above step S240, namely "overlaying the target AR material onto the real scene view of the target real scene to obtain an AR view and displaying the AR view", with reference to the embodiments.
[0084] In the embodiments of this application, after receiving the target AR material returned by the server, the first device can display the target AR material.The material is superimposed on the real scene view of the target real scene to obtain the AR view, and the AR view is displayed, thereby realizing the augmented reality display of the target real scene.
[0085] The so-called AR view refers to a technical view that combines virtual information with the real world. In the embodiments of this application, it is a view obtained by superimposing such as 3D models, animations, videos, etc. with the real scene and then rendering it.
[0086] As an implementable method, after displaying the AR view, the above method further includes:
[0087] In response to detecting the operation behavior of the user of the first device based on the AR view, the behavior data of the operation behavior is sent to the server.
[0088] Wherein, the user can perform operation behavior based on the AR view, and the first device can send the behavior data of the operation behavior to the server, providing a basis for the server to perform subsequent processing based on the behavior data.
[0089] As an example, the AR view is an AR view that superimposes the red envelope falling animation on the real scene image. The user can perform the red envelope grabbing operation by clicking on the falling red envelopes on the screen. After the user completes the red envelope grabbing operation, the behavior data of the red envelope grabbing operation can be sent to the server.
[0090] Figure 3 is a flowchart of the augmented reality data processing method provided in this application embodiment. This method can be executed by the server in the system shown in Figure 1. As shown in Figure 3, the method may include the following steps:
[0091] Step S310: Receive target information sent by the first device. The target information is obtained by the first device through decoding the visible light signal emitted by the second device. The target information is related to the target real scene.
[0092] Step S320: Determine the target AR material based on the target information.
[0093] Step S330: Return the target AR material to the first device so that the first device can overlay the target AR material onto the real scene view of the target real scene to obtain an AR view and display the AR view.
[0094] When displaying augmented reality for different real scenes, the difficulty lies in how to provide AR materials that are compatible with the real scene. As can be seen from the above process, in this application, the second device emits a visible light signal carrying the target information, so that the first device can decode the visible light signal to obtain the target information. The target information is related to the target real-world scene, enabling the determination of target AR materials adapted to the target real-world scene based on this target information, thereby solving the problem of augmented reality display for different real-world scenes.
[0095] In addition, compared with the method of additionally deploying signal enhancement equipment in related technologies, the second device in this application can be implemented using the lighting equipment already deployed in the scene, which is an effective use of existing infrastructure, without the need for additional equipment deployment, greatly reducing deployment costs.
[0096] The following describes in detail each step of the above process and the effects that can be further produced, with reference to the embodiments. SpecificationPage 6 / 14 10 CN 121888017 A
[0097] First, the above step S310, namely "receiving target information sent by the first device, the target information being obtained by the first device through decoding the visible light signal emitted by the second device, and the target information being related to the target real scene", will be described in detail with reference to the embodiments.
[0098] The second device may include a visible light signal transmitting module, which is used to encode and transmit visible light signals. The first device has a visible light signal acquisition module, which acquires the visible light signal emitted by the second device.
[0099] The visible light signal is essentially obtained by the visible light signal transmitting module of the second device encoding the target information and then carrying the encoded information in visible light, that is, using VLC (Visible Light Communication) technology.
[0100] After acquiring the visible light signal, the first device can decode the visible light signal based on a preset visible light signal decoding algorithm to obtain the target information.
[0101] The target real-world scene is the scene where the user of the first device is currently located, that is, the real-world scene where augmented reality display needs to be performed. The target information is related to the target real-world scene, so that the target information can characterize some relevant information of the target real-world scene, and the target AR material that is compatible with the target real-world scene can be determined based on the target information.
[0102] As an example, the target information may include, but is not limited to, the identification information of the second device, the location information of the target real-world scene, and the scene identifier of the target real-world scene.
[0103] The second device can be a device associated with the target real-world scene, so that the target AR material that is compatible with the target real-world scene can be determined based on the identification information of the second device.
[0104] As an example, the second device can be an LED light near the target real-world scene, which can provide illumination for the target real-world scene and can also emit visible light signals to the vicinity of the target real-world scene.
[0105] The above step S320 "determining the target AR material based on the target information" will be described in detail below with reference to the embodiments.
[0106] After the first device decodes the target information, it can send the target information to the server, and the server determines the target AR material based on the target information.
[0107] Specifically, when the target information includes the identification information of the second device, since the second device is associated with the target real-world scene, the target real-world scene that needs to be displayed in augmented reality can be determined based on the identification information of the second device, thereby determining the target AR material that is compatible with the target real-world scene.
[0108] When the target information includes the location information of the target real-world scene, the location information can characterize the location of the target real-world scene, so that the target real-world scene that needs to be displayed in augmented reality can be determined based on the location information, fromAnd the target AR material that is compatible with the target real scene can be determined.
[0109] When the target information includes the scene identifier of the target real scene, the scene identifier can serve as a unique identifier of the target real scene, so that the target real scene that needs to be displayed in augmented reality can be determined based on the scene identifier, thereby the target AR material that is compatible with the target real scene can be determined.
[0110] The target AR material may include, but is not limited to, 3D models, animations, videos, etc. For example, in games such as grabbing red envelopes, the target AR material is the animation of red envelopes falling.
[0111] The server can pre-set an AR material library and determine the target AR material from the AR material library based on the target information.
[0112] As an achievable method, when determining the target AR material based on the target information, the target AR material corresponding to the target information can be determined based on the first preset correspondence between the target information and the target AR material. Wherein, the target information and the target AR material can be established in a first preset correspondence so that the target AR material corresponding to the target information can be quickly determined based on the first preset correspondence. Instruction manual 7 / 14 page 11 CN 121888017 A
[0113] As another feasible method, when determining the target AR material based on the target information, the candidate AR material corresponding to the target information can be determined first based on the second preset correspondence between the target information and the candidate AR material; then, the target AR material can be selected from the candidate AR material based on the user information of the user of the first device.
[0114] The target information and the candidate AR material can be established in a second preset correspondence so that the candidate AR material corresponding to the target information can be quickly determined based on the second preset correspondence.
[0115] The user information can characterize some personalized features of the user. Filtering the candidate AR material based on the user information can make the selected target AR material more in line with the user's personalized features while adapting to the target real scene.
[0116] The above-mentioned user information includes, but is not limited to, the user's user identifier, the user's historical operation behavior, and the user's related attribute information.
[0117] The historical operation behavior can be the operation behavior performed by the user based on the AR view that has been displayed on the first device. For example, the AR view is a real-world view overlaid with a falling red envelope animation, and the historical operation behavior is to click on the falling red envelopes on the screen to grab them.
[0118] When filtering target AR materials from candidate AR materials based on historical operation behavior, the following two methods can be used, but are not limited to:
[0119] The first method: Based on the user's historical operation behavior, determine the type of target AR material, and filter AR materials of the determined type from candidate AR materials as target AR materials.
[0120] In this implementation method, historical operation behavior can reflect some of the user's operation preferences, based on the user's historical operation behavior.Historical operation behavior can determine the type of AR material preferred by the user, and then AR materials of the determined type can be selected from the candidate AR materials as target AR materials.
[0121] For example, the user's historical operation behavior is the red envelope grabbing operation. Based on this historical operation behavior, it can be determined that the user is very likely to grab red envelopes again when interacting with the AR view next time, and candidate AR materials of the type related to grabbing red envelopes can be displayed to the user as target AR materials.
[0122] In addition to being based on user preferences, in this implementation method, the AR implementation path can also be planned in advance on the server side for the real scene. For example, from the user entering the exhibition hall to leaving the exhibition hall, a path of "welcome message - venue introduction - activity 1 - activity 2 - grab red envelopes" can be designed for the user. For the first target message received from the user, the target AR material is determined to be an animation containing a welcome message; for the second target message received from the user, the target AR material is determined to be a venue introduction video; for the third target message received from the user, the target AR material is determined to be activity animation 1; for the fourth target message received from the user, the target AR material is determined to be activity animation 2; for the fifth target message received from the user, the target AR material is determined to be a red envelope.
[0123] The second method: Based on the user's historical operation behavior, determine the AR material already used by the user, and determine the target AR material from the candidate AR materials other than the AR materials already used.
[0124] Historical operation behavior can also reflect the user's use of AR materials. For AR materials already used by the user, it is necessary to avoid repeatedly displaying these used AR materials, which would affect the user's experience. Therefore, the used AR materials in the candidate AR materials can be excluded, and the remaining candidate AR materials can be determined as the target AR materials, thereby avoiding repeated display of used AR materials and ensuring the user's experience.
[0125] As an optional approach, in certain exhibition venues, such as museums, AR material display groups may be pre-set, which need to contain several types of AR materials. When displaying AR materials to users, it is necessary to enable users to see as many types of AR materials as possible in the AR material display group. This allows the determination of target AR materials to be based on the user's historical operation behavior as described on page 8 / 14 of the specification, 12 CN 121888017 A, to determine the types of AR materials that have been shown to the user, and to determine the types of AR materials that have not been shown in the AR material display group as the types of target AR materials, and to select the AR materials of the determined types from the candidate AR materials as the target AR materials.
[0126] The following describes in detail step S330, "The target AR material is returned to the first device so that the first device can overlay the target AR material onto the real scene view of the target real scene to obtain an AR view and display the AR view," with reference to the embodiments.
[0127] In this embodiment, after receiving the target AR material returned by the server, the first device can overlay the target AR material onto the real scene view of the target real scene to obtain an AR view and display the AR view, thereby realizing the augmented reality display of the target real scene.
[0128] As an achievable method, after the first device displays the AR view, the above method may further include: the server responds to receiving the behavior data of the preset operation behavior, determines the real scene to be recommended associated with the target real scene, the behavior data is sent by the first device in response to detecting that the user has performed a preset operation behavior based on the AR view; generates guidance information and sends the guidance information to the first device, the guidance information is used to guide the user to move to the associated area of the real scene to be recommended.
[0129] Wherein, after the user performs an operation behavior based on the AR view, the first device will send the behavior data of the operation behavior to the server.
[0130] There are certain service associations between different real-world scenarios, and association relationships can be established between real-world scenarios with service associations. When a user performs a preset operation in the target real-world scenario, the user can be recommended to move to an associated real-world scenario to be recommended. The real-world scenario to be recommended is then displayed in augmented reality, allowing the user to interact with the real-world scenario in the two associated real-world scenarios, thus improving the user's interactive experience.
[0131] As an example, the AR view of the target real-world scenario is a real-world view overlaid with a red envelope falling animation. The preset operation performed by the user is to grab a red envelope by hitting the falling red envelope on the screen. At this time, the server can send guidance information to the first device. For example, the guidance information can be a text guidance information such as "Move to area X to continue grabbing red envelopes", or a path guidance information towards area X. Area X is the associated area of the real-world scenario to be recommended. By performing augmented reality interaction with the real-world scenario to be recommended within the associated area and continuing to grab red envelopes, the interaction between the user and different real-world scenarios can be deepened, thus improving the user's interactive experience.
[0132] The method provided in this application embodiment can be applied to various application scenarios, including but not limited to: augmented reality display for different real-world scenarios in the indoor environments of various performance and exhibition venues.
[0133] As an example, Figure 4 is a flowchart of an optional implementation of the augmented reality data processing method provided in this application.
[0134] The process includes the following steps:
[0135] Step S410: The VLC emitting module of the LED emits a VLC light signal.
[0136] The LED lighting corresponds to the first device described above in the embodiments of this application. In this example, the VLC transmitting module is integrated into the LED lighting and is used to encode and transmit VLC signals carrying target information.
[0137] Step S420: The mobile phone identifies and decodes the VLC signal through the camera.
[0138] The mobile phone corresponds to the first device described above in the embodiments of this application. The user's mobile phone may include a visible light signal acquisition module for acquiring the VLC signal emitted by the LED lighting. The visible light signal acquisition module in the mobile phone may be a camera. The user's mobile phone may have a built-in VLC decoding algorithm for decoding the VLC signal. The target information is obtained by decoding from the VLC signal. The target information may be the identification information of the LED lighting. Specification 9 / 14 pages 13 CN 121888017 A
[0139] Step S430: The mobile phone sends the identification information obtained by decoding from the VLC signal to the server.
[0140] Step S440: The server retrieves AR materials from the AR material library and sends the AR materials to the mobile phone.
[0141] The server can pre-configure an AR material library, which stores AR materials. The AR material library can use identification information such as LEDs as indexes to facilitate the detection of corresponding target AR materials.
[0142] Step S450: Present the AR materials on the mobile phone.
[0143] The user's mobile phone may also include an AR rendering engine, which is used to overlay the target AR materials with the real scene view to form an AR view and display it, so that the target AR materials can blend with the real environment.
[0144] Step S460: Collect user interaction data and submit it to the server.
[0145] When the user performs interactive operations based on the AR view, the mobile phone can collect the user's operation behavior data and report it to the server. The server also includes an interaction module, which is used to receive and analyze the user interaction data reported by the user's mobile phone.
[0146] The steps of the augmented reality data processing method in this application can be executed by an application (APP), plugins in the application, mini-programs, etc. installed on the mobile phone.
[0147] This technical solution aims to enhance the interactivity of the user's on-site experience by utilizing a smartphone app combined with VLC communication technology and AR technology. In this solution, the venue's LED lighting system can send VLC-encoded signals. The smartphone app identifies and decodes these light signals through its camera, subsequently triggering target AR materials corresponding to the target information, such as 3D models, animations, and videos, thereby enhancing the user's on-site interactive experience.
[0148] The above description describes specific embodiments of this specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims may be performed in a different order than in the embodiments.The desired result can still be achieved. Furthermore, the processes depicted in the accompanying drawings do not necessarily require a specific or sequential order to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0149] In summary, the augmented reality data processing system provided in this application includes a first device, a second device, and a server.
[0150] The second device is used to generate and emit a visible light signal carrying target information.
[0151] The first device is used to acquire the visible light signal emitted by the second device, decode the visible light signal, acquire the target information carried by the visible light signal, and send the target information to the server. The target information is related to the target real-world scene.
[0152] The server is used to determine the target AR material based on the target information and return the target AR material to the first device.
[0153] The first device is also used to overlay the target AR material onto the real-world scene view of the target real-world scene to obtain an AR view, and display the AR view.
[0154] In addition to the effects described above, the technical solutions provided by the above embodiments of this application can further achieve the following technical effects:
[0155] 1) In this application, the user can interact based on the AR view, and the first device sends the generated operation behavior to the server. The server can determine the target AR material to be sent to the first device based on the user's historical operation behavior, thereby achieving accurate matching of the target AR material.
[0156] 2) In this application, the first device can receive interactive prompt information when it is located in the associated area of the target real scene (e.g., the geofence area), and generate and display an interactive prompt interface based on the interactive prompt information to prompt the user to trigger the visible light signal acquisition space to acquire visible light signals. This method is more convenient for the user and improves the user experience. Instruction manual, pages 10 / 14, CN 121888017 A
[0157] 3) The server can determine the type of target AR material based on the user's historical operation behavior, and filter the determined type of AR material as the target AR material, thereby realizing a strong correlation between the target AR material and the user's preferences or historical operations, so that the pushed target AR material is more in line with the user's needs or more in line with the service requirements.
[0158] 4) The server can determine the AR material that the user has used based on the user's historical operation behavior, and avoid repeatedly sending AR material that the user has used when determining the target AR material to be sent to the first device, further improving the user experience.
[0159] 5) In this application, based on the user's interaction with the AR view, the server can determine the real scene to be recommended based on the user's operation behavior and generate guidance information to guide the user to move to the recommended scene.The way of guiding users to the associated areas of real-world scenes can help users quickly determine the positional relationship between multiple target real-world scenes, saving users time and improving user experience.
[0160] Of course, any product implementing this application does not necessarily need to achieve all of the above advantages at the same time.
[0161] According to another embodiment, an augmented reality data processing device is provided. FIG5 shows a schematic block diagram of the augmented reality data processing device according to one embodiment, which is disposed in the first device in the architecture shown in FIG1. As shown in FIG5, the augmented reality data processing device 500 includes: a visible light signal acquisition module 510, a visible light signal decoding module 520, an AR material acquisition module 530, and an AR display module 540. The main functions of each component module are as follows:
[0162] The visible light signal acquisition module 510 is used to acquire the visible light signal emitted by the second device.
[0163] The visible light signal decoding module 520 is used to decode the visible light signal to acquire the target information carried by the visible light signal, the target information being related to the target real-world scene.
[0164] The AR material acquisition module 530 is used to send target information to the server so that the server can determine the target AR material based on the target information and return the target AR material.
[0165] The AR display module 540 is used to overlay the target AR material onto the real scene view of the target real scene to obtain an AR view and display the AR view.
[0166] As one possible implementation, the above device further includes:
[0167] A behavior data reporting module (not shown in the figure), used to send behavior data of the operation behavior to the server in response to detecting the operation behavior of the user of the first device based on the AR view after displaying the AR view.
[0168] In one possible implementation, the visible light signal acquisition module 510 is specifically used for:
[0169] In response to receiving interactive prompt information, generating and displaying an interactive prompt interface based on the interactive prompt information, the interactive prompt interface including a visible light signal acquisition control, the interactive prompt information being triggered and sent in response to the first device being located within the associated area of the target real scene;
[0170] In response to detecting a user's trigger operation on the visible light signal acquisition control, calling the visible light signal acquisition module of the first device to acquire visible light signals.
[0171] In one possible implementation, the associated area is a geofence area created based on a geofence service, and the interactive prompt information is sent to the first device by the geofence system in response to detecting that the first device is located within the geofence area of the target real scene.
[0172] According to another embodiment, an augmented reality data processing apparatus is provided. FIG6 shows a schematic block diagram of the augmented reality data processing apparatus according to one embodiment, the apparatus being disposed on the server side of the architecture shown in FIG1.As shown in Figure 6, the augmented reality data processing device 600 includes: a target information receiving module 610, an AR material determination module 620, and an AR material return module 630. The main functions of each module are as follows:
[0173] The target information receiving module 610 is used to receive target information sent by a first device. The target information is obtained by decoding the visible light signal emitted by a second device (see page 11 / 14 of the first device's manual, CN 121888017 A). The target information is related to the target real-world scene.
[0174] The AR material determination module 620 is used to determine the target AR material based on the target information.
[0175] The AR material return module 630 is used to return the target AR material to the first device, so that the first device can overlay the target AR material onto the real-world scene view of the target real-world scene to obtain an AR view and display the AR view.
[0176] In one possible manner, the AR material determination module 620 is specifically used for:
[0177] determining the target AR material corresponding to the target information based on a first preset correspondence between the target information and the target AR material; or,
[0178] determining the candidate AR material corresponding to the target information based on a second preset correspondence between the target information and the candidate AR material; and selecting the target AR material from the candidate AR material based on the user-related information of the user of the first device.
[0179] In one possible manner, when the AR material determination module 620 selects the target AR material from the candidate AR material based on the user-related information of the user of the first device, it is specifically used for at least one of the following:
[0180] determining the type of the target AR material based on the user's historical operation behavior, and selecting the AR material of the determined type from the candidate AR material as the target AR material; or,
[0181] determining the AR material that the user has used based on the user's historical operation behavior, and determining the target AR material from the candidate AR material other than the AR material that has been used.
[0182] As one possible implementation, the above-mentioned device further includes a guidance module (not shown in the figure), the guidance module being used to:
[0183] After the first device displays the AR view, in response to receiving behavior data of a preset operation behavior, determine a real scene to be recommended associated with the target real scene, the behavior data being sent by the first device in response to detecting that the user has performed a preset operation behavior based on the AR view;
[0184] Generate guidance information and send the guidance information to the first device, the guidance information being used to guide the user to move to the associated area of the real scene to be recommended.
[0185] The various embodiments in this specification are described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other, and each embodiment focuses on describing the differences from other embodiments. In particular, for the system orAs the system embodiment is basically similar to the method embodiment, it is described simply. For relevant details, please refer to the description of the method embodiment. The system and system embodiment described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without creative effort.
[0186] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. The collection, use and processing of related data need to comply with the relevant laws, regulations and standards of relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.
[0187] In addition, this application embodiment also provides a computer-readable storage medium storing a computer program thereon. When the program is executed by a processor, it implements the steps of any of the methods in the foregoing method embodiments.
[0188] And an electronic device, comprising:
[0189] one or more processors; and
[0190] a memory associated with one or more processors, the memory for storing program instructions, which, when read and executed by one or more processors, perform the steps of any of the methods in the foregoing method embodiments.
[0191] This application also provides a computer program product, comprising a computer program that, when executed by a processor, implements the steps of any of the methods in the foregoing method embodiments.
[0192] FIG7 exemplarily illustrates the architecture of an electronic device, which may specifically include a processor 710, a video display adapter 711, a disk drive 712, an input / output interface 713, a network interface 714, and a memory 720. The processor 710, video display adapter 711, disk drive 712, input / output interface 713, network interface 714, and memory 720 can be communicatively connected via a communication bus 730.
[0193] The processor 710 can be implemented using a general-purpose CPU, microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solution provided in this application.
[0194] The memory 720 can be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 720 can store the operating system 721 for controlling the operation of the electronic device 700, and the basic input / output system (BIOS) 722 for controlling the low-level operation of the electronic device 700. In addition, it can also store a web browser 723, a data storage management system 724, and 725, etc. The aforementioned augmented reality data processing system 725 can be the application program that specifically implements the aforementioned steps in the embodiments of this application. In summary, when the technical solution provided by this application is implemented by software or firmware, the relevant program code is stored in the memory 720 and is called and executed by the processor 710.
[0195] The input / output interface 713 is used to connect the input / output module to realize information input and output. The input / output module can be configured as a component in the device (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input devices may include keyboards, mice, touch screens, microphones, various sensors, etc., and the output devices may include displays, speakers, vibrators, indicator lights, etc.
[0196] The network interface 714 is used to connect the communication module (not shown in the figure) to realize communication interaction between this device and other devices. The communication module can realize communication through wired means (e.g., USB, network cable, etc.) or through wireless means (e.g., mobile network, WIFI, Bluetooth, etc.).
[0197] The bus 730 includes a path for transmitting information between various components of the device (e.g., processor 710, video display adapter 711, disk drive 712, input / output interface 713, network interface 714, and memory 720).
[0198] It should be noted that although the above device only shows processor 710, video display adapter 711, disk drive 712, input / output interface 713, network interface 714, memory 720, bus 730, etc., in specific implementations, the device may also include other components necessary for normal operation. Furthermore, those skilled in the art will understand that the above-described device may only include the components necessary to implement the solution of this application, and may not necessarily include all the components shown in the figures.
[0199] As can be seen from the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solution of this application, in essence or the part that contributes to the prior art, can be embodied in the form of a computer program product, which can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., including several instructions to cause a computer to...The machine device (which may be a personal computer, server, or network device, etc.) executes the methods described in various embodiments or certain parts of the embodiments of this application.
[0200] The technical solutions provided by this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the core ideas of the methods and the specification of this application (pages 13 / 14, CN 121888017 A). At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. In summary, the content of this specification should not be construed as a limitation of this application. Instruction manual 14 / 14 pages 18 CN 121888017 A Figure 1 Instruction manual Figure 1 / 5 pages 19 CN 121888017 A Figure 2 Figure 3 Instruction manual Figure 2 / 5 pages 20 CN 121888017 A Figure 4 Instruction manual Figure 3 / 5 pages 21 CN 121888017 A Figure 5 Figure 6 Instruction manual Figure 4 / 5 pages 22 CN 121888017 A Figure 7 Instruction manual Figure 5 / 5 pages 23 CN 121888017 A Abstract The embodiment of the invention discloses an augmented reality data processing method and system and a computer readable storage medium. According to the specific scheme, the method comprises the steps that a visible light signal emitted by a second device is acquired; the visible light signal is decoded; target information carried by the visible light signal is obtained, and the target information is related to the target reality scene; sending the target information to a server, so that the server determines atarget AR material based on the target information, and returns the target AR material; and superposing the target AR material on the real scene view of the target real scene to obtain an AR view, and displaying the AR view. According to the method and the device, the target information is acquired based on visual light communication, and the AR material matched with the real scene is determined based on the target information, so that the problem of performing augmented reality display on different real scenes can be solved.
Claims
1. An augmented reality data processing method, characterized in that, include: Acquire the visible light signal emitted by the second device; The visible light signal is decoded to obtain the target information carried by the visible light signal, and the target information is related to the target's real-world scene; The target information is sent to the server so that the server can determine the target augmented reality (AR) material based on the target information and return the target AR material. An AR view is obtained by overlaying the target AR material onto the real-world view of the target real-world scene, and then the AR view is displayed.
2. The method according to claim 1, characterized in that, After displaying the AR view, the method further includes: In response to detecting user actions based on the AR view, the behavioral data of the actions is sent to the server.
3. The method according to claim 1 or 2, characterized in that, The acquisition of the visible light signal emitted by the second device includes: In response to receiving interactive prompt information, an interactive prompt interface is generated and displayed based on the interactive prompt information. The interactive prompt interface includes a visible light signal acquisition control. The interactive prompt information is triggered and sent in response to the first device being located within the associated area of the target real scene. In response to detecting a user's trigger operation on the visible light signal acquisition control, the visible light signal acquisition module of the first device is invoked to acquire the visible light signal.
4. The method according to claim 3, characterized in that, The associated area is a geofenced area created based on the geofence service, and the interactive prompt information is sent to the first device by the geofence system in response to detecting that the first device is located within the geofenced area of the target real scene.
5. An augmented reality data processing method, characterized in that, include: The device receives target information sent by a first device, which is obtained by the first device through decoding a visible light signal emitted by a second device, and the target information is related to the target's real-world scene. The target AR material is determined based on the target information; The target AR material is returned to the first device, so that the first device overlays the target AR material onto the real scene view of the target real scene to obtain an AR view, and displays the AR view.
6. The method according to claim 5, characterized in that, The step of determining the target AR material based on the target information includes: Based on a first preset correspondence between the target information and the target AR material, the target AR material corresponding to the target information is determined; or... Based on the second preset correspondence between the target information and the candidate AR material, the candidate AR material corresponding to the target information is determined; based on the user-related information of the user of the first device, the target AR material is selected from the candidate AR material.
7. The method according to claim 6, characterized in that, Based on user-related information of the user of the first device, the target AR material is selected from the candidate AR materials, including at least one of the following: Based on the user's historical user behavior, determine the type of the target AR material, and select the AR material of the determined type from the candidate AR materials as the target AR material; or... Based on the user's historical operation behavior, the AR materials that the user has used are determined, and the target AR material is determined from the candidate AR materials other than the AR materials that have been used.
8. The method according to any one of claims 5-7, characterized in that, After the first device displays the AR view, the method further includes: In response to receiving behavioral data of a preset operation behavior, a recommended real-world scene associated with the target real-world scene is determined. The behavioral data is sent by the first device in response to detecting that the user has performed a preset operation behavior based on the AR view. Generate guidance information and send the guidance information to the first device. The guidance information is used to guide the user to move to the associated area of the real-world scene to be recommended.
9. An augmented reality data processing system, characterized in that, Includes the first device, the second device, and the server; The second device is used to generate and transmit a visible light signal carrying target information; The first device is used to acquire the visible light signal emitted by the second device, decode the visible light signal, acquire the target information carried by the visible light signal, and send the target information to the server. The target information is related to the target real-world scene. The server is used to determine the target AR material based on the target information and return the target AR material to the first device; The first device is further configured to overlay the target AR material onto a real-world view of the target real-world scene to obtain an AR view, and to display the AR view.
10. The system according to claim 9, characterized in that, When the server determines the target AR material based on the target information, it is specifically used for: Based on a first preset correspondence between the target information and the target AR material, the target AR material corresponding to the target information is determined; or... Based on the second preset correspondence between the target information and the candidate AR material, the candidate AR material corresponding to the target information is determined; Based on the user-related information of the user of the first device, the target AR material is selected from the candidate AR materials.
11. The system according to claim 9 or 10, characterized in that, When the first device acquires the visible light signal emitted by the second device, it is specifically used for: In response to receiving interactive prompt information, an interactive prompt interface is generated and displayed based on the interactive prompt information. The interactive prompt interface includes a visible light signal acquisition control. The interactive prompt information is triggered and sent in response to the first device being located within the associated area of the target real scene. In response to detecting a user's trigger operation on the visible light signal acquisition control, the visible light signal acquisition module of the first device is invoked to acquire the visible light signal.
12. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the steps of the method according to any one of claims 1-8.
13. An electronic device, characterized in that, include: One or more processors; as well as A memory associated with the one or more processors, the memory being used to store program instructions that, when read and executed by the one or more processors, perform the steps of the method according to any one of claims 1-8.
14. A computer program product, comprising a computer program, characterized in that, When executed by a processor, the computer program implements the steps of the method according to any one of claims 1-8.