AR Scene Generation Method, Terminal, and Computer-Readable Storage Medium

Abstract

The present application discloses an AR scene generation method, a terminal, and a computer-readable storage medium. Among them, the AR scene generation method includes: the second terminal forms an AR scene according to the status feature information and location information sent by the first terminal, and in combination with the pre-stored image features in the second terminal and the current scene information obtained by the second terminal. And a virtual image corresponding to the user carrying the first terminal can be displayed in the AR scene, and the position of the virtual image in the AR scene corresponds to the position of the user in the current environment. In the embodiments of the present application, the specific position of the user in the current environment can be relatively intuitively determined through the AR scene, so as to improve the effect of finding people in the case of a relatively complex surrounding environment or a large number of people.

Description

Technical Field

[0001] The embodiments of the present application relate to, but are not limited to, the field of information processing technologies, and in particular, to an AR scene generation method, a terminal, and a computer-readable storage medium. Background Art

[0002] In public places with a large number of people and relatively complex environments, such as shopping malls, supermarkets, and tourist attractions, it is easy for children or the elderly to get lost. Although a certain number of surveillance cameras are deployed in these public places, due to the large number of people and possible blind spots in the surveillance, the effect of finding people is limited. Moreover, when using a public address system to search for missing people, there are also problems such as whether the missing person can hear and understand the broadcast. Especially when the missing person is a child, the effect of searching by broadcast is not high.

[0003] In order to prevent children or the elderly from getting lost in public places, families often choose to equip them with anti-lost smart bracelets. Through the wireless connection between the smart bracelet and the mobile phone, when the wearer of the bracelet exceeds the safe range, both the mobile phone and the smart bracelet will emit a beeping alarm to remind the family to search immediately. However, when the surrounding environment is relatively complex or there are a large number of people, it is still difficult to accurately locate the child or the elderly, so the effect of finding people is limited. Summary of the Invention

[0004] The following is an overview of the subject matter described in detail in this document. This overview is not intended to limit the scope of protection of the claims.

[0005] In a first aspect, the embodiments of the present application provide an AR scene generation method, a terminal, and a computer-readable storage medium, which can improve the effect of finding people in a relatively complex surrounding environment or when there are a large number of people.

[0006] In a second aspect, the embodiments of the present application provide an AR scene generation method, which is applied to a second terminal communicatively connected to a first terminal, and includes:

[0007] Obtaining status feature information and location information sent by the first terminal;

[0008] Combining the status feature information with pre-stored image features to form a virtual image corresponding to the status feature information;

[0009] Obtaining current scene information, and combining the virtual image with the current scene information according to the location information to form an augmented reality (AR) scene;

[0010] Displaying the AR scene.

[0011] In a third aspect, the embodiments of the present application further provide an AR scene generation method, which is applied to a system and includes:

[0012] The first terminal sends status feature information and location information to the second terminal;

[0013] The second terminal combines the status feature information and pre-stored image features to form a virtual image corresponding to the status feature information;

[0014] The second terminal obtains the current scene information and combines the virtual image with the current scene information according to the location information to form an AR scene;

[0015] The second terminal displays the AR scene.

[0016] In a fourth aspect, an embodiment of the present application further provides a terminal, including: a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the AR scene generation method in the second aspect described above is implemented.

[0017] In a fifth aspect, an embodiment of the present application further provides a computer-readable storage medium storing computer-executable instructions for executing the AR scene generation method described above.

[0018] Embodiments of the present application include: The second terminal forms a virtual image corresponding to the status feature information by obtaining the status feature information and location information sent by the first terminal and combining the status feature information with the pre-stored image features. Then, the second terminal forms an AR (Augmented Reality) scene by obtaining the current scene information and combining the virtual image with the current scene information according to the location information. When the second terminal displays the AR scene, the virtual image can be displayed in the AR scene, and the virtual image corresponds to the user carrying the first terminal, and the position of the virtual image in the AR scene corresponds to the position of the user in the current environment. According to the solution provided by the embodiments of the present application, the second terminal forms an AR scene based on the status feature information and location information sent by the first terminal, and combines the pre-stored image features in the second terminal and the current scene information obtained by the second terminal. Moreover, the virtual image corresponding to the user carrying the first terminal can be displayed in the AR scene, and the position of the virtual image in the AR scene corresponds to the position of the user in the current environment. Therefore, the specific position of the user in the current environment can be determined more intuitively through the AR scene, thereby improving the effect of finding people in a relatively complex surrounding environment or a large number of people.

[0019] Other features and advantages of the present application will be described in the subsequent specification, and partly will become obvious from the specification, or will be understood by implementing the present application. The objectives and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the specification, claims and drawings. Description of the Drawings

[0020] The drawings are used to provide a further understanding of the technical solution of the present application, and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the technical solution of the present application, and do not constitute a limitation to the technical solution of the present application.

[0021] Figure 1 is a schematic framework diagram of a system structure platform for implementing the AR scene generation method provided by an embodiment of the present application;

[0022] Figure 2 is a flowchart of an AR scene generation method applied to a second terminal provided by an embodiment of the present application;

[0023] Figure 3 is a flowchart of an AR scene generation method applied to a second terminal provided by another embodiment of the present application;

[0024] Figure 4A is a schematic diagram of the display content of a second terminal provided by an embodiment of the present application;

[0025] Figure 4B is a schematic diagram of the display content of a second terminal provided by another embodiment of the present application;

[0026] Figure 5 is a schematic diagram of the display content of a second terminal provided by another embodiment of the present application;

[0027] Figure 6 is a schematic diagram of a terminal provided by an embodiment of the present application. Detailed Embodiments

[0028] In order to make the objectives, technical solutions and advantages of the present application more clear and understandable, the present application will be further described in detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0029] It should be noted that although the functional modules are divided in the device schematic diagram and the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order from the module division in the device or the order in the flowchart. Terms such as "first" and "second" in the specification, claims and the above-mentioned drawings are used to distinguish similar objects and do not necessarily need to describe a specific order or sequence.

[0030] The present application provides an AR scene generation method, a terminal, and a computer-readable storage medium. The second terminal obtains the status feature information and location information sent by the first terminal, combines the status feature information with the pre-stored image features to form a virtual image corresponding to the status feature information. Then, the second terminal obtains the current scene information and combines the virtual image with the current scene information according to the location information to form an AR scene. When the second terminal displays the AR scene, the virtual image can be displayed in the AR scene, and the virtual image corresponds to the user carrying the first terminal, and the position of the virtual image in the AR scene corresponds to the position of the user in the current environment. Therefore, the specific position of the user in the current environment can be determined more intuitively through the AR scene, so as to improve the effect of finding people in a relatively complex surrounding environment or a large number of people.

[0031] The embodiments of the present application will be further described below with reference to the accompanying drawings.

[0032] As Figure 1 shown, Figure 1 is a schematic framework diagram of a system structure platform for executing the AR scene generation method provided by an embodiment of the present application.

[0033] As Figure 1 shown, the system structure platform 100 includes a first terminal 110 and a second terminal 120 that can communicate wirelessly with each other. The first terminal 110 includes a first memory 111, a first processor 112, and a first network module 113. The second terminal 120 includes a second memory 121, a second processor 122, and a second network module 123. Among them, the first network module 113 is electrically connected to the first processor 112, and the first memory 111 and the first processor 112 can be connected by a bus or other means. Figure 1 Taking the connection by bus as an example; the second network module 123 is electrically connected to the second processor 122, and the second memory 121 and the second processor 122 can be connected by a bus or other means. Figure 1 Taking the connection by bus as an example.

[0034] In one embodiment, the first terminal 110 may be a smart wearable device, for example, the first terminal 110 may be a smart bracelet, a smart watch, a smart belt or a smart necklace; the second terminal 120 may be a smart phone, a tablet computer, a smart camera or a smart glasses. When the first terminal 110 is a smart wearable device, the first terminal 110 may further include a motion data acquisition module and a position acquisition module, wherein the motion data acquisition module may be a device such as a three-axis gyroscope or a six-axis gyroscope, which may acquire information such as the motion state, movement amplitude and motion speed of the user wearing the first terminal 110; the position acquisition module may be a GPS (Global Positioning System) module, which may acquire horizontal coordinate information and altitude information of the user wearing the first terminal 110. In addition, the altitude information corresponding to the first terminal 110 may also be acquired through a pressure sensor. When the second terminal 120 is a device such as a smart phone, a tablet computer, a smart camera or smart glasses, the second terminal 120 may also include a camera and a display screen, wherein the camera is used to obtain the current environmental information around the user, and the display screen is used to display the AR scene formed by the virtual image combined with the current environmental information, and the user can determine the actual position of the user wearing the first terminal 110 according to the AR scene displayed on the display screen. It is worth noting that the virtual image can be pre-selected and stored in the second memory 121, and the second terminal 120 pre-records the user's action characteristics through the camera, thereby forming a virtual image of corresponding walking, running, climbing, climbing, etc.

[0035] Wireless communication can be performed between the first network module 113 and the second network module 123, for example, data transmission can be performed via a WIFI network, or data transmission can be performed via a mobile network, wherein the mobile network can be a 3G network, an LTE network, or a 5G network. When data transmission is performed between the first network module 113 and the second network module 123 via a 5G network, the 5G network can provide a high-speed data transmission rate, thereby enabling real-time association between the first terminal 110 and the second terminal 120, so that the real-time motion status of the user wearing the first terminal 110 can be observed through the display screen of the second terminal 120.

[0036] The status characteristic information of the first user wearing the first terminal 110, such as motion state information, action amplitude information, and motion speed information, etc., can be obtained by the first terminal 110 in real time. After the first terminal 110 obtains the status characteristic information of the first user, the first terminal 110 will send the status characteristic information and the position information of the first terminal 110 to the second terminal 120. When the second terminal 120 receives the status characteristic information and the position information, the second terminal 120 can first combine the status characteristic information and the pre-stored image characteristics pre-recorded in the second terminal 120 to form a virtual image corresponding to the motion state of the first user. In addition, the second user obtains the current scene information through the camera of the second terminal 120, and the second terminal 120 can combine the virtual image into the current scene information according to the position information of the first terminal 110 to form an AR scene that can indicate the actual position of the first user, and display the AR scene through the display screen. Therefore, the second user can relatively intuitively determine the specific position of the first user in the current environment through the AR scene, so as to improve the effect of finding people in a relatively complex surrounding environment or a large number of people.

[0037] The first memory 111 and the second memory 121 are respectively used as a non-transitory computer-readable storage medium, and can be respectively used to store non-transitory software programs and non-transitory computer-executable programs. In addition, both the first memory 111 and the second memory 121 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some embodiments, the first memory 111 may optionally include a memory remotely disposed relative to the first processor 112, and these remote memories may be connected to the first terminal 110 through a network. In other embodiments, the second memory 121 may optionally include a memory remotely disposed relative to the second processor 122, and these remote memories may be connected to the second terminal 120 through a network. Examples of the above networks include, but are not limited to, the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0038] Those skilled in the art can understand that Figure 1 the device structure shown in

[0039] does not constitute a limitation on the system structure platform 100, and may include more or fewer components than shown in the figure, or combine some components, or different component arrangements. Figure 1 In the system structure platform 100 shown in

[0040] Based on the above-mentioned system structure platform 100, various embodiments of the AR scene generation method of the present application are proposed.

[0041] like Figure 2 As shown, Figure 2 1 is a flowchart of an AR scene generation method applied to a second terminal in communication connection with a first terminal provided by an embodiment of the present application, and the AR scene generation method includes but is not limited to the following steps:

[0042] Step S100: Acquire status characteristic information and location information sent by the first terminal.

[0043] In one embodiment, the first terminal may be a smart wearable device such as a smart bracelet, a smart watch, a smart belt or a smart necklace, and the first terminal has functions such as wireless communication, positioning, and motion state detection. The state characteristic information includes at least one of motion state information, motion amplitude information, and motion speed information. Among them, the motion state corresponding to the motion state information may be a stationary state, a walking state, a running state, or a climbing state, and the motion amplitude information and the motion speed information are different according to the different motion states. For example, when the motion state corresponding to the motion state information is a running state, if the first terminal is a smart bracelet or a smart watch, the motion amplitude information may be the swing degree of the arm, and if the first terminal is a smart knee pad, the motion amplitude information may be the lifting degree of the leg, and at this time, the motion speed information may be the moving speed of the user when running. In addition, the position information may include only horizontal coordinate information, or may include horizontal coordinate information and altitude information, and the content of the position information may be different according to the different environments in which the user is currently located. For example, when the user is in a square, the position information includes only horizontal coordinate information; for another example, when the user is in a shopping mall, the position information includes horizontal coordinate information and altitude information.

[0044] In one embodiment, the first terminal can obtain status characteristic information and location information of a user wearing the first terminal. After the first terminal obtains the status characteristic information and location information, the first terminal will send the status characteristic information and location information to the second terminal so that the second terminal can perform subsequent operations based on the status characteristic information and location information obtained by the first terminal.

[0045] Step S200, combining the state characteristic information and the pre-stored image characteristics to form a virtual image corresponding to the state characteristic information.

[0046] In one embodiment, the second terminal may pre-store pre-stored image features, which are virtual visualized action content, for example, the pre-stored image features may be action images in a walking state, or action images in a running state, etc. The pre-stored image features may be stored in the second terminal in different ways, for example, the second terminal may obtain and store the pre-stored image features by file download or file transfer; for another example, the user's action image may be photographed by the camera of the second terminal, and the user's action features may be obtained and recorded, so that various virtual action images such as walking, running, climbing, climbing over, standing, squatting, etc. are formed and stored in the second terminal.

[0047] In one embodiment, a virtual image corresponding to the state feature information can be formed by calling, for example, according to the motion state information in the state feature information, a pre-stored image feature pre-stored in the second terminal is called, and the pre-stored image feature is the virtual image corresponding to the state feature information. By observing the pre-stored image feature, the current motion state of the user wearing the first terminal can be understood. In addition, a virtual image corresponding to the state feature information can also be formed by combining data. For example, according to the motion state information in the state feature information, the corresponding pre-stored image feature is found in the second terminal, and then the motion amplitude information and motion speed information in the state feature information are combined with the pre-stored image feature, thereby generating a virtual image with visualized motion content corresponding to the state feature information. Therefore, the current motion state of the user wearing the first terminal can be understood by observing the virtual image.

[0048] Step S300, obtaining current scene information, combining the virtual image with the current scene information according to the position information, and forming an AR scene.

[0049] In one embodiment, the current scene information is the actual environment information of the user, and the second terminal can obtain the current scene information in different ways. For example, when the user is in a shopping mall or a supermarket, the user can use the second terminal to connect to the local server to download the current scene information. To illustrate with an example, assuming that the user is in a shopping mall or a supermarket, and the shopping mall or the supermarket has posted a QR code corresponding to the actual scene map, then the user can connect to the local server in the shopping mall or the supermarket by scanning the QR code to download the current scene information. For another example, the user can use the camera of the second terminal to shoot the surrounding environment to obtain the current scene information.

[0050] In one embodiment, since the current scene information corresponds to the actual environment in which the user is currently located, a map corresponding to the actual environment in which the user is currently located can be formed based on the current scene information. When the virtual image corresponding to the user wearing the first terminal is combined with the current scene information based on the position information of the first terminal, an AR scene combining the virtual image and the actual scene can be formed, and the virtual image is in a specific position in the AR scene, and the specific position is determined by the position information of the first terminal.

[0051] In one embodiment, the second terminal can use its current position as the origin of the measurement coordinate system in the AR scene, and determine the position of the first terminal relative to the second terminal in combination with the position information of the first terminal, so as to determine the specific position of the virtual image in the AR scene. For example, the second terminal can obtain the horizontal coordinate information and altitude information of the second terminal in real time through the GPS module set inside it. Similarly, the first terminal can also obtain the horizontal coordinate information and altitude information of the first terminal in real time through the GPS module set inside it. When the first terminal sends its current horizontal coordinate information and altitude information to the second terminal, the second terminal will use its current horizontal coordinate information and altitude information as the origin of the measurement coordinate system in the AR scene. Therefore, the difference between the horizontal coordinate information of the first terminal and the horizontal coordinate information of the second terminal, and the difference between the altitude information of the first terminal and the altitude information of the second terminal, are the coordinate information of the first terminal in the measurement coordinate system. Therefore, according to the coordinate information, the specific position of the virtual image corresponding to the user wearing the first terminal in the AR scene can be determined.

[0052] In one embodiment, the size of the virtual image can be adjusted according to the distance between the first terminal and the second terminal. For example, when the size of the virtual image in the AR scene becomes larger and larger, it can be considered that the first user wearing the first terminal is getting closer to the second user carrying the second terminal; for another example, when the size of the virtual image in the AR scene becomes smaller and smaller, it can be considered that the first user wearing the first terminal is getting farther and farther from the second user carrying the second terminal.

[0053] Step S400: displaying an AR scene.

[0054] In one embodiment, the second terminal has a display screen. When the second terminal forms an AR scene by combining the virtual image and the current scene information, the second terminal can use the display screen to display the AR scene. At this time, the user holding the second terminal can more intuitively determine the specific location of the user wearing the first terminal in the current environment through the AR scene, thereby improving the effect of finding people when the surrounding environment is relatively complex or there are a large number of people.

[0055] In one embodiment, according to the above steps S100, S200, and S300, the second terminal forms a virtual image corresponding to the status feature information by obtaining the status feature information and location information sent by the first terminal and combining the status feature information with the pre-stored image features. Additionally, the second terminal forms an AR scene by obtaining the current scene information and combining the virtual image with the current scene information according to the location information. When the second terminal displays the AR scene, the virtual image can be displayed in the AR scene, and the virtual image corresponds to the user carrying the first terminal. Moreover, the position of the virtual image in the AR scene corresponds to the position of the user in the current environment. Therefore, the specific position of the user in the current environment can be determined more intuitively through the AR scene, thereby improving the effect of finding people in a relatively complex surrounding environment or a large number of people.

[0056] In addition, in one embodiment, the virtual image is prominently displayed in the AR scene.

[0057] In one embodiment, there can be different implementation manners for the virtual image to be prominently displayed in the AR scene. For example, the virtual image can be prominently displayed in a color different from the environmental color in the AR scene, such as a red virtual image. Or, the virtual image can be displayed in a flashing manner in the AR scene.

[0058] In one embodiment, according to the position information of the scenery in the AR scene and the position information of the virtual image in the AR scene, the virtual image can also have different display manners. For example, when the virtual image is in front of the scenery, that is, when the first terminal is closer to the second terminal than the scenery, the outline of the virtual image can be formed by solid lines. Or, when the virtual image is behind the scenery, that is, when the scenery is closer to the second terminal than the first terminal, the outline of the virtual image can be formed by dashed lines. In this embodiment, to determine whether the virtual image is closer to the second terminal or the scenery is closer to the second terminal, the pre-installed distance measurement software in the second terminal can be used for measurement and comparison. Those skilled in the art can understand that using the distance measurement software for distance measurement belongs to the prior art, so it will not be elaborated here.

[0059] The following is an exemplary description:

[0060] First example:

[0061] Suppose both the first user and the second user are in a supermarket. The first user wears a first terminal, and the second user carries a second terminal. When the second user turns on the camera of the second terminal and takes pictures of the surrounding environment, the scenery in the supermarket captured will be displayed on the display screen of the second terminal. For example, the shelves around the second user will be shown on the display screen of the second terminal. Since the first terminal sends the state characteristic information and location information corresponding to the first user to the second terminal, the second terminal will form a virtual image corresponding to the motion state of the first user according to the pre-stored image characteristics and the state characteristic information. Then, the second terminal will combine this virtual image into the real scene captured by the camera according to the location information of the first user. When the first user is behind the shelf in the supermarket, the second user's eyes cannot see the first user. However, in the AR scene displayed on the display screen of the second terminal, the virtual image corresponding to the motion state of the first user can form its outline in a dotted line and be superimposed on the shelf blocking the front of the first user, thus creating a perspective visual effect, enabling the second user to see the motion state of the first user behind the shelf through the display screen of the second terminal, thereby improving the effect of finding people and solving the problem of children or the elderly getting lost. When the first user is in front of the shelf, in the AR scene displayed on the display screen of the second terminal, the virtual image corresponding to the motion state of the first user can form its outline in a solid line and be superimposed on the corresponding shelf. Therefore, by observing the form of the outline of the virtual image, the second user can determine whether the first user is blocked by the scenery, thus quickly determining the specific location of the first user, improving the effect of finding people, and solving the problem of children or the elderly getting lost.

[0062] Second example:

[0063] Suppose both the first user and the second user are in a shopping mall. The first user wears a first terminal, and the second user carries a second terminal. When the second user turns on the camera of the second terminal and takes pictures of the surrounding environment, the scenery in the shopping mall captured will be displayed on the display screen of the second terminal. For example, the merchants on the floor where the second user is currently located and the merchants on the upper floor are displayed on the display screen of the second terminal. Since the first terminal sends the status feature information and location information corresponding to the first user to the second terminal, the second terminal will form a virtual image corresponding to the motion state of the first user based on the pre-stored image features and the status feature information. Then, the second terminal will combine this virtual image into the real scene captured by the camera according to the location information of the first user. When the first user is on the upper floor, the second user can only see the ceiling with their eyes. However, in the AR scene displayed on the display screen of the second terminal, the virtual image corresponding to the motion state of the first user can be presented in a flashing state and superimposed on the corresponding position on the upper floor, thus forming a perspective visual effect, enabling the second user to see the motion state of the first user on the upper floor through the display screen of the second terminal, thereby improving the effect of finding people and alleviating the problem of children or the elderly getting lost. When the first user and the second user are on the same floor, in the AR scene displayed on the display screen of the second terminal, the virtual image corresponding to the motion state of the first user can be presented in a constantly lit state and superimposed on the corresponding position on the current floor. Therefore, by observing the presentation mode of the virtual image, the second user can determine whether the first user is blocked by the scenery, thus quickly determining the specific location of the first user, improving the effect of finding people, and alleviating the problem of children or the elderly getting lost.

[0064] In addition, in another embodiment, an indication mark for indicating the position of the virtual image is displayed in the AR scene.

[0065] In one embodiment, the form of the indication mark can have different implementation manners. For example, the indication mark can be a static arrow, a dynamic arrow, or a dynamic finger, etc. This embodiment does not limit the specific form of the indication mark, as long as the indication mark can play a role in indicating the direction.

[0066] In one embodiment, when the virtual image corresponding to the motion state of the first user is not in the local AR scene currently displayed on the display screen of the second terminal, the second terminal can display an indication mark for indicating the position of the virtual image in the AR scene according to the location information sent by the first terminal. In this case, the second user only needs to change the shooting angle of the second terminal according to the indication direction of the indication mark to make the virtual image appear in the AR scene displayed on the display screen of the second terminal, thereby improving the effect of finding people and alleviating the problem of children or the elderly getting lost.

[0067] As Figure 3 shown, in another embodiment, the AR scene generation method further includes but is not limited to the following steps:

[0068] Step S500: Display a two-dimensional map corresponding to the current scene information;

[0069] Step S600: Display a position marker corresponding to the virtual image in the two-dimensional map according to the position information.

[0070] In one embodiment, two windows can be displayed on the display screen of the second terminal, namely the first window and the second window. Among them, the AR scene can be displayed in the first window, and the two-dimensional map corresponding to the current scene information can be displayed in the second window. And a position marker corresponding to the virtual image is displayed in the two-dimensional map. That is, the AR scene displayed in the first window and the two-dimensional map displayed in the second window are mutually related. The second user can not only determine the specific position of the first user through the AR scene, but also determine the specific position of the first user through the two-dimensional map. Combining the position information about the first user provided by the two windows, the specific position where the first user is currently located can be confirmed more accurately, thereby further improving the effect of searching for people and improving the problem of children or the elderly getting lost.

[0071] In one embodiment, the position marker corresponding to the virtual image displayed in the two-dimensional map can have different display methods. For example, the position marker can be a constantly lit bright spot, or a flashing bright spot, or a constantly lit arrow, etc. This embodiment does not limit the specific form of the position marker, as long as the position marker can play an indicating role.

[0072] In one embodiment, a position marker corresponding to the second terminal can also be displayed in the two-dimensional map. The second user can determine the direction and position of the first user wearing the first terminal relative to the second terminal according to the position marker corresponding to the second terminal and the position marker corresponding to the virtual image in the two-dimensional map, thereby further improving the effect of searching for people and improving the problem of children or the elderly getting lost. In addition, this embodiment does not limit the specific form of the position marker corresponding to the second terminal, as long as it can play an indicating role.

[0073] The following is an exemplary illustration:

[0074] Third example:

[0075] Referring to Figure 4A and Figure 4B, when the second user uses the second terminal to locate the first user wearing the first terminal, a first window Q1 and a second window Q2 will be displayed on the display screen of the second terminal. Among them, the first window Q1 displays an AR scene formed by combining a virtual image and current scene information, and the second window Q2 displays a two-dimensional map associated with the AR scene. And a first position marker M1 corresponding to the virtual image and a second position marker M2 corresponding to the second terminal are displayed in the two-dimensional map. As Figure 4A shown, when the virtual image corresponding to the first user appears in the middle position of the AR scene, in the two-dimensional map displayed in the second window Q2, the first position marker M1 is directly in front of the second position marker M2. Although the second user can initially determine the specific position of the first user based on the direction and position of the first position marker M1 relative to the second position marker M2, the second user does not know whether the first user will be blocked by an obstacle. At this time, the second user can judge whether the first user is blocked by an obstacle by observing the specific form of the virtual image in the AR scene displayed in the first window Q1. For example, when the outline of the virtual image is composed of dotted lines, it can be considered that the first user is blocked by an obstacle, and when the outline of the virtual image is composed of solid lines, it can be considered that the first user is not blocked by an obstacle. As Figure 4B shown, the virtual image corresponding to the first user does not appear in the AR scene displayed in the first window Q1. In the two-dimensional map displayed in the second window Q2, the first position marker M1 and the second position marker M2 appear simultaneously. Since the virtual image corresponding to the first user does not appear in the AR scene displayed in the first window Q1, the second user cannot know the specific position of the first user only based on the AR scene. At this time, the second user can determine the specific position of the first user wearing the first terminal through the first position marker M1 and the second position marker M2 displayed in the two-dimensional map.

[0076] Fourth example:

[0077] Refer to Figure 5 , a first window Q1 and a second window Q2 are displayed on the display screen of the second terminal. Among them, the first window Q1 displays an AR scene formed by combining a virtual image and current scene information, and the second window Q2 displays a two-dimensional map associated with the AR scene. And a first position marker M1 corresponding to the virtual image and a second position marker M2 corresponding to the second terminal are displayed in the two-dimensional map. As Figure 5As shown, in the AR scene displayed in the first window Q1, there is no virtual image corresponding to the first user. However, in this AR scene, there is an indication mark M3 for indicating the direction of the virtual image. At the same time, in the two-dimensional map displayed in the second window Q2, there are a first position mark M1 and a second position mark M2. Although the virtual image corresponding to the first user does not appear in the AR scene displayed in the first window Q1, there is an indication mark M3 in this AR scene. The second user can adjust the shooting angle of the second terminal according to the direction indicated by the indication mark M3, so as to find the virtual image and make the virtual image appear in this AR scene. In addition, the second user can also determine the specific position of the first user wearing the first terminal through the first position mark M1 and the second position mark M2 displayed in the two-dimensional map, so as to achieve a more effective person-searching effect.

[0078] In addition, another embodiment of the present application also provides an AR scene generation method applied to an AR scene generation system. The AR scene generation method includes but is not limited to the following steps:

[0079] Step A100, the first terminal sends status feature information and position information to the second terminal;

[0080] Step A200, the second terminal combines the status feature information and the pre-stored image features to form a virtual image corresponding to the status feature information;

[0081] Step A300, the second terminal obtains the current scene information, and combines the virtual image with the current scene information according to the position information to form an AR scene;

[0082] Step A400, the second terminal displays the AR scene.

[0083] In this embodiment, the status feature information includes one or more of motion state information, action amplitude information, and motion speed information.

[0084] In this embodiment, the position information includes horizontal coordinate information, or a combination of horizontal coordinate information and altitude information.

[0085] In addition, in another embodiment, the virtual image is prominently displayed in the AR scene.

[0086] In addition, in another embodiment, an indication mark for indicating the position of the virtual image is displayed in the AR scene.

[0087] In addition, in another embodiment, the AR scene generation method further includes but is not limited to the following steps:

[0088] Step A500, the second terminal displays a two-dimensional map corresponding to the current scene information;

[0089] Step A600, the second terminal displays a position marker corresponding to the virtual image in the two-dimensional map according to the position information.

[0090] It should be noted that the AR scene generation method applied to the AR scene generation system in the above-mentioned embodiments and the AR scene generation method applied to the second terminal in the above-mentioned embodiments are both based on the same inventive concept. The only difference between the two lies in the different emphasis on the main body. For example, the main body emphasized in the AR scene generation method applied to the second terminal in the above-mentioned embodiments is the second terminal, while the main body emphasized in the AR scene generation method applied to the AR scene generation system in the above-mentioned embodiments is the AR scene generation system including the first terminal and the second terminal. Therefore, the above two have the same beneficial effects, that is, the second terminal can form an AR scene according to the status feature information and position information sent by the first terminal, and in combination with the pre-stored image features in the second terminal and the current scene information obtained by the second terminal, and a virtual image corresponding to the user carrying the first terminal can be displayed in the AR scene, and the position of the virtual image in the AR scene corresponds to the position of the user in the current environment. Therefore, the specific position of the user in the current environment can be more intuitively determined through the AR scene, so as to improve the effect of finding people in the case of relatively complex surrounding environment or large number of people. In addition, since the above two have similar method principles and the only difference lies in the different emphasis on the main body, the method principle of the AR scene generation method applied to the AR scene generation system in this embodiment will not be elaborated here.

[0091] As Figure 6 shown, an embodiment of the present application provides a terminal. The terminal 200 is an intelligent terminal with a camera and a display screen, and the intelligent terminal has wireless communication capabilities, such as a smart phone, a tablet computer, a smart camera or smart glasses, etc.

[0092] Specifically, the terminal 200 includes: a memory 201, a processor 202, and a computer program stored on the memory 201 and executable on the processor 202.

[0093] The processor 202 and the memory 201 can be connected by a bus or other means, Figure 6 taking the connection by bus as an example.

[0094] It should be noted that the terminal 200 in this embodiment and Figure 1 the system structure platform 100 in the embodiment shown Figure 1 are based on the same inventive concept. The terminal 200 in this embodiment can form a part of the system structure platform 100 in the embodiment shown, so the two have the same implementation principle and beneficial effects, which will not be elaborated here.

[0095] The non-transitory software program and instructions required to implement the AR scene generation method applied to the second terminal in the above embodiments are stored in the memory 201. When executed by the processor 202, the AR scene generation method applied to the second terminal in the above embodiments is executed. For example, the method steps S100 to S400 described above are executed, Figure 2 and the method steps S500 to S600 in Figure 3 are executed.

[0096] In addition, an embodiment of the present application further provides an AR scene generation system, including a first terminal and a second terminal, where:

[0097] The first terminal sends status feature information and location information corresponding to the first terminal to the second terminal;

[0098] After receiving the status feature information and location information sent by the first terminal, the second terminal combines the status feature information and pre-stored image features to form a virtual image corresponding to the status feature information;

[0099] The second terminal obtains the current scene information, and combines the virtual image with the current scene information according to the location information to form an AR scene;

[0100] The second terminal displays the AR scene.

[0101] In addition, the second terminal can also display a two-dimensional map corresponding to the current scene information, and the second terminal can display a position marker corresponding to the virtual image in the two-dimensional map according to the location information.

[0102] Among them, the status feature information includes one or more of motion state information, action amplitude information, and motion speed information; the location information includes horizontal coordinate information, or a combination of horizontal coordinate information and altitude information.

[0103] It should be noted that the AR scene generation system in the above-mentioned embodiments and the AR scene generation method applied to the AR scene generation system in the above-mentioned embodiments are based on the same inventive concept. Therefore, the corresponding content of the AR scene generation method applied to the AR scene generation system in the above-mentioned embodiments also applies to the AR scene generation system in the above-mentioned embodiments, and will not be elaborated here.

[0104] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, that is, they may be located in one place, or may be distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0105] In addition, an embodiment of the present application further provides a computer-readable storage medium storing computer-executable instructions that are executed by a processor or a controller, for example, executed by Figure 6 a processor 202 in Figure 2 such that the above-mentioned processor 202 executes the AR scene generation method applied to the second terminal in the above embodiment, for example, executes the method steps S100 to S400 in Figure 3 and the method steps S500 to S600 in Figure 1 If executed in cooperation by a first processor 112 and a second processor 122 in

[0106] Those of ordinary skill in the art can understand that all or some of the steps and systems disclosed above can be implemented as software, firmware, hardware, and their appropriate combinations. Some physical components or all physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on a computer-readable medium, which can include a computer storage medium (or a non-transitory medium) and a communication medium (or a transitory medium). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information, such as computer-readable instructions, data structures, program modules, or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, communication media typically includes computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and can include any information delivery medium.

[0107] The above is a specific description of the preferred embodiment of the present application. However, the present application is not limited to the above embodiments. Those skilled in the art can make various equivalent deformations or substitutions without departing from the spirit of the present application, and these equivalent deformations or substitutions are all included in the scope defined by the claims of the present application.

Claims

1. An AR scene generation method, applied to a second terminal communicatively connected to a first terminal, comprising: Obtaining status feature information and location information of a user wearing the first terminal sent by the first terminal; Combining the status feature information and pre-stored image features to form a virtual image corresponding to the status feature information; Obtaining current scene information, and combining the virtual image with the current scene information according to the location information to form an augmented reality (AR) scene; Displaying the AR scene.

2. The AR scene generation method according to claim 1, wherein The virtual image is prominently displayed in the AR scene.

3. The AR scene generation method according to claim 1, wherein An indication marker for indicating the location of the virtual image is displayed in the AR scene.

4. The AR scene generation method according to claim 1, wherein It further includes the following steps: Displaying a two-dimensional map corresponding to the current scene information; Displaying a location marker corresponding to the virtual image in the two-dimensional map according to the location information.

5. The AR scene generation method according to any one of claims 1 to 4, characterized in that, The status feature information includes at least one of the following: Motion state information; Action amplitude information; Motion speed information.

6. The AR scene generation method according to any one of claims 1 to 4, characterized in that, The location information includes one of the following: Horizontal coordinate information; Horizontal coordinate information and altitude information.

7. An AR scene generation method, applied to a system, comprising: The first terminal sends status feature information and location information of a user wearing the first terminal to the second terminal; The second terminal combines the status feature information and pre-stored image features to form a virtual image corresponding to the status feature information; The second terminal obtains current scene information, and combines the virtual image with the current scene information according to the location information to form an AR scene; The second terminal displays the AR scene.

8. The AR scene generation method according to claim 7, characterized in that, The virtual image is prominently displayed in the AR scene.

9. The AR scene generation method according to claim 7, wherein An indication marker for indicating the location of the virtual image is displayed in the AR scene.

10. The AR scene generation method according to claim 7, wherein, It further includes the following steps: The second terminal displays a two-dimensional map corresponding to the current scene information; The second terminal displays a location marker corresponding to the virtual image in the two-dimensional map according to the location information.

11. The AR scene generation method according to claim 7 or 10, characterized in that The status feature information includes at least one of the following: Motion state information; Action amplitude information; Motion speed information.

12. The AR scene generation method according to claim 7 or 10, characterized in that, The location information includes one of the following: Horizontal coordinate information; Horizontal coordinate information and altitude information.

13. A terminal, comprising: A memory, a processor, and a computer program stored on the memory and executable on the processor, wherein when the processor executes the computer program, the AR scene generation method according to any one of claims 1 to 6 is implemented.

14. A computer-readable storage medium storing computer-executable instructions for executing the AR scene generation method according to any one of claims 1 to 6 or the AR scene generation method according to any one of claims 7 to 12.

Images