Scene picture display method and device, equipment and storage medium

Abstract

The invention discloses a scene picture display method and device, equipment and a storage medium, and relates to the technical field of computers and the Internet. The method comprises the steps that a first scene is shot, a picture, obtained through shooting, of the first scene is displayed, and the first scene is a real scene; in the picture of the first scene, displaying a first transmission door for connecting the first scene and a second scene, the second scene being a virtual scene; and after the terminal equipment moves to a first position in the first scene, displaying a picture of the second scene, the first position being a position corresponding to the first transmission door in the first scene. By displaying the transmission door in the picture of the real scene, the user can experience the process of transmitting the real scene to the virtual scene through the transmission door based on the movement of the terminal equipment, and the interaction mode is more diversified and novel. In addition, in the transmission process, the user needs to control the terminal device to move for interaction, and the immersion of the user is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer and Internet technology, and in particular, to a method, device, equipment and storage medium for displaying a scene image. Background Art

[0002] With the rapid development of information technology, augmented reality technology has gradually matured. Augmented reality aims to enhance human capabilities, provide humans with various auxiliary information, and become an important hub for communication between human individuals and the information world.

[0003] In the related technology, a shooting method based on augmented reality technology is provided. Based on the picture captured by the camera of the terminal device, a virtual model is placed at a fixed position on the picture for users to check in and take pictures. Users can take photos with the virtual model.

[0004] However, the interaction form of the above method is single. Summary of the invention

[0005] The embodiment of the present application provides a method, device, equipment and storage medium for displaying a scene image. The technical solution provided by the embodiment of the present application is as follows.

[0006] According to one aspect of an embodiment of the present application, a method for displaying a scene picture is provided, the method being executed by a terminal device, the method comprising:

[0007] Shooting a first scene and displaying a picture of the first scene obtained by shooting, wherein the first scene is a real scene;

[0008] In the screen of the first scene, a first transmission portal for connecting the first scene and a second scene is displayed, and the second scene is a virtual scene;

[0009] After the terminal device moves to a first position in the first scene, a picture of the second scene is displayed, and the first position is a position corresponding to the first transmission portal in the first scene.

[0010] According to one aspect of an embodiment of the present application, a display device for a scene image is provided, the device being arranged in a terminal device, the device comprising:

[0011] A shooting module, used for shooting a first scene and displaying a picture of the first scene obtained by shooting, wherein the first scene is a real scene;

[0012] A first display module, configured to display, in a screen of the first scene, a first transmission portal for connecting the first scene and a second scene, wherein the second scene is a virtual scene;

[0013] The second display module is used to display the picture of the second scene after the terminal device moves to the first position in the first scene, and the first position is the position corresponding to the first transmission portal in the first scene.

[0014] According to one aspect of an embodiment of the present application, a terminal device is provided, the terminal device comprising a processor and a memory, the memory storing a computer program, and the processor being used to execute the computer program to implement the above-mentioned method for displaying a scene picture.

[0015] According to one aspect of an embodiment of the present application, a computer-readable storage medium is provided, in which a computer program is stored. The computer program is loaded and executed by a processor to implement the above-mentioned method for displaying a scene picture.

[0016] According to one aspect of an embodiment of the present application, a computer program product is provided, wherein the computer program product comprises a computer program, and the computer program is loaded and executed by a processor to implement the above-mentioned method for displaying a scene picture.

[0017] The technical solution provided in the embodiments of the present application can bring the following beneficial effects:

[0018] By displaying a portal in the real scene, based on the movement of the terminal device, the user can experience the process of being transferred from the real scene to the virtual scene through the portal, and the interaction method is more diverse and novel.

[0019] In addition, during the transmission process, the user needs to control the movement of the terminal device and cross the portal. The changes in the display screen of the terminal device create a feeling of being transmitted from the real scene to the virtual scene through the portal, which enhances the user's sense of immersion. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 It is a schematic diagram of an implementation environment of a solution provided by an embodiment of the present application;

[0021] Figure 2 It is a schematic diagram of a related technology provided by an embodiment of the present application;

[0022] Figure 3 is a schematic diagram of a related technology provided by another embodiment of the present application;

[0023] Figure 4 is a flow chart of a method for displaying a scene image provided by an embodiment of the present application;

[0024] Figure 5 is a schematic diagram of a skybox model provided by an embodiment of the present application;

[0025] Figure 6 is a schematic diagram of a screen of a first scene provided by an embodiment of the present application;

[0026] Figure 7 is a schematic diagram of a first mark provided by an embodiment of the present application;

[0027] Figure 8 is a flow chart of a method for displaying a scene image provided by another embodiment of the present application;

[0028] Fig. 9 is a schematic diagram of an interactive screen of a virtual character provided by an embodiment of the present application;

[0029] Fig.10 is a schematic diagram of an interactive screen of virtual decoration provided by an embodiment of the present application;

[0030] Fig.11 is a schematic diagram of an interactive node provided by an embodiment of the present application;

[0031] Fig.12 is a schematic diagram of a first transmission portal displayed in a screen of a first scene provided by an embodiment of the present application;

[0032] Fig.13 is a schematic diagram of a first transmission portal displayed in a screen of a second scene provided by an embodiment of the present application;

[0033] Fig.14 is a block diagram of a display device for a scene image provided by an embodiment of the present application;

[0034] Fig.15 is a block diagram of a display device for a scene image provided by another embodiment of the present application;

[0035] Fig.16 This is a structural block diagram of a terminal device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0036] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0037] Please refer to Figure 1 , which shows a schematic diagram of a solution implementation environment provided by an embodiment of the present application. The solution implementation environment can be implemented as a system architecture of a certain application, and the application can provide a scene screen display function for the user. The solution implementation environment may include: a terminal device 100 and a server 200.

[0038] The terminal device 100 may be an electronic device such as a PC (Personal Computer), a tablet computer, a mobile phone, a wearable device, a vehicle terminal, a VR (Virtual Reality) device, an AR (Augmented Reality) device, an MR (Mixed Reality) device, etc. The terminal device 100 may be installed with a client running a target application, and the target application may provide a user with a scene screen display function. Exemplarily, the target application may be a game application, or a social application, a shopping application, a live broadcast application, a camera application, etc., which is not limited in this application. Exemplarily, the target application may display a screen of the first scene obtained by shooting the first scene, display a first portal in the screen of the first scene, and display a screen of the second scene after the terminal device moves to the first position in the first scene. Among them, the first scene is a real scene, the second scene is a virtual scene, the first portal is used to connect the first scene and the second scene, and the first position is the corresponding position of the first portal in the first scene. In addition, the present application does not limit the form of the target application, including but not limited to App (Application) installed in the terminal device 100, mini-programs, etc., and can also be in the form of a web page.

[0039] The server 200 may be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The server 200 may be a background server of the target application, used to provide background services for the client of the target application.

[0040] The terminal device 100 and the server 200 may communicate via a network, such as a wired or wireless network.

[0041] With the rapid development of information technology, augmented reality technology has gradually matured and has been gradually applied to people's lives. In the related technology, two application solutions of augmented reality technology are provided.

[0042] In one solution, based on the image captured by the camera of the terminal device, a virtual model is placed at a fixed position in the image for the user to take a photo and check in, and the user can take a photo with the virtual model. Figure 2 As shown, the virtual model 210 is displayed on the screen captured by the camera of the terminal device. At this time, if the user Figure 2 In the picture captured by the camera shown, the user can take a photo with the virtual model 210 to complete the photo check-in.

[0043] In another solution, an augmented reality model can be displayed based on WebAR (Web Augmented Reality) technology. Users can move the viewing angle of the screen by dragging the mouse, swiping left or right, zooming in or out, and view the content displayed on the screen in all directions. For example, Figure 3 As shown, the user can experience the perspective on the steps by clicking control 310, and can also view the scenery of the building in different seasons by clicking control 320.

[0044] However, of the two solutions mentioned above, the interactive form of Solution 1 is simple, which is just a form of taking photos and checking in with a virtual model and a real person; Solution 2 is based on seeing the picture on the terminal device, and moving the perspective through operations such as mouse or sliding, which lacks immersion.

[0045] The present application proposes a method for displaying scene images, which can display a first transmission portal in the image of the first scene obtained by shooting, and the first transmission portal is used to connect the first scene and the second scene, wherein the first scene is a real scene and the second scene is a virtual scene, and after the terminal device moves in the first scene to the position corresponding to the first transmission portal in the first scene, the image of the second scene is displayed. The user can experience the transmission from the real scene to the virtual scene, and browse the virtual scene by changing the viewing angle through the camera of the terminal device, and the interactive forms are diverse, which enhances the user's immersion.

[0046] Please refer to Figure 4 , which shows a flow chart of a method for displaying a scene screen provided by an embodiment of the present application. The method is executed by a terminal device, for example, by a client of a target application installed in the terminal device. The method may include at least one of the following steps 410 to 430.

[0047] Step 410, photographing a first scene and displaying a picture of the first scene obtained by photographing the first scene, where the first scene is a real scene.

[0048] In some embodiments, the picture of the first scene is a picture of the first scene obtained by shooting the first scene in real time.

[0049] In some embodiments, the first scene is photographed by a camera, and a picture of the first scene obtained by the photographing is displayed.

[0050] In some embodiments, the camera used to shoot the first scene may be a camera of the terminal device, an external camera connected to the terminal device, or a camera of another terminal device that has established a communication connection with the terminal device, and this application does not limit this. The camera of the terminal device refers to a camera integrated in the terminal device, which is used to implement the shooting function of the terminal device.

[0051] In some embodiments, the first scene is photographed by a camera of the terminal device, and a picture of the first scene obtained by the photographing is displayed.

[0052] In some embodiments, the first scene is photographed by an external camera of the terminal device, and the photographed image of the first scene is displayed.

[0053] In some embodiments, the first scene is photographed by a camera of a first terminal device, and the photographed image of the first scene is displayed on a second terminal device, wherein the first terminal device and the second terminal device are different terminal devices.

[0054] In some embodiments, the captured image of the first scene may be saved as a picture or a video, or may not be saved, and this application does not limit this. In some embodiments, the user may choose whether to save the captured image of the first scene. In some embodiments, the user may also choose to save the image of the first scene as a picture format or a video format.

[0055] In some embodiments, only the captured image of the first scene may be saved, or the image of the first scene and the first portal displayed in the image of the first scene may be saved.

[0056] Step 420: Display a first portal for connecting the first scene and the second scene in the screen of the first scene, where the second scene is a virtual scene.

[0057] In some embodiments, while displaying the picture of the first scene, a first transmission portal is displayed in the picture of the first scene.

[0058] In some embodiments, when the screen of the first scene is displayed, in response to a placement operation on the first transmission portal, the first transmission portal is displayed in the screen of the first scene. Exemplarily, in response to a click operation on the first transmission portal, the first transmission portal is displayed in the screen of the first scene.

[0059] In some embodiments, when a screen of the first scene is displayed, a first mark is displayed in the screen of the first scene; in response to an operation on the first mark, a first transmission portal is displayed at the first mark. Exemplarily, in response to a click operation on the first mark, the first transmission portal is displayed at the first mark.

[0060] The first mark is used to identify a preset position of the first portal in the picture of the first scene.

[0061] In some embodiments, when a screen of a first scene is displayed, in response to a placement operation on a first transmission portal, a first mark is displayed in the screen of the first scene; in response to an operation on the first mark, a first transmission portal is displayed at the first mark.

[0062] In some embodiments, when the screen of the first scene is displayed, the first content is displayed through the first portal, and the first content is part of the content in the second scene observed through the first portal. For example, the second scene displays a desk, a blackboard, and a bookshelf, and when the screen of the first scene is displayed, the desk can be displayed through the first portal.

[0063] In some embodiments, the first content may change as the viewing angle of the terminal device relative to the first position changes, and the first position is the position corresponding to the first portal in the first scene. For example, a desk, a blackboard, and a bookshelf are displayed in the second scene. When the screen of the first scene is displayed, the desk can be displayed through the first portal. As the terminal device moves, the desk is displayed through the first portal instead of the bookshelf.

[0064] In some embodiments, the second scene may be a virtual scene such as an e-sports museum, a virtual character's room, a store, a secret room, a maze, etc. The second scene may include an interactive model. For example, the second scene is an e-sports museum, and there may be photos hanging on the wall in the e-sports museum. Clicking on the photos can play a video. For example, the second scene is a virtual character's room, and clicking on the virtual character can interact with the virtual character such as greeting and simple communication.

[0065] Step 430, after the terminal device moves to the first position in the first scene, the screen of the second scene is displayed, and the first position is the position corresponding to the first portal in the first scene.

[0066] In some embodiments, the second scene is a virtual scene constructed based on a skybox. In some embodiments, the second scene is a 360-degree panoramic virtual scene constructed based on a skybox. Figure 5 As shown, the second scene 510 is a panoramic virtual scene, area 520 is the first portal, character 530 is the relative position of the user in the second scene, and the user is in the first scene and can view content with the same perspective as character 530 through the terminal device.

[0067] In some embodiments, the second scene may be a simulation scene of the real world, a semi-simulation and semi-fictional scene, or a purely fictional scene, which is not limited in the present application.

[0068] In some embodiments, the display style of the second scene is related to the time period of the real world. For example, if the real world is daytime, the second scene in the virtual daytime period is displayed; if the real world is nighttime, the second scene in the virtual nighttime period is displayed. The virtual daytime period refers to the daytime period in the virtual scene, and the virtual nighttime period refers to the nighttime period in the virtual scene.

[0069] In some embodiments, the display style of the second scene is independent of the time period of the real world. For example, no matter whether the real world is daytime or nighttime, the second scene in the virtual daytime period is always displayed.

[0070] In some embodiments, the present application does not limit the division of the display style of the second scene. Exemplarily, the display style of the second scene may include a second scene in a virtual daytime period, a second scene in a virtual nighttime period, a second scene in a virtual dusk period, a second scene in a virtual early morning period, and other display styles divided according to time periods. Exemplarily, the display style of the second scene can also be divided based on the four seasons of spring, summer, autumn, and winter. Exemplarily, the display style of the second scene can be divided in a combination of the four seasons and time periods, such as the second scene in a virtual daytime period in spring, the second scene in a virtual nighttime period in summer, the second scene in a virtual dusk period in autumn, the second scene in a virtual early morning period in winter, and so on. The virtual dusk period refers to the dusk period in the virtual scene, and the virtual early morning period refers to the early morning period in the virtual scene.

[0071] In the embodiment of the present application, only the display style of the second scene is exemplified, and the display style of the second scene can be divided in various ways. For example, the display style of the second scene can be implemented based on the design ideas of the designer, and can also be implemented based on user customization.

[0072] In some embodiments, in response to the terminal device moving in the first scene, the image of the first scene captured by the camera of the terminal device is synchronously displayed on the screen of the terminal device. In this process, the relative position of the first portal in the first scene remains unchanged. Figure 6 As shown, a first transmission portal 620 is displayed in a screen 610 of the first scene. In response to movement of the terminal device, the screen of the first scene changes from 610 to 630, and at this time, the relative position of the first transmission portal 620 in the first scene remains unchanged.

[0073] In some embodiments, in the first scene, a second position corresponding to the terminal device is determined, and the second position changes as the terminal device moves; the distance between the second position and the first position is determined; when displaying the picture of the first scene, if the distance between the second position and the first transmission portal gradually increases after passing the first position, the picture of the second scene is displayed.

[0074] In some embodiments, when the screen of the first scene is displayed, after the second position passes the first position, the distance between the first position and the second position is confirmed as a negative value; when the screen of the second scene is displayed, after the second position passes the first position, the distance between the first position and the second position is confirmed as a positive value. The above method can distinguish the scene currently displayed by the terminal device.

[0075] In some embodiments, when the screen of the second scene is displayed, after the terminal device moves to the first position in the first scene, the screen of the first scene is displayed. In other words, the user can get the feeling of being transported from the virtual scene back to the real scene through the portal through the change of the display screen of the terminal device.

[0076] The technical solution provided in the embodiment of the present application displays a portal in the screen of the real scene. Based on the movement of the terminal device, the user can experience the process of being transferred from the real scene to the virtual scene through the portal, and the interaction method is more diverse and novel.

[0077] In addition, during the transmission process, the user needs to control the movement of the terminal device and cross the portal. The changes in the display screen of the terminal device create a feeling of being transmitted from the real scene to the virtual scene through the portal, which enhances the user's sense of immersion.

[0078] In some embodiments, the picture of the first scene may be captured by a camera in real time, or may be a picture or video captured by a camera.

[0079] In some embodiments, the camera used to shoot the first scene may be a camera of a terminal device, an external camera connected to the terminal device, or a camera of another terminal device that has established a communication connection with the terminal device. This application does not limit this.

[0080] For the above situation, the present application provides the following embodiments for detailed description.

[0081] 1. The image of the first scene is obtained by real-time shooting of the first scene. 1.1. The camera shooting the first scene is the camera of the terminal device.

[0082] In this case, the terminal device is a terminal device that displays a screen of the first scene.

[0083] In some embodiments, in response to the camera function of the terminal device being turned on, the first scene is photographed and a picture of the first scene obtained by the photographing is displayed.

[0084] In some embodiments, the camera function of the terminal device can be enabled by an application that provides a method for displaying the scene image, or it can be enabled by the system of the terminal device, and this application does not limit this.

[0085] In some embodiments, in response to the movement of the terminal device, a picture of the first scene captured by the terminal device after the movement is displayed, and the relative position of the first portal in the picture of the first scene remains unchanged.

[0086] In some embodiments, since the movement of the terminal device is a continuous process, in order to facilitate the display of the screen of the first scene, the screen of the first scene can be updated and displayed at intervals. Exemplarily, in response to the terminal device being in a moving state, the screen of the first scene is updated and displayed at intervals of a first duration. For example, the first duration is t, where t is a natural number greater than 0, such as t is 0.01 seconds. The shorter the first duration, the more continuous the change of the screen of the first scene displayed on the terminal device, and the longer the first duration, the less the processing resources of the terminal device are consumed by the terminal device to update and display the screen of the first scene.

[0087] Through the above method, the user can experience the process of transferring from a real scene to a virtual scene by using a terminal device, such as a mobile phone, and the requirements for the terminal device are low.

[0088] 1.2. The camera used to shoot the first scene is an external camera connected to the terminal device.

[0089] In this case, the terminal device is a terminal device that displays a screen of the first scene.

[0090] In some embodiments, the external camera moves synchronously with the terminal device, that is, the external camera moves in the same manner as the terminal device. For example, if the terminal device moves forward 1m, the external camera also moves forward 1m. In this case, in response to the movement of the terminal device, the image of the first scene captured by the external camera after the movement is displayed, and the relative position of the first portal in the image of the first scene remains unchanged. Under this method, there is no need to process the image of the first scene captured by the external camera, and the processing resources of the terminal device are consumed less.

[0091] In some embodiments, the external camera does not move synchronously with the terminal device. For example, no matter how the terminal device moves, the external camera does not move. In this case, first, according to the position of the external camera, a third position is determined in the picture of the first scene, the third position is the corresponding position of the external camera in the picture of the first scene, the third position is determined as the initial position of the terminal device in the picture of the first scene, and a virtual camera is set at the third position, and the virtual camera is in an invisible state. In response to the movement of the terminal device, the movement trajectory of the terminal device is determined, the position and parameters of the virtual camera are adjusted according to the movement trajectory of the terminal device, and the picture of the first scene captured by the adjusted virtual camera is displayed. The picture of the first scene captured by the virtual camera includes a first portal.

[0092] In some embodiments, the movement trajectory of the terminal device includes a translation trajectory and a rotation trajectory of the terminal device. According to the translation trajectory of the terminal device, the position of the virtual camera is adjusted, and according to the rotation trajectory of the terminal device, the position and parameters of the virtual camera are adjusted. The parameters of the virtual camera are parameters that affect the shooting picture of the virtual camera, such as the field of view angle obtained by the virtual camera.

[0093] In the above method, the images captured by the external camera need to be processed based on the movement of the terminal device before being displayed, which has high real-time requirements, places great computing pressure on the terminal device, and places high requirements on the terminal device.

[0094] In some embodiments, the external camera does not move synchronously with the terminal device. For example, no matter how the external camera moves, the terminal device does not move. In this case, in response to the movement of the terminal device, the image of the first scene captured by the external camera after the movement is displayed, and the relative position of the first portal in the image of the first scene remains unchanged. Under this method, there is no need to process the image of the first scene captured by the external camera, and the processing resources of the terminal device are consumed less, but the user does not need to control the terminal device to move, and the immersion is poor.

[0095] 1.3. The camera that captures the first scene is a camera of another terminal device that has established a communication connection with the terminal device.

[0096] For example, a camera that shoots a first scene is a camera of a first terminal device, and a terminal device that displays a picture of the first scene is a second terminal device.

[0097] In some embodiments, the first terminal device moves synchronously with the second terminal device, that is, the first terminal device moves in the same manner as the second terminal device. For example, if the second terminal device moves forward 1m, the first terminal device also moves forward 1m. In this case, in response to the movement of the second terminal device, the image of the first scene captured by the first terminal device after the movement is displayed, and the relative position of the first portal in the image of the first scene remains unchanged. Under this method, there is no need to process the image of the first scene captured by the first terminal device, and the processing resources of the second terminal device are consumed less.

[0098] In some embodiments, the first terminal device does not move synchronously with the second terminal device. For example, no matter how the second terminal device moves, the first terminal device does not move. In this case, firstly, according to the position of the first terminal device, a fourth position is determined in the screen of the first scene, the fourth position is the corresponding position of the first terminal device in the screen of the first scene, the fourth position is determined as the initial position of the second terminal device in the screen of the first scene, and a virtual camera is set at the fourth position, and the virtual camera is in an invisible state. In response to the movement of the second terminal device, the movement trajectory of the second terminal device is determined, the position and parameters of the virtual camera are adjusted according to the movement trajectory of the second terminal device, and the screen of the first scene captured by the adjusted virtual camera is displayed. The screen of the first scene captured by the virtual camera includes the first portal. In this method, it is necessary to process the screen captured by the first terminal device based on the movement of the second terminal device before displaying it, which has high real-time requirements, high computing pressure on the second terminal device, and high requirements on the second terminal device.

[0099] In some embodiments, the first terminal device does not move synchronously with the second terminal device. For example, no matter how the first terminal device moves, the second terminal device does not move. In this case, in response to the movement of the second terminal device, the picture of the first scene captured by the first terminal device after the movement is displayed, and the relative position of the first portal in the picture of the first scene remains unchanged. Under this method, there is no need to process the picture of the first scene captured by the first terminal device, and the processing resources of the second terminal device are consumed less, but the user does not need to control the movement of the second terminal device, and the immersion is poor.

[0100] 2. The first scene is a picture or video taken by the camera

[0101] In this case, the camera that captures the image of the first scene has little impact on the solution.

[0102] In some embodiments, first, according to the position of the terminal device, a fifth position is determined in the picture of the first scene, the fifth position is the position corresponding to the camera in the picture of the first scene, the fifth position is determined as the initial position of the terminal device in the picture of the first scene, and a virtual camera is set at the fifth position, and the virtual camera is in an invisible state. In response to the movement of the terminal device, the movement trajectory of the terminal device is determined, the position and parameters of the virtual camera are adjusted according to the movement trajectory of the terminal device, and the picture of the first scene captured by the adjusted virtual camera is displayed. The picture of the first scene captured by the virtual camera includes a first portal. In this method, based on the movement of the terminal device, the picture captured by the first terminal device needs to be processed and then displayed, which has high real-time requirements, high computing pressure on the terminal device, and high requirements on the terminal device.

[0103] If the picture of the first scene is a video taken by a camera, the terminal device may not move, and based on the passage of time, as the video is played, the user experiences the process of being transferred from the real scene to the virtual scene.

[0104] If the picture of the first scene is a picture taken by a camera, the user's operation of rotating the terminal device to change the viewing angle in the first scene may not be satisfied.

[0105] In this method, there is no need to call the camera of the terminal device, and the process of transferring from the real scene to the virtual scene can be experienced based on historical pictures or videos.

[0106] In some embodiments, the technical solution provided in the embodiments of the present application may also be applied to an environment where one virtual scene is transmitted to another virtual scene, and the present application does not limit this.

[0107] In some embodiments, before displaying the first transmission portal, the user needs to determine the position corresponding to the first transmission portal in the first scene. In this regard, the present application provides the following embodiments. The method may include at least one of the following steps 1 to 2.

[0108] Step 1: display a first mark in a picture of a first scene.

[0109] The first mark is used to indicate a preset position of the first transmission portal in the picture of the first scene.

[0110] In some embodiments, the present application does not limit the style of the first mark. For example, the first mark can be a circular mark, a rectangular mark, or a Figure 7 Mark 711 shown.

[0111] In some embodiments, a sixth position is determined in the screen of the first scene, and the first mark is displayed at the sixth position. The sixth position may be any position in the screen of the first scene, or may be a position determined in the screen of the first scene based on a specific rule.

[0112] In some embodiments, the method of displaying the first mark in the picture of the first scene may include at least one of the following steps.

[0113] Step A: performing plane recognition on the picture of the first scene to determine the first plane in the picture of the first scene.

[0114] In some embodiments, the terminal device analyzes the image of the first scene, extracts feature points in the image of the first scene, calculates the three-dimensional spatial information of the feature points, processes the three-dimensional spatial information of the feature points, and determines the first plane. In some embodiments, the first plane is calibrated according to information such as the position and boundary direction of the first plane.

[0115] In some embodiments, the feature points are generally points in the picture of the first scene where the brightness, intensity, and color change greatly, so the feature points are usually points at corner positions.

[0116] In some embodiments, VIO (Visual-Inertial Odometry) and IMU (Inertial Measurement Units) are used to calculate the three-dimensional spatial information of feature points.

[0117] In some embodiments, the first plane may be a horizontal plane or a vertical plane. In some embodiments, the terminal device may only recognize the horizontal plane, may only recognize the vertical plane, or may recognize both the horizontal plane and the vertical plane, which is not limited in this application.

[0118] Step B, determining the center position of the first plane.

[0119] Step C, displaying a first mark at the center position.

[0120] In some embodiments, the first mark may not be displayed at the median position of the first plane. For example, a position is randomly determined in the first plane and the first mark is displayed at the position.

[0121] In some embodiments, the user can arbitrarily adjust the position of the first mark in the first plane.

[0122] In some embodiments, in response to the movement of the terminal device, the picture of the first scene changes, and the position of the first mark in the picture of the first scene also changes.

[0123] In some embodiments, if the terminal device moves, the terminal device re-executes the above steps A to C in the screen of the first scene after the movement, re-determines the position of the first mark and displays the first mark.

[0124] For example, Figure 7 As shown, if the terminal device moves, the picture of the first scene changes from picture 710 to picture 720, and the position of the first mark also changes from position 711 to position 721.

[0125] Step 2: In response to an operation on the first mark, display a first transmission portal at the first mark.

[0126] In some embodiments, in response to a confirmation operation on the first mark, a first transfer portal is displayed at the first mark.

[0127] In some embodiments, in response to an adjustment operation on the first mark, a display position of the first mark in the picture of the first scene is adjusted.

[0128] The operation mentioned in the embodiment of the present application can be at least one of the following operations: click operation, double-click operation, slide operation, long press operation, drag operation. Of course, the specific operation can be implemented based on the design of the designer, and the present application does not limit this.

[0129] In some embodiments, the above content can be implemented through an AR system, for example, by determining the position of the first marker through an AR tracker.

[0130] Please refer to Figure 8 , which shows a flow chart of a method for displaying a scene screen provided by an embodiment of the present application. The terminal device performs plane recognition on the screen of the first scene, determines the first plane in the screen of the first scene, determines the position of the first mark in the first plane, and displays the first mark (plane recognition, display anchor point); in response to the operation on the first mark, displays the first portal in the screen of the first scene (click the anchor point to place the model); according to the movement of the terminal device, adjust the displayed screen (monitor movement). If the terminal device enters the first portal from the first scene (enters the portal), the screen of the first scene is switched to the screen of the second scene (switch the virtual world perspective), and the user can interact with the content displayed in the screen of the second scene (click on the object to generate interaction). If the terminal device enters the first portal from the second scene (moves away from the portal), the screen of the second scene is switched to the screen of the first scene (switch the real world perspective).

[0131] Through the above method, the user can determine the display position of the first portal in the picture of the first scene by himself, which can avoid the first portal being displayed in a position that is difficult to reach and affecting the user experience.

[0132] In some embodiments, the user can interact with the content displayed in the screen of the second scene. In this regard, the present application provides the following embodiments.

[0133] In some embodiments, the content displayed in the second scene includes the following two parts: an original model of the second scene and an added model.

[0134] The original model of the second scene refers to the model that cannot be changed in the second scene. In other words, the original model and the second scene are a whole and cannot be separated. The added model refers to the model added on the basis of the second scene. The added model can be user-defined or selected by the user based on the candidate models provided by the application. User-defined refers to the model uploaded to the application by the user.

[0135] In some embodiments, the content displayed in the second scene may be divided into an interactive model and a non-interactive model according to whether interaction is possible.

[0136] In some embodiments, after step 430, step 440 ( Figure 4 not shown).

[0137] Step 440: In response to the operation on the interactive model in the second scene, the interactive screen of the interactive model is displayed in the screen of the second scene.

[0138] In some embodiments, the interactive model may include virtual characters, virtual props, virtual decorations, etc., which is not limited in this application.

[0139] For example, Fig. 9 As shown, in response to the operation on the virtual character 910, the interactive screen of the virtual character 910 is displayed in the screen of the second scene. For example, the virtual character 910 is displayed in a greeting gesture, and a dialogue welcome is displayed.

[0140] For example, Fig.10 As shown, in response to the operation on the virtual decoration 1010, the interactive screen of the virtual decoration 1010 is displayed in the screen of the second scene. For example, the virtual decoration 1010 is switched from the "click plant watering" state to the "complete watering" state.

[0141] In some embodiments, in response to the operation of obtaining the interactive model in the second scene, the interactive screen of the interactive model is displayed in the screen of the second scene, and the corresponding interactive sound effect is played. Fig. 9As shown, in response to the operation on the virtual character 910, the interactive screen of the virtual character 910 is displayed in the screen of the second scene, and the interactive sound effect "Welcome" of the virtual character 910 is played. Fig.10 As shown, in response to the operation on the virtual decoration 1010, the interactive screen of the virtual decoration 1010 is displayed in the screen of the second scene, and the sound effect of watering is played.

[0142] In some embodiments, an interaction node is added to any interactive model displayed in the second scene. The interaction node is used to identify operations on the interactive model. The interaction node is invisible in the screen of the second scene.

[0143] In some embodiments, the original model in the second scene does not have interactive capabilities, and needs to add interactive nodes to it to make it interactive. In some embodiments, the interactive nodes are used to detect touch events. In some embodiments, the interactive nodes are geometric bodies with a volume similar to that of the interactive model. For example, Fig.11 As shown, interaction nodes 1121-1123 are added to the first model 1110, and the interaction nodes are used to detect touch events.

[0144] In some embodiments, the first model is a gltf (Graphics Language Transmission Format) model. This cross-platform format has become the standard for 3D objects on the Web. It is defined by OpenGL (Open Graphics Library) and Vulkan (Vulkan is called the "next version of OpenGL" and aims to provide lower CPU (Central Processing Unit) overhead and more GPU (Graphics Processing Unit) control. This makes GLTF basically the JPG (Joint Photographic Experts Group) format of 3D models: a universal standard for Web export.

[0145] Through the above method, the user can interact with the content displayed in the second scene, and the interaction mode is more diverse. And it can be applicable to various sky box models, and supports the interactive function of elements in the sky box model, and also supports placing other models in the sky box model, and can quickly update the interactive content, with high flexibility and scalability. Of course, the technical solution provided by the embodiment of the present application is also applicable to other models or scenes such as illumination models, and the present application will not repeat them here.

[0146] In some embodiments, the user can see the content in another scene through the first portal.

[0147] In some embodiments, when displaying a picture of a first scene, first content is displayed through a first transmission portal, and the first content is a portion of content in a second scene observed through the first transmission portal.

[0148] For example, Fig.12 As shown, part of the content in the second scene can be observed through the first transmission portal 1210.

[0149] In some embodiments, the parameters of the first model are set to the first parameters, the first model is the model corresponding to the second scene, and the first model under the first parameters is in an unobservable state; the first area occupied by the first portal on the first model is determined, and the parameters of the first area are set to the second parameters, and the first area under the second parameters is in a transparent state; wherein the first content is displayed through the first area in the transparent state.

[0150] In some embodiments, when displaying a picture of a second scene, second content is displayed through the first transmission portal, and the second content is a portion of the content in the first scene observed through the first transmission portal.

[0151] For example, Fig.13 As shown, part of the content in the first scene can be observed through the first transmission portal 1310.

[0152] In some embodiments, the parameters of the first model are initialized to third parameters, the first model under the third parameters is in an observable state, and the first model is the model corresponding to the second scene; the first area occupied by the first portal on the first model is determined, and the orientation of the first area is set to be from inside to outside; wherein the second content is displayed through the first area which is oriented from inside to outside.

[0153] In some embodiments, when the display switches from the screen of the first scene to the screen of the second scene, the parameters of the first model are adjusted from the first parameters to the third parameters; when the display switches from the screen of the second scene to the screen of the first scene, the parameters of the first model are adjusted from the third parameters to the first parameters.

[0154] In some embodiments, when displaying the screen of the first scene, it is necessary to ensure that the first model is in an unobservable state. When the screen of the first scene is switched to display the screen of the second scene, the first model needs to be adjusted from an unobservable state to an observable state, so the parameters of the first model need to be adjusted from the first parameters to the third parameters. Similarly, when the screen of the second scene is switched to display the screen of the first scene, the parameters of the first model need to be adjusted from the third parameters to the first parameters.

[0155] In some embodiments, when the screen of the first scene is displayed, the direction of the first transmission portal is from outside to inside, that is, the second scene is observed from the first scene, and when the screen of the second scene is displayed, the first transmission portal is used to observe the first scene from the second scene, so its direction is from inside to outside. When switching between the screens displaying the first scene and the second scene, it is necessary to consider adjusting the direction of the first transmission portal.

[0156] In some embodiments, the content displayed in the first transmission portal may change as the terminal device moves. For example, if the angle of the second position relative to the first position changes, the content displayed in the first transmission portal also changes accordingly.

[0157] In some embodiments, the content displayed in the first transmission portal is determined based on the relative relationship between the second position and the first position. Exemplarily, the content displayed in the first transmission portal is determined based on the angle between the line between the second position and the first position and the line passing through the first position and perpendicular to the first transmission portal.

[0158] Through the above method, the user can observe another scene through the portal, thereby enhancing the user's sense of immersion.

[0159] In some embodiments, the user can determine the second scene and the content displayed in the second scene by himself.

[0160] In some embodiments, the scene image display method provided in the embodiment of the present application further includes at least one of the following steps 450 to 460: Figure 4 not shown).

[0161] Step 450: display at least one candidate scene.

[0162] In some embodiments, at least one candidate scene may be provided by an application or uploaded by a user.

[0163] Step 460: In response to an operation on a target scene in at least one candidate scene, determine the target scene as a second scene.

[0164] In some embodiments, in response to a selection operation on a target scene from at least one candidate scene, the target scene is determined to be the second scene.

[0165] In some embodiments, multiple target scenes may be selected from at least one candidate scene, and the second scene may be determined from the multiple target scenes. Exemplarily, two target scenes, target scene 1 and target scene 2, are selected from at least one candidate scene.

[0166] In some embodiments, when multiple target scenes are selected, multiple portals may be displayed in the screen of the first scene, corresponding to the multiple target scenes respectively, or only one portal may be displayed in the screen of the first scene.

[0167] In some embodiments, when multiple portals are displayed in the screen of the first scene, and they correspond to the multiple target scenes respectively, the marking information of the target scene corresponding to the portal can be displayed on the portal displayed in the screen of the first scene. The marking information can be the name of the target scene, or it can be the information of the target scene marked by the thumbnail of the target scene. For example, if portal 1 displayed in the screen of the first scene corresponds to target scene 1, target scene 1 is displayed on portal 1.

[0168] In some embodiments, when a portal is displayed in the screen of the first scene, when the screen of the first scene is switched to display the screen of the second scene, a target scene can be randomly determined from multiple target scenes as the second scene, and the screen of the target scene can be displayed. In some embodiments, multiple target scenes can have corresponding weights respectively, and the weights of each target scene can be the same or different. The weight of the target scene is used to indicate the probability that the target scene is determined to be the second scene. For example,

[0169] In some embodiments, when a portal is displayed in the screen of the first scene, multiple target scenes are sorted, and the second scene is determined according to the sorting of the target scenes.

[0170] In some embodiments, when the screen of the first scene is switched to the screen of the second scene for the i-th time, the i-th target scene is determined as the second scene, and the screen of the i-th target scene is displayed, where i is an integer greater than 0. For example, when the screen of the first scene is switched to the screen of the second scene for the first time, the first target scene is determined as the second scene, and the screen of the first target scene is displayed; when the screen of the first scene is switched to the screen of the second scene for the second time, the second target scene is determined as the second scene, and the screen of the second target scene is displayed.

[0171] In some embodiments, when the scene screen is switched for the kth time, the screen of the kth target scene is displayed, and when the scene screen is switched for the N+1th time, the screen of the first scene is displayed, wherein k and N are integers greater than 0, and N is the number of target scenes. When the scene screen is switched for the first time, that is, when the screen of the first scene is switched to the screen of another scene through the portal for the first time, the screen of the first target scene is displayed, when the scene screen is switched for the second time, the screen of the second target scene is displayed, and when the scene screen is switched for the N+1th time, the screen of the first scene is displayed.

[0172] Through the above method, users can experience multiple virtual scenes to increase the fun.

[0173] In some embodiments, step 460 may be performed before step 420, may be performed after step 420, or may be performed simultaneously with step 420, which is not limited in the present application.

[0174] In some embodiments, step 420 may be implemented as follows: in response to an operation on a target scene in at least one candidate scene, determining the target scene as the second scene, and displaying the first portal in the screen of the first scene.

[0175] In some embodiments, in response to an operation on a target scene in at least one candidate scene, the target scene is determined to be a second scene, and a first mark is displayed in a screen of the first scene; in response to an operation on the first mark, a first portal is displayed at the first mark. The first portal is used to connect the first scene and the second scene.

[0176] Through the above method, the user can choose the second scene to experience by himself, which can better meet the personalized needs of the user.

[0177] In some embodiments, in some embodiments, the scene screen display method provided by the embodiment of the present application further includes at least one of the following steps 470 to 480 ( Figure 4 not shown).

[0178] Step 470: display at least one candidate model, where the candidate model includes at least one of the following: a candidate virtual character, a candidate virtual prop, and a second portal.

[0179] In some embodiments, at least one candidate model may be provided by an application or uploaded by a user.

[0180] Step 480 , in response to an operation on a target model in at least one candidate model, adding the target model to the second scene, and displaying the target model in a screen of the second scene.

[0181] In some embodiments, in response to an operation on a target model among at least one candidate model, the target model in an unadded state is displayed in a screen of a second scene; in response to an operation on the target model in an unadded state, the target model is added to the second scene, and the target model is displayed in the screen of the second scene.

[0182] In some embodiments, in response to an adjustment operation on the target model in the unadded state, a display position of the target model in the unadded state in the picture of the second scene is adjusted.

[0183] In some embodiments, in response to a confirmation operation for a target model in an unadded state, a target model is added to the second scene, and the target model is displayed in the screen of the second scene, and the display position of the target model in the screen of the second scene is the display position of the target model in the unadded state in the screen of the second scene when the confirmation operation is performed.

[0184] Next, an example will be given in which the target model is the second portal.

[0185] In some embodiments, when the target model is the second transmission portal, step 480 may include at least one of the following sub-steps.

[0186] Step 1: display a second mark in a picture of a second scene.

[0187] Step 2: In response to the operation on the second mark, add a second portal at the second mark, and display the second portal in the picture of the second scene.

[0188] In some embodiments, the second portal is used to connect the second scene and the third scene.

[0189] In some embodiments, the third scene can be a different scene from the second scene, or can be the same scene as the second scene, and this application does not limit this. If the user adds multiple portals in the first model, different portals can connect different scenes, and the user can build a maze based on the connection relationship between the portals and different scenes.

[0190] In some embodiments, the third scene may be the first scene, or may be different from the first scene, which is not limited in this application.

[0191] In some embodiments, the third scene is the same as the first scene, that is, the second portal is used to connect the second scene with the first scene, then the functions of the first portal and the second portal can be distinguished, for example, the first portal and the second portal are set as one-way portals, the first portal can only be used to transmit from the first scene to the second scene, and the second portal can only be used to transmit from the second scene to the first scene.

[0192] In some embodiments, the third scene is the same as the first scene, and the usage counts of the first and second portals can be set. For example, the usage count of the first portal is set to 1, that is, after teleporting from the first scene to the second scene, the first portal disappears and needs to be teleported back to the first scene through the second portal.

[0193] It should be noted that the above situations can be combined arbitrarily to obtain different combination schemes, and each combination scheme should belong to the protection scope of this application, and this application will not go into details one by one.

[0194] Through the above method, users can design the second scene, which is more participatory and has richer interactive methods.

[0195] In some embodiments, the technical solution provided by the embodiments of the present application can be applied in mini-programs. Mini-programs can be developed based on XR-frame (Extended Reality-frame) capabilities. XR-frame is implemented based on the A-frame framework, so Web (network) applications developed using the A-Frame framework can also implement the technical solution provided by the embodiments of the present application. In addition to Web-XR technology, game engines can also be used to develop target applications, not limited to mini-programs.

[0196] Using the WebXR technology of the mini program allows users to experience AR interaction on the mini program and can easily share it with friends, which is conducive to the dissemination of the target application's products.

[0197] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0198] Please refer to Fig.14 , which shows a block diagram of a scene screen display device provided by an embodiment of the present application. The device has the function of implementing the above-mentioned scene screen display method, and the function can be implemented by hardware, or by hardware executing corresponding software. The device can be the terminal device described above, or it can be set in the terminal device. Fig.14 As shown, the device 1400 may include: a shooting module 1410 , a first display module 1420 , and a second display module 1430 .

[0199] The shooting module 1410 is used to shoot a first scene and display a picture of the first scene obtained by shooting. The first scene is a real scene.

[0200] The first display module 1420 is used to display a first portal for connecting the first scene and a second scene in the screen of the first scene, where the second scene is a virtual scene.

[0201] The second display module 1430 is used to display the picture of the second scene after the terminal device moves to a first position in the first scene, and the first position is a position corresponding to the first transmission portal in the first scene.

[0202] In some embodiments, the first display module 1420 is used to display a first mark in the screen of the first scene; in response to an operation on the first mark, the first portal is displayed at the first mark.

[0203] In some embodiments, the first display module 1420 is used to perform plane recognition on the picture of the first scene, determine a first plane in the picture of the first scene; determine a center position of the first plane; and display the first mark at the center position.

[0204] In some embodiments, the second display module 1430 is used to determine a second position corresponding to the terminal device in the first scene, the second position changes as the terminal device moves; determine the distance between the second position and the first position; when displaying the picture of the first scene, if the distance between the second position and the first transmission portal gradually increases after passing the first position, then the picture of the second scene is displayed.

[0205] In some embodiments, Fig.15 As shown, the device 1400 also includes a third display module 1440 .

[0206] The third display module 1440 is used to display the interactive screen of the interactive model in the screen of the second scene in response to the operation on the interactive model in the second scene.

[0207] In some embodiments, Fig.15 As shown, the device 1400 also includes an adding module 1450 .

[0208] The adding module 1450 is used to add an interactive node for any interactive model displayed in the second scene, and the interactive node is used to identify operations on the interactive model. The interactive node is invisible in the screen of the second scene.

[0209] In some embodiments, the third display module 1440 is also used to display first content through the first transmission portal when displaying the picture of the first scene, and the first content is a part of the content in the second scene observed through the first transmission portal; or, when displaying the picture of the second scene, display second content through the first transmission portal, and the second content is a part of the content in the first scene observed through the first transmission portal.

[0210] In some embodiments, the third display module 1440 is used to set the parameters of the first model to the first parameters, the first model is the model corresponding to the second scene, and the first model under the first parameters is in an unobservable state; determine the first area occupied by the first portal on the first model, set the parameters of the first area to the second parameters, and the first area under the second parameters is in a transparent state; wherein the first content is displayed through the first area in the transparent state.

[0211] In some embodiments, the third display module 1440 is used to initialize the parameters of the first model to third parameters, the first model under the third parameters is in an observable state, and the first model is the model corresponding to the second scene; determine the first area occupied by the first portal on the first model, and set the orientation of the first area to be from inside to outside; wherein, the second content is displayed through the first area which is oriented from inside to outside.

[0212] In some embodiments, the third display module 1440 is further used to display at least one candidate scene; in response to an operation on a target scene in the at least one candidate scene, the target scene is determined as the second scene.

[0213] In some embodiments, the third display module 1440 is also used to display at least one candidate model, and the candidate model includes at least one of the following: a candidate virtual character, a candidate virtual prop, and a second portal; in response to an operation on a target model among the at least one candidate model, the target model is added to the second scene, and the target model is displayed in the screen of the second scene.

[0214] In some embodiments, the target model is the second portal, and the third display module 1440 is used to display a second mark in the picture of the second scene; in response to an operation on the second mark, the second portal is added at the second mark, and the second portal is displayed in the picture of the second scene.

[0215] The technical solution provided in the embodiment of the present application displays a portal in the screen of the real scene. Based on the movement of the terminal device, the user can experience the process of being transferred from the real scene to the virtual scene through the portal, and the interaction method is more diverse and novel.

[0216] In addition, during the transmission process, users need to control the movement of terminal devices to interact, which enhances the user's sense of immersion.

[0217] It should be noted that the device provided in the above embodiment, when implementing its functions, is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the content structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0218] Please refer to Fig.16 , which shows a block diagram of a terminal device 1600 provided in one embodiment of the present application. The terminal device 1600 may be any electronic device with data calculation, processing and storage functions. The terminal device 1600 may be used to implement the method for displaying a scene screen provided in the above embodiment.

[0219] Typically, the terminal device 1600 includes: a processor 1601 and a memory 1602 .

[0220] Processor 1601 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. Processor 1601 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1601 may also include a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, also known as a CPU; the coprocessor is a low-power processor for processing data in a standby state. In some embodiments, processor 1601 may be integrated with a GPU, which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, processor 1601 may also include an AI processor for processing computing operations related to machine learning.

[0221] The memory 1602 may include one or more computer-readable storage media, which may be non-transitory. The memory 1602 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1602 is used to store a computer program, which is configured to be executed by one or more processors to implement the above-mentioned scene screen display method.

[0222] Those skilled in the art will understand that Fig.16The structure shown in the figure does not constitute a limitation on the terminal device 1600, and may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component arrangement.

[0223] In an illustrative embodiment, a computer-readable storage medium is also provided, in which a computer program is stored, and when the computer program is executed by a processor of a terminal device, the method for displaying the scene screen described above is implemented. Optionally, the computer-readable storage medium described above may be a ROM (Read-Only Memory), a RAM (Random Access Memory), a CD-ROM (Compact Disc Read-Only Memory), a magnetic tape, a floppy disk, an optical data storage device, and the like.

[0224] In an exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program, the computer program being stored in a computer-readable storage medium. A processor of a terminal device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the terminal device executes the above-mentioned method for displaying a scene screen.

[0225] It should be noted that this application can display a prompt interface, pop-up window or output voice prompt information before collecting relevant data of users and during the process of collecting relevant data of users. The prompt interface, pop-up window or voice prompt information is used to prompt the user that its relevant data is currently being collected, so that this application only starts to execute the relevant steps of obtaining relevant data of users after obtaining the confirmation operation issued by the user to the prompt interface or pop-up window, otherwise (that is, when the confirmation operation issued by the user to the prompt interface or pop-up window is not obtained), the relevant steps of obtaining relevant data of users are terminated, that is, the relevant data of users are not obtained. In other words, all user data (including the location data of navigation objects) collected by this application are processed strictly in accordance with the requirements of relevant national laws and regulations, and the informed consent or separate consent of the subject of personal information is obtained with the consent and authorization of the user. The subsequent data use and processing behavior is carried out within the scope of authorization of laws and regulations and the subject of personal information, and the collection, use and processing of relevant user data shall comply with the relevant laws, regulations and standards of relevant countries and regions.

[0226] It should be understood that the "multiple" mentioned in this article refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. In addition, the step numbers described in this article only illustrate a possible execution sequence between the steps. In some other embodiments, the above steps may not be executed in the order of the numbers, such as two steps with different numbers are executed at the same time, or two steps with different numbers are executed in the opposite order to the diagram. The embodiments of the present application are not limited to this.

[0227] The above description is only an exemplary embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A method for displaying a scene image, characterized in that: The method is performed by a terminal device, and the method includes: Shooting a first scene and displaying a picture of the first scene obtained by shooting, wherein the first scene is a real scene; In the screen of the first scene, a first transmission portal for connecting the first scene and a second scene is displayed, and the second scene is a virtual scene; After the terminal device moves to a first position in the first scene, a picture of the second scene is displayed, and the first position is a position corresponding to the first transmission portal in the first scene.

2. The method according to claim 1, characterized in that The step of displaying, in the screen of the first scene, a first transmission portal for connecting the first scene and the second scene comprises: Displaying a first mark in the picture of the first scene; In response to an operation on the first mark, the first transfer gate is displayed at the first mark.

3. The method according to claim 2, characterized in that The step of displaying a first mark in a picture of the first scene includes: Performing plane recognition on the picture of the first scene to determine a first plane in the picture of the first scene; determining a center position of the first plane; The first mark is displayed at the center position.

4. The method according to claim 1, characterized in that After the terminal device moves to the first position in the first scene, displaying a picture of the second scene includes: In the first scenario, determining a second position corresponding to the terminal device, where the second position changes as the terminal device moves; determining a distance between the second position and the first position; When the picture of the first scene is displayed, if the distance between the second position and the first transmission gate gradually increases after the second position passes the first position, the picture of the second scene is displayed.

5. The method according to claim 1, characterized in that After displaying the screen of the second scene, the method further includes: In response to an operation on the interactive model in the second scene, an interactive screen of the interactive model is displayed in the screen of the second scene.

6. The method according to claim 5, characterized in that The method further comprises: For any interactive model displayed in the second scene, an interactive node is added, where the interactive node is used to identify an operation on the interactive model, and the interactive node is invisible in the screen of the second scene.

7. The method according to claim 1, characterized in that The method further comprises: In the case of displaying the picture of the first scene, displaying first content through the first transmission portal, the first content being part of the content in the second scene observed through the first transmission portal; or, When the image of the second scene is displayed, second content is displayed through the first transmission portal, and the second content is a part of the content in the first scene observed through the first transmission portal.

8. The method according to claim 7, characterized in that The displaying of the first content through the first transmission portal includes: Setting a parameter of a first model to a first parameter, where the first model is a model corresponding to the second scenario, and the first model under the first parameter is in an unobservable state; Determine a first area occupied by the first transmission gate on the first model, set a parameter of the first area to a second parameter, and the first area under the second parameter is in a transparent state; The first content is displayed through the first area in the transparent state.

9. The method according to claim 7, characterized in that: The displaying of the second content through the first transmission portal includes: Initializing the parameters of the first model to the third parameters, the first model being the model corresponding to the second scenario, and the first model under the third parameters being in an observable state; Determine a first area occupied by the first transmission gate on the first model, and set the orientation of the first area to be from inside to outside; The second content is displayed through the first area facing from the inside to the outside.

10. The method according to claim 1, characterized in that The method further comprises: displaying at least one candidate scene; In response to an operation on a target scene among the at least one candidate scene, the target scene is determined as the second scene.

11. The method according to claim 1, characterized in that: The method further comprises: Displaying at least one candidate model, wherein the candidate model includes at least one of the following: a candidate virtual character, a candidate virtual prop, and a second portal; In response to an operation on a target model among the at least one candidate model, the target model is added to the second scene, and the target model is displayed on a screen of the second scene.

12. The method according to claim 11, characterized in that The target model is the second transmission portal, and the adding of the target model in the second scene and the display of the target model in the screen of the second scene include: Displaying a second mark in the picture of the second scene; In response to the operation on the second mark, the second transmission portal is added at the second mark, and the second transmission portal is displayed in the screen of the second scene.

13. A scene image display device, characterized in that: The device is arranged in a terminal device, and comprises: A shooting module, used for shooting a first scene and displaying a picture of the first scene obtained by shooting, wherein the first scene is a real scene; A first display module, configured to display, in a screen of the first scene, a first transmission portal for connecting the first scene and a second scene, wherein the second scene is a virtual scene; The second display module is used to display the picture of the second scene after the terminal device moves to the first position in the first scene, and the first position is the position corresponding to the first transmission portal in the first scene.

14. A terminal device, characterized in that: The terminal device comprises a processor and a memory, wherein a computer program is stored in the memory, and the processor is configured to execute the computer program to implement the method according to any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which is loaded and executed by a processor to implement the method according to any one of claims 1 to 12.

16. A computer program product, characterized in that The computer program product comprises a computer program, which is loaded and executed by a processor to implement the method according to any one of claims 1 to 12.

Images