Digital content presentation method and apparatus
Patent Information
- Application Number
- CN202211018783.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-08-24
- Publication Date
- 2026-10-09
- Estimated Expiration
- 2042-08-24
AI Technical Summary
较低的效率会影响用户的体验,这并不是“所见即所得”的体验经历
[0009]本申请通过获取当前的室内空间对应的目标虚拟现实空间;响应于确定目标虚拟现实空间存在数字化内容,调用目标虚拟现实空间对应的目标增强现实空间;响应于确定目标增强现实空间中的数字化内容,在当前目标设备的显示范围内,呈现数字化内容,克服了现有技术中数字化内容仅能在平面设备中呈现的问题,丰富了数字化内容的呈现方式,提升了用户的交互体验。
Smart Images

Figure CN115390966B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computer technology, specifically to the field of augmented reality technology, and in particular to a method and apparatus for presenting digital content. Background Technology
[0002] We are currently entering an era of immersive internet experiences, but interaction with apps on devices remains confined to flat surfaces and limited by the screen. With improved support for technologies like eye-tracking and gesture tracking, very realistic augmented reality (AR) experiences are now possible. However, these experiences primarily involve interacting with pre-set AR models placed in real-world spaces and haven't yet touched upon app interaction.
[0003] Currently, interaction with applications remains limited to flat devices, and application interactions are still separate from real-life scenarios, not well integrated. When users need to use an application in a specific location, they still need to open their device, locate the application, and then interact with it. This inefficiency impacts the user experience, which is not a "what you see is what you get" experience. Summary of the Invention
[0004] This application provides a method, apparatus, device, and storage medium for presenting digital content.
[0005] According to a first aspect, embodiments of this application provide a method for presenting digital content, the method comprising: obtaining a target virtual reality space corresponding to the current indoor space; in response to determining that digital content exists in the target virtual reality space, invoking a target augmented reality space corresponding to the target virtual reality space; and in response to determining the digital content in the target augmented reality space, presenting the digital content within the display range of the current target device.
[0006] According to a second aspect, embodiments of this application provide a digital content presentation device, including: an acquisition module configured to acquire a target virtual reality space corresponding to the current indoor space; an invocation module configured to, in response to determining that digital content exists in the target virtual reality space, invoke a target augmented reality space corresponding to the target virtual reality space; and a presentation module configured to, in response to determining that digital content exists in the target augmented reality space, present the digital content within the display range of the current target device.
[0007] According to a third aspect, embodiments of this application provide an electronic device including one or more processors; a storage device having one or more programs stored thereon, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement a digital content presentation method as described in any embodiment of the first aspect.
[0008] According to a fourth aspect, embodiments of this application provide a computer-readable medium having a computer program stored thereon that, when executed by a processor, implements a digital content presentation method as described in any embodiment of the first aspect.
[0009] This application obtains the target virtual reality space corresponding to the current indoor space; in response to determining that digital content exists in the target virtual reality space, it invokes the target augmented reality space corresponding to the target virtual reality space; in response to determining the digital content in the target augmented reality space, it presents the digital content within the display range of the current target device, overcoming the problem that digital content can only be presented on flat devices in the prior art, enriching the presentation methods of digital content, and improving the user's interactive experience.
[0010] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description
[0011] Figure 1 This is an exemplary system architecture diagram to which this application can be applied;
[0012] Figure 2 This is a flowchart of one embodiment of the digital content presentation method according to this application;
[0013] Figure 3 This is a schematic diagram of an application scenario of the digital content presentation method according to this application;
[0014] Figure 4 This is a flowchart of yet another embodiment of the digital content presentation method according to this application;
[0015] Figure 5 This is a schematic diagram of one embodiment of the digital content presentation apparatus according to this application;
[0016] Figure 6 This is a schematic diagram of the structure of a computer system suitable for implementing the server embodiments of this application. Detailed Implementation
[0017] The following description, in conjunction with the accompanying drawings, illustrates exemplary embodiments of this application, including various details to aid understanding. These should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this application. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.
[0018] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other. This application will now be described in detail with reference to the accompanying drawings and embodiments.
[0019] Figure 1 An exemplary system architecture 100 is shown, in which embodiments of the digital content presentation method of this application can be applied.
[0020] like Figure 1 As shown, system architecture 100 may include terminal devices 101, 102, and 103, a network 104, and a server 105. Network 104 serves as the medium for providing communication links between terminal devices 101, 102, and 103 and server 105. Network 104 may include various connection types, such as wired or wireless communication links, or fiber optic cables, etc.
[0021] Users can use terminal devices 101, 102, and 103 to interact with server 105 via network 104 to receive or send messages, etc. Client application software, such as video playback applications and communication applications, can be installed on terminal devices 101, 102, and 103.
[0022] Terminal devices 101, 102, and 103 can be either hardware or software. When terminal devices 101, 102, and 103 are hardware, they can be various electronic devices, including but not limited to smartphones, smart bracelets, AR glasses, tablets, laptops, and desktop computers. When terminal devices 101, 102, and 103 are software, they can be installed in the aforementioned electronic devices. They can be implemented as multiple software programs or software modules, or as a single software program or software module. No specific limitations are made here.
[0023] Server 105 can be a server that provides various services, such as: obtaining the target virtual reality space corresponding to the current indoor space; in response to determining that digital content exists in the target virtual reality space, calling the target augmented reality space corresponding to the target virtual reality space; and in response to determining that digital content exists in the target augmented reality space, presenting the digital content within the display range of the current target device.
[0024] It should be noted that server 105 can be either hardware or software. When server 105 is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or as a single server. When server 105 is software, it can be implemented as multiple software programs or software modules (e.g., used to provide digital content presentation services), or as a single software program or software module. No specific limitations are made here.
[0025] It should be noted that the digital content presentation method provided in the embodiments of this disclosure can be executed by server 105, terminal devices 101, 102, and 103, or by server 105 and terminal devices 101, 102, and 103 in cooperation with each other. Accordingly, all parts (e.g., units, sub-units, modules, and sub-modules) of the digital content presentation device can be entirely located in server 105, entirely located in terminal devices 101, 102, and 103, or separately located in server 105 and terminal devices 101, 102, and 103.
[0026] It should be understood that Figure 1 The number of terminal devices, networks, and servers shown is merely illustrative. Depending on implementation needs, any number of terminal devices, networks, and servers can be included.
[0027] Figure 2 A flowchart 200 illustrates an embodiment of the digital content presentation method applicable to this application. The digital content presentation method includes the following steps:
[0028] Step 201: Obtain the target virtual reality space corresponding to the current indoor space.
[0029] In this embodiment, the execution entity (e.g., Figure 1 The server 105 or terminal devices 101, 102, 103 can directly determine the target virtual reality space corresponding to the current indoor space based on the user's selection operation in multiple virtual reality spaces. Alternatively, it can collect environmental information of the current real indoor space through image acquisition devices, sensor devices, etc., and determine the target virtual reality space based on the collected environmental information. This application does not limit this.
[0030] The interior space can be any enclosed space, such as a living room, master bedroom, kitchen, or meeting room; this application does not limit this.
[0031] Here, the image acquisition device can be any device that converts optical image signals into electrical signals in existing or future technologies, such as an RGB-D depth camera or a video camera, and this application does not limit it.
[0032] The target virtual reality space is constructed based on a scaled-down 3D model of the indoor space.
[0033] In some optional methods, the target virtual reality space corresponding to the current indoor space is obtained, including: collecting environmental information of the current indoor space; determining the target model information for constructing a scaled 3D model based on the collected environmental information and SLAM technology; and determining the target virtual reality space among multiple preset virtual reality spaces based on the target model information.
[0034] In this implementation, the executing entity can collect environmental information of the current real indoor space through image acquisition devices, sensor devices, etc., and obtain the collected environmental information. Based on SLAM (Simultaneous Localization and Mapping) technology, the collected environmental information is used to determine the target model information for constructing a scaled 3D model, such as the coordinate system of the indoor space, key feature points, key frames, 3D room type, sensor information, etc. Based on the target model information, the target virtual reality space is determined among multiple preset virtual reality spaces.
[0035] Here, the model information of the scaled 3D model corresponding to the target virtual reality space is matched with the target model information.
[0036] Specifically, after acquiring the collected environmental information, the executing entity uses the following steps of SLAM technology: feature-based correlation search, local pose optimization, global pose optimization, and pose estimation to obtain a 3D point cloud. Further, based on the 3D point cloud, indoor layout recognition is performed. This indoor layout recognition includes: deep learning object segmentation, such as door and window recognition, appliance recognition, etc., and determining room types based on the segmentation results, such as bedroom, kitchen, living room, bathroom, etc. Finally, based on room type, 3D point cloud, and other information, the target model information for constructing a scaled 3D model is determined. Based on the target model information, the target virtual reality space is determined from multiple preset virtual reality spaces, and the scaled 3D model information corresponding to the target virtual reality space is matched with the target model information.
[0037] Among them, the model information of the proportional 3D model corresponding to each virtual reality space in the multiple preset virtual reality spaces can be determined by SLAM technology based on the environmental information of the indoor space collected by the user when entering the indoor space for the first time through image acquisition devices and sensor devices.
[0038] This approach involves collecting environmental information from the current indoor space; using the collected environmental information and SLAM technology, determining the target model information for constructing a scaled 3D model; and using the target model information, identifying the target virtual reality space from multiple preset virtual reality spaces, effectively improving the accuracy of the identified target virtual space.
[0039] Step 202: In response to determining that digital content exists in the target virtual reality space, the target augmented reality space corresponding to the target virtual reality space is invoked.
[0040] In this embodiment, after obtaining the target virtual reality space, the executing entity can determine whether there is digital content in the target virtual reality space. If there is digital content, it can call the target augmented reality space corresponding to the target virtual reality space. There is a mapping relationship between the target augmented reality space and the target virtual reality space.
[0041] Here, digital content can include various forms, such as applications, images, and videos, and this application does not limit it. Digital content is typically added to the target virtual reality space via anchor points.
[0042] Among them, the target augmented reality space is constructed based on the real spatial information of the indoor space corresponding to the target virtual reality space. The target augmented reality space has a mapping relationship with the target virtual reality space, that is, there is a one-to-one correspondence between objects in the target augmented reality space and objects in the target virtual reality space.
[0043] Specifically, digital content, such as application A, is set at location A in the target virtual reality space, and digital content, application A, is also set at the corresponding location A' in the target augmented reality space.
[0044] Furthermore, it should be noted that, to ensure the accuracy of the mapping relationship between the target augmented reality space and the target virtual reality space, the mapping relationship between the target augmented reality space and the target virtual reality space can be established based on the user's location, the environmental information of the current location, and the conditions of deep learning, such as WiFi signal, GPS, etc.
[0045] In some alternative methods, digital content in the target virtual reality space is added by: adding anchor points directly in the target virtual reality space; or setting the digital content directly on the anchor points in the target virtual reality space.
[0046] In this implementation, for the target virtual reality space, the executing entity can directly add anchor points in the target virtual reality space, and synchronize the anchor point information, such as status information and location information, to the target augmented reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space; digital content can be directly set on the anchor points in the target virtual reality space, and the digital content information, such as location information, size information, and status information, can be synchronized to the target augmented reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space.
[0047] This approach enhances the flexibility of adding digital content by directly adding anchor points to the target virtual reality space and setting the digital content on these anchor points.
[0048] In some alternative methods, digital content in the target virtual reality space is added in the following ways: anchor points are added directly in the target augmented reality space, and the information of the anchor points is synchronized to the target virtual reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space; or digital content is set directly on the anchor points in the target virtual reality space.
[0049] In this implementation, for the target augmented reality space, the executing entity can directly add anchor points in the target augmented reality space, and synchronize the anchor point information, such as status information and location information, to the target virtual reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space; digital content can be directly set on the anchor points in the target virtual reality space, and the information of the digital content, such as location information, size information, and status information, can be synchronized to the target augmented reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space.
[0050] This implementation method adds anchor points directly to the target augmented reality space and synchronizes the anchor point information to the target virtual reality space based on the mapping relationship between the target virtual reality space and the target augmented reality space; it directly sets digital content on the anchor points in the target virtual reality space, improving the flexibility of adding digital content.
[0051] In some alternative methods, digital content in the target virtual reality space is added by: directly adding anchor points in the target virtual reality space and synchronizing the anchor point information to the target augmented reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space; setting digital content on the anchor points in the target augmented reality space and synchronizing the digital content to the target virtual reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space.
[0052] In this implementation, the executing entity can directly add anchor points in the target virtual reality space, and synchronize the anchor point information, such as status information and location information, to the target augmented reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space; digital content can be directly set on the anchor points in the target augmented reality space, and the digital content information, such as location information, size information, and status information, can be synchronized to the target virtual reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space.
[0053] This implementation method improves the flexibility of adding digital content by directly adding anchor points to the target virtual reality space and synchronizing the information of the anchor points to the target augmented reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space. Digital content is set on the anchor points in the target augmented reality space and synchronized to the target virtual reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space.
[0054] In some alternative methods, digital content in the target virtual reality space is added by: directly adding anchor points in the target augmented reality space and synchronizing the anchor point information to the target augmented reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space; setting digital content on the anchor points in the target augmented reality space and synchronizing the digital content to the target virtual reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space.
[0055] In this implementation, the executing entity can directly add anchor points in the target augmented reality space, and synchronize the anchor point information, such as status information and location information, to the target virtual reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space; digital content can be directly set on the anchor points in the target augmented reality space, and the digital content information, such as location information, size information, and status information, can be synchronized to the target virtual reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space.
[0056] This implementation method improves the flexibility of adding digital content by directly adding anchor points to the target augmented reality space and synchronizing the information of the anchor points to the target augmented reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space.
[0057] In some alternative approaches, anchor points are added directly in the target virtual reality space, including: dividing the target virtual reality space into multiple cubes of the same size; and identifying the target cube as an anchor point in response to detecting a selection operation on the target cube.
[0058] In this implementation, the execution entity can directly add anchor points in the target virtual reality space by first dividing the target virtual reality space into multiple cubes of the same size according to the size of the indoor space; then listening to the user's selection operation on the target cube in real time or periodically, and in response to detecting the user's selection operation on the target cube, determining the target cube as the anchor point.
[0059] This implementation divides the target virtual reality space into multiple cubes of the same size; in response to the detection of a selection operation on the target cube, the target cube is determined as an anchor point, thereby improving the accuracy and flexibility of the anchor point position determined in the target virtual reality space.
[0060] In some alternative approaches, anchor points are added directly in the target augmented reality space, including: dividing the target augmented reality space into multiple cubes of the same size; and identifying the target cube as an anchor point in response to detecting a selection operation on the target cube.
[0061] In this implementation, the execution entity can directly add anchor points in the target augmented reality space by dividing the target augmented reality space into multiple cubes of the same size according to the size of the indoor space; then, it can listen for the user's selection operation on the target cube in real time or periodically, and in response to the detection of the user's selection operation on the target cube, it can determine the target cube as the anchor point.
[0062] This implementation divides the target augmented reality space into multiple cubes of the same size; in response to the detection of a selection operation on the target cube, the target cube is determined as an anchor point. This overcomes the problem in the prior art that the anchor point position must be determined by a marker or object specified by an outdoor positioning or identification system, and improves the accuracy and flexibility of the anchor point position determined in the target augmented reality space.
[0063] Step 203: In response to determining the digital content in the target augmented reality space, present the digital content within the display range of the current target device.
[0064] In this embodiment, after the executing entity invokes the target augmented reality space, it can further determine whether the digital content of the target augmented reality space is within the display range of the current target device. If it is within the display range of the target device, the digital content is presented to receive user interaction operations on the digital content.
[0065] Here, the target device can be a device that provides augmented reality functionality in existing or future technologies, such as AR glasses, AR mobile phones, AR laptops, etc., and this application does not limit it.
[0066] See also Figure 3 , Figure 3 This is a schematic diagram of an application scenario of the digital content presentation method according to this embodiment.
[0067] exist Figure 3 In the application scenario, when a user enters the current indoor space, they can use a terminal device to select a target virtual reality space corresponding to the current indoor space from among multiple preset virtual reality spaces. The execution entity 301 obtains the current indoor space 302, such as a conference room, based on the user's selection of the target virtual reality space. Further, in response to determining that digital content 303, such as a photo album, exists in the target virtual reality space, the execution entity calls the target augmented reality space corresponding to the target virtual reality space. The target augmented reality space is constructed based on the real environmental information of the indoor space corresponding to the target virtual reality space, and there is a mapping relationship between the target augmented reality space and the target virtual reality space; that is, the target augmented reality space also contains the digital content 303, the photo album. In response to determining the digital content 303 in the target augmented reality space, the digital content 303, i.e., the photo album, is displayed within the display range 305 of the current target device 304, i.e., the device providing augmented reality functionality, such as an AR camera.
[0068] The digital content presentation method provided by the embodiments of this disclosure obtains the target virtual reality space corresponding to the current indoor space; in response to determining that digital content exists in the target virtual reality space, it invokes the target augmented reality space corresponding to the target virtual reality space; in response to determining the digital content in the target augmented reality space, it presents the digital content within the display range of the current target device, overcoming the problem that digital content can only be presented on planar devices in the prior art, enriching the presentation methods of digital content, and improving the user's interactive experience.
[0069] Further reference Figure 4 This illustrates a flow 400 of another embodiment of the digital content presentation method. In this embodiment, the flow 400 of the digital content presentation method may include the following steps:
[0070] Step 401: Obtain the target virtual reality space corresponding to the current indoor space.
[0071] In this embodiment, the implementation details and technical effects of step 401 can be found in the description of step 201, and will not be repeated here.
[0072] Step 402: In response to determining that digital content exists in the target virtual reality space, the target augmented reality space corresponding to the target virtual reality space is invoked.
[0073] In this embodiment, the implementation details and technical effects of step 402 can be found in the description of step 202, and will not be repeated here.
[0074] Step 403: In response to determining the digital content in the target augmented reality space, present the digital content within the display range of the current target device.
[0075] In this embodiment, the implementation details and technical effects of step 403 can be found in the description of step 203, and will not be repeated here.
[0076] Step 404: Process the presented digital content based on the target interactive operation.
[0077] In this embodiment, after the executing entity presents digital content within the display range of the target device, it can monitor the target interactive operation in real time or periodically, that is, the user's interactive operation in response to the presented digital content. In response to the detection of the target interactive operation, the entity manages and presents the presented digital content according to the target interactive operation.
[0078] Here, the interactive operations for digital content, i.e., target operations, can be categorized into two modes: normal mode (i.e., non-editing mode) and editing mode.
[0079] In some alternative approaches, digital content is processed based on the target interactive operation, including: in response to determining that the mode corresponding to the target interactive operation is a normal mode, presenting the digital content according to the target interactive operation.
[0080] In this implementation, the executing entity can determine the user's interactive operation on the presented digital content, i.e. the target interactive operation, and the corresponding mode. If it is determined that the mode corresponding to the target interactive operation is the normal mode, the digital content can be presented according to the target interactive operation.
[0081] Specifically, for example, the digital content displayed within the display range of the target device, such as AR glasses, is a widget program, such as a clock, calendar, weather, etc. The executing entity can display the calendar page and weather page according to the target interaction operation in the user's normal mode, such as swiping the calendar page and weather page.
[0082] For example, the digital content displayed within the display range of the target device, such as AR glasses, is a media program, such as photo albums, audio, and video. The executing entity can present the photo album, audio, and video content according to the user's target interactive operations in normal mode, such as swiping the photo album, turning audio on and off, fast-forwarding video, etc.
[0083] For example, the digital content displayed within the display range of the target device, such as AR glasses, is device control cards (smart furniture device plug-ins), such as lamp switch, air conditioner switch, router switch, etc. The executing entity can display the lamp switch card and air conditioner switch card according to the user's target interactive operation in normal mode, such as turning off the lamp or turning on the air conditioner.
[0084] For example, the digital content displayed within the display range of the target device, such as AR glasses, is virtual home decoration, such as refrigerators and cabinets. The executing entity can present the refrigerator and cabinets according to the target interaction operation in the user's normal mode, such as moving the refrigerator or moving the cabinet.
[0085] This implementation achieves the presentation of digital content in augmented reality space under normal mode by responding to the determination that the mode corresponding to the target interactive operation is normal mode, and presenting the digital content according to the target interactive operation.
[0086] In some alternative approaches, the presented digital content is processed based on the target interactive operation, including: in response to determining that the mode corresponding to the target interactive operation is an editing mode, managing the presented digital content and its corresponding anchor points according to the target interactive operation.
[0087] In this implementation, the executing entity can determine the mode corresponding to the target interactive operation. If the mode corresponding to the target interactive operation is determined to be the editing mode, the anchor point corresponding to the digital content can be presented first, and then the anchor point or digital content can be managed according to the user's target interactive operation on the anchor point or digital content.
[0088] Here, the methods by which the implementing entity manages anchor points or digital content can include various methods, such as deletion, addition, and tagging.
[0089] This implementation manages the digital content and its corresponding anchor points in the augmented reality space by responding to the mode corresponding to the target interactive operation as the editing mode, and managing the presented digital content and its corresponding anchor points according to the target interactive operation.
[0090] The above embodiments of this application, and Figure 2Compared to the corresponding embodiments, the process 400 of the digital content presentation method in this embodiment reflects the response to determining the digital content in the target augmented reality space, presenting the digital content within the display range of the current target device, and processing the presented digital content based on the target interactive operation, thereby realizing the interaction between the user and the digital content in the augmented reality space and improving the user experience.
[0091] Further reference Figure 5 As an implementation of the methods shown in the above figures, this application provides an embodiment of a digital content presentation device, which is similar to... Figure 1 Corresponding to the method embodiments shown, this device can be specifically applied to various electronic devices.
[0092] like Figure 5 As shown, the digital content presentation device 500 of this embodiment includes: an acquisition module 501, a calling module 502, and a presentation module 503.
[0093] The acquisition module 501 can be configured to acquire the target virtual reality space corresponding to the current indoor space.
[0094] Module 502 can be configured to invoke the target augmented reality space corresponding to the target virtual reality space in response to determining that digital content exists in the target virtual reality space.
[0095] The presentation module 503 can be configured to present digital content within the display range of the current target device in response to digital content in a determined target augmented reality space.
[0096] In some alternative embodiments of this embodiment, the device further includes a processing module configured to process the presented digital content based on the target interactive operation.
[0097] In some optional embodiments of this example, the processing module is further configured to present the digital content in response to determining that the mode corresponding to the target interactive operation is the normal mode.
[0098] In some optional embodiments of this example, the processing module is further configured to manage the presented digital content and its corresponding anchor points in response to determining that the mode corresponding to the target interactive operation is the editing mode.
[0099] In some optional embodiments of this example, the acquisition module is further configured to collect environmental information of the current indoor space; determine the target model information for constructing a scaled 3D model based on the collected environmental information and SLAM technology; and determine the target virtual reality space among multiple preset virtual reality spaces based on the target model information.
[0100] In some optional ways of this embodiment, the digital content of the target virtual reality space is added in the following ways: directly adding anchor points in the target virtual reality space; or directly setting the digital content on the anchor points in the target virtual reality space.
[0101] In some optional ways of this embodiment, the digital content of the target virtual reality space is added in the following ways: anchor points are added directly in the target augmented reality space, and the information of the anchor points is synchronized to the target virtual reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space; or the digital content is directly set on the anchor points in the target virtual reality space.
[0102] In some optional ways of this embodiment, the digital content of the target virtual reality space is added in the following ways: anchor points are added directly to the target virtual reality space, and the information of the anchor points is synchronized to the target augmented reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space; or digital content is set on the anchor points in the target augmented reality space, and the digital content is synchronized to the target virtual reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space.
[0103] In some optional ways of this embodiment, the digital content of the target virtual reality space is added in the following ways: anchor points are added directly in the target augmented reality space, and the information of the anchor points is synchronized to the target virtual reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space; or the digital content is directly set on the anchor points in the target virtual reality space.
[0104] In some optional embodiments of this example, adding anchor points directly in the target augmented reality space includes: dividing the target augmented reality space into multiple cubes of the same size; and determining the target cube as an anchor point in response to detecting a selection operation on the target cube.
[0105] In some optional embodiments of this example, adding anchor points directly in the target virtual reality space includes: dividing the target virtual reality space into multiple cubes of the same size; and determining the target cube as an anchor point in response to detecting a selection operation on the target cube.
[0106] According to embodiments of this application, this application also provides an electronic device and a readable storage medium.
[0107] like Figure 6 The diagram shown is a block diagram of an electronic device according to an embodiment of the digital content presentation method of this application.
[0108] 600 is a block diagram of an electronic device for a digital content presentation method according to embodiments of this application. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present application described and / or claimed herein.
[0109] like Figure 6 As shown, the electronic device includes one or more processors 601, a memory 602, and interfaces for connecting the components, including high-speed interfaces and low-speed interfaces. The components are interconnected via different buses and can be mounted on a common motherboard or otherwise as required. The processors can process instructions executed within the electronic device, including instructions stored in or on memory to display graphical information of a GUI on an external input / output device (such as a display device coupled to the interface). In other embodiments, multiple processors and / or multiple buses can be used with multiple memories and multiple memory modules, if desired. Similarly, multiple electronic devices can be connected, each providing some of the necessary operations (e.g., as a server array, a group of blade servers, or a multiprocessor system). Figure 6 Take the 601 processor as an example.
[0110] The memory 602 is the non-transitory computer-readable storage medium provided in this application. The memory stores instructions executable by at least one processor to cause the at least one processor to perform the digital content presentation method provided in this application. The non-transitory computer-readable storage medium of this application stores computer instructions for causing a computer to perform the digital content presentation method provided in this application.
[0111] Memory 602, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as the program instructions / modules corresponding to the digital content presentation method in the embodiments of this application (e.g., appendix). Figure 5 The acquisition module 501, invocation module 502, and presentation module 503 are shown. The processor 601 executes various functional applications and data processing of the server by running non-transient software programs, instructions, and modules stored in the memory 602, thereby realizing the digital content presentation method in the above method embodiments.
[0112] Memory 602 may include a program storage area and a data storage area. The program storage area may store the operating system and applications required for at least one function; the data storage area may store data created by the use of the electronic device for presenting digital content. Furthermore, memory 602 may include high-speed random access memory and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory 602 may optionally include memory remotely located relative to processor 601, and these remote memories can be connected to the electronic device for presenting digital content via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.
[0113] The electronic device for digital content presentation may further include an input device 603 and an output device 604. The processor 601, memory 602, input device 603, and output device 604 may be connected via a bus or other means. Figure 6 Taking the example of a connection between China and Israel via a bus.
[0114] Input device 603 can receive input digital or character information, as well as key signal inputs related to user settings and function control of electronic devices for quality monitoring of live video streams, such as touchscreens, keypads, mice, trackpads, touchpads, joysticks, one or more mouse buttons, trackballs, joysticks, etc. Output device 604 may include display devices, auxiliary lighting devices (e.g., LEDs), and haptic feedback devices (e.g., vibration motors). The display device may include, but is not limited to, liquid crystal displays (LCDs), light-emitting diode (LED) displays, and plasma displays. In some embodiments, the display device may be a touchscreen.
[0115] Various implementations of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, application-specific integrated circuits (ASICs), computer hardware, firmware, software, and / or combinations thereof. These various implementations may include: implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transferring data and instructions to the storage system, the at least one input device, and the at least one output device.
[0116] These computational programs (also referred to as programs, software, software applications, or code) include machine instructions for a programmable processor and can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. As used herein, the terms “machine-readable medium” and “computer-readable medium” refer to any computer program product, device, and / or apparatus (e.g., disk, optical disk, memory, programmable logic device (PLD)) used to provide machine instructions and / or data to a programmable processor, including machine-readable media that receive machine instructions as machine-readable signals. The term “machine-readable signal” refers to any signal used to provide machine instructions and / or data to a programmable processor.
[0117] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).
[0118] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with embodiments of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.
[0119] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. Client-server relationships are created by computer programs running on the respective computers and having a client-server relationship with each other.
[0120] The technical solutions according to the embodiments of this application enrich the presentation methods of digital content and enhance the user's interactive experience.
[0121] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this application can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this application can be achieved, and this is not limited herein.
[0122] The specific embodiments described above do not constitute a limitation on the scope of protection of this application. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this application should be included within the scope of protection of this application.
Claims
1. A method for presenting digital content, the method comprising: Obtain the target virtual reality space corresponding to the current indoor space, wherein the target virtual reality space is constructed based on a scaled 3D model of the indoor space; In response to determining that digital content exists in the target virtual reality space, a target augmented reality space corresponding to the target virtual reality space is invoked, wherein the target augmented reality space is constructed based on the real environmental information of the indoor space corresponding to the target virtual reality space, and there is a mapping relationship between the target augmented reality space and the target virtual reality space; In response to determining the digital content in the target augmented reality space, the digital content is presented within the display range of the current target device, which is a device that provides augmented reality functionality.
2. The method according to claim 1, further comprising: The presented digital content is processed based on the target interactive operation, wherein the target interactive operation is used to indicate the interactive operation for the presented digital content.
3. The method according to claim 2, wherein, The processing of the presented digital content based on the target interactive operation includes: In response to determining that the mode corresponding to the target interactive operation is the normal mode, the presented digital content is presented according to the target interactive operation.
4. The method according to claim 2, wherein, The processing of the presented digital content based on the target interactive operation includes: In response to determining that the mode corresponding to the target interactive operation is the editing mode, the presented digital content and its corresponding anchor points are managed according to the target interactive operation.
5. The method according to claim 1, wherein, The step of obtaining the target virtual reality space corresponding to the current indoor space includes: Collect environmental information about the current indoor space; Based on the collected environmental information and SLAM technology, the target model information for constructing a scaled 3D model is determined. Based on the target model information, a target virtual reality space is determined among multiple preset virtual reality spaces, and the model information of the proportional 3D model corresponding to the target virtual reality space is matched with the target model information.
6. The method according to claim 1, wherein, Digital content for the target virtual reality space is added in the following ways: Add anchor points directly to the target virtual reality space; The digital content is placed directly at the anchor point in the target virtual reality space.
7. The method according to claim 1, wherein, Digital content for the target virtual reality space is added in the following ways: Anchor points are added directly to the target augmented reality space, and the information of the anchor points is synchronized to the target virtual reality space based on the mapping relationship between the target virtual reality space and the target augmented reality space. Digital content is placed directly at the anchor point in the target virtual reality space.
8. The method according to claim 1, wherein, Digital content for the target virtual reality space is added in the following ways: Anchor points are added directly to the target virtual reality space, and the information of the anchor points is synchronized to the target augmented reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space. The digital content is set at the anchor point in the target augmented reality space, and the digital content is synchronized to the target virtual reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space.
9. The method according to claim 1, wherein, Digital content for the target virtual reality space is added in the following ways: Anchor points are added directly to the target augmented reality space, and the information of the anchor points is synchronized to the target virtual reality space based on the mapping relationship between the target virtual reality space and the target augmented reality space. The digital content is set at the anchor point in the target augmented reality space, and the digital content is synchronized to the target virtual reality space according to the mapping relationship between the target virtual reality space and the target augmented reality space.
10. The method according to claim 7 or 9, wherein, The method of directly adding anchor points in the target augmented reality space includes: Divide the target augmented reality space into multiple cubes of the same size; In response to the detection of a selection operation on the target cube, the target cube is identified as an anchor point.
11. The method according to any one of claims 6 or 8, wherein, The method of directly adding anchor points in the target virtual reality space includes: Divide the target virtual reality space into multiple cubes of the same size; In response to the detection of a selection operation on the target cube, the target cube is identified as an anchor point.
12. A digital content presentation device, the device comprising: The acquisition module acquires the target virtual reality space corresponding to the current indoor space, and the target virtual reality space is constructed based on a scaled 3D model of the indoor space. The calling module is configured to call a target augmented reality space corresponding to the target virtual reality space in response to determining that digital content exists in the target virtual reality space. The target augmented reality space is constructed based on the real environmental information of the indoor space corresponding to the target virtual reality space, and there is a mapping relationship between the target augmented reality space and the target virtual reality space. A presentation module is configured to, in response to determining digital content in the target augmented reality space, present the digital content within the display range of a current target device, the target device being a device that provides augmented reality functionality.
13. An electronic device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores information that can be executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1-11.
14. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause the computer to perform the method according to any one of claims 1-11.
Citation Information
Patent Citations
Image processing method and device in augmented reality, storage medium and electronic device
CN109754471A
Scene switching method and head-mounted electronic equipment
CN111142673A